2024-09-10T20:30:33.274 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T20:30:33.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:30:33.397 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899631' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpoB+nOBjLQpJGm/l4e8gk932nSwQsg5LROIdE2Iq54BuxS/TBgljTW2H1un6V3KxFccytoKvTYwuZm7PIlDao= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrpLH82TQBhRSdnn1sEzVHfY79SPj9e/8JQ0Tpv5dL8L0DqRyvFRzYXP1K0gDILNT1wLDyOqBUdtpCoeyYXmfk= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE+7g3vIR3iDdCucZGAhGi0iqIJgAco1hqAuNFLuA6GQc6blZ67jJHn+hHa632ZJBdTRidjBXhYmbmvWR8X0HHs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T20:30:33.397 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T20:30:33.398 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T20:30:33.398 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T20:30:33.399 INFO:teuthology.task.internal:Checking packages... 2024-09-10T20:30:33.420 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T20:30:33.421 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T20:30:33.421 INFO:teuthology.packaging:ref: None 2024-09-10T20:30:33.421 INFO:teuthology.packaging:tag: None 2024-09-10T20:30:33.421 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:30:33.421 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:30:33.421 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:30:33.557 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T20:30:33.559 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T20:30:33.565 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T20:30:33.565 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T20:30:33.572 INFO:teuthology.task.internal:Saving configuration 2024-09-10T20:30:33.593 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T20:30:33.599 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T20:30:33.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:25:19.674320', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPpoB+nOBjLQpJGm/l4e8gk932nSwQsg5LROIdE2Iq54BuxS/TBgljTW2H1un6V3KxFccytoKvTYwuZm7PIlDao='} 2024-09-10T20:30:33.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:25:19.671067', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBrpLH82TQBhRSdnn1sEzVHfY79SPj9e/8JQ0Tpv5dL8L0DqRyvFRzYXP1K0gDILNT1wLDyOqBUdtpCoeyYXmfk='} 2024-09-10T20:30:33.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:25:19.672868', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE+7g3vIR3iDdCucZGAhGi0iqIJgAco1hqAuNFLuA6GQc6blZ67jJHn+hHa632ZJBdTRidjBXhYmbmvWR8X0HHs='} 2024-09-10T20:30:33.667 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T20:30:33.673 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T20:30:33.673 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T20:30:33.673 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T20:30:33.673 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T20:30:33.762 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe511410af0>, signals=[15]) 2024-09-10T20:30:33.762 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T20:30:33.768 INFO:teuthology.task.internal:Opening connections... 2024-09-10T20:30:33.768 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T20:30:33.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:30:33.845 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-09-10T20:30:33.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:30:33.921 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-10T20:30:33.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:30:33.996 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T20:30:34.003 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-10T20:30:34.021 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-10T20:30:34.021 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-10T20:30:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-09-10T20:30:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-09-10T20:30:34.079 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:30:34.080 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:30:34.081 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-10T20:30:34.106 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-09-10T20:30:34.125 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-09-10T20:30:34.125 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-09-10T20:30:34.182 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-09-10T20:30:34.182 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-09-10T20:30:34.182 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:30:34.183 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:30:34.184 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:30:34.184 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-09-10T20:30:34.206 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-10T20:30:34.224 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-10T20:30:34.224 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:30:34.283 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:30:34.284 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:30:34.284 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:30:34.284 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-10T20:30:34.306 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T20:30:34.316 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T20:30:34.321 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T20:30:34.321 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:30:34.323 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:30:34.326 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:30:34.342 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T20:30:34.348 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T20:30:34.348 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:30:34.381 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:30:34.383 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:30:34.494 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T20:30:34.571 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T20:30:34.586 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T20:30:34.586 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T20:30:34.586 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T20:30:34.586 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:30:34.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:30:34.604 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-10T20:30:34.660 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:30:34.661 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.14.0-503.el9.x86_64 2024-09-10T20:30:34.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2024-09-10T20:30:37.180 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T20:30:42.115 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-10T20:30:47.465 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-10T20:30:49.066 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-10T20:30:50.878 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-10T20:30:56.559 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-10T20:30:58.623 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T20:30:58.624 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T20:30:58.713 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T20:30:58.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout:Install 4 Packages 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 79 M 2024-09-10T20:30:58.720 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 126 M 2024-09-10T20:30:58.721 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-10T20:30:58.935 INFO:teuthology.orchestra.run.smithi067.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 197 kB/s | 23 kB 00:00 2024-09-10T20:30:59.802 INFO:teuthology.orchestra.run.smithi067.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-10T20:31:00.352 INFO:teuthology.orchestra.run.smithi067.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-10T20:31:00.728 INFO:teuthology.orchestra.run.smithi067.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-09-10T20:31:00.728 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:31:00.728 INFO:teuthology.orchestra.run.smithi067.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-10T20:31:01.436 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-10T20:31:01.816 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-10T20:31:01.817 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-10T20:31:02.792 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-10T20:31:02.793 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-10T20:31:05.357 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-10T20:31:06.011 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T20:31:06.095 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:31:08.941 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:31:09.073 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:31:14.270 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:31:14.315 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:19.457 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:58.350 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:58.392 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:58.722 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:58.722 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T20:31:58.722 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:31:58.722 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T20:31:59.551 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T20:31:59.552 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:31:59.552 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-10T20:31:59.879 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T20:31:59.966 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T20:31:59.966 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T20:31:59.966 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T20:31:59.966 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T20:31:59.966 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T20:31:59.967 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T20:31:59.967 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T20:31:59.967 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T20:32:00.026 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T20:32:00.026 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T20:32:00.027 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2024-09-10T20:32:00.058 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2024-09-10T20:32:00.058 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2024-09-10T20:32:00.058 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.06 2024-09-10T20:32:00.058 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 82.el9 2024-09-10T20:32:00.058 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Group : Unspecified 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 8274670 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : builder@centos.org 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2024-09-10T20:32:00.059 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:32:00.060 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:32:00.061 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:32:00.061 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 5.14.0-505.el9.x86_64 2024-09-10T20:32:00.061 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:32:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-09-10T20:32:02.067 INFO:teuthology.orchestra.run.smithi067.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:32:02.102 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-09-10T20:32:02.104 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-10T20:32:02.119 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.GuDgzOuE7E 2024-09-10T20:32:02.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GuDgzOuE7E 2024-09-10T20:32:02.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.GuDgzOuE7E 2024-09-10T20:32:02.331 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.GuDgzOuE7E is 6KB 2024-09-10T20:32:02.379 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.GuDgzOuE7E 2024-09-10T20:32:02.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:32:02.460 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:32:02.460 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:32:02.460 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:32:02.460 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T20:32:02.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T20:32:02.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2024-09-10T20:32:32.620 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T20:32:32.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:32:32.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:32:51.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-10T20:33:00.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:33:00.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:33:03.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-10T20:33:15.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:33:15.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:33:46.932 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-10T20:33:47.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:33:47.307 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T20:33:47.307 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-10T20:33:47.322 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-505.el9.x86_64 2024-09-10T20:33:47.322 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T20:33:47.323 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:33:47.323 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:33:48.324 DEBUG:teuthology.parallel:result is None 2024-09-10T20:33:48.324 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T20:33:48.331 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T20:33:48.331 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:33:48.334 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:33:48.336 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:33:48.355 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T20:33:48.374 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T20:33:48.395 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T20:33:48.395 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:33:48.398 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:33:48.402 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:33:48.440 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T20:33:48.446 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T20:33:48.446 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:33:48.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:33:48.483 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:33:48.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:33:48.500 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:33:48.502 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:33:48.526 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:33:48.559 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.574 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.590 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.611 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.615 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.661 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:33:48.663 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T20:33:48.671 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T20:33:48.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:33:48.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:33:48.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:33:48.704 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T20:33:48.713 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T20:33:48.713 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:33:48.740 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:33:48.743 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:33:48.760 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:48.849 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:48.886 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:48.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:49.012 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:33:49.012 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:33:49.090 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:49.136 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:49.193 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:49.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:49.319 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:33:49.319 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:33:49.385 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:49.432 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:33:49.487 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:49.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:33:49.613 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:33:49.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:33:49.680 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-10T20:33:49.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-09-10T20:33:49.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-10T20:33:49.717 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:33:49.738 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:33:49.758 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:33:50.238 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T20:33:50.246 INFO:teuthology.task.internal:Starting timer... 2024-09-10T20:33:50.246 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T20:33:50.260 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T20:33:50.268 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T20:33:50.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-09-10T20:33:50.346 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-09-10T20:33:50.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-09-10T20:33:50.390 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-09-10T20:33:50.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-10T20:33:50.463 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-10T20:33:50.466 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T20:33:50.466 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-09-10T20:33:50.485 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-09-10T20:33:50.486 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-09-10T20:33:50.513 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-09-10T20:33:50.513 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-10T20:33:50.540 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-10T20:33:50.541 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-10T20:33:50.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:33:50.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:33:50.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:33:50.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:33:50.596 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:33:50.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:33:50.625 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T20:33:50.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:33:50.656 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:33:50.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:33:50.719 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T20:33:50.729 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T20:33:50.740 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T20:33:50.741 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi083.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T20:37:49.565 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-10T20:37:49.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:37:49.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:37:49.663 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-10T20:37:49.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-10T20:37:49.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-10T20:37:49.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:37:49.855 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-10T20:37:49.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-10T20:37:49.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-10T20:37:49.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:37:50.029 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-10T20:37:50.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-10T20:37:50.126 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T20:37:50.286 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T20:37:50.286 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:37:50.287 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:37:50.290 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:37:50.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:37:50.293 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:37:50.293 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:37:50.318 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:37:50.324 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:37:50.325 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:37:50.333 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:37:50.340 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:37:50.340 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:37:50.359 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-09-10T20:37:50.366 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-09-10T20:37:50.366 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-10T20:37:50.371 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-09-10T20:37:50.377 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-10T20:37:50.378 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-09-10T20:37:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:37:50.392 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:37:50.392 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:37:50.401 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:37:50.407 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:37:50.407 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:37:50.459 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:37:50.461 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:37:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:37:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-10T20:37:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.462 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.463 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.465 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.467 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.471 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:37:50.472 INFO:teuthology.run_tasks:Running task install... 2024-09-10T20:37:50.481 DEBUG:teuthology.task.install:project ceph 2024-09-10T20:37:50.481 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T20:37:50.481 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T20:37:50.481 INFO:teuthology.task.install:Using flavor: default 2024-09-10T20:37:50.486 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T20:37:50.486 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T20:37:50.487 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:37:50.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:37:50.489 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:37:50.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:37:50.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:37:50.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:37:50.637 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:37:50.638 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:37:50.650 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:37:50.650 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:37:50.661 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:37:50.661 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:37:50.757 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:37:50.757 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:37:50.757 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:37:50.765 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:37:50.765 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:37:50.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:37:50.779 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:37:50.779 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:37:50.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:37:50.785 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:37:50.785 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:37:50.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:37:50.791 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:37:50.806 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:37:50.806 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:37:50.851 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:37:50.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:37:50.871 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:37:50.928 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:37:50.932 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:37:50.946 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:37:50.992 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-09-10T20:37:50.994 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-09-10T20:37:50.996 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-10T20:37:50.998 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-10T20:37:51.009 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-09-10T20:37:51.011 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-09-10T20:37:51.225 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-10T20:37:51.228 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-09-10T20:37:51.235 INFO:teuthology.orchestra.run.smithi083.stdout:45 files removed 2024-09-10T20:37:51.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:37:51.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:37:51.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:37:51.810 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 336 kB/s | 84 kB 00:00 2024-09-10T20:37:51.812 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-10T20:37:51.815 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-10T20:37:52.094 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-10T20:37:52.099 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-10T20:37:52.104 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T20:37:52.370 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T20:37:52.375 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T20:37:52.388 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-10T20:37:52.817 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-10T20:37:53.213 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-10T20:37:55.239 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-10T20:37:58.152 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 20 MB 00:04 2024-09-10T20:37:58.186 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.2 MB 00:05 2024-09-10T20:37:59.615 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-10T20:38:01.066 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-10T20:38:02.436 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T20:38:02.477 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T20:38:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-10T20:38:04.736 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-10T20:38:05.949 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T20:38:07.942 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-10T20:38:09.604 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-10T20:38:10.230 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:10.230 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:10.244 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:38:10.245 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:38:10.246 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:38:10.247 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:38:10.249 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:38:10.252 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:38:10.253 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:38:10.315 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-10T20:38:10.335 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:38:10.336 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:38:10.337 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:38:10.338 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:38:10.339 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:38:10.340 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:38:10.341 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:38:10.342 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:38:10.343 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:38:10.344 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:38:10.345 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:38:10.346 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:38:10.347 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:38:10.348 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout:Install 149 Packages 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-10T20:38:10.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:38:10.350 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 240 M 2024-09-10T20:38:10.350 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-10T20:38:10.894 INFO:teuthology.orchestra.run.smithi172.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-09-10T20:38:11.138 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-10T20:38:11.321 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T20:38:11.452 INFO:teuthology.orchestra.run.smithi172.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.6 MB/s | 900 kB 00:00 2024-09-10T20:38:11.552 INFO:teuthology.orchestra.run.smithi172.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.4 MB/s | 145 kB 00:00 2024-09-10T20:38:12.336 INFO:teuthology.orchestra.run.smithi172.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-09-10T20:38:12.678 INFO:teuthology.orchestra.run.smithi172.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.8 MB/s | 5.5 MB 00:01 2024-09-10T20:38:12.719 INFO:teuthology.orchestra.run.smithi172.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-09-10T20:38:13.134 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 12 MB/s | 23 MB 00:01 2024-09-10T20:38:13.236 INFO:teuthology.orchestra.run.smithi172.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 8.6 MB/s | 4.8 MB 00:00 2024-09-10T20:38:13.642 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:13.643 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:13.657 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:38:13.658 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:38:13.659 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:38:13.660 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:38:13.661 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:38:13.664 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:38:13.665 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:38:13.729 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-10T20:38:13.738 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-10T20:38:13.738 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-10T20:38:13.738 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-10T20:38:13.738 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-10T20:38:13.738 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:38:13.739 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:38:13.740 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:38:13.741 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:38:13.742 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:38:13.743 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:38:13.744 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:38:13.745 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:38:13.746 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:38:13.747 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:38:13.748 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:38:13.749 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:38:13.750 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:38:13.751 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-10T20:38:13.752 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-10T20:38:13.752 INFO:teuthology.orchestra.run.smithi083.stdout:Install 149 Packages 2024-09-10T20:38:13.752 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 8 Packages 2024-09-10T20:38:13.752 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:38:13.752 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 240 M 2024-09-10T20:38:13.753 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-10T20:38:14.120 INFO:teuthology.orchestra.run.smithi172.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 6.4 MB/s | 22 MB 00:03 2024-09-10T20:38:14.253 INFO:teuthology.orchestra.run.smithi172.stdout:(9/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 11 MB/s | 11 MB 00:01 2024-09-10T20:38:14.270 INFO:teuthology.orchestra.run.smithi172.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 167 kB/s | 25 kB 00:00 2024-09-10T20:38:14.462 INFO:teuthology.orchestra.run.smithi172.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 9.9 MB/s | 17 MB 00:01 2024-09-10T20:38:14.487 INFO:teuthology.orchestra.run.smithi172.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.0 MB/s | 225 kB 00:00 2024-09-10T20:38:14.521 INFO:teuthology.orchestra.run.smithi172.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 463 kB/s | 27 kB 00:00 2024-09-10T20:38:14.546 INFO:teuthology.orchestra.run.smithi172.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 544 kB/s | 32 kB 00:00 2024-09-10T20:38:14.622 INFO:teuthology.orchestra.run.smithi172.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-10T20:38:14.655 INFO:teuthology.orchestra.run.smithi172.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.5 MB/s | 755 kB 00:00 2024-09-10T20:38:14.689 INFO:teuthology.orchestra.run.smithi172.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T20:38:14.739 INFO:teuthology.orchestra.run.smithi172.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 5.9 MB/s | 507 kB 00:00 2024-09-10T20:38:14.823 INFO:teuthology.orchestra.run.smithi172.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 543 kB/s | 45 kB 00:00 2024-09-10T20:38:14.906 INFO:teuthology.orchestra.run.smithi172.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T20:38:15.032 INFO:teuthology.orchestra.run.smithi172.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.3 MB/s | 161 kB 00:00 2024-09-10T20:38:15.140 INFO:teuthology.orchestra.run.smithi083.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-09-10T20:38:15.166 INFO:teuthology.orchestra.run.smithi172.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-10T20:38:15.191 INFO:teuthology.orchestra.run.smithi172.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 2.0 MB/s | 321 kB 00:00 2024-09-10T20:38:15.233 INFO:teuthology.orchestra.run.smithi172.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T20:38:15.258 INFO:teuthology.orchestra.run.smithi172.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.4 MB/s | 99 kB 00:00 2024-09-10T20:38:15.300 INFO:teuthology.orchestra.run.smithi172.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T20:38:15.392 INFO:teuthology.orchestra.run.smithi172.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-10T20:38:15.501 INFO:teuthology.orchestra.run.smithi172.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 316 kB/s | 34 kB 00:00 2024-09-10T20:38:15.559 INFO:teuthology.orchestra.run.smithi172.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.2 MB 00:00 2024-09-10T20:38:15.584 INFO:teuthology.orchestra.run.smithi172.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T20:38:16.185 INFO:teuthology.orchestra.run.smithi172.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-10T20:38:16.268 INFO:teuthology.orchestra.run.smithi172.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.4 MB/s | 291 kB 00:00 2024-09-10T20:38:16.546 INFO:teuthology.orchestra.run.smithi083.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 640 kB/s | 900 kB 00:01 2024-09-10T20:38:16.674 INFO:teuthology.orchestra.run.smithi083.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.1 MB/s | 145 kB 00:00 2024-09-10T20:38:16.752 INFO:teuthology.orchestra.run.smithi172.stdout:(33/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 20 MB/s | 50 MB 00:02 2024-09-10T20:38:16.777 INFO:teuthology.orchestra.run.smithi172.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 97 kB/s | 49 kB 00:00 2024-09-10T20:38:16.802 INFO:teuthology.orchestra.run.smithi172.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 330 kB/s | 16 kB 00:00 2024-09-10T20:38:16.828 INFO:teuthology.orchestra.run.smithi172.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T20:38:16.986 INFO:teuthology.orchestra.run.smithi172.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 9.9 MB/s | 14 MB 00:01 2024-09-10T20:38:17.003 INFO:teuthology.orchestra.run.smithi172.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 104 kB/s | 18 kB 00:00 2024-09-10T20:38:17.045 INFO:teuthology.orchestra.run.smithi172.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 3.2 MB/s | 783 kB 00:00 2024-09-10T20:38:17.107 INFO:teuthology.orchestra.run.smithi083.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.3 MB/s | 5.5 MB 00:02 2024-09-10T20:38:17.146 INFO:teuthology.orchestra.run.smithi172.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-10T20:38:17.196 INFO:teuthology.orchestra.run.smithi172.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-10T20:38:17.238 INFO:teuthology.orchestra.run.smithi172.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-10T20:38:17.263 INFO:teuthology.orchestra.run.smithi172.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-10T20:38:17.297 INFO:teuthology.orchestra.run.smithi172.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T20:38:17.322 INFO:teuthology.orchestra.run.smithi172.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T20:38:17.355 INFO:teuthology.orchestra.run.smithi172.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-10T20:38:17.381 INFO:teuthology.orchestra.run.smithi172.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T20:38:17.406 INFO:teuthology.orchestra.run.smithi172.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T20:38:17.407 INFO:teuthology.orchestra.run.smithi083.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-09-10T20:38:17.448 INFO:teuthology.orchestra.run.smithi172.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-10T20:38:17.473 INFO:teuthology.orchestra.run.smithi172.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-10T20:38:17.499 INFO:teuthology.orchestra.run.smithi172.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 7.8 MB/s | 943 kB 00:00 2024-09-10T20:38:17.524 INFO:teuthology.orchestra.run.smithi172.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 287 kB/s | 22 kB 00:00 2024-09-10T20:38:17.558 INFO:teuthology.orchestra.run.smithi172.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T20:38:17.583 INFO:teuthology.orchestra.run.smithi172.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-10T20:38:17.641 INFO:teuthology.orchestra.run.smithi172.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-10T20:38:17.666 INFO:teuthology.orchestra.run.smithi083.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 2.4 MB/s | 2.4 MB 00:00 2024-09-10T20:38:17.667 INFO:teuthology.orchestra.run.smithi172.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-10T20:38:17.725 INFO:teuthology.orchestra.run.smithi172.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-10T20:38:17.751 INFO:teuthology.orchestra.run.smithi172.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-10T20:38:17.776 INFO:teuthology.orchestra.run.smithi172.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-10T20:38:17.801 INFO:teuthology.orchestra.run.smithi172.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-10T20:38:17.851 INFO:teuthology.orchestra.run.smithi172.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-10T20:38:17.876 INFO:teuthology.orchestra.run.smithi172.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-10T20:38:17.910 INFO:teuthology.orchestra.run.smithi172.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-10T20:38:17.935 INFO:teuthology.orchestra.run.smithi172.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-10T20:38:17.977 INFO:teuthology.orchestra.run.smithi172.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T20:38:18.011 INFO:teuthology.orchestra.run.smithi172.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T20:38:18.036 INFO:teuthology.orchestra.run.smithi172.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 383 kB/s | 38 kB 00:00 2024-09-10T20:38:18.225 INFO:teuthology.orchestra.run.smithi083.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 5.9 MB/s | 4.8 MB 00:00 2024-09-10T20:38:18.353 INFO:teuthology.orchestra.run.smithi172.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-10T20:38:18.445 INFO:teuthology.orchestra.run.smithi172.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-10T20:38:18.528 INFO:teuthology.orchestra.run.smithi172.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-10T20:38:18.571 INFO:teuthology.orchestra.run.smithi172.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-09-10T20:38:18.662 INFO:teuthology.orchestra.run.smithi172.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-10T20:38:18.737 INFO:teuthology.orchestra.run.smithi172.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-10T20:38:18.924 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-10T20:38:19.071 INFO:teuthology.orchestra.run.smithi172.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-10T20:38:19.171 INFO:teuthology.orchestra.run.smithi172.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 9.0 MB/s | 5.8 MB 00:00 2024-09-10T20:38:19.189 INFO:teuthology.orchestra.run.smithi172.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-10T20:38:19.222 INFO:teuthology.orchestra.run.smithi172.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-10T20:38:19.255 INFO:teuthology.orchestra.run.smithi172.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-10T20:38:19.281 INFO:teuthology.orchestra.run.smithi172.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-10T20:38:19.341 INFO:teuthology.orchestra.run.smithi083.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 4.7 MB/s | 22 MB 00:04 2024-09-10T20:38:19.356 INFO:teuthology.orchestra.run.smithi172.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 9.6 MB/s | 6.0 MB 00:00 2024-09-10T20:38:19.381 INFO:teuthology.orchestra.run.smithi172.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 152 kB/s | 19 kB 00:00 2024-09-10T20:38:19.391 INFO:teuthology.orchestra.run.smithi083.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-10T20:38:19.407 INFO:teuthology.orchestra.run.smithi172.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T20:38:19.432 INFO:teuthology.orchestra.run.smithi172.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-10T20:38:19.491 INFO:teuthology.orchestra.run.smithi172.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-10T20:38:19.516 INFO:teuthology.orchestra.run.smithi172.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-10T20:38:19.591 INFO:teuthology.orchestra.run.smithi172.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-10T20:38:19.617 INFO:teuthology.orchestra.run.smithi172.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-10T20:38:19.642 INFO:teuthology.orchestra.run.smithi172.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 511 kB/s | 77 kB 00:00 2024-09-10T20:38:19.667 INFO:teuthology.orchestra.run.smithi172.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T20:38:19.692 INFO:teuthology.orchestra.run.smithi172.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-10T20:38:19.718 INFO:teuthology.orchestra.run.smithi172.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T20:38:19.743 INFO:teuthology.orchestra.run.smithi172.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T20:38:19.768 INFO:teuthology.orchestra.run.smithi172.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-10T20:38:19.794 INFO:teuthology.orchestra.run.smithi172.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-10T20:38:19.817 INFO:teuthology.orchestra.run.smithi083.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 6.9 MB/s | 11 MB 00:01 2024-09-10T20:38:19.819 INFO:teuthology.orchestra.run.smithi172.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-10T20:38:19.844 INFO:teuthology.orchestra.run.smithi172.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T20:38:19.869 INFO:teuthology.orchestra.run.smithi172.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-10T20:38:19.883 INFO:teuthology.orchestra.run.smithi083.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-10T20:38:19.886 INFO:teuthology.orchestra.run.smithi172.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T20:38:19.928 INFO:teuthology.orchestra.run.smithi172.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T20:38:19.934 INFO:teuthology.orchestra.run.smithi083.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 542 kB/s | 27 kB 00:00 2024-09-10T20:38:19.945 INFO:teuthology.orchestra.run.smithi172.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-10T20:38:19.979 INFO:teuthology.orchestra.run.smithi172.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T20:38:19.984 INFO:teuthology.orchestra.run.smithi083.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 637 kB/s | 32 kB 00:00 2024-09-10T20:38:19.996 INFO:teuthology.orchestra.run.smithi172.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T20:38:20.021 INFO:teuthology.orchestra.run.smithi172.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-10T20:38:20.071 INFO:teuthology.orchestra.run.smithi172.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-10T20:38:20.117 INFO:teuthology.orchestra.run.smithi083.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.6 MB/s | 755 kB 00:00 2024-09-10T20:38:20.169 INFO:teuthology.orchestra.run.smithi083.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 3.1 MB/s | 162 kB 00:00 2024-09-10T20:38:20.171 INFO:teuthology.orchestra.run.smithi172.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T20:38:20.213 INFO:teuthology.orchestra.run.smithi172.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-10T20:38:20.219 INFO:teuthology.orchestra.run.smithi083.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T20:38:20.247 INFO:teuthology.orchestra.run.smithi172.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-10T20:38:20.272 INFO:teuthology.orchestra.run.smithi172.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-10T20:38:20.298 INFO:teuthology.orchestra.run.smithi172.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T20:38:20.311 INFO:teuthology.orchestra.run.smithi083.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 5.4 MB/s | 507 kB 00:00 2024-09-10T20:38:20.323 INFO:teuthology.orchestra.run.smithi172.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T20:38:20.356 INFO:teuthology.orchestra.run.smithi172.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T20:38:20.390 INFO:teuthology.orchestra.run.smithi172.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-10T20:38:20.474 INFO:teuthology.orchestra.run.smithi172.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-10T20:38:20.549 INFO:teuthology.orchestra.run.smithi172.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T20:38:20.574 INFO:teuthology.orchestra.run.smithi172.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T20:38:20.600 INFO:teuthology.orchestra.run.smithi172.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T20:38:20.625 INFO:teuthology.orchestra.run.smithi172.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-10T20:38:20.650 INFO:teuthology.orchestra.run.smithi172.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-10T20:38:20.818 INFO:teuthology.orchestra.run.smithi172.stdout:(119/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-10T20:38:20.842 INFO:teuthology.orchestra.run.smithi172.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2024-09-10T20:38:20.877 INFO:teuthology.orchestra.run.smithi172.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-09-10T20:38:20.910 INFO:teuthology.orchestra.run.smithi172.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.6 MB/s | 220 kB 00:00 2024-09-10T20:38:20.927 INFO:teuthology.orchestra.run.smithi083.stdout:(18/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 9.0 MB/s | 5.5 MB 00:00 2024-09-10T20:38:20.935 INFO:teuthology.orchestra.run.smithi172.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T20:38:20.960 INFO:teuthology.orchestra.run.smithi172.stdout:(124/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-10T20:38:20.978 INFO:teuthology.orchestra.run.smithi083.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 907 kB/s | 45 kB 00:00 2024-09-10T20:38:20.985 INFO:teuthology.orchestra.run.smithi172.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-10T20:38:21.011 INFO:teuthology.orchestra.run.smithi172.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 720 kB/s | 18 kB 00:00 2024-09-10T20:38:21.028 INFO:teuthology.orchestra.run.smithi083.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.8 MB/s | 143 kB 00:00 2024-09-10T20:38:21.036 INFO:teuthology.orchestra.run.smithi172.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-10T20:38:21.061 INFO:teuthology.orchestra.run.smithi172.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T20:38:21.086 INFO:teuthology.orchestra.run.smithi172.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T20:38:21.120 INFO:teuthology.orchestra.run.smithi172.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T20:38:21.145 INFO:teuthology.orchestra.run.smithi172.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T20:38:21.170 INFO:teuthology.orchestra.run.smithi172.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T20:38:21.203 INFO:teuthology.orchestra.run.smithi083.stdout:(21/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 4.9 MB/s | 17 MB 00:03 2024-09-10T20:38:21.212 INFO:teuthology.orchestra.run.smithi172.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T20:38:21.229 INFO:teuthology.orchestra.run.smithi083.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 806 kB/s | 161 kB 00:00 2024-09-10T20:38:21.237 INFO:teuthology.orchestra.run.smithi172.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-10T20:38:21.279 INFO:teuthology.orchestra.run.smithi083.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 4.2 MB/s | 321 kB 00:00 2024-09-10T20:38:21.280 INFO:teuthology.orchestra.run.smithi172.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-10T20:38:21.304 INFO:teuthology.orchestra.run.smithi083.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-10T20:38:21.305 INFO:teuthology.orchestra.run.smithi172.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-10T20:38:21.330 INFO:teuthology.orchestra.run.smithi083.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T20:38:21.347 INFO:teuthology.orchestra.run.smithi172.stdout:(137/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-10T20:38:21.355 INFO:teuthology.orchestra.run.smithi083.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T20:38:21.372 INFO:teuthology.orchestra.run.smithi172.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 670 kB/s | 90 kB 00:00 2024-09-10T20:38:21.385 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:21.386 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:38:21.389 INFO:teuthology.orchestra.run.smithi172.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 366 kB/s | 31 kB 00:00 2024-09-10T20:38:21.398 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:38:21.399 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:38:21.400 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:38:21.401 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:38:21.403 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:38:21.405 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:38:21.406 INFO:teuthology.orchestra.run.smithi083.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T20:38:21.406 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:38:21.414 INFO:teuthology.orchestra.run.smithi172.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-10T20:38:21.432 INFO:teuthology.orchestra.run.smithi172.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 857 kB/s | 36 kB 00:00 2024-09-10T20:38:21.456 INFO:teuthology.orchestra.run.smithi083.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 687 kB/s | 34 kB 00:00 2024-09-10T20:38:21.457 INFO:teuthology.orchestra.run.smithi172.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-10T20:38:21.475 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-10T20:38:21.482 INFO:teuthology.orchestra.run.smithi172.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-10T20:38:21.494 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-10T20:38:21.494 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-10T20:38:21.494 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-10T20:38:21.494 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:38:21.495 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:38:21.496 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:38:21.497 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:38:21.498 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:38:21.499 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:38:21.500 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:38:21.501 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:38:21.502 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:38:21.503 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:38:21.504 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:38:21.505 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:38:21.506 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:38:21.507 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================= 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout:Install 149 Packages 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 8 Packages 2024-09-10T20:38:21.508 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:38:21.509 INFO:teuthology.orchestra.run.smithi172.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T20:38:21.509 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 240 M 2024-09-10T20:38:21.510 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-10T20:38:21.514 INFO:teuthology.orchestra.run.smithi083.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T20:38:21.532 INFO:teuthology.orchestra.run.smithi172.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T20:38:21.558 INFO:teuthology.orchestra.run.smithi172.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T20:38:21.583 INFO:teuthology.orchestra.run.smithi172.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T20:38:21.609 INFO:teuthology.orchestra.run.smithi172.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T20:38:21.659 INFO:teuthology.orchestra.run.smithi172.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T20:38:21.831 INFO:teuthology.orchestra.run.smithi083.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 6.3 MB/s | 3.2 MB 00:00 2024-09-10T20:38:21.884 INFO:teuthology.orchestra.run.smithi172.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-09-10T20:38:21.943 INFO:teuthology.orchestra.run.smithi172.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.6 MB/s | 3.5 MB 00:00 2024-09-10T20:38:21.993 INFO:teuthology.orchestra.run.smithi172.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-10T20:38:22.017 INFO:teuthology.orchestra.run.smithi067.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-10T20:38:22.043 INFO:teuthology.orchestra.run.smithi172.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 407 kB/s | 41 kB 00:00 2024-09-10T20:38:22.085 INFO:teuthology.orchestra.run.smithi172.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-09-10T20:38:22.202 INFO:teuthology.orchestra.run.smithi172.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-10T20:38:22.250 INFO:teuthology.orchestra.run.smithi067.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T20:38:22.269 INFO:teuthology.orchestra.run.smithi172.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-10T20:38:22.301 INFO:teuthology.orchestra.run.smithi067.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.8 MB/s | 145 kB 00:00 2024-09-10T20:38:22.311 INFO:teuthology.orchestra.run.smithi172.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-10T20:38:22.317 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:38:22.317 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 240 MB 00:11 2024-09-10T20:38:22.501 INFO:teuthology.orchestra.run.smithi067.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 8.8 MB/s | 5.5 MB 00:00 2024-09-10T20:38:22.628 INFO:teuthology.orchestra.run.smithi067.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 7.3 MB/s | 2.4 MB 00:00 2024-09-10T20:38:22.668 INFO:teuthology.orchestra.run.smithi067.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 9.2 MB/s | 1.5 MB 00:00 2024-09-10T20:38:23.151 INFO:teuthology.orchestra.run.smithi067.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 9.1 MB/s | 4.8 MB 00:00 2024-09-10T20:38:23.423 INFO:teuthology.orchestra.run.smithi083.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 4.6 MB/s | 7.4 MB 00:01 2024-09-10T20:38:23.468 INFO:teuthology.orchestra.run.smithi067.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 14 MB/s | 22 MB 00:01 2024-09-10T20:38:23.510 INFO:teuthology.orchestra.run.smithi067.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 606 kB/s | 25 kB 00:00 2024-09-10T20:38:23.523 INFO:teuthology.orchestra.run.smithi083.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.8 MB/s | 291 kB 00:00 2024-09-10T20:38:23.562 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-10T20:38:23.718 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-10T20:38:23.718 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-10T20:38:23.877 INFO:teuthology.orchestra.run.smithi067.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 14 MB/s | 17 MB 00:01 2024-09-10T20:38:23.940 INFO:teuthology.orchestra.run.smithi083.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 5.8 MB/s | 14 MB 00:02 2024-09-10T20:38:23.965 INFO:teuthology.orchestra.run.smithi083.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 112 kB/s | 49 kB 00:00 2024-09-10T20:38:23.991 INFO:teuthology.orchestra.run.smithi083.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 330 kB/s | 16 kB 00:00 2024-09-10T20:38:24.011 INFO:teuthology.orchestra.run.smithi067.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 13 MB/s | 11 MB 00:00 2024-09-10T20:38:24.036 INFO:teuthology.orchestra.run.smithi067.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.4 MB/s | 225 kB 00:00 2024-09-10T20:38:24.041 INFO:teuthology.orchestra.run.smithi083.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.7 MB/s | 285 kB 00:00 2024-09-10T20:38:24.061 INFO:teuthology.orchestra.run.smithi067.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 541 kB/s | 27 kB 00:00 2024-09-10T20:38:24.087 INFO:teuthology.orchestra.run.smithi067.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 633 kB/s | 32 kB 00:00 2024-09-10T20:38:24.100 INFO:teuthology.orchestra.run.smithi083.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 313 kB/s | 18 kB 00:00 2024-09-10T20:38:24.145 INFO:teuthology.orchestra.run.smithi067.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 8.8 MB/s | 755 kB 00:00 2024-09-10T20:38:24.170 INFO:teuthology.orchestra.run.smithi067.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.9 MB/s | 162 kB 00:00 2024-09-10T20:38:24.183 INFO:teuthology.orchestra.run.smithi083.stdout:(38/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 4.0 MB/s | 783 kB 00:00 2024-09-10T20:38:24.196 INFO:teuthology.orchestra.run.smithi067.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T20:38:24.225 INFO:teuthology.orchestra.run.smithi083.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 638 kB/s | 80 kB 00:00 2024-09-10T20:38:24.237 INFO:teuthology.orchestra.run.smithi067.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 7.4 MB/s | 507 kB 00:00 2024-09-10T20:38:24.305 INFO:teuthology.orchestra.run.smithi067.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 677 kB/s | 45 kB 00:00 2024-09-10T20:38:24.309 INFO:teuthology.orchestra.run.smithi083.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T20:38:24.372 INFO:teuthology.orchestra.run.smithi067.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.1 MB/s | 143 kB 00:00 2024-09-10T20:38:24.384 INFO:teuthology.orchestra.run.smithi083.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T20:38:24.426 INFO:teuthology.orchestra.run.smithi083.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-10T20:38:24.447 INFO:teuthology.orchestra.run.smithi067.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-10T20:38:24.477 INFO:teuthology.orchestra.run.smithi083.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T20:38:24.516 INFO:teuthology.orchestra.run.smithi067.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 4.6 MB/s | 321 kB 00:00 2024-09-10T20:38:24.519 INFO:teuthology.orchestra.run.smithi083.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 9.1 MB/s | 1.2 MB 00:00 2024-09-10T20:38:24.544 INFO:teuthology.orchestra.run.smithi083.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T20:38:24.569 INFO:teuthology.orchestra.run.smithi083.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T20:38:24.591 INFO:teuthology.orchestra.run.smithi067.stdout:(23/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 5.5 MB 00:00 2024-09-10T20:38:24.595 INFO:teuthology.orchestra.run.smithi083.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T20:38:24.616 INFO:teuthology.orchestra.run.smithi067.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 306 kB 00:00 2024-09-10T20:38:24.650 INFO:teuthology.orchestra.run.smithi067.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-10T20:38:24.684 INFO:teuthology.orchestra.run.smithi067.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-10T20:38:24.767 INFO:teuthology.orchestra.run.smithi067.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.0 MB/s | 171 kB 00:00 2024-09-10T20:38:24.851 INFO:teuthology.orchestra.run.smithi067.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 411 kB/s | 34 kB 00:00 2024-09-10T20:38:24.934 INFO:teuthology.orchestra.run.smithi067.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.2 MB 00:00 2024-09-10T20:38:24.959 INFO:teuthology.orchestra.run.smithi067.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.4 MB/s | 154 kB 00:00 2024-09-10T20:38:25.320 INFO:teuthology.orchestra.run.smithi083.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 918 kB/s | 689 kB 00:00 2024-09-10T20:38:25.437 INFO:teuthology.orchestra.run.smithi083.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 918 kB/s | 107 kB 00:00 2024-09-10T20:38:25.529 INFO:teuthology.orchestra.run.smithi083.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-10T20:38:25.554 INFO:teuthology.orchestra.run.smithi083.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 185 kB/s | 22 kB 00:00 2024-09-10T20:38:25.595 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-10T20:38:25.596 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-10T20:38:25.654 INFO:teuthology.orchestra.run.smithi083.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T20:38:25.671 INFO:teuthology.orchestra.run.smithi083.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 279 kB/s | 33 kB 00:00 2024-09-10T20:38:25.780 INFO:teuthology.orchestra.run.smithi083.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-10T20:38:25.891 INFO:teuthology.orchestra.run.smithi083.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 101 kB/s | 11 kB 00:00 2024-09-10T20:38:26.008 INFO:teuthology.orchestra.run.smithi083.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-10T20:38:26.018 INFO:teuthology.orchestra.run.smithi067.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 7.0 MB/s | 7.4 MB 00:01 2024-09-10T20:38:26.092 INFO:teuthology.orchestra.run.smithi083.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-09-10T20:38:26.125 INFO:teuthology.orchestra.run.smithi083.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-10T20:38:26.177 INFO:teuthology.orchestra.run.smithi067.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 11 MB/s | 14 MB 00:01 2024-09-10T20:38:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-10T20:38:26.202 INFO:teuthology.orchestra.run.smithi067.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.5 MB/s | 291 kB 00:00 2024-09-10T20:38:26.219 INFO:teuthology.orchestra.run.smithi067.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.2 MB/s | 49 kB 00:00 2024-09-10T20:38:26.244 INFO:teuthology.orchestra.run.smithi067.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 393 kB/s | 16 kB 00:00 2024-09-10T20:38:26.278 INFO:teuthology.orchestra.run.smithi067.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T20:38:26.326 INFO:teuthology.orchestra.run.smithi083.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-10T20:38:26.345 INFO:teuthology.orchestra.run.smithi067.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 273 kB/s | 18 kB 00:00 2024-09-10T20:38:26.378 INFO:teuthology.orchestra.run.smithi067.stdout:(38/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 5.7 MB/s | 783 kB 00:00 2024-09-10T20:38:26.443 INFO:teuthology.orchestra.run.smithi083.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-10T20:38:26.468 INFO:teuthology.orchestra.run.smithi083.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-10T20:38:26.560 INFO:teuthology.orchestra.run.smithi083.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-10T20:38:26.585 INFO:teuthology.orchestra.run.smithi083.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T20:38:26.678 INFO:teuthology.orchestra.run.smithi083.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-10T20:38:26.703 INFO:teuthology.orchestra.run.smithi083.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 328 kB/s | 38 kB 00:00 2024-09-10T20:38:27.162 INFO:teuthology.orchestra.run.smithi067.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 14 MB/s | 50 MB 00:03 2024-09-10T20:38:27.187 INFO:teuthology.orchestra.run.smithi067.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 95 kB/s | 80 kB 00:00 2024-09-10T20:38:27.446 INFO:teuthology.orchestra.run.smithi067.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 675 kB/s | 191 kB 00:00 2024-09-10T20:38:27.462 INFO:teuthology.orchestra.run.smithi083.stdout:(67/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 6.2 MB/s | 50 MB 00:08 2024-09-10T20:38:27.545 INFO:teuthology.orchestra.run.smithi083.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-09-10T20:38:27.571 INFO:teuthology.orchestra.run.smithi067.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 672 kB/s | 801 kB 00:01 2024-09-10T20:38:27.671 INFO:teuthology.orchestra.run.smithi083.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T20:38:27.680 INFO:teuthology.orchestra.run.smithi067.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-09-10T20:38:27.738 INFO:teuthology.orchestra.run.smithi067.stdout:(44/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 460 kB/s | 253 kB 00:00 2024-09-10T20:38:27.788 INFO:teuthology.orchestra.run.smithi067.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-10T20:38:27.796 INFO:teuthology.orchestra.run.smithi083.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T20:38:27.847 INFO:teuthology.orchestra.run.smithi067.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-10T20:38:27.906 INFO:teuthology.orchestra.run.smithi067.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-10T20:38:27.948 INFO:teuthology.orchestra.run.smithi067.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-10T20:38:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-10T20:38:28.173 INFO:teuthology.orchestra.run.smithi067.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-10T20:38:28.206 INFO:teuthology.orchestra.run.smithi067.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-09-10T20:38:28.266 INFO:teuthology.orchestra.run.smithi067.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-10T20:38:28.299 INFO:teuthology.orchestra.run.smithi067.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-10T20:38:28.349 INFO:teuthology.orchestra.run.smithi067.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-10T20:38:28.355 INFO:teuthology.orchestra.run.smithi083.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-10T20:38:28.400 INFO:teuthology.orchestra.run.smithi067.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-10T20:38:28.442 INFO:teuthology.orchestra.run.smithi067.stdout:(56/157): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 943 kB 00:00 2024-09-10T20:38:28.467 INFO:teuthology.orchestra.run.smithi067.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-10T20:38:28.480 INFO:teuthology.orchestra.run.smithi083.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-10T20:38:28.517 INFO:teuthology.orchestra.run.smithi067.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-10T20:38:28.542 INFO:teuthology.orchestra.run.smithi067.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-10T20:38:28.547 INFO:teuthology.orchestra.run.smithi083.stdout:(73/157): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-10T20:38:28.597 INFO:teuthology.orchestra.run.smithi083.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-10T20:38:28.642 INFO:teuthology.orchestra.run.smithi067.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T20:38:28.693 INFO:teuthology.orchestra.run.smithi067.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-10T20:38:28.705 INFO:teuthology.orchestra.run.smithi083.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-10T20:38:28.743 INFO:teuthology.orchestra.run.smithi067.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-10T20:38:28.802 INFO:teuthology.orchestra.run.smithi067.stdout:(63/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T20:38:28.831 INFO:teuthology.orchestra.run.smithi083.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T20:38:28.835 INFO:teuthology.orchestra.run.smithi067.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-10T20:38:28.860 INFO:teuthology.orchestra.run.smithi067.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-10T20:38:28.877 INFO:teuthology.orchestra.run.smithi067.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-10T20:38:28.956 INFO:teuthology.orchestra.run.smithi083.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-10T20:38:29.065 INFO:teuthology.orchestra.run.smithi083.stdout:(78/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.1 MB/s | 4.9 MB 00:02 2024-09-10T20:38:29.090 INFO:teuthology.orchestra.run.smithi083.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-09-10T20:38:29.174 INFO:teuthology.orchestra.run.smithi083.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-10T20:38:29.207 INFO:teuthology.orchestra.run.smithi083.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T20:38:29.283 INFO:teuthology.orchestra.run.smithi083.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-10T20:38:29.386 INFO:teuthology.orchestra.run.smithi067.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-09-10T20:38:29.675 INFO:teuthology.orchestra.run.smithi083.stdout:(83/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T20:38:29.700 INFO:teuthology.orchestra.run.smithi083.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 601 kB/s | 250 kB 00:00 2024-09-10T20:38:29.792 INFO:teuthology.orchestra.run.smithi083.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-10T20:38:29.917 INFO:teuthology.orchestra.run.smithi083.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 356 kB/s | 77 kB 00:00 2024-09-10T20:38:29.942 INFO:teuthology.orchestra.run.smithi083.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 281 kB/s | 42 kB 00:00 2024-09-10T20:38:30.178 INFO:teuthology.orchestra.run.smithi067.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-10T20:38:30.226 INFO:teuthology.orchestra.run.smithi083.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-10T20:38:30.353 INFO:teuthology.orchestra.run.smithi067.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-09-10T20:38:30.376 INFO:teuthology.orchestra.run.smithi083.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 587 kB/s | 269 kB 00:00 2024-09-10T20:38:30.412 INFO:teuthology.orchestra.run.smithi067.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T20:38:30.493 INFO:teuthology.orchestra.run.smithi083.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 437 kB/s | 51 kB 00:00 2024-09-10T20:38:30.602 INFO:teuthology.orchestra.run.smithi083.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-10T20:38:30.679 INFO:teuthology.orchestra.run.smithi067.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-10T20:38:30.686 INFO:teuthology.orchestra.run.smithi083.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 607 kB/s | 279 kB 00:00 2024-09-10T20:38:30.813 INFO:teuthology.orchestra.run.smithi083.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 333 kB/s | 42 kB 00:00 2024-09-10T20:38:30.920 INFO:teuthology.orchestra.run.smithi083.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-10T20:38:31.004 INFO:teuthology.orchestra.run.smithi067.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.3 MB/s | 4.9 MB 00:02 2024-09-10T20:38:31.088 INFO:teuthology.orchestra.run.smithi067.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-10T20:38:31.263 INFO:teuthology.orchestra.run.smithi067.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-10T20:38:31.295 INFO:teuthology.orchestra.run.smithi083.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 589 kB/s | 221 kB 00:00 2024-09-10T20:38:31.305 INFO:teuthology.orchestra.run.smithi067.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T20:38:31.412 INFO:teuthology.orchestra.run.smithi083.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-10T20:38:31.446 INFO:teuthology.orchestra.run.smithi067.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-10T20:38:31.537 INFO:teuthology.orchestra.run.smithi083.stdout:(97/157): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:02 2024-09-10T20:38:31.563 INFO:teuthology.orchestra.run.smithi083.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 315 kB/s | 47 kB 00:00 2024-09-10T20:38:31.597 INFO:teuthology.orchestra.run.smithi067.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-10T20:38:31.647 INFO:teuthology.orchestra.run.smithi067.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-10T20:38:31.671 INFO:teuthology.orchestra.run.smithi083.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-10T20:38:31.697 INFO:teuthology.orchestra.run.smithi067.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-10T20:38:31.814 INFO:teuthology.orchestra.run.smithi067.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T20:38:31.872 INFO:teuthology.orchestra.run.smithi083.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-10T20:38:31.881 INFO:teuthology.orchestra.run.smithi067.stdout:(81/157): postgresql-server-13.16-1.el9.x86_64. 3.9 MB/s | 5.8 MB 00:01 2024-09-10T20:38:31.899 INFO:teuthology.orchestra.run.smithi067.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 415 kB/s | 35 kB 00:00 2024-09-10T20:38:32.005 INFO:teuthology.orchestra.run.smithi083.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 651 kB/s | 304 kB 00:00 2024-09-10T20:38:32.048 INFO:teuthology.orchestra.run.smithi067.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-10T20:38:32.072 INFO:teuthology.orchestra.run.smithi083.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-10T20:38:32.114 INFO:teuthology.orchestra.run.smithi083.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-10T20:38:32.164 INFO:teuthology.orchestra.run.smithi083.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-10T20:38:32.171 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-10T20:38:32.190 INFO:teuthology.orchestra.run.smithi067.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-10T20:38:32.223 INFO:teuthology.orchestra.run.smithi083.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T20:38:32.256 INFO:teuthology.orchestra.run.smithi083.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T20:38:32.272 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:38:32.274 INFO:teuthology.orchestra.run.smithi067.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 925 kB/s | 77 kB 00:00 2024-09-10T20:38:32.281 INFO:teuthology.orchestra.run.smithi083.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-10T20:38:32.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:38:32.324 INFO:teuthology.orchestra.run.smithi067.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-10T20:38:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:38:32.406 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:38:32.440 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:38:32.441 INFO:teuthology.orchestra.run.smithi083.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-10T20:38:32.465 INFO:teuthology.orchestra.run.smithi083.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T20:38:32.491 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:38:32.491 INFO:teuthology.orchestra.run.smithi083.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-10T20:38:32.508 INFO:teuthology.orchestra.run.smithi067.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-10T20:38:32.516 INFO:teuthology.orchestra.run.smithi083.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-10T20:38:32.550 INFO:teuthology.orchestra.run.smithi083.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-10T20:38:32.583 INFO:teuthology.orchestra.run.smithi083.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-09-10T20:38:32.625 INFO:teuthology.orchestra.run.smithi067.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-10T20:38:32.642 INFO:teuthology.orchestra.run.smithi083.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-10T20:38:32.667 INFO:teuthology.orchestra.run.smithi083.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T20:38:32.684 INFO:teuthology.orchestra.run.smithi083.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-10T20:38:32.809 INFO:teuthology.orchestra.run.smithi067.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-10T20:38:32.827 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:38:32.834 INFO:teuthology.orchestra.run.smithi067.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-10T20:38:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T20:38:32.884 INFO:teuthology.orchestra.run.smithi067.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T20:38:32.897 INFO:teuthology.orchestra.run.smithi083.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 141 kB/s | 32 kB 00:00 2024-09-10T20:38:32.918 INFO:teuthology.orchestra.run.smithi083.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 60 kB/s | 14 kB 00:00 2024-09-10T20:38:32.935 INFO:teuthology.orchestra.run.smithi067.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-10T20:38:32.941 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:32.944 INFO:teuthology.orchestra.run.smithi083.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.6 MB/s | 172 kB 00:00 2024-09-10T20:38:32.986 INFO:teuthology.orchestra.run.smithi083.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T20:38:32.993 INFO:teuthology.orchestra.run.smithi067.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-09-10T20:38:33.011 INFO:teuthology.orchestra.run.smithi083.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T20:38:33.037 INFO:teuthology.orchestra.run.smithi083.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T20:38:33.062 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:33.070 INFO:teuthology.orchestra.run.smithi083.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T20:38:33.087 INFO:teuthology.orchestra.run.smithi083.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 641 kB/s | 11 kB 00:00 2024-09-10T20:38:33.101 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:33.104 INFO:teuthology.orchestra.run.smithi083.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-10T20:38:33.121 INFO:teuthology.orchestra.run.smithi083.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T20:38:33.146 INFO:teuthology.orchestra.run.smithi083.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-10T20:38:33.172 INFO:teuthology.orchestra.run.smithi083.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-10T20:38:33.192 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:33.202 INFO:teuthology.orchestra.run.smithi067.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-09-10T20:38:33.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:38:33.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:38:33.260 INFO:teuthology.orchestra.run.smithi067.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-09-10T20:38:33.263 INFO:teuthology.orchestra.run.smithi083.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-10T20:38:33.297 INFO:teuthology.orchestra.run.smithi083.stdout:(130/157): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-09-10T20:38:33.310 INFO:teuthology.orchestra.run.smithi067.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-10T20:38:33.322 INFO:teuthology.orchestra.run.smithi083.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-09-10T20:38:33.348 INFO:teuthology.orchestra.run.smithi083.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T20:38:33.373 INFO:teuthology.orchestra.run.smithi083.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T20:38:33.398 INFO:teuthology.orchestra.run.smithi083.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-10T20:38:33.404 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:38:33.423 INFO:teuthology.orchestra.run.smithi083.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-10T20:38:33.449 INFO:teuthology.orchestra.run.smithi083.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T20:38:33.461 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:38:33.474 INFO:teuthology.orchestra.run.smithi083.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T20:38:33.489 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:33.494 INFO:teuthology.orchestra.run.smithi067.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-10T20:38:33.499 INFO:teuthology.orchestra.run.smithi083.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T20:38:33.525 INFO:teuthology.orchestra.run.smithi083.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-10T20:38:33.550 INFO:teuthology.orchestra.run.smithi083.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T20:38:33.553 INFO:teuthology.orchestra.run.smithi067.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 997 kB/s | 58 kB 00:00 2024-09-10T20:38:33.575 INFO:teuthology.orchestra.run.smithi083.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T20:38:33.576 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:33.598 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:38:33.601 INFO:teuthology.orchestra.run.smithi083.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T20:38:33.634 INFO:teuthology.orchestra.run.smithi083.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-10T20:38:33.644 INFO:teuthology.orchestra.run.smithi067.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-10T20:38:33.660 INFO:teuthology.orchestra.run.smithi083.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T20:38:33.661 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:38:33.683 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:38:33.685 INFO:teuthology.orchestra.run.smithi083.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-10T20:38:33.706 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:38:33.710 INFO:teuthology.orchestra.run.smithi083.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-10T20:38:33.728 INFO:teuthology.orchestra.run.smithi067.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2024-09-10T20:38:33.779 INFO:teuthology.orchestra.run.smithi067.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-10T20:38:33.786 INFO:teuthology.orchestra.run.smithi083.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-10T20:38:33.853 INFO:teuthology.orchestra.run.smithi083.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T20:38:33.918 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:38:34.064 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:38:34.070 INFO:teuthology.orchestra.run.smithi067.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-10T20:38:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:38:34.285 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:34.346 INFO:teuthology.orchestra.run.smithi083.stdout:(149/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-09-10T20:38:34.346 INFO:teuthology.orchestra.run.smithi067.stdout:(104/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-10T20:38:34.382 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:34.428 INFO:teuthology.orchestra.run.smithi083.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 5.4 MB/s | 3.5 MB 00:00 2024-09-10T20:38:34.429 INFO:teuthology.orchestra.run.smithi067.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-10T20:38:34.463 INFO:teuthology.orchestra.run.smithi067.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.2 MB/s | 309 kB 00:00 2024-09-10T20:38:34.480 INFO:teuthology.orchestra.run.smithi067.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T20:38:34.619 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:34.620 INFO:teuthology.orchestra.run.smithi083.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 8.5 MB/s | 2.3 MB 00:00 2024-09-10T20:38:34.630 INFO:teuthology.orchestra.run.smithi067.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-10T20:38:34.647 INFO:teuthology.orchestra.run.smithi067.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-10T20:38:34.662 INFO:teuthology.orchestra.run.smithi083.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 984 kB/s | 41 kB 00:00 2024-09-10T20:38:34.664 INFO:teuthology.orchestra.run.smithi067.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-10T20:38:34.689 INFO:teuthology.orchestra.run.smithi067.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T20:38:34.704 INFO:teuthology.orchestra.run.smithi083.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 6.6 MB/s | 1.8 MB 00:00 2024-09-10T20:38:34.723 INFO:teuthology.orchestra.run.smithi067.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T20:38:34.729 INFO:teuthology.orchestra.run.smithi083.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-10T20:38:34.733 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:38:34.756 INFO:teuthology.orchestra.run.smithi067.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-09-10T20:38:34.762 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:38:34.779 INFO:teuthology.orchestra.run.smithi083.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-10T20:38:34.796 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:38:34.798 INFO:teuthology.orchestra.run.smithi067.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T20:38:34.815 INFO:teuthology.orchestra.run.smithi067.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-10T20:38:34.830 INFO:teuthology.orchestra.run.smithi083.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-10T20:38:34.832 INFO:teuthology.orchestra.run.smithi067.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T20:38:34.849 INFO:teuthology.orchestra.run.smithi067.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 852 kB/s | 14 kB 00:00 2024-09-10T20:38:34.870 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:38:34.875 INFO:teuthology.orchestra.run.smithi067.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T20:38:34.900 INFO:teuthology.orchestra.run.smithi067.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-10T20:38:34.913 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:38:34.946 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:38:34.989 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:38:35.022 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:38:35.050 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:38:35.059 INFO:teuthology.orchestra.run.smithi067.stdout:(120/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-09-10T20:38:35.092 INFO:teuthology.orchestra.run.smithi067.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-09-10T20:38:35.117 INFO:teuthology.orchestra.run.smithi067.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.4 MB/s | 303 kB 00:00 2024-09-10T20:38:35.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:38:35.151 INFO:teuthology.orchestra.run.smithi067.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T20:38:35.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:38:35.210 INFO:teuthology.orchestra.run.smithi067.stdout:(124/157): python3-google-auth-2.34.0-1.el9.noa 1.4 MB/s | 220 kB 00:00 2024-09-10T20:38:35.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:38:35.227 INFO:teuthology.orchestra.run.smithi067.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-09-10T20:38:35.246 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:38:35.252 INFO:teuthology.orchestra.run.smithi067.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-10T20:38:35.277 INFO:teuthology.orchestra.run.smithi067.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T20:38:35.302 INFO:teuthology.orchestra.run.smithi067.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-10T20:38:35.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:38:35.328 INFO:teuthology.orchestra.run.smithi067.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T20:38:35.353 INFO:teuthology.orchestra.run.smithi067.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T20:38:35.357 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:38:35.378 INFO:teuthology.orchestra.run.smithi067.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T20:38:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:38:35.403 INFO:teuthology.orchestra.run.smithi067.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T20:38:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:38:35.437 INFO:teuthology.orchestra.run.smithi067.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-09-10T20:38:35.463 INFO:teuthology.orchestra.run.smithi067.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-10T20:38:35.488 INFO:teuthology.orchestra.run.smithi067.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T20:38:35.499 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:38:35.521 INFO:teuthology.orchestra.run.smithi067.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-10T20:38:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-10T20:38:35.555 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:38:35.571 INFO:teuthology.orchestra.run.smithi067.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-10T20:38:35.614 INFO:teuthology.orchestra.run.smithi067.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-10T20:38:35.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:38:35.639 INFO:teuthology.orchestra.run.smithi067.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-10T20:38:35.664 INFO:teuthology.orchestra.run.smithi067.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-10T20:38:35.689 INFO:teuthology.orchestra.run.smithi067.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-10T20:38:35.714 INFO:teuthology.orchestra.run.smithi067.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-09-10T20:38:35.731 INFO:teuthology.orchestra.run.smithi067.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-10T20:38:35.757 INFO:teuthology.orchestra.run.smithi067.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T20:38:35.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:38:35.790 INFO:teuthology.orchestra.run.smithi067.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-10T20:38:35.824 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:38:35.832 INFO:teuthology.orchestra.run.smithi067.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-10T20:38:35.857 INFO:teuthology.orchestra.run.smithi067.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T20:38:35.924 INFO:teuthology.orchestra.run.smithi067.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T20:38:36.125 INFO:teuthology.orchestra.run.smithi067.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.5 MB 00:00 2024-09-10T20:38:36.242 INFO:teuthology.orchestra.run.smithi067.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-09-10T20:38:36.351 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:38:36.453 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:38:36.491 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:38:36.533 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:38:36.534 INFO:teuthology.orchestra.run.smithi067.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 140 kB/s | 41 kB 00:00 2024-09-10T20:38:36.571 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:38:36.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:38:36.759 INFO:teuthology.orchestra.run.smithi067.stdout:(153/157): NetworkManager-1.49.90-1.el9.x86_64. 2.8 MB/s | 2.3 MB 00:00 2024-09-10T20:38:36.786 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:38:36.858 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:38:36.901 INFO:teuthology.orchestra.run.smithi067.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-10T20:38:36.926 INFO:teuthology.orchestra.run.smithi067.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 634 kB/s | 249 kB 00:00 2024-09-10T20:38:36.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:38:37.013 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:38:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:38:37.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:38:37.143 INFO:teuthology.orchestra.run.smithi067.stdout:(156/157): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-10T20:38:37.162 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:38:37.209 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:38:37.244 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:38:37.288 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:38:37.331 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:38:37.466 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:38:37.523 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:38:37.564 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:38:37.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:38:37.743 INFO:teuthology.orchestra.run.smithi067.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-09-10T20:38:37.750 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:38:37.750 INFO:teuthology.orchestra.run.smithi067.stdout:Total 15 MB/s | 240 MB 00:16 2024-09-10T20:38:37.782 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:38:38.041 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:38:38.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:38:38.106 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:38:38.190 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:38:38.327 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:38:38.370 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:38:38.407 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:38:38.441 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:38:38.481 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:38:38.520 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:38:38.550 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:38:38.585 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:38:38.626 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:38:38.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:38:38.702 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:38:38.788 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:38:38.833 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:38:38.864 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:38:38.967 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:38:39.025 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:38:39.046 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-10T20:38:39.215 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-10T20:38:39.216 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-10T20:38:39.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:38:39.797 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:38:39.831 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:38:39.929 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:38:39.977 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:38:40.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:38:40.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:38:40.150 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:38:40.336 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:38:40.364 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:38:40.443 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:38:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:38:41.202 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:38:41.626 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-10T20:38:41.627 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-10T20:38:42.420 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:38:42.493 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:38:42.553 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:38:42.874 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:38:42.916 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:38:43.015 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:38:43.046 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:38:43.082 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:38:43.575 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:38:43.611 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:38:43.682 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:38:43.721 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:38:46.013 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:46.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:46.614 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:38:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:38:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:38:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:38:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:38:46.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-10T20:38:48.347 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:38:48.386 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:38:48.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:38:48.473 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:38:48.498 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:38:48.554 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:38:48.902 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:38:49.037 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:49.166 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:49.192 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:49.284 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:49.313 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:38:49.343 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:38:49.517 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:38:49.577 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:38:49.603 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:49.710 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:49.738 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:38:49.801 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:38:49.830 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:38:49.855 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:38:50.009 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:38:50.228 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:38:50.353 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:38:50.466 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:50.538 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:50.779 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:38:50.888 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:38:50.918 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:38:50.953 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:38:51.027 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:38:51.079 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:38:51.119 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:38:51.162 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:38:51.195 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:38:51.222 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:38:51.294 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:38:51.346 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:38:51.383 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:38:51.419 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:38:51.500 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:38:51.530 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:38:51.573 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:38:51.601 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:38:51.675 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:38:51.725 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:38:51.803 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:38:51.947 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:38:52.012 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:38:52.564 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:38:52.650 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:38:52.693 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:38:52.736 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:38:52.774 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:38:52.830 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:38:53.005 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:38:53.069 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:38:53.163 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:38:53.235 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:38:53.308 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:38:53.345 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:38:53.381 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:38:53.429 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:38:53.464 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:38:53.508 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:38:53.549 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:38:53.692 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:38:53.860 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:38:53.901 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:38:54.008 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:38:54.043 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:38:54.083 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:38:54.124 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:38:54.157 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:38:54.260 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:38:54.397 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:38:54.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:38:54.467 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:38:54.504 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:38:54.541 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:38:54.581 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:38:54.610 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:38:54.653 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:38:54.670 INFO:teuthology.orchestra.run.smithi083.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 691 kB/s | 16 MB 00:24 2024-09-10T20:38:54.675 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:38:54.676 INFO:teuthology.orchestra.run.smithi083.stdout:Total 5.9 MB/s | 240 MB 00:40 2024-09-10T20:38:54.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:38:54.729 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:38:54.762 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:38:54.853 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:38:54.902 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:38:54.932 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:38:55.041 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:38:55.100 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:38:55.851 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-10T20:38:55.865 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:38:55.917 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:38:55.950 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:38:56.003 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-10T20:38:56.003 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-10T20:38:56.055 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:38:56.106 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:38:56.151 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:38:56.241 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:38:56.278 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:38:56.468 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:38:56.500 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:38:56.579 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:38:57.274 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:38:57.385 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:38:57.957 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-10T20:38:57.957 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-10T20:38:58.390 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:38:58.565 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:58.581 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:58.582 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:58.582 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:38:58.582 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:38:58.707 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:38:58.786 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:38:58.813 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:38:58.846 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:38:59.190 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:38:59.234 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:38:59.326 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:38:59.364 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:38:59.401 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:38:59.920 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:38:59.945 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:39:00.016 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:39:00.047 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:39:00.093 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:00.121 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:00.352 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:00.376 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:00.376 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:00.376 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:39:00.376 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:00.376 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:00.377 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:00.828 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:00.851 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:00.852 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:00.852 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:39:00.852 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:00.852 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:00.852 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:00.967 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:39:01.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:39:01.080 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:39:01.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:39:01.312 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:39:01.390 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:39:01.480 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:39:01.627 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:39:01.662 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:39:01.702 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:39:01.730 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:39:02.110 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:02.137 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:02.169 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:39:02.235 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:39:02.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:02.519 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:02.551 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:03.156 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:03.196 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:39:03.288 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:39:03.289 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:39:03.289 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:39:03.289 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:03.314 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:39:04.341 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-10T20:39:04.441 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:39:04.479 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:39:04.533 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:39:04.567 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:39:04.593 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:39:04.635 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:39:04.968 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:39:05.193 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:39:05.315 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:39:05.344 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:39:05.435 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:39:05.465 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:39:05.467 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:05.494 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:39:05.524 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:05.648 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:39:05.705 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:39:05.733 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:39:05.837 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:39:05.859 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:39:05.921 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:39:05.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:39:05.966 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:39:06.119 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:39:06.247 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:39:06.396 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:39:06.491 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:06.505 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:39:06.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:06.577 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:39:06.631 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:06.796 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:39:06.797 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:39:06.826 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:06.851 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:06.905 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:39:06.910 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:06.922 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:06.939 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:39:06.973 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:39:07.020 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:39:07.037 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:39:07.066 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:39:07.082 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:39:07.115 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:39:07.158 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:39:07.199 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:39:07.236 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:39:07.305 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:39:07.353 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:39:07.392 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:39:07.427 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:39:07.505 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:39:07.538 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:39:07.581 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:39:07.611 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:39:07.680 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:39:07.726 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:39:07.801 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:39:07.939 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:39:07.995 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:39:08.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:39:08.054 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:08.078 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:08.078 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:08.078 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:39:08.079 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:08.079 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:08.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:08.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:08.145 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:08.145 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:08.145 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:39:08.145 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:08.189 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:08.212 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:08.212 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:08.212 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:39:08.212 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:08.213 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:08.213 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:08.509 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:39:08.531 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:08.555 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:39:08.636 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:39:08.679 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:39:08.717 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:39:08.759 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:39:08.930 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:39:08.987 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:39:09.094 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:39:09.168 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:39:09.242 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:39:09.284 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:39:09.320 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:39:09.367 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:39:09.402 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:39:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:39:09.488 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:39:09.622 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:39:09.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:39:09.707 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:39:09.809 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:39:09.848 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:39:09.888 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:39:09.914 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:39:09.939 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:39:10.029 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:39:10.156 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:39:10.205 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:39:10.235 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:39:10.269 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:39:10.316 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:39:10.348 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:39:10.378 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:39:10.412 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:39:10.446 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:39:10.487 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:39:10.522 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:39:10.608 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:39:10.824 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:39:10.934 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:39:11.037 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:39:11.093 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:39:11.804 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:39:11.857 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:39:11.899 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:39:11.996 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:39:12.046 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:39:12.090 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:39:12.177 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:39:12.210 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:39:12.402 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:39:12.433 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:39:12.509 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:39:13.143 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:39:13.243 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:39:13.263 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:39:13.292 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:39:13.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:39:13.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:39:13.393 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:39:13.576 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:39:13.631 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:39:13.662 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:39:13.691 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:39:13.737 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:39:14.292 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:14.343 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:14.364 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:14.475 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:39:14.571 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:39:14.598 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:39:14.632 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:39:14.950 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:39:14.995 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:39:15.069 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:39:15.100 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:39:15.144 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:39:15.219 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:39:15.289 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:39:15.330 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:39:15.410 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:39:15.450 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:39:15.476 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:39:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:39:15.502 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:15.578 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:15.634 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:39:15.645 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:15.660 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-09-10T20:39:15.661 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:15.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:39:15.670 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:39:15.676 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:15.676 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:15.719 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:39:15.750 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:39:15.855 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:15.856 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:15.948 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:15.949 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:39:15.967 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:39:15.967 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:15.967 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:39:15.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:16.011 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:17.654 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:17.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:17.913 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:17.937 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:17.938 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:17.938 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:39:17.938 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:17.938 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:17.938 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:18.033 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:18.338 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:18.405 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:18.430 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:18.430 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:18.430 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:39:18.430 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:18.431 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:18.431 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:18.544 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:39:18.603 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:39:18.666 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:39:18.864 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:39:18.885 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:39:18.914 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:39:18.925 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:39:18.995 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:39:19.016 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:39:19.016 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:39:19.016 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:39:19.016 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:19.043 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:39:19.094 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:39:19.252 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:39:19.290 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:39:19.321 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:39:19.348 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:39:19.822 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:19.847 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:19.879 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:39:19.949 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:39:19.978 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:39:22.561 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:39:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:39:22.563 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:39:22.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:39:22.565 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:39:22.566 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:39:22.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:39:22.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:39:22.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:39:22.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:39:22.567 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:39:22.573 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:39:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:39:22.575 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:39:22.576 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:39:22.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:39:22.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:39:22.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:39:22.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:39:22.577 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:39:22.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:39:22.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:39:22.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:39:22.579 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:39:22.580 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:39:22.581 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:39:22.582 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:39:23.375 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:23.434 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:24.451 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:24.476 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:24.600 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:24.770 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:39:24.803 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:24.829 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:24.829 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:24.829 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:39:24.830 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:24.830 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:24.830 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:24.879 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:24.891 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:25.004 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:39:25.055 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:39:25.121 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:25.121 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:39:25.122 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.123 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.124 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:39:25.125 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.126 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:39:25.127 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:39:25.128 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:39:25.129 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:39:25.130 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:39:25.131 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:39:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:39:25.133 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:39:25.134 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:39:25.135 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:39:25.135 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:39:25.135 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-10T20:39:25.545 DEBUG:teuthology.parallel:result is None 2024-09-10T20:39:26.061 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:39:26.089 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:26.115 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:26.156 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:26.181 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:26.181 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:26.181 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:39:26.181 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:26.232 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:26.257 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:26.583 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:26.608 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-09-10T20:39:30.979 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-09-10T20:39:30.980 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-09-10T20:39:30.980 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-09-10T20:39:30.980 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:31.148 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:39:31.163 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:39:31.163 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:31.163 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:39:31.163 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:31.595 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:39:31.637 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:39:31.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:39:31.709 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:39:31.736 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:39:31.938 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:39:31.991 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:39:32.021 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:39:32.051 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:39:32.089 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:39:32.615 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:39:32.642 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:32.734 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:32.777 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:32.799 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:32.866 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:39:32.889 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:33.333 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:39:33.356 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:33.463 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:39:33.529 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:39:33.592 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:39:33.712 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:39:33.787 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:39:33.798 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:39:33.834 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:39:33.845 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:39:33.911 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:39:33.941 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:39:33.976 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:39:34.001 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:39:34.009 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:39:34.028 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:39:34.028 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:34.103 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:34.104 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:34.148 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:39:34.171 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:34.193 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:39:34.196 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:39:34.202 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:34.202 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:34.233 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:39:34.261 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:39:34.389 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:34.390 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:34.473 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:34.541 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:34.691 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:34.718 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:39:34.750 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:39:34.841 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:39:34.891 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:38.043 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:39:38.114 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:39.072 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:39:39.098 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:39.211 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:39:39.376 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:39:39.409 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:39.432 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:39:39.432 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:39.432 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:39:39.433 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:39.433 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:39:39.433 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:39.476 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:39.487 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:39:39.585 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:39:39.632 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:39:40.577 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:39:40.620 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:39:40.643 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:40.681 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:40.681 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:39:40.682 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:39:40.683 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:39:40.684 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:39:40.685 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:39:40.686 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:39:40.687 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:39:40.688 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:39:40.689 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:39:40.690 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:39:40.691 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:39:40.692 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:39:40.693 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:39:40.694 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:39:40.695 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:40.710 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:39:40.710 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:40.710 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:39:40.710 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:40.755 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:40.778 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:39:40.778 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:40.779 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:39:40.779 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:40.779 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:39:40.779 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:41.106 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:39:41.129 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:43.213 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:43.213 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:43.213 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:39:43.214 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.215 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.216 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:39:43.217 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:39:43.218 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:39:43.219 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.220 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:39:43.221 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:39:43.222 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:39:43.223 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:39:43.224 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:39:43.225 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:39:43.226 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:39:43.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:39:43.227 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-10T20:39:43.655 DEBUG:teuthology.parallel:result is None 2024-09-10T20:39:45.784 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:39:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:39:45.867 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:39:45.899 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:39:45.926 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:39:46.105 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:39:46.148 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:39:46.178 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:39:46.209 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:39:46.255 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:39:46.882 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:46.927 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:46.947 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:39:47.773 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:39:47.866 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:39:47.907 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:39:47.995 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:39:48.036 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:39:48.061 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:39:48.087 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:39:48.087 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:48.171 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:39:48.172 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:48.264 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:39:48.289 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:39:48.294 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:48.294 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:48.495 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:39:48.496 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:48.955 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:39:49.022 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:55.241 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:39:55.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:39:55.243 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:39:55.244 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:39:55.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:39:55.246 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:39:55.247 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:39:55.248 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:39:55.249 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:39:55.252 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:39:55.253 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:39:55.254 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:39:55.255 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:39:55.256 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:39:55.257 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:39:55.258 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:39:55.259 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:57.952 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.953 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.954 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:39:57.955 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:39:57.956 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:39:57.957 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:39:57.958 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:39:57.959 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:39:57.960 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:39:57.961 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:39:57.962 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:39:57.963 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:39:57.964 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:39:57.965 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:39:57.966 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:39:57.966 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:39:57.966 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-10T20:39:58.412 DEBUG:teuthology.parallel:result is None 2024-09-10T20:39:58.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:39:58.568 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:39:58.595 INFO:teuthology.orchestra.run.smithi067.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.596 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.596 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:39:58.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:39:58.746 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:39:58.769 INFO:teuthology.orchestra.run.smithi083.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.770 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.770 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:39:58.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:39:58.915 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:39:58.941 INFO:teuthology.orchestra.run.smithi172.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.942 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:39:58.942 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:39:58.944 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T20:39:58.944 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:39:58.944 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:39:58.978 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:39:58.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:39:59.008 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:39:59.008 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:39:59.039 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T20:39:59.039 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:39:59.039 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:39:59.069 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:39:59.141 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:39:59.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:39:59.170 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:39:59.238 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:39:59.239 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:39:59.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:39:59.339 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T20:39:59.339 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:39:59.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:39:59.367 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:39:59.434 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:39:59.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:39:59.463 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:39:59.532 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:39:59.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:39:59.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:39:59.623 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T20:39:59.623 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:39:59.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:39:59.651 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:39:59.717 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:39:59.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:39:59.746 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:39:59.815 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:39:59.815 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:39:59.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:39:59.905 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T20:40:00.010 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2}} 2024-09-10T20:40:00.010 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:40:00.010 INFO:tasks.cephadm:Cluster fsid is d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:40:00.010 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T20:40:00.011 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.67', 'mon.b': '172.21.15.83', 'mon.c': '172.21.15.172'} 2024-09-10T20:40:00.011 INFO:tasks.cephadm:First mon is mon.a on smithi067 2024-09-10T20:40:00.011 INFO:tasks.cephadm:First mgr is x 2024-09-10T20:40:00.011 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T20:40:00.011 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2024-09-10T20:40:00.039 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname $(hostname -s) 2024-09-10T20:40:00.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-10T20:40:00.095 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T20:40:00.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:40:00.252 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T20:40:00.412 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:40:00.414 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T20:40:00.414 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T20:40:00.414 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:00.799 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 20:40 /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:00.799 DEBUG:teuthology.orchestra.run.smithi083:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.164 INFO:teuthology.orchestra.run.smithi083.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 20:40 /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.165 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 20:40 /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.559 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.579 DEBUG:teuthology.orchestra.run.smithi083:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.599 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T20:40:01.636 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T20:40:01.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T20:40:01.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T20:40:01.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T20:40:03.233 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T20:40:03.448 INFO:teuthology.orchestra.run.smithi083.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T20:40:03.469 INFO:teuthology.orchestra.run.smithi067.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T20:40:37.641 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout: "repo_digests": [ 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T20:40:37.642 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-10T20:40:38.987 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-10T20:41:05.242 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout: "repo_digests": [ 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-10T20:41:05.243 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-10T20:41:05.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2024-09-10T20:41:05.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph 2024-09-10T20:41:05.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-10T20:41:05.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2024-09-10T20:41:05.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /etc/ceph 2024-09-10T20:41:05.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-10T20:41:05.443 INFO:tasks.cephadm:Writing seed config... 2024-09-10T20:41:05.444 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T20:41:05.444 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T20:41:05.444 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T20:41:05.444 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T20:41:05.445 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T20:41:05.446 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T20:41:05.447 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:41:05.447 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T20:41:05.466 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d92bf05e-6fb4-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-10T20:41:05.466 DEBUG:teuthology.orchestra.run.smithi067:mon.a> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T20:41:05.509 DEBUG:teuthology.orchestra.run.smithi067:mgr.x> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T20:41:05.551 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T20:41:05.552 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.67 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T20:41:05.769 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:41:05.769 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.67', '--skip-admin-label'] 2024-09-10T20:41:05.770 INFO:teuthology.orchestra.run.smithi067.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T20:41:05.770 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying podman|docker is present... 2024-09-10T20:41:05.794 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 5.2.2 2024-09-10T20:41:05.794 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying lvm2 is present... 2024-09-10T20:41:05.794 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying time synchronization is in place... 2024-09-10T20:41:05.802 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T20:41:05.802 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T20:41:05.808 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T20:41:05.809 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:41:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2024-09-10T20:41:05.822 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2024-09-10T20:41:05.822 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2024-09-10T20:41:05.823 INFO:teuthology.orchestra.run.smithi067.stdout:Repeating the final host check... 2024-09-10T20:41:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 5.2.2 2024-09-10T20:41:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T20:41:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl is present 2024-09-10T20:41:05.846 INFO:teuthology.orchestra.run.smithi067.stdout:lvcreate is present 2024-09-10T20:41:05.853 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T20:41:05.853 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T20:41:05.859 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T20:41:05.860 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:41:05.866 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2024-09-10T20:41:05.873 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2024-09-10T20:41:05.873 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2024-09-10T20:41:05.873 INFO:teuthology.orchestra.run.smithi067.stdout:Host looks OK 2024-09-10T20:41:05.873 INFO:teuthology.orchestra.run.smithi067.stdout:Cluster fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Acquiring lock 139888563245936 on /run/cephadm/d92bf05e-6fb4-11ef-bcea-c7b262605968.lock 2024-09-10T20:41:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Lock 139888563245936 acquired on /run/cephadm/d92bf05e-6fb4-11ef-bcea-c7b262605968.lock 2024-09-10T20:41:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 3300 ... 2024-09-10T20:41:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 6789 ... 2024-09-10T20:41:05.874 INFO:teuthology.orchestra.run.smithi067.stdout:Base mon IP(s) is [172.21.15.67:3300, 172.21.15.67:6789], mon addrv is [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-09-10T20:41:05.877 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.67 metric 100 2024-09-10T20:41:05.877 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.67 metric 100 2024-09-10T20:41:05.880 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T20:41:05.880 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T20:41:05.880 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T20:41:05.882 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link noprefixroute 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2024-09-10T20:41:05.883 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2024-09-10T20:41:05.884 INFO:teuthology.orchestra.run.smithi067.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T20:41:05.884 INFO:teuthology.orchestra.run.smithi067.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T20:41:05.885 INFO:teuthology.orchestra.run.smithi067.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T20:41:08.911 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T20:41:08.911 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T20:41:08.911 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T20:41:08.912 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T20:41:08.912 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T20:41:08.912 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T20:41:08.912 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T20:41:12.804 INFO:teuthology.orchestra.run.smithi067.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T20:41:12.804 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T20:41:12.804 INFO:teuthology.orchestra.run.smithi067.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T20:41:13.769 INFO:teuthology.orchestra.run.smithi067.stdout:stat: stdout 167 167 2024-09-10T20:41:13.769 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial keys... 2024-09-10T20:41:14.657 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQDqruBmiS3kBBAAnX6GHgC2mU5w9Y2zo1eFFg== 2024-09-10T20:41:15.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQDrruBmnxRXABAAidSJ8KCtKr27BFtXMzvSHQ== 2024-09-10T20:41:16.470 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQDrruBma37GMhAABOKkARVUX1/+/+d8WpVRdQ== 2024-09-10T20:41:16.471 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial monmap... 2024-09-10T20:41:17.368 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool for a [v2:172.21.15.67:3300,v1:172.21.15.67:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: set fsid to d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:41:17.369 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mon... 2024-09-10T20:41:18.675 INFO:teuthology.orchestra.run.smithi067.stdout:create mon.a on 2024-09-10T20:41:18.988 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T20:41:19.141 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T20:41:19.325 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target. 2024-09-10T20:41:19.325 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target. 2024-09-10T20:41:19.567 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a 2024-09-10T20:41:19.567 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T20:41:19.732 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target.wants/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@.service. 2024-09-10T20:41:20.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:19 smithi067 podman[30505]: 2024-09-10 20:41:19.873470359 +0000 UTC m=+0.022116448 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:41:20.223 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T20:41:20.223 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon to start... 2024-09-10T20:41:20.231 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon... 2024-09-10T20:41:20.352 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 podman[30505]: 2024-09-10 20:41:20.147768633 +0000 UTC m=+0.296414715 container init 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-10T20:41:20.353 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 podman[30505]: 2024-09-10 20:41:20.150924184 +0000 UTC m=+0.299570264 container start 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T20:41:20.353 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 ceph-mon[30525]: mkfs d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:20.353 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 ceph-mon[30525]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T20:41:20.353 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 bash[30505]: 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 2024-09-10T20:41:20.353 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:20 smithi067 systemd[1]: Started Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: monmap epoch 1 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: last_changed 2024-09-10T20:41:16.765185+0000 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:41:21.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: min_mon_release 19 (squid) 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: election_strategy: 1 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: fsmap 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: mgrmap e1: no daemons active 2024-09-10T20:41:21.234 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:21 smithi067 ceph-mon[30525]: from='client.? 172.21.15.67:0/783174124' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T20:41:21.235 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T20:41:21.237 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout id: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:21.237 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T20:41:21.237 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout services: 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.51416s) 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout data: 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:mon is available 2024-09-10T20:41:21.238 INFO:teuthology.orchestra.run.smithi067.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T20:41:22.281 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:22 smithi067 ceph-mon[30525]: from='client.? 172.21.15.67:0/1271541367' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T20:41:22.281 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:22 smithi067 ceph-mon[30525]: from='client.? 172.21.15.67:0/1271541367' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T20:41:22.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:22.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T20:41:22.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:22.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T20:41:22.286 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T20:41:22.287 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T20:41:22.287 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T20:41:22.287 INFO:teuthology.orchestra.run.smithi067.stdout:Generating new minimal ceph.conf... 2024-09-10T20:41:23.299 INFO:teuthology.orchestra.run.smithi067.stdout:Restarting the monitor... 2024-09-10T20:41:23.327 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 ceph-mon[30525]: from='client.? 172.21.15.67:0/3931906458' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:41:23.583 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 systemd[1]: Stopping Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:41:23.899 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a[30521]: 2024-09-10T20:41:23.578+0000 7fd3a9269640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T20:41:23.900 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a[30521]: 2024-09-10T20:41:23.578+0000 7fd3a9269640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T20:41:23.900 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 podman[30766]: 2024-09-10 20:41:23.630635566 +0000 UTC m=+0.158224074 container died 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T20:41:24.242 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 podman[30766]: 2024-09-10 20:41:23.978803553 +0000 UTC m=+0.506392050 container cleanup 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T20:41:24.242 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:23 smithi067 bash[30766]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a 2024-09-10T20:41:24.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 podman[30779]: 2024-09-10 20:41:24.238181853 +0000 UTC m=+0.611513176 container remove 38fbc450c307193d35a113526ff2ee5dc248ee2a7c29fd9c8c25aea32470f5b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T20:41:24.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 systemd[1]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T20:41:24.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 systemd[1]: Stopped Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:41:24.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 systemd[1]: Starting Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:41:24.870 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 podman[30871]: 2024-09-10 20:41:24.518187504 +0000 UTC m=+0.015909627 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:41:24.870 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 podman[30871]: 2024-09-10 20:41:24.652034509 +0000 UTC m=+0.149756668 container create c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T20:41:24.870 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 podman[30871]: 2024-09-10 20:41:24.866802064 +0000 UTC m=+0.364524178 container init c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T20:41:24.957 INFO:teuthology.orchestra.run.smithi067.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 podman[30871]: 2024-09-10 20:41:24.870134853 +0000 UTC m=+0.367856967 container start c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: pidfile_write: ignore empty --pid-file 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: load: jerasure load: lrc 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: RocksDB version: 7.9.2 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Git sha 0 2024-09-10T20:41:25.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: DB SUMMARY 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: DB Session ID: EHHQBHSKV9YZ6RR28Z3I 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: CURRENT file: CURRENT 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96062 ; 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.error_if_exists: 0 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.create_if_missing: 0 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.paranoid_checks: 1 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T20:41:25.191 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.env: 0x55e1d71c5180 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.info_log: 0x55e1d9a03700 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.statistics: (nil) 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.use_fsync: 0 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_log_file_size: 0 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T20:41:25.192 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_fallocate: 1 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.use_direct_reads: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.db_log_dir: 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.wal_dir: 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T20:41:25.193 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.write_buffer_manager: 0x55e1d9a07b80 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T20:41:25.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.unordered_write: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.row_cache: None 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.wal_filter: None 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.two_write_queues: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.wal_compression: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.atomic_flush: 0 2024-09-10T20:41:25.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T20:41:25.196 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T20:41:25.196 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.log_readahead_size: 0 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T20:41:25.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_background_jobs: 2 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_background_compactions: -1 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_subcompactions: 1 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_open_files: -1 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T20:41:25.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_background_flushes: -1 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Compression algorithms supported: 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kZSTD supported: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kXpressCompression supported: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kBZip2Compression supported: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kLZ4Compression supported: 1 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kZlibCompression supported: 1 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: kSnappyCompression supported: 1 2024-09-10T20:41:25.199 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.merge_operator: 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_filter: None 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e1d9a03320) 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout: cache_index_and_filter_blocks: 1 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T20:41:25.200 INFO:journalctl@ceph.mon.a.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: pin_top_level_index_and_filter: 1 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: index_type: 0 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: data_block_index_type: 0 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: index_shortening: 1 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: checksum: 4 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: no_block_cache: 0 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_cache: 0x55e1d99f7610 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_cache_name: BinnedLRUCache 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_cache_options: 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: capacity : 536870912 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: num_shard_bits : 4 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: strict_capacity_limit : 0 2024-09-10T20:41:25.201 INFO:journalctl@ceph.mon.a.smithi067.stdout: high_pri_pool_ratio: 0.000 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_cache_compressed: (nil) 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: persistent_cache: (nil) 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_size: 4096 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_size_deviation: 10 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_restart_interval: 16 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: index_block_restart_interval: 1 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: metadata_block_size: 4096 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: partition_filters: 0 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: use_delta_encoding: 1 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: filter_policy: bloomfilter 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: whole_key_filtering: 1 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: verify_compression: 0 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: read_amp_bytes_per_bit: 0 2024-09-10T20:41:25.202 INFO:journalctl@ceph.mon.a.smithi067.stdout: format_version: 5 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: enable_index_compression: 1 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: block_align: 0 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: max_auto_readahead_size: 262144 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: prepopulate_block_cache: 0 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: initial_auto_readahead_size: 8192 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression: NoCompression 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.num_levels: 7 2024-09-10T20:41:25.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T20:41:25.204 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T20:41:25.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T20:41:25.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.inplace_update_support: 0 2024-09-10T20:41:25.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.bloom_locality: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.max_successive_merges: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.ttl: 2592000 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T20:41:25.208 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enable_blob_files: false 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.min_blob_size: 0 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0eb58dbb-28a8-481e-b521-b78ab9dab618 2024-09-10T20:41:25.209 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000884897959, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000884899378, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92125, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 289, "table_properties": {"data_size": 90166, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11930, "raw_average_key_size": 48, "raw_value_size": 83459, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 248, "num_filter_entries": 248, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726000884, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0eb58dbb-28a8-481e-b521-b78ab9dab618", "db_session_id": "EHHQBHSKV9YZ6RR28Z3I", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000884899512, "job": 1, "event": "recovery_finished"} 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e1d9a26e00 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: DB pointer 0x55e1d9b28000 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout: ** DB Stats ** 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T20:41:25.210 INFO:journalctl@ceph.mon.a.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: ** Compaction Stats [default] ** 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: L0 2/0 91.83 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Sum 2/0 91.83 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: ** Compaction Stats [default] ** 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T20:41:25.211 INFO:journalctl@ceph.mon.a.smithi067.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 103.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Cumulative compaction: 0.00 GB write, 19.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Interval compaction: 0.00 GB write, 19.05 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T20:41:25.212 INFO:journalctl@ceph.mon.a.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: Block cache BinnedLRUCache@0x55e1d99f7610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: starting mon.a rank 0 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???) e1 preinit fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).mds e1 new map 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).mds e1 print_map 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: e1 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: btime 2024-09-10T20:41:20:188828+0000 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: legacy client fscid: -1 2024-09-10T20:41:25.213 INFO:journalctl@ceph.mon.a.smithi067.stdout: 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout: No filesystems configured 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 bash[30871]: c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 systemd[1]: Started Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: monmap epoch 1 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: last_changed 2024-09-10T20:41:16.765185+0000 2024-09-10T20:41:25.214 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: min_mon_release 19 (squid) 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: election_strategy: 1 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: fsmap 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T20:41:25.215 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:24 smithi067 ceph-mon[30891]: mgrmap e1: no daemons active 2024-09-10T20:41:26.005 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T20:41:26.026 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T20:41:26.026 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mgr... 2024-09-10T20:41:26.026 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T20:41:26.027 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T20:41:26.271 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x 2024-09-10T20:41:26.271 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T20:41:26.427 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968.target.wants/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@.service. 2024-09-10T20:41:26.451 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 systemd[1]: Starting Ceph mgr.x for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:41:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:26 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/484064612' entity='client.admin' 2024-09-10T20:41:26.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 podman[31103]: 2024-09-10 20:41:26.584723092 +0000 UTC m=+0.015861538 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:41:26.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 podman[31103]: 2024-09-10 20:41:26.692240364 +0000 UTC m=+0.123378835 container create c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T20:41:26.964 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T20:41:26.965 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-09-10T20:41:26.973 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T20:41:26.973 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:41:26.973 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-09-10T20:41:26.973 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T20:41:26.985 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T20:41:26.985 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-09-10T20:41:26.993 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T20:41:26.994 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:41:26.994 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-09-10T20:41:26.994 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T20:41:26.994 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr to start... 2024-09-10T20:41:26.994 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr... 2024-09-10T20:41:27.099 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 podman[31103]: 2024-09-10 20:41:26.886193781 +0000 UTC m=+0.317332210 container init c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T20:41:27.099 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 podman[31103]: 2024-09-10 20:41:26.889036737 +0000 UTC m=+0.320175171 container start c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T20:41:27.099 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 bash[31103]: c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae 2024-09-10T20:41:27.099 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:26 smithi067 systemd[1]: Started Ceph mgr.x for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:41:27.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:27 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2973225481' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.118 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T20:41:28.119 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T20:41:28.120 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T20:41:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T20:41:20:188828+0000", 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T20:41:28.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T20:41:20.189497+0000", 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:28.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T20:41:28.126 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:41:28.126 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (1/15)... 2024-09-10T20:41:31.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:30 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/327336482' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T20:41:31.242 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T20:41:31.243 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T20:41:31.244 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T20:41:31.247 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T20:41:20:188828+0000", 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T20:41:31.248 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T20:41:20.189497+0000", 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T20:41:31.249 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:41:31.250 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (2/15)... 2024-09-10T20:41:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: Activating manager daemon x 2024-09-10T20:41:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: mgrmap e2: x(active, starting, since 0.0031729s) 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: Manager daemon x is now available 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' 2024-09-10T20:41:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:32 smithi067 ceph-mon[30891]: from='mgr.14100 172.21.15.67:0/1908766859' entity='mgr.x' 2024-09-10T20:41:34.225 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:34 smithi067 ceph-mon[30891]: mgrmap e3: x(active, since 1.00773s) 2024-09-10T20:41:34.226 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4168071392' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T20:41:34.514 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:34.514 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:41:34.514 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T20:41:34.515 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T20:41:34.516 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T20:41:34.519 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.519 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T20:41:20:188828+0000", 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T20:41:34.521 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T20:41:20.189497+0000", 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi067.stdout:mgr is available 2024-09-10T20:41:35.541 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:35 smithi067 ceph-mon[30891]: mgrmap e4: x(active, since 2s) 2024-09-10T20:41:35.541 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/495100538' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T20:41:35.545 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:35.545 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T20:41:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T20:41:35.547 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T20:41:35.547 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T20:41:35.547 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T20:41:35.547 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T20:41:35.547 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling cephadm module... 2024-09-10T20:41:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:36 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3612930751' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T20:41:36.546 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ignoring --setuser ceph since I am not root 2024-09-10T20:41:36.546 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ignoring --setgroup ceph since I am not root 2024-09-10T20:41:37.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:37 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3612930751' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T20:41:37.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:37 smithi067 ceph-mon[30891]: mgrmap e5: x(active, since 4s) 2024-09-10T20:41:38.215 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:41:38.215 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T20:41:38.215 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T20:41:38.216 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T20:41:38.216 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T20:41:38.216 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:41:38.216 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2024-09-10T20:41:38.216 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 5... 2024-09-10T20:41:38.498 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:38 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4182470288' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: Active manager daemon x restarted 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: Activating manager daemon x 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: mgrmap e6: x(active, starting, since 0.00352189s) 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T20:41:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:41 smithi067 ceph-mon[30891]: Manager daemon x is now available 2024-09-10T20:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T20:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T20:41:43.072 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:41:43.073 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 5 is available 2024-09-10T20:41:43.073 INFO:teuthology.orchestra.run.smithi067.stdout:Setting orchestrator backend to cephadm... 2024-09-10T20:41:43.413 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:43.413 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:43.413 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: Found migration_current of "None". Setting to last migration. 2024-09-10T20:41:43.413 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: mgrmap e7: x(active, since 1.00629s) 2024-09-10T20:41:43.414 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-mon[30891]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:41:43.934+0000 7f8c47924640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:20:41:43] ENGINE Error in HTTPServer.serve 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: Traceback (most recent call last): 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._connections.run(self.expiration_interval) 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._run(expiration_interval) 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T20:41:44.009 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: s = self.context.wrap_socket( 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: return self.sslsocket_class._create( 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self.do_handshake() 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._sslobj.do_handshake() 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T20:41:44.010 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: [10/Sep/2024:20:41:43] ENGINE Bus STARTING 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: [10/Sep/2024:20:41:43] ENGINE Serving on https://172.21.15.67:7150 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: [10/Sep/2024:20:41:43] ENGINE Error in HTTPServer.serve 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout: Traceback (most recent call last): 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T20:41:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._run(expiration_interval) 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: s = self.context.wrap_socket( 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: return self.sslsocket_class._create( 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: self.do_handshake() 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._sslobj.do_handshake() 2024-09-10T20:41:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T20:41:44.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: [10/Sep/2024:20:41:44] ENGINE Serving on http://172.21.15.67:8765 2024-09-10T20:41:44.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: [10/Sep/2024:20:41:44] ENGINE Bus STARTED 2024-09-10T20:41:44.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:41:44.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:44 smithi067 ceph-mon[30891]: mgrmap e8: x(active, since 2s) 2024-09-10T20:41:45.451 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T20:41:45.451 INFO:teuthology.orchestra.run.smithi067.stdout:Generating ssh key... 2024-09-10T20:41:46.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:45 smithi067 ceph-mon[30891]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-mon[30891]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-mon[30891]: Generating ssh key... 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: Generating public/private rsa key pair. 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: Your identification has been saved in /tmp/tmpc7j468ug/key 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: Your public key has been saved in /tmp/tmpc7j468ug/key.pub 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: The key fingerprint is: 2024-09-10T20:41:46.796 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: SHA256:/VS4oALEvHk09il7x7cuI8FGKn0aa5FjCDjh3BF1OWE ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: The key's randomart image is: 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: +---[RSA 3072]----+ 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | ++. Eo | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: |. oo *o . | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: |oo. o= o... . . | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: |oo..o.o +o . o | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | . . +.BS.. o | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | o X.* oo. | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | o X o ... | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | + . o . | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: | . . +. | 2024-09-10T20:41:46.797 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:41:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: +----[SHA256]-----+ 2024-09-10T20:41:48.272 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:41:48.272 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T20:41:48.273 INFO:teuthology.orchestra.run.smithi067.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T20:41:48.282 INFO:teuthology.orchestra.run.smithi067.stdout:Adding host smithi067... 2024-09-10T20:41:48.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:48 smithi067 ceph-mon[30891]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:49.587 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:49 smithi067 ceph-mon[30891]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "addr": "172.21.15.67", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:50.515 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:50 smithi067 ceph-mon[30891]: Deploying cephadm binary to smithi067 2024-09-10T20:41:53.305 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Added host 'smithi067' with addr '172.21.15.67' 2024-09-10T20:41:53.306 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying unmanaged mon service... 2024-09-10T20:41:53.987 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:53 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:53.988 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:53 smithi067 ceph-mon[30891]: Added host smithi067 2024-09-10T20:41:53.988 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:53 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:41:54.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T20:41:54.722 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying unmanaged mgr service... 2024-09-10T20:41:55.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:54 smithi067 ceph-mon[30891]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:55.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:54 smithi067 ceph-mon[30891]: Saving service mon spec with placement count:5 2024-09-10T20:41:55.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:54 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:57.023 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:56 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:57.024 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:56 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:57.024 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:56 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T20:41:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:58 smithi067 ceph-mon[30891]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:41:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:58 smithi067 ceph-mon[30891]: Saving service mgr spec with placement count:2 2024-09-10T20:41:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:58 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:58 smithi067 ceph-mon[30891]: from='mgr.14118 172.21.15.67:0/1808408696' entity='mgr.x' 2024-09-10T20:41:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:41:58 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1532121033' entity='client.admin' 2024-09-10T20:42:00.482 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling the dashboard module... 2024-09-10T20:42:00.710 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:00 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2939950527' entity='client.admin' 2024-09-10T20:42:01.762 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:01 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3626134325' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T20:42:01.762 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ignoring --setuser ceph since I am not root 2024-09-10T20:42:01.762 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ignoring --setgroup ceph since I am not root 2024-09-10T20:42:02.700 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:02 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3626134325' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T20:42:02.700 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:02 smithi067 ceph-mon[30891]: mgrmap e9: x(active, since 19s) 2024-09-10T20:42:03.263 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:42:03.263 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T20:42:03.263 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T20:42:03.264 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T20:42:03.264 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T20:42:03.264 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:42:03.264 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2024-09-10T20:42:03.264 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 9... 2024-09-10T20:42:03.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:03 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/612880467' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T20:42:07.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: Active manager daemon x restarted 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: Activating manager daemon x 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: mgrmap e10: x(active, starting, since 0.00349115s) 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T20:42:07.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:06 smithi067 ceph-mon[30891]: Manager daemon x is now available 2024-09-10T20:42:07.983 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:07.983 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T20:42:07.983 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T20:42:07.983 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:07 smithi067 ceph-mon[30891]: mgrmap e11: x(active, since 1.00743s) 2024-09-10T20:42:08.236 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2024-09-10T20:42:08.236 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T20:42:08.236 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T20:42:08.237 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2024-09-10T20:42:08.237 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 9 is available 2024-09-10T20:42:08.237 INFO:teuthology.orchestra.run.smithi067.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T20:42:08.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:08 smithi067 ceph-mon[30891]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T20:42:08.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:08 smithi067 ceph-mon[30891]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:42:09.136+0000 7fb66ab4c640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:20:42:09] ENGINE Error in HTTPServer.serve 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: Traceback (most recent call last): 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._connections.run(self.expiration_interval) 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._run(expiration_interval) 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T20:42:09.326 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: s = self.context.wrap_socket( 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: return self.sslsocket_class._create( 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self.do_handshake() 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: self._sslobj.do_handshake() 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T20:42:09.327 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:42:10.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: mgrmap e12: x(active, since 2s) 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: [10/Sep/2024:20:42:08] ENGINE Bus STARTING 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: [10/Sep/2024:20:42:09] ENGINE Serving on http://172.21.15.67:8765 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: [10/Sep/2024:20:42:09] ENGINE Serving on https://172.21.15.67:7150 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: [10/Sep/2024:20:42:09] ENGINE Bus STARTED 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: [10/Sep/2024:20:42:09] ENGINE Error in HTTPServer.serve 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: Traceback (most recent call last): 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._connections.run(self.expiration_interval) 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._run(expiration_interval) 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T20:42:10.046 INFO:journalctl@ceph.mon.a.smithi067.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: s = self.context.wrap_socket( 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: return self.sslsocket_class._create( 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: self.do_handshake() 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: self._sslobj.do_handshake() 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:10.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:11.205 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:11.207 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUAwnG96maSIVa72ex8fIXne84yCQwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIwNDIxMFoXDTM0\nMDkxMTIwNDIxMFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjY3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA0pOJ+c8vHl9+LIfhwTpNRcRg/OQqayjDp0Ee\nkpaLc7/vpC/Wf3pa+8WoagYpZI5iSLK7qb3LPXNzVKOMCvsVixPXTMF3dZcvMdr1\nDsJPCT6T7ELlD5Jaujm38yurh5W4VXeivAASUmn3xt31bt1SL2xOB1yHIxQPJrPJ\ngUJOhrRbkw1CPFJVG3Jt5r8MUuiiIGpPztziBXdEri1WCafc1G8dJ6PwDMiff4w8\ndlsRXtDa0hWppilySonKJxRoQpKpbV38Jc0QZbkoA4zJ+qE3xdmmY4Pf5YKtPCms\nYZdb30oFoKCTpmyfYIe0pYx50u7LzjPhx1TiAmX/gTqocGWkuqBnVGgO+4xHOdKz\noYRN2skkB2XkkIkuotP6hQO5RMHmKd0rSpVdV7jwoTRPxI7nucc5cZArCsenmJRL\nQM3GGcmOvnbd2brE/PhYSYHD9+Vi88WMAbZbsyrhMEQfVVNiQYUTfjuSGKlUUCMz\nIWFjsWnUndZE466/aunV6vlHr0bCKiQx0RasjDmO9w+pwOw0HvJK55l2V9voku4q\n655xBz4Qt0XONPAJRjlxeahnhFoTlw5g3XIZ3LPxwrEpZocdPh0d1LIX+fmVQ+CP\npAW44tDYXYOywQQ/8DPu49W2PFeeChFGJb+V2bxCxSgJiZSeXslXAj5qpx09852T\nuHruYncCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDY3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPQzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQDL\n1dCKW2clDuhXSyHY7rKZCVEgZ3n6hAJgmcSI2kS7UzbXUVKJmEMhlT87ElJAoGeM\nY6DY7lXtaO2Dhkzqi6DSEUfrnJwqlMVq84nycvyI6V/MacKZXyFVAo4I2qhrXqYn\n6SHU7Dru6QwHa8djLJltHLfjmFmAfMZpRj1Q5JVV6Czh4fWYDqRKcwYaq2pc3QwD\nxC5WM02PwN8hCs9h1muJ3jyAk3EGV0BZJp40G2I42VSiIr5YxgSBtbfCMm9XxILC\nxPDPeXHOEq5kPRghE+3DJNf3A+KS5KSb6xbkpk99Xy4Yp+2fgGPB0pjqiWhPY4d+\nr77Kc25Puu5kEMDK2RqatkzCc5k2ZVlxmH7+knAcyQJMh1fNmLHtG2pR01fjgyjn\nXyjIenw5R4+v5rwiwrDwBEQYnY6FuZZny5Xf+rQV2BqATBtP3oic218AcFY5886P\nm7gs7aA+46D3SAaGX1lTJGhywLWidfJPwkA4lH43kHi2haIjLt7YaKxp6bhmnPGC\nDZwaGNZlVWpQnCdw69DyYD8/gSAOFPYCFPbiRKzptvCvYF8iJPT1CbYaov1SxHXV\nHUVOcs6lCTOAMIQTLfG7a8IoALDdl9bKiMBmotFsr5TfK5YeQbSswenrUl3rbYzb\nbTwJrXkbAnTpPOxJBzuQ9sUjBtmReIZr9eqmz80M3Q==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA0pOJ+c8vHl9+LIfhwTpNRcRg/OQqayjDp0EekpaLc7/vpC/W\nf3pa+8WoagYpZI5iSLK7qb3LPXNzVKOMCvsVixPXTMF3dZcvMdr1DsJPCT6T7ELl\nD5Jaujm38yurh5W4VXeivAASUmn3xt31bt1SL2xOB1yHIxQPJrPJgUJOhrRbkw1C\nPFJVG3Jt5r8MUuiiIGpPztziBXdEri1WCafc1G8dJ6PwDMiff4w8dlsRXtDa0hWp\npilySonKJxRoQpKpbV38Jc0QZbkoA4zJ+qE3xdmmY4Pf5YKtPCmsYZdb30oFoKCT\npmyfYIe0pYx50u7LzjPhx1TiAmX/gTqocGWkuqBnVGgO+4xHOdKzoYRN2skkB2Xk\nkIkuotP6hQO5RMHmKd0rSpVdV7jwoTRPxI7nucc5cZArCsenmJRLQM3GGcmOvnbd\n2brE/PhYSYHD9+Vi88WMAbZbsyrhMEQfVVNiQYUTfjuSGKlUUCMzIWFjsWnUndZE\n466/aunV6vlHr0bCKiQx0RasjDmO9w+pwOw0HvJK55l2V9voku4q655xBz4Qt0XO\nNPAJRjlxeahnhFoTlw5g3XIZ3LPxwrEpZocdPh0d1LIX+fmVQ+CPpAW44tDYXYOy\nwQQ/8DPu49W2PFeeChFGJb+V2bxCxSgJiZSeXslXAj5qpx09852TuHruYncCAwEA\nAQKCAgBcK7RDIgrP0qCZwUhxmaFlHlYNm5ltmkQ5m2lUZIzZt3OffEj5N4dHmPbk\noZnQp/ohNAqse6TQWw5qR8PusoR1gdPFhxFQ6UIBIoQNV8PcmgWJbqZwsHEB/m2k\nBMNp74Dl+B3FCIr8g+GurEzXoAxvMYrd8gQ8uHUBTcSvzWQt1hgXP8B0Qt15zBaK\n36j3SVhds+sG8uwD1Ha9fp6gT1d7rL8oMLvL/KzD2ZBFhgsOY4DEYDMHxjB+q91O\nScJxEV0TwAW0ThQVUnxPQXrPN24ALgqEmJ6SCSbmpJ8NgID4NaBM9LxsJjOEvyG1\nLM3OJDQVJ+R1qZPb1OWHnTNJL1RwiKPBEnzggQ24A0S0fOagIWM+UfgOKelz8u5m\noXnjKYUCz4bBcIrmyoJ7stE082ld0nOMVvfWHRVtvjnsmLtW2YL3cSAOiU95udjx\nT3/9zQcT/Noqj9EBpsOPREJBW++7Rka2p1eHZWJwBpMPEgEl9Y/ayIRzo3L9TUuJ\n2DqivO2trkcl7S6iooA9t2rrLCZ/puRJthcHF+EmZJFfoRrXW4SXx7Wc87qIr2qx\nMZk+2rrJEmojgvaA8Ebx5KHCb5XBF1+xjV+skMY4I4Qsdfp/t0HkuVVxQwE1mlnm\nfBxHYyvOBJXYqEp0Loe6PCu6SnVxGP9VbTCua2NJPQjHxEFXEQKCAQEA7Tdu7IEk\n3fzaCb7A1IezlCshu2+1uYi5N998rg33sqbekONigwpX0Av75CGVHZqdS19JBNhb\ngGA3MfHgFMwNXV+U/3zurCMTEYh+2dW9FsMoWBKXTtxayTPhlNtdguZtvF0I3bOv\nzwTCHNWEd50LA703k/Abbkr5ME6bsb2Jh2U74fxKyM2Ks4iy9Uirl+0rO2q1O6dZ\nLogz2hfF2XBb4gquGs5cZV438fZwJwHLnHa5FFArTp8t0Ru6LwWZGSHTBF88Xu48\nk7ju3OnCjV0jGp7qIe7B918VyGIgiieTLsuBbpNhmeskvr2+M2zQhLK1XWroaeI/\nzzId2BOXwJu13QKCAQEA40AWZyvuXcY3Aqd0EInMZN18C76xRzNF+NM24mrPFzTC\nt43GRd4QDMr1wybjK7UVz2NxARXY+2Qyv9MGfi9CKBgX4oJjE1y5UwC9UbqZt0nY\nbAJjw8um6quzYxe5pYfYqBX+KBJuYKzakVd567gxboR8Z9r7sRvIzf5CYIp+7BHR\nrwYHM9xm1sNQi+O6gcIEyGva9ZXDIHYAUtmMhMefJd80MqTZQvCgEMxwOHb6HqPY\n/IR6sQj0Lz8ItV4xZ44SpcsrflPTtFVM8vmJWeHvoxOYKBP4Q4/MTlGNW2ruxfMG\nbYLeJqyc0JP+w5U48ct3mknj/qLk4sMPuPPwa7VmYwKCAQEAk7jtjsJtnwATF/Z+\nRtuq7R5fB0ZtuHh4P18hWZLBKbPY7glsE4ahYKHV3x86qRDb21AfPLEvaiaAuM2T\naeAYgok/VEsMpo3BFi4WMLl143Ls8MvDBg0bTCjO1dA1z4qH08FsAAQh+51O9H3S\n3FojvdRbg/kGXAy8WWTaeDk8J+DXBcgDGkFFmsAKEc2LbjT3syykZ92zH9MZ1zru\nrpXV4lIcUf0odMfTtw5skR4BGhKk9w1lqrRd59aIfzfRO2Fg81wLUGKzvppvxYqc\n6UOS1MUZsL/qco34Fq1k7iPu+DkrBR0qrptMaqvmgkfFIp3Xa7FjwmxuqCzhgOnS\nmtNc0QKCAQAr3TD11Sr7eskfgAcNMiv7xCyvb610WtdEwjAz3/39MrfrCjidP9HF\nRl/NvXHX++orz7v+Q6NQUvTgxfDY5nJUnuHtXNGW6Sz0co4YenY1RNG7d3KeVm7v\nmRjVJb010FTnjOc0AOrBSlwd9c6Yy0LvXC9PNJukggJukIdrbxA0rPPWXsmBHyfS\niHzBo8FaToLx1K+8+51gZKaHV2qiLo3vl3fR1rQBEcUzuOJoY76/r0yw4Tl1do77\nl6UsrPPIU0oSKndIuRGCG3zw4W27pbrFtYCHK+Od1uHOtDsezDMujkxNUxdiS6sx\nL3/bbLBDK8z4QQ77FaIsiw472worICaVAoIBADPFYaO/cw0aKc7BpM/86Fo9fINY\nIjU94NX8WWfEQsUnUoyeXprxiOvlftrKbHq7AX1WhKLVTcqp0cWm70PhNgkyyX2Z\nEYx31VhozVirqcB+dQ1cUQq1WjQFfmAlFDii/Bdl0roiYygu14VDdMVe74dWYizx\n55iWcing1mzniY3Ev0Pdc9nmb8EnPF5n2Vj9zdDXIralA7+HyrmYm2rOEHMFnkZl\ng8Mfa9uvdoz3AwTQgAzoyKD7NIQlzJEM7JbXBAjiY+NRYB8+rRK1K/3jEtGsS5hF\nIK1mL4k/RQAylt2CNj8/iCfpRtHgItIyVQ6soUQBRPLDCYQFhvW49UKRRp4=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T20:42:13.276 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T20:42:13.869 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:13 smithi067 ceph-mon[30891]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:13.869 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:13 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:14.474 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T20:42:14.474 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial admin user... 2024-09-10T20:42:15.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:14 smithi067 ceph-mon[30891]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:15.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:15.889 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Xw8yPWGBe4ekKc9feFZCyOq9pk7I0qAY6kVsfFegBZ/sagnNRV6pe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726000935, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T20:42:15.889 INFO:teuthology.orchestra.run.smithi067.stdout:Fetching dashboard port number... 2024-09-10T20:42:16.494 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:16 smithi067 ceph-mon[30891]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:16.495 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T20:42:17.082 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T20:42:17.083 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2024-09-10T20:42:17.091 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T20:42:17.091 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2024-09-10T20:42:17.091 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2024-09-10T20:42:17.091 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph Dashboard is now available at: 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout: URL: https://smithi067.front.sepia.ceph.com:8443/ 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout: User: admin 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout: Password: 77d6qvaam8 2024-09-10T20:42:17.094 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:17.095 INFO:teuthology.orchestra.run.smithi067.stdout:Saving cluster configuration to /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config directory 2024-09-10T20:42:17.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:17 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2649091462' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T20:42:18.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T20:42:18.376 INFO:teuthology.orchestra.run.smithi067.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T20:42:18.376 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.376 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:18.376 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: ceph telemetry on 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout:For more information see: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:18.377 INFO:teuthology.orchestra.run.smithi067.stdout:Bootstrap complete. 2024-09-10T20:42:18.418 INFO:tasks.cephadm:Fetching config... 2024-09-10T20:42:18.418 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:42:18.418 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T20:42:18.435 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T20:42:18.435 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:42:18.435 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T20:42:18.491 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T20:42:18.491 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:42:18.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T20:42:18.557 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T20:42:18.557 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:42:18.557 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T20:42:18.613 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T20:42:18.613 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T20:42:18.692 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:18.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T20:42:18.748 INFO:teuthology.orchestra.run.smithi083.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:18.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T20:42:18.801 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMajAsmpD2XNBYxuOmFbIgB+uYf+kI/ARdhE2W80+q5RJ5dRtLSjTTVYd3fkEPoXU5Ssl3D0czN2Qw3fuWzuI8qlnMPvUJ4QI60+/MmOEgaGhe2P0+pYHeomUUHL4CB9ln32RXZyf58GXnzUTY1xTx3ZRGKedVPCRmjC9q8tp38iLiNHI2bSi4Okivdj+7yxiFpiYTpUUiXhrCOwy0TA/EavVd5qp5Me1u2c8xhpKmmaS8qS101G0SM36QUU3Q0fBvbdkS9xHPEkE2zQVNyXSlbNgco8xdaxxes1XX2tkBNFJKY3TGSy5SASPXCWkfQAy8srx6JB04mXJK9GhIYoJU8P1eRRpOMGWO+whY/ewGfbBdfgCukqzilkcydN4FakV2sgTQj6VPpDJdQS3d7KFUl7Bb2KrC/tUsAZeIraDjYSysxVJA4P95XV/go1eTBnjxisye30bpeULLewboiRCoJqIBS9sYh3NMOJTY7Ygr7397ijkv3JzzMSsgoQJ0mR0= ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:18.814 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T20:42:19.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1562269856' entity='client.admin' 2024-09-10T20:42:19.069 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:20.015 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:19 smithi067 ceph-mon[30891]: mgrmap e13: x(active, since 12s) 2024-09-10T20:42:20.015 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:19 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3419989357' entity='client.admin' 2024-09-10T20:42:20.725 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T20:42:20.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T20:42:21.206 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"} : dispatch 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:21.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:23.116 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi083 2024-09-10T20:42:23.116 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:42:23.116 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/etc/ceph/ceph.conf 2024-09-10T20:42:23.135 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:42:23.135 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:23.193 INFO:tasks.cephadm:Adding host smithi083 to orchestrator... 2024-09-10T20:42:23.193 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch host add smithi083 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-10T20:42:23.216 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: Updating smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:23.217 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:23.217 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:23.217 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:23.217 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:23.442 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:24.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:23 smithi067 ceph-mon[30891]: Updating smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T20:42:25.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:24 smithi067 ceph-mon[30891]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi083", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:26.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:25 smithi067 ceph-mon[30891]: Deploying cephadm binary to smithi083 2024-09-10T20:42:27.924 INFO:teuthology.orchestra.run.smithi067.stdout:Added host 'smithi083' with addr '172.21.15.83' 2024-09-10T20:42:27.936 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:27 smithi067 ceph-mon[30891]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:28.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T20:42:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:29.189 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:28 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:29.189 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:28 smithi067 ceph-mon[30891]: Added host smithi083 2024-09-10T20:42:29.189 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:28 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:29.189 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:28 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:29.190 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:28 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:29.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:29.476 INFO:teuthology.orchestra.run.smithi067.stdout:[{"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}] 2024-09-10T20:42:30.033 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-10T20:42:30.034 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:42:30.034 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-10T20:42:30.052 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:42:30.052 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:30.110 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-10T20:42:30.110 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch host add smithi172 2024-09-10T20:42:30.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:30 smithi067 ceph-mon[30891]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:30.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:30.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:30 smithi067 ceph-mon[30891]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:42:30.368 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"} : dispatch 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:42:33.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-10T20:42:33.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: Deploying cephadm binary to smithi172 2024-09-10T20:42:33.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:33.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:33.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:33.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:34 smithi067 ceph-mon[30891]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:34 smithi067 ceph-mon[30891]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:34.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:34 smithi067 ceph-mon[30891]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T20:42:34.930 INFO:teuthology.orchestra.run.smithi067.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-10T20:42:35.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T20:42:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:36.136 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:36.136 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:36.136 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: Added host smithi172 2024-09-10T20:42:36.136 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:36.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:36.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:36.338 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:42:36.338 INFO:teuthology.orchestra.run.smithi067.stdout:[{"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-10T20:42:37.086 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T20:42:37.086 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T20:42:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:37.456 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:37 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:37.456 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:37 smithi067 ceph-mon[30891]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:42:38.278 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-09-10T20:42:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:38 smithi067 ceph-mon[30891]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:38 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1681906100' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T20:42:38.885 INFO:tasks.cephadm:Adding mon.a on smithi067 2024-09-10T20:42:38.885 INFO:tasks.cephadm:Adding mon.b on smithi083 2024-09-10T20:42:38.885 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-09-10T20:42:38.885 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c' 2024-09-10T20:42:39.127 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T20:42:39.173 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T20:42:39.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1681906100' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T20:42:39.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:39.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:39.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:39.549 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:39.549 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:39.549 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-10T20:42:39.549 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:39.549 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:42:39.936 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-10T20:42:40.510 DEBUG:teuthology.orchestra.run.smithi083:mon.b> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T20:42:40.514 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T20:42:40.517 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T20:42:40.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T20:42:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-10T20:42:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:40.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:40.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:40.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:40.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:42:40.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:41.232 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:41 smithi067 ceph-mon[30891]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:41 smithi067 ceph-mon[30891]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T20:42:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:41 smithi067 ceph-mon[30891]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:41.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:41 smithi067 ceph-mon[30891]: Saving service mon spec with placement smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c;count:3 2024-09-10T20:42:41.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:41 smithi067 ceph-mon[30891]: Deploying daemon mon.c on smithi172 2024-09-10T20:42:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:42:41.870 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","modified":"2024-09-10T20:41:16.765185Z","created":"2024-09-10T20:41:16.765185Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T20:42:41.870 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-10T20:42:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:42 smithi067 ceph-mon[30891]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:42 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/1007154118' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 podman[35246]: 2024-09-10 20:42:44.279291975 +0000 UTC m=+0.015742876 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:42:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:44 smithi067 ceph-mon[30891]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.841 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T20:42:44.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 podman[35246]: 2024-09-10 20:42:44.595033732 +0000 UTC m=+0.331484635 container init 80f3fbaa9a128fc125178de0467e2e42323ae916b2ade711532cec90f205c9f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 podman[35246]: 2024-09-10 20:42:44.598131841 +0000 UTC m=+0.334582742 container start 80f3fbaa9a128fc125178de0467e2e42323ae916b2ade711532cec90f205c9f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pidfile_write: ignore empty --pid-file 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: load: jerasure load: lrc 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: RocksDB version: 7.9.2 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Git sha 0 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: DB SUMMARY 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: DB Session ID: 1XNT3AWNRH8ZNU8OBBAV 2024-09-10T20:42:44.866 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: CURRENT file: CURRENT 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.error_if_exists: 0 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.create_if_missing: 0 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.paranoid_checks: 1 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.env: 0x56413e18c180 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.info_log: 0x56413f69b700 2024-09-10T20:42:44.867 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T20:42:44.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.statistics: (nil) 2024-09-10T20:42:44.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.use_fsync: 0 2024-09-10T20:42:44.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_log_file_size: 0 2024-09-10T20:42:44.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T20:42:44.869 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_fallocate: 1 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.use_direct_reads: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.db_log_dir: 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.wal_dir: 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T20:42:44.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.write_buffer_manager: 0x56413f69fb80 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T20:42:44.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.unordered_write: 0 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.row_cache: None 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.wal_filter: None 2024-09-10T20:42:44.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.two_write_queues: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.wal_compression: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.atomic_flush: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.log_readahead_size: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T20:42:44.873 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_background_jobs: 2 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_background_compactions: -1 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_subcompactions: 1 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T20:42:44.874 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_open_files: -1 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_background_flushes: -1 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Compression algorithms supported: 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kZSTD supported: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kXpressCompression supported: 0 2024-09-10T20:42:44.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kBZip2Compression supported: 0 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kLZ4Compression supported: 1 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kZlibCompression supported: 1 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: kSnappyCompression supported: 1 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T20:42:44.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.merge_operator: 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_filter: None 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56413f69b320) 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_type: 0 2024-09-10T20:42:44.877 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_index_type: 0 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_shortening: 1 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: checksum: 4 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: no_block_cache: 0 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache: 0x56413f68f610 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_options: 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: capacity : 536870912 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_shard_bits : 4 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: strict_capacity_limit : 0 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_compressed: (nil) 2024-09-10T20:42:44.878 INFO:journalctl@ceph.mon.c.smithi172.stdout: persistent_cache: (nil) 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size: 4096 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size_deviation: 10 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_restart_interval: 16 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_block_restart_interval: 1 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: metadata_block_size: 4096 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: partition_filters: 0 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: use_delta_encoding: 1 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: filter_policy: bloomfilter 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: whole_key_filtering: 1 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: verify_compression: 0 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-10T20:42:44.879 INFO:journalctl@ceph.mon.c.smithi172.stdout: format_version: 5 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_index_compression: 1 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_align: 0 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: prepopulate_block_cache: 0 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression: NoCompression 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.num_levels: 7 2024-09-10T20:42:44.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T20:42:44.881 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T20:42:44.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T20:42:44.883 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T20:42:44.884 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.inplace_update_support: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.bloom_locality: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.max_successive_merges: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.ttl: 2592000 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T20:42:44.885 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enable_blob_files: false 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.min_blob_size: 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T20:42:44.886 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dcdae6a2-7e44-4afc-98b3-4a079b0a2110 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000964625602, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000964626008, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726000964, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dcdae6a2-7e44-4afc-98b3-4a079b0a2110", "db_session_id": "1XNT3AWNRH8ZNU8OBBAV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726000964626102, "job": 1, "event": "recovery_finished"} 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56413f6bee00 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: DB pointer 0x56413f7c0000 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** DB Stats ** 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T20:42:44.887 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T20:42:44.889 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache BinnedLRUCache@0x56413f68f610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: starting mon.c rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:44.890 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(???) e0 preinit fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: e1 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: btime 2024-09-10T20:41:20:188828+0000 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: legacy client fscid: -1 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout: No filesystems configured 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T20:42:44.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Deploying cephadm binary to smithi172 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:44.892 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Added host smithi172 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:42:44.893 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1681906100' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1681906100' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:44.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:42:44.895 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Saving service mon spec with placement smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c;count:3 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: Deploying daemon mon.c on smithi172 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/1007154118' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 ceph-mon[35265]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 bash[35246]: 80f3fbaa9a128fc125178de0467e2e42323ae916b2ade711532cec90f205c9f5 2024-09-10T20:42:44.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:44 smithi172 systemd[1]: Started Ceph mon.c for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:42:45.097 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: mon.a calling monitor election 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: mon.c calling monitor election 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: monmap epoch 2 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: last_changed 2024-09-10T20:42:44.651595+0000 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: min_mon_release 19 (squid) 2024-09-10T20:42:50.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: election_strategy: 1 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: fsmap 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: mgrmap e13: x(active, since 42s) 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: overall HEALTH_OK 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:42:50.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:50.171 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:42:50.171 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","modified":"2024-09-10T20:42:44.651595Z","created":"2024-09-10T20:41:16.765185Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T20:42:50.172 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: mon.a calling monitor election 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: mon.c calling monitor election 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.172 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: monmap epoch 2 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: last_changed 2024-09-10T20:42:44.651595+0000 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: min_mon_release 19 (squid) 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: election_strategy: 1 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: fsmap 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: mgrmap e13: x(active, since 42s) 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: overall HEALTH_OK 2024-09-10T20:42:50.173 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:50.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:42:50.174 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:42:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:50 smithi067 ceph-mon[30891]: Deploying daemon mon.b on smithi083 2024-09-10T20:42:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:50 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/2360983454' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:50 smithi172 ceph-mon[35265]: Deploying daemon mon.b on smithi083 2024-09-10T20:42:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:50 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/2360983454' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:51.773 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T20:42:51.773 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T20:42:52.026 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:42:52.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:51 smithi067 ceph-mon[30891]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:52.146 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:51 smithi172 ceph-mon[35265]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:52.677 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:42:52.677 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","modified":"2024-09-10T20:42:44.651595Z","created":"2024-09-10T20:41:16.765185Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T20:42:52.678 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-10T20:42:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:52 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/494531997' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:53.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:52 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/494531997' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:53.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:53 smithi083 systemd[1]: Started Ceph mon.b for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:42:54.238 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T20:42:54.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T20:42:54.488 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:42:58.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:42:58.806 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","modified":"2024-09-10T20:42:53.482084Z","created":"2024-09-10T20:41:16.765185Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T20:42:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-09-10T20:42:58.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:58.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: mon.a calling monitor election 2024-09-10T20:42:58.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.806 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: mon.c calling monitor election 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: mon.b calling monitor election 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: monmap epoch 3 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: last_changed 2024-09-10T20:42:53.482084+0000 2024-09-10T20:42:58.807 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: min_mon_release 19 (squid) 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: election_strategy: 1 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: 2: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: fsmap 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: mgrmap e13: x(active, since 51s) 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: overall HEALTH_OK 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.808 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: mon.a calling monitor election 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: mon.c calling monitor election 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: mon.b calling monitor election 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:58.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: monmap epoch 3 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: last_changed 2024-09-10T20:42:53.482084+0000 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: min_mon_release 19 (squid) 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: election_strategy: 1 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: 2: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2024-09-10T20:42:58.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: fsmap 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: mgrmap e13: x(active, since 51s) 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: overall HEALTH_OK 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:58.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:42:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: mon.a calling monitor election 2024-09-10T20:42:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: mon.c calling monitor election 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: mon.b calling monitor election 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: monmap epoch 3 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: last_changed 2024-09-10T20:42:53.482084+0000 2024-09-10T20:42:59.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: created 2024-09-10T20:41:16.765185+0000 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: min_mon_release 19 (squid) 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: election_strategy: 1 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: 0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: 2: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: fsmap 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: mgrmap e13: x(active, since 51s) 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: overall HEALTH_OK 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:59.048 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:42:59.402 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T20:42:59.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T20:42:59.671 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:42:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:59 smithi172 ceph-mon[35265]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:59 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/3895163262' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:42:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:59.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:59 smithi067 ceph-mon[30891]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:59 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/3895163262' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:59.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:42:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:42:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:42:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:59 smithi083 ceph-mon[35058]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:42:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:59 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/3895163262' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T20:42:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:42:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:43:00.307 INFO:teuthology.orchestra.run.smithi067.stdout:# minimal ceph.conf for d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:43:00.307 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-10T20:43:00.307 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:43:00.308 INFO:teuthology.orchestra.run.smithi067.stdout: mon_host = [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-10T20:43:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1131465644' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:00 smithi083 ceph-mon[35058]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1131465644' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:00 smithi172 ceph-mon[35265]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:01.003 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi067:/etc/ceph/ceph.conf 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1131465644' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:01.004 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:00 smithi067 ceph-mon[30891]: Updating smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T20:43:01.037 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T20:43:01.037 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:43:01.037 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T20:43:01.065 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:43:01.065 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:43:01.133 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:43:01.133 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T20:43:01.160 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:43:01.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:43:01.226 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:43:01.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T20:43:01.253 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:43:01.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T20:43:01.319 INFO:tasks.cephadm:Adding mgr.x on smithi067 2024-09-10T20:43:01.320 INFO:tasks.cephadm:Adding mgr.y on smithi083 2024-09-10T20:43:01.320 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-09-10T20:43:01.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi067=x;smithi083=y;smithi172=z' 2024-09-10T20:43:01.595 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:43:01.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:01.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.964 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:01.965 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:01 smithi172 ceph-mon[35265]: Reconfiguring daemon mon.a on smithi067 2024-09-10T20:43:02.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:02.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:02.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:02.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:01 smithi067 ceph-mon[30891]: Reconfiguring daemon mon.a on smithi067 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:02.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:01 smithi083 ceph-mon[35058]: Reconfiguring daemon mon.a on smithi067 2024-09-10T20:43:02.250 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-09-10T20:43:02.794 DEBUG:teuthology.orchestra.run.smithi083:mgr.y> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T20:43:02.796 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T20:43:02.799 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T20:43:02.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T20:43:02.802 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T20:43:02.802 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T20:43:02.845 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T20:43:02.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T20:43:02.888 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T20:43:02.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T20:43:02.931 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T20:43:02.931 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T20:43:02.974 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T20:43:02.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T20:43:03.017 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T20:43:03.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T20:43:03.060 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T20:43:03.060 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T20:43:03.103 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T20:43:03.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T20:43:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:03.134 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T20:43:03.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T20:43:03.184 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T20:43:03.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T20:43:03.203 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:03.210 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T20:43:03.210 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T20:43:03.257 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T20:43:03.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T20:43:03.301 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T20:43:03.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T20:43:03.363 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T20:43:03.363 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T20:43:03.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: Reconfiguring mon.b (monmap changed)... 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: Reconfiguring daemon mon.b on smithi083 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi067=x;smithi083=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: Saving service mgr spec with placement smithi067=x;smithi083=y;smithi172=z;count:3 2024-09-10T20:43:03.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.406 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T20:43:03.406 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T20:43:03.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: Reconfiguring mon.b (monmap changed)... 2024-09-10T20:43:03.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: Reconfiguring daemon mon.b on smithi083 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi067=x;smithi083=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: Saving service mgr spec with placement smithi067=x;smithi083=y;smithi172=z;count:3 2024-09-10T20:43:03.420 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.422 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T20:43:03.422 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: Reconfiguring mon.b (monmap changed)... 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:03.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:03.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:03.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: Reconfiguring daemon mon.b on smithi083 2024-09-10T20:43:03.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi067=x;smithi083=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:03.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: Saving service mgr spec with placement smithi067=x;smithi083=y;smithi172=z;count:3 2024-09-10T20:43:03.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:03.471 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T20:43:03.472 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T20:43:03.523 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T20:43:03.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T20:43:03.599 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T20:43:03.599 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T20:43:03.645 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T20:43:03.645 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T20:43:03.697 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T20:43:03.697 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T20:43:03.743 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T20:43:03.744 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi067') 2024-09-10T20:43:04.637 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:04.706 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: Reconfiguring mon.c (monmap changed)... 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: Reconfiguring daemon mon.c on smithi172 2024-09-10T20:43:04.707 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:04 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4120125266' entity='client.admin' 2024-09-10T20:43:04.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:04.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: Reconfiguring mon.c (monmap changed)... 2024-09-10T20:43:04.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:04.733 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:04.733 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:04.733 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: Reconfiguring daemon mon.c on smithi172 2024-09-10T20:43:04.733 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:04 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4120125266' entity='client.admin' 2024-09-10T20:43:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: Reconfiguring mon.c (monmap changed)... 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: Reconfiguring daemon mon.c on smithi172 2024-09-10T20:43:04.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:04 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4120125266' entity='client.admin' 2024-09-10T20:43:05.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi067') 2024-09-10T20:43:05.711 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi067') 2024-09-10T20:43:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.731 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.731 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3290979316' entity='client.admin' 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:05.871 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:05.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:05.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:05.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:05.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:05 smithi172 ceph-mon[35265]: Deploying daemon mgr.z on smithi172 2024-09-10T20:43:05.916 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3290979316' entity='client.admin' 2024-09-10T20:43:05.916 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:05.916 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.916 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:05.917 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:05 smithi067 ceph-mon[30891]: Deploying daemon mgr.z on smithi172 2024-09-10T20:43:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3290979316' entity='client.admin' 2024-09-10T20:43:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:05 smithi083 ceph-mon[35058]: Deploying daemon mgr.z on smithi172 2024-09-10T20:43:06.439 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:06.442 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:06.443 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:06.647 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 systemd[1]: Starting Ceph mgr.z for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:43:06.903 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 podman[36826]: 2024-09-10 20:43:06.546503149 +0000 UTC m=+0.015541026 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:43:06.903 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 podman[36826]: 2024-09-10 20:43:06.645036152 +0000 UTC m=+0.114074020 container create 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:43:06.904 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 podman[36826]: 2024-09-10 20:43:06.872339538 +0000 UTC m=+0.341377406 container init 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:43:06.904 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 podman[36826]: 2024-09-10 20:43:06.875156944 +0000 UTC m=+0.344194812 container start 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T20:43:07.199 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 ceph-mgr[36845]: -- 172.21.15.172:0/2658190131 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1c0f230e0 con 0x55f1c0f00800 2024-09-10T20:43:07.199 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 bash[36826]: 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b 2024-09-10T20:43:07.199 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 20:43:06 smithi172 systemd[1]: Started Ceph mgr.z for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:43:08.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: Deploying daemon mgr.y on smithi083 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2847927267' entity='client.admin' 2024-09-10T20:43:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1179253384' entity='client.admin' 2024-09-10T20:43:08.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:08 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1352984751' entity='client.admin' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: Deploying daemon mgr.y on smithi083 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2847927267' entity='client.admin' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1179253384' entity='client.admin' 2024-09-10T20:43:08.305 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:08 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1352984751' entity='client.admin' 2024-09-10T20:43:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: Deploying daemon mgr.y on smithi083 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2847927267' entity='client.admin' 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1179253384' entity='client.admin' 2024-09-10T20:43:08.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:08 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1352984751' entity='client.admin' 2024-09-10T20:43:08.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.807+0000 7f18adffb640 1 -- 172.21.15.67:0/4003740223 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) ==== 109+0+0 (secure 0 0 0) 0x7f18a801e170 con 0x7f18b01049c0 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f18a003f510 msgr2=0x7f18a00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f18a003f510 0x7f18a00419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a4005d00 tx=0x7f18a400b410 comp rx=0 tx=0).stop 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b01049c0 msgr2=0x7f18b0199e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b01049c0 0x7f18b0199e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f18a800eaa0 tx=0x7f18a800ef60 comp rx=0 tx=0).stop 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 shutdown_connections 2024-09-10T20:43:08.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f18a003f510 0x7f18a00419d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b01049c0 0x7f18b0199e60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18b0104080 0x7f18b0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 --2- 172.21.15.67:0/4003740223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18b0101220 0x7f18b0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 >> 172.21.15.67:0/4003740223 conn(0x7f18b00fc970 msgr2=0x7f18b0107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 shutdown_connections 2024-09-10T20:43:08.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:08.810+0000 7f18b7064640 1 -- 172.21.15.67:0/4003740223 wait complete. 2024-09-10T20:43:08.892 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:08 smithi083 systemd[1]: Starting Ceph mgr.y for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:43:09.019 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:09.020 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 -- 172.21.15.67:0/2755558359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4102a70 msgr2=0x7f63a4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 --2- 172.21.15.67:0/2755558359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4102a70 0x7f63a4102ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6394009930 tx=0x7f639402a420 comp rx=0 tx=0).stop 2024-09-10T20:43:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 -- 172.21.15.67:0/2755558359 shutdown_connections 2024-09-10T20:43:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 --2- 172.21.15.67:0/2755558359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 0x7f63a4109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 --2- 172.21.15.67:0/2755558359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4102a70 0x7f63a4102ef0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 --2- 172.21.15.67:0/2755558359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4101910 0x7f63a4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.215+0000 7f63abdf5640 1 -- 172.21.15.67:0/2755558359 >> 172.21.15.67:0/2755558359 conn(0x7f63a40fd1e0 msgr2=0x7f63a40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:09.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.216+0000 7f63abdf5640 1 -- 172.21.15.67:0/2755558359 shutdown_connections 2024-09-10T20:43:09.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.216+0000 7f63abdf5640 1 -- 172.21.15.67:0/2755558359 wait complete. 2024-09-10T20:43:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 Processor -- start 2024-09-10T20:43:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 -- start start 2024-09-10T20:43:09.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 0x7f63a419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 0x7f63a419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 0x7f63a419c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63a410d360 con 0x7f63a4101910 2024-09-10T20:43:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f63a410d1e0 con 0x7f63a4102a70 2024-09-10T20:43:09.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63abdf5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63a410d4e0 con 0x7f63a4103430 2024-09-10T20:43:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63a9b91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 0x7f63a419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63a9b91640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 0x7f63a419ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57798/0 (socket says 172.21.15.67:57798) 2024-09-10T20:43:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63a9b91640 1 -- 172.21.15.67:0/216761693 learned_addr learned my addr 172.21.15.67:0/216761693 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:09.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63a9390640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 0x7f63a419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.217+0000 7f63aa392640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 0x7f63a419c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 -- 172.21.15.67:0/216761693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 msgr2=0x7f63a419c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 0x7f63a419c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 -- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 msgr2=0x7f63a419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 0x7f63a419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 -- 172.21.15.67:0/216761693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a419c960 con 0x7f63a4102a70 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63a9390640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 0x7f63a419b480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f639402a940 tx=0x7f6394004fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639403f070 con 0x7f63a4102a70 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f6394003a60 con 0x7f63a4102a70 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394035030 con 0x7f63a4102a70 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a419cbf0 con 0x7f63a4102a70 2024-09-10T20:43:09.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.218+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a41a3160 con 0x7f63a4102a70 2024-09-10T20:43:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.219+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f639403b980 con 0x7f63a4102a70 2024-09-10T20:43:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.220+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a4101d10 con 0x7f63a4102a70 2024-09-10T20:43:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.220+0000 7f639affd640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 0x7f63900419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.220+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6394074810 con 0x7f63a4102a70 2024-09-10T20:43:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.220+0000 7f63a9b91640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 0x7f63900419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.220+0000 7f63a9b91640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 0x7f63900419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009c90 tx=0x7f63a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.225+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f63940303a0 con 0x7f63a4102a70 2024-09-10T20:43:09.237 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:08 smithi083 podman[36183]: 2024-09-10 20:43:08.87303058 +0000 UTC m=+0.015701719 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:43:09.237 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:08 smithi083 podman[36183]: 2024-09-10 20:43:08.978638295 +0000 UTC m=+0.121309415 container create 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:43:09.237 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:09 smithi083 podman[36183]: 2024-09-10 20:43:09.20610571 +0000 UTC m=+0.348776832 container init 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T20:43:09.238 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:09 smithi083 podman[36183]: 2024-09-10 20:43:09.209195023 +0000 UTC m=+0.351866153 container start 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:43:09.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.424+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f63a41a34b0 con 0x7f63a4102a70 2024-09-10T20:43:09.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.431+0000 7f639affd640 1 -- 172.21.15.67:0/216761693 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f6394036260 con 0x7f63a4102a70 2024-09-10T20:43:09.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.433+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 msgr2=0x7f63900419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 0x7f63900419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009c90 tx=0x7f63a0005f90 comp rx=0 tx=0).stop 2024-09-10T20:43:09.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 msgr2=0x7f63a419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 0x7f63a419b480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f639402a940 tx=0x7f6394004fd0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 shutdown_connections 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f639003f510 0x7f63900419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a4103430 0x7f63a419c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63a4102a70 0x7f63a419b480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 --2- 172.21.15.67:0/216761693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63a4101910 0x7f63a419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 >> 172.21.15.67:0/216761693 conn(0x7f63a40fd1e0 msgr2=0x7f63a40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:09.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 shutdown_connections 2024-09-10T20:43:09.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.434+0000 7f63abdf5640 1 -- 172.21.15.67:0/216761693 wait complete. 2024-09-10T20:43:09.641 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mgr[36202]: -- 172.21.15.83:0/1504258640 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c6f77b0e0 con 0x563c6f759000 2024-09-10T20:43:09.641 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:09 smithi083 bash[36183]: 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 2024-09-10T20:43:09.641 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 20:43:09 smithi083 systemd[1]: Started Ceph mgr.y for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 -- 172.21.15.67:0/3394162538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8103430 msgr2=0x7f4ca8109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 --2- 172.21.15.67:0/3394162538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8103430 0x7f4ca8109db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800be60 tx=0x7f4c9802c510 comp rx=0 tx=0).stop 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 -- 172.21.15.67:0/3394162538 shutdown_connections 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 --2- 172.21.15.67:0/3394162538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8103430 0x7f4ca8109db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 --2- 172.21.15.67:0/3394162538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 0x7f4ca8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 --2- 172.21.15.67:0/3394162538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8101910 0x7f4ca8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 -- 172.21.15.67:0/3394162538 >> 172.21.15.67:0/3394162538 conn(0x7f4ca80fd1e0 msgr2=0x7f4ca80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 -- 172.21.15.67:0/3394162538 shutdown_connections 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.710+0000 7f4cad64e640 1 -- 172.21.15.67:0/3394162538 wait complete. 2024-09-10T20:43:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 Processor -- start 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 -- start start 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 0x7f4ca8197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8103430 0x7f4ca8197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810c2b0 con 0x7f4ca8101910 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810c130 con 0x7f4ca8102a70 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.711+0000 7f4cad64e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca810c430 con 0x7f4ca8103430 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57816/0 (socket says 172.21.15.67:57816) 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1661555079 learned_addr learned my addr 172.21.15.67:0/1661555079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca77fe640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8103430 0x7f4ca8197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca67fc640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 0x7f4ca8197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1661555079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8103430 msgr2=0x7f4ca8197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8103430 0x7f4ca8197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1661555079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 msgr2=0x7f4ca8197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 0x7f4ca8197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 -- 172.21.15.67:0/1661555079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81984e0 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4ca6ffd640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d950 tx=0x7f4ca000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0017030 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f4ca0004020 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0005580 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81987d0 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.712+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca819eeb0 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.713+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f4ca0009a30 con 0x7f4ca8101910 2024-09-10T20:43:09.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.713+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca8101d10 con 0x7f4ca8101910 2024-09-10T20:43:09.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.714+0000 7f4c9ffff640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 0x7f4c940419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:09.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.714+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4ca00536e0 con 0x7f4ca8101910 2024-09-10T20:43:09.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.714+0000 7f4ca67fc640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 0x7f4c940419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:09.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.714+0000 7f4ca67fc640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 0x7f4c940419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c90005d00 tx=0x7f4c9000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:09.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.718+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ca0009d50 con 0x7f4ca8101910 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='client.? ' entity='client.admin' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='client.? ' entity='client.admin' 2024-09-10T20:43:09.882 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:09.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.924+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f4ca8108cf0 con 0x7f4ca8101910 2024-09-10T20:43:09.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.927+0000 7f4c9ffff640 1 -- 172.21.15.67:0/1661555079 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v17)=0 v17) ==== 115+0+0 (secure 0 0 0) 0x7f4ca001ad10 con 0x7f4ca8101910 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 msgr2=0x7f4c940419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 0x7f4c940419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c90005d00 tx=0x7f4c9000b410 comp rx=0 tx=0).stop 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 msgr2=0x7f4ca8196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d950 tx=0x7f4ca000de10 comp rx=0 tx=0).stop 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 shutdown_connections 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4c9403f510 0x7f4c940419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8103430 0x7f4ca8197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ca8102a70 0x7f4ca8197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 --2- 172.21.15.67:0/1661555079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ca8101910 0x7f4ca8196a20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:09.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 >> 172.21.15.67:0/1661555079 conn(0x7f4ca80fd1e0 msgr2=0x7f4ca8105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:09.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 shutdown_connections 2024-09-10T20:43:09.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:09.929+0000 7f4cad64e640 1 -- 172.21.15.67:0/1661555079 wait complete. 2024-09-10T20:43:10.089 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='client.? ' entity='client.admin' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='client.? ' entity='client.admin' 2024-09-10T20:43:10.090 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='client.? ' entity='client.admin' 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:10.123 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='client.? ' entity='client.admin' 2024-09-10T20:43:10.124 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 -- 172.21.15.67:0/1409471631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 msgr2=0x7febe0102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 --2- 172.21.15.67:0/1409471631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0102e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7febdc009930 tx=0x7febdc02a420 comp rx=0 tx=0).stop 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 -- 172.21.15.67:0/1409471631 shutdown_connections 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 --2- 172.21.15.67:0/1409471631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0104560 0x7febe010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 --2- 172.21.15.67:0/1409471631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0103ba0 0x7febe0104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 --2- 172.21.15.67:0/1409471631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0102e40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 -- 172.21.15.67:0/1409471631 >> 172.21.15.67:0/1409471631 conn(0x7febe00fe2f0 msgr2=0x7febe0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 -- 172.21.15.67:0/1409471631 shutdown_connections 2024-09-10T20:43:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.518+0000 7febe763e640 1 -- 172.21.15.67:0/1409471631 wait complete. 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 Processor -- start 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 -- start start 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0103ba0 0x7febe0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0104560 0x7febe0199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e4a0 con 0x7febe0102a40 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e320 con 0x7febe0103ba0 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe763e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febe010e620 con 0x7febe0104560 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe53da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe53da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57826/0 (socket says 172.21.15.67:57826) 2024-09-10T20:43:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe53da640 1 -- 172.21.15.67:0/3290877281 learned_addr learned my addr 172.21.15.67:0/3290877281 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe4bd9640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0103ba0 0x7febe0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.519+0000 7febe5bdb640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0104560 0x7febe0199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 -- 172.21.15.67:0/3290877281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0104560 msgr2=0x7febe0199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0104560 0x7febe0199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 -- 172.21.15.67:0/3290877281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0103ba0 msgr2=0x7febe0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0103ba0 0x7febe0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 -- 172.21.15.67:0/3290877281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe019a800 con 0x7febe0102a40 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe53da640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febdc005940 tx=0x7febdc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc03f070 con 0x7febe0102a40 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7febdc031d40 con 0x7febe0102a40 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe019aa90 con 0x7febe0102a40 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc035030 con 0x7febe0102a40 2024-09-10T20:43:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.520+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe01a1080 con 0x7febe0102a40 2024-09-10T20:43:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.521+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe0102e40 con 0x7febe0102a40 2024-09-10T20:43:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.521+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7febdc003930 con 0x7febe0102a40 2024-09-10T20:43:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.522+0000 7febd67fc640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 0x7febcc0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.522+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7febdc074990 con 0x7febe0102a40 2024-09-10T20:43:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.522+0000 7febe4bd9640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 0x7febcc0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.522+0000 7febe4bd9640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 0x7febcc0419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7febd0009990 tx=0x7febd0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:10.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.526+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7febdc005310 con 0x7febe0102a40 2024-09-10T20:43:10.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.722+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7febe0063d50 con 0x7febe0102a40 2024-09-10T20:43:10.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.725+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7febdc045650 con 0x7febe0102a40 2024-09-10T20:43:10.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.726+0000 7febd67fc640 1 -- 172.21.15.67:0/3290877281 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7febdc04cc00 con 0x7febe0102a40 2024-09-10T20:43:10.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 msgr2=0x7febcc0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:10.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 0x7febcc0419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7febd0009990 tx=0x7febd0009110 comp rx=0 tx=0).stop 2024-09-10T20:43:10.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 msgr2=0x7febe0198cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:10.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febdc005940 tx=0x7febdc0042f0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 shutdown_connections 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febcc03f510 0x7febcc0419d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe0104560 0x7febe0199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe0103ba0 0x7febe0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 --2- 172.21.15.67:0/3290877281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febe0102a40 0x7febe0198cd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 >> 172.21.15.67:0/3290877281 conn(0x7febe00fe2f0 msgr2=0x7febe0107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 shutdown_connections 2024-09-10T20:43:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:10.728+0000 7febe763e640 1 -- 172.21.15.67:0/3290877281 wait complete. 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1661555079' entity='client.admin' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.012 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3290877281' entity='client.admin' 2024-09-10T20:43:11.013 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:11.013 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:11.013 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1661555079' entity='client.admin' 2024-09-10T20:43:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3290877281' entity='client.admin' 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:11.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1661555079' entity='client.admin' 2024-09-10T20:43:11.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3290877281' entity='client.admin' 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T20:43:11.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1248206761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d741010c0 msgr2=0x7f7d741014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1248206761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d741010c0 0x7f7d741014c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400aa40 tx=0x7f7d6402b750 comp rx=0 tx=0).stop 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1248206761 shutdown_connections 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1248206761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102be0 0x7f7d74109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1248206761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d74102220 0x7f7d741026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1248206761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d741010c0 0x7f7d741014c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:11.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1248206761 >> 172.21.15.67:0/1248206761 conn(0x7f7d740fc9b0 msgr2=0x7f7d740fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.960+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1248206761 shutdown_connections 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1248206761 wait complete. 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 Processor -- start 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 -- start start 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 0x7f7d74198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410c3c0 con 0x7f7d74102be0 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410c240 con 0x7f7d741010c0 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.961+0000 7f7d78f9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410c540 con 0x7f7d74102220 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:11.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57862/0 (socket says 172.21.15.67:57862) 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:44506/0 (socket says 172.21.15.67:44506) 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d7259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 0x7f7d74198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 -- 172.21.15.67:0/1073237796 learned_addr learned my addr 172.21.15.67:0/1073237796 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 -- 172.21.15.67:0/1073237796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 msgr2=0x7f7d74199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 -- 172.21.15.67:0/1073237796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 msgr2=0x7f7d74198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 0x7f7d74198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 -- 172.21.15.67:0/1073237796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7419a860 con 0x7f7d74102be0 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6bfff640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d7259c640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 0x7f7d74198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:43:11.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d72d9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00eb10 tx=0x7f7d6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c004b20 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7d6c004cc0 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7419ab50 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c010690 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.962+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741a1230 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.963+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f7d6c005020 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.963+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d741014c0 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.964+0000 7f7d6b7fe640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 0x7f7d600419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.964+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7d6c054290 con 0x7f7d74102be0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.964+0000 7f7d7259c640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 0x7f7d600419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.964+0000 7f7d7259c640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 0x7f7d600419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005ab0 tx=0x7f7d64005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:11.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.968+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7d6c011d70 con 0x7f7d74102be0 2024-09-10T20:43:12.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.157+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f7d741a1970 con 0x7f7d74102be0 2024-09-10T20:43:12.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.160+0000 7f7d6b7fe640 1 -- 172.21.15.67:0/1073237796 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f7d6c01fd10 con 0x7f7d74102be0 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 msgr2=0x7f7d600419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 0x7f7d600419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d64005ab0 tx=0x7f7d64005a20 comp rx=0 tx=0).stop 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 msgr2=0x7f7d74199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00eb10 tx=0x7f7d6c00c2d0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 shutdown_connections 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d74102be0 0x7f7d74199fc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7d6003f510 0x7f7d600419d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d74102220 0x7f7d74199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 --2- 172.21.15.67:0/1073237796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d741010c0 0x7f7d74198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 >> 172.21.15.67:0/1073237796 conn(0x7f7d740fc9b0 msgr2=0x7f7d741057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 shutdown_connections 2024-09-10T20:43:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.162+0000 7f7d78f9d640 1 -- 172.21.15.67:0/1073237796 wait complete. 2024-09-10T20:43:12.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 -- 172.21.15.67:0/1053890534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe8105bc0 msgr2=0x7fdfe8108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 --2- 172.21.15.67:0/1053890534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8108010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009900 tx=0x7fdfdc02a410 comp rx=0 tx=0).stop 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 -- 172.21.15.67:0/1053890534 shutdown_connections 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 --2- 172.21.15.67:0/1053890534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 0x7fdfe810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 --2- 172.21.15.67:0/1053890534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8108010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 --2- 172.21.15.67:0/1053890534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe806bea0 0x7fdfe8105680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 -- 172.21.15.67:0/1053890534 >> 172.21.15.67:0/1053890534 conn(0x7fdfe80fd210 msgr2=0x7fdfe80ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 -- 172.21.15.67:0/1053890534 shutdown_connections 2024-09-10T20:43:12.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.185+0000 7fdfee02e640 1 -- 172.21.15.67:0/1053890534 wait complete. 2024-09-10T20:43:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.186+0000 7fdfee02e640 1 Processor -- start 2024-09-10T20:43:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.186+0000 7fdfee02e640 1 -- start start 2024-09-10T20:43:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:12.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 0x7fdfe8101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe810e540 con 0x7fdfe806bea0 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe810e3c0 con 0x7fdfe8108750 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfee02e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe810e6c0 con 0x7fdfe8105bc0 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57894/0 (socket says 172.21.15.67:57894) 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 -- 172.21.15.67:0/2506727150 learned_addr learned my addr 172.21.15.67:0/2506727150 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe7fff640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 0x7fdfe8101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe6ffd640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 -- 172.21.15.67:0/2506727150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe8105bc0 msgr2=0x7fdfe8101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 -- 172.21.15.67:0/2506727150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 msgr2=0x7fdfe8101b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 0x7fdfe8101b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.187+0000 7fdfe77fe640 1 -- 172.21.15.67:0/2506727150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe81020a0 con 0x7fdfe806bea0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.188+0000 7fdfe77fe640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c920 tx=0x7fdfd800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.188+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8007c70 con 0x7fdfe806bea0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.188+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe8102330 con 0x7fdfe806bea0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.188+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdfd8007e10 con 0x7fdfe806bea0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.188+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe80739e0 con 0x7fdfe806bea0 2024-09-10T20:43:12.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80186d0 con 0x7fdfe806bea0 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fdfd80189b0 con 0x7fdfe806bea0 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd40050b0 con 0x7fdfe806bea0 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfe4ff9640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 0x7fdfd00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdfd8054be0 con 0x7fdfe806bea0 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.189+0000 7fdfe6ffd640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 0x7fdfd00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.190+0000 7fdfe6ffd640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 0x7fdfd00419d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc005790 tx=0x7fdfdc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.196+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdfd8014030 con 0x7fdfe806bea0 2024-09-10T20:43:12.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.385+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fdfd40053a0 con 0x7fdfe806bea0 2024-09-10T20:43:12.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.387+0000 7fdfe4ff9640 1 -- 172.21.15.67:0/2506727150 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v21)=0 v21) ==== 117+0+0 (secure 0 0 0) 0x7fdfd80203a0 con 0x7fdfe806bea0 2024-09-10T20:43:12.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 msgr2=0x7fdfd00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 0x7fdfd00419d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc005790 tx=0x7fdfdc000bc0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 msgr2=0x7fdfe8102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c920 tx=0x7fdfd800cde0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 shutdown_connections 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe8108750 0x7fdfe8101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd003f510 0x7fdfd00419d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe8105bc0 0x7fdfe8101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 --2- 172.21.15.67:0/2506727150 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe806bea0 0x7fdfe8102db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 >> 172.21.15.67:0/2506727150 conn(0x7fdfe80fd210 msgr2=0x7fdfe8103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 shutdown_connections 2024-09-10T20:43:12.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:12.390+0000 7fdfee02e640 1 -- 172.21.15.67:0/2506727150 wait complete. 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: Reconfiguring daemon mgr.x on smithi067 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2551926702' entity='client.admin' 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: Standby manager daemon z started 2024-09-10T20:43:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T20:43:12.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:12.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T20:43:12.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:12.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:12.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:12 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1073237796' entity='client.admin' 2024-09-10T20:43:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T20:43:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: Reconfiguring daemon mgr.x on smithi067 2024-09-10T20:43:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2551926702' entity='client.admin' 2024-09-10T20:43:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: Standby manager daemon z started 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:12.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:12 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1073237796' entity='client.admin' 2024-09-10T20:43:12.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:12.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T20:43:12.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: Reconfiguring daemon mgr.x on smithi067 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2551926702' entity='client.admin' 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: Standby manager daemon z started 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.172:0/264347981' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:12.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:12 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1073237796' entity='client.admin' 2024-09-10T20:43:12.757 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:12.758 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:12.758 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:12.759 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/276504975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 msgr2=0x7f5a98102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/276504975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98102e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009930 tx=0x7f5a9402a420 comp rx=0 tx=0).stop 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/276504975 shutdown_connections 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/276504975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98104560 0x7f5a9810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/276504975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98103ba0 0x7f5a98104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/276504975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98102e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/276504975 >> 172.21.15.67:0/276504975 conn(0x7f5a980fe2f0 msgr2=0x7f5a98100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/276504975 shutdown_connections 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.337+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/276504975 wait complete. 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 Processor -- start 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 -- start start 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98103ba0 0x7f5a981993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98104560 0x7f5a98199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9810e580 con 0x7f5a98102a40 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9810e400 con 0x7f5a98104560 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9fd7d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9810e700 con 0x7f5a98103ba0 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9db19640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9db19640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56654/0 (socket says 172.21.15.67:56654) 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9db19640 1 -- 172.21.15.67:0/359384379 learned_addr learned my addr 172.21.15.67:0/359384379 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9d318640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98103ba0 0x7f5a981993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9e31a640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98104560 0x7f5a98199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.338+0000 7f5a9db19640 1 -- 172.21.15.67:0/359384379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98103ba0 msgr2=0x7f5a981993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9db19640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98103ba0 0x7f5a981993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9db19640 1 -- 172.21.15.67:0/359384379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98104560 msgr2=0x7f5a98199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9db19640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98104560 0x7f5a98199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9db19640 1 -- 172.21.15.67:0/359384379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9819a880 con 0x7f5a98102a40 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9db19640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009a50 tx=0x7f5a94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9403f030 con 0x7f5a98102a40 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a94003a80 con 0x7f5a98102a40 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9819ab10 con 0x7f5a98102a40 2024-09-10T20:43:13.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a94035070 con 0x7f5a98102a40 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.339+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a981a1080 con 0x7f5a98102a40 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.340+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a98102e40 con 0x7f5a98102a40 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.341+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f5a9403bcc0 con 0x7f5a98102a40 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.341+0000 7f5a8affd640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 0x7f5a8407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.342+0000 7f5a9d318640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 0x7f5a8407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.342+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5a940bc9b0 con 0x7f5a98102a40 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.342+0000 7f5a9d318640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 0x7f5a8407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c005d00 tx=0x7f5a8c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.347+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5a94085010 con 0x7f5a98102a40 2024-09-10T20:43:13.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.536+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f5a981a1400 con 0x7f5a98102a40 2024-09-10T20:43:13.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.541+0000 7f5a8affd640 1 -- 172.21.15.67:0/359384379 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7f5a94089a40 con 0x7f5a98102a40 2024-09-10T20:43:13.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 msgr2=0x7f5a8407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 0x7f5a8407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c005d00 tx=0x7f5a8c00b410 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 msgr2=0x7f5a98198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009a50 tx=0x7f5a94004270 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 shutdown_connections 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a98104560 0x7f5a98199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5a8407a3b0 0x7f5a8407c870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a98103ba0 0x7f5a981993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.543+0000 7f5a9fd7d640 1 --2- 172.21.15.67:0/359384379 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5a98102a40 0x7f5a98198d50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.544+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 >> 172.21.15.67:0/359384379 conn(0x7f5a980fe2f0 msgr2=0x7f5a98104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.544+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 shutdown_connections 2024-09-10T20:43:13.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:13.544+0000 7f5a9fd7d640 1 -- 172.21.15.67:0/359384379 wait complete. 2024-09-10T20:43:13.594 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:13 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2506727150' entity='client.admin' 2024-09-10T20:43:13.594 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:13 smithi067 ceph-mon[30891]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T20:43:13.594 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:13 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T20:43:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:13 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2506727150' entity='client.admin' 2024-09-10T20:43:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:13 smithi172 ceph-mon[35265]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T20:43:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:13 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T20:43:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:13 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2506727150' entity='client.admin' 2024-09-10T20:43:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:13 smithi083 ceph-mon[35058]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-10T20:43:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:13 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 -- 172.21.15.67:0/1642484263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8102a40 msgr2=0x7f66e8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/1642484263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8102a40 0x7f66e8102e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009930 tx=0x7f66d802a420 comp rx=0 tx=0).stop 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 -- 172.21.15.67:0/1642484263 shutdown_connections 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/1642484263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8104560 0x7f66e810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/1642484263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8103ba0 0x7f66e8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/1642484263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8102a40 0x7f66e8102e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 -- 172.21.15.67:0/1642484263 >> 172.21.15.67:0/1642484263 conn(0x7f66e80fe2f0 msgr2=0x7f66e8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 -- 172.21.15.67:0/1642484263 shutdown_connections 2024-09-10T20:43:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.159+0000 7f66ee3bd640 1 -- 172.21.15.67:0/1642484263 wait complete. 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 Processor -- start 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 -- start start 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 0x7f66e8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8104560 0x7f66e8199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.160+0000 7f66ee3bd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66e810e5b0 con 0x7f66e8103ba0 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66ee3bd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66e810e430 con 0x7f66e8104560 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66ee3bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66e810e730 con 0x7f66e8102a40 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 0x7f66e8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57844/0 (socket says 172.21.15.67:57844) 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 -- 172.21.15.67:0/2551926702 learned_addr learned my addr 172.21.15.67:0/2551926702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66ec95a640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8104560 0x7f66e8199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 -- 172.21.15.67:0/2551926702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 msgr2=0x7f66e8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 0x7f66e8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 -- 172.21.15.67:0/2551926702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8104560 msgr2=0x7f66e8199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8104560 0x7f66e8199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 -- 172.21.15.67:0/2551926702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e819a890 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e7fff640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 0x7f66e8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e77fe640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e9f0 tx=0x7f66dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00cd80 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f66dc0108c0 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e819ab80 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0187d0 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.161+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e81a1260 con 0x7f66e8103ba0 2024-09-10T20:43:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.162+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f66dc0189b0 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.162+0000 7f66e57fa640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 0x7f66d00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.162+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e8102e40 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.163+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f66dc0541e0 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.163+0000 7f66e7fff640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 0x7f66d00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.163+0000 7f66e7fff640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 0x7f66d00419d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66d8005ab0 tx=0x7f66d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.167+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f66dc01fe30 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.355+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f66e8063d50 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.359+0000 7f66e57fa640 1 -- 172.21.15.67:0/2551926702 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f66dc0071c0 con 0x7f66e8103ba0 2024-09-10T20:43:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 msgr2=0x7f66d00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 0x7f66d00419d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66d8005ab0 tx=0x7f66d8005a20 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 msgr2=0x7f66e81993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e9f0 tx=0x7f66dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 shutdown_connections 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66e8104560 0x7f66e8199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66e8103ba0 0x7f66e81993b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66d003f510 0x7f66d00419d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 --2- 172.21.15.67:0/2551926702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e8102a40 0x7f66e8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 >> 172.21.15.67:0/2551926702 conn(0x7f66e80fe2f0 msgr2=0x7f66e8106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 shutdown_connections 2024-09-10T20:43:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:11.361+0000 7f66ee3bd640 1 -- 172.21.15.67:0/2551926702 wait complete. 2024-09-10T20:43:14.599 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:14.599 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/359384379' entity='client.admin' 2024-09-10T20:43:14.599 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: Standby manager daemon y started 2024-09-10T20:43:14.599 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T20:43:14.599 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:14.600 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T20:43:14.600 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:14 smithi067 ceph-mon[30891]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:14.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 -- 172.21.15.67:0/1379626117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0103ba0 msgr2=0x7f9ff0104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/1379626117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0104020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009930 tx=0x7f9fd802a420 comp rx=0 tx=0).stop 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 -- 172.21.15.67:0/1379626117 shutdown_connections 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/1379626117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 0x7f9ff010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/1379626117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0104020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/1379626117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0102a40 0x7f9ff0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 -- 172.21.15.67:0/1379626117 >> 172.21.15.67:0/1379626117 conn(0x7f9ff00fe2f0 msgr2=0x7f9ff0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 -- 172.21.15.67:0/1379626117 shutdown_connections 2024-09-10T20:43:14.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.601+0000 7f9ff59fc640 1 -- 172.21.15.67:0/1379626117 wait complete. 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.602+0000 7f9ff59fc640 1 Processor -- start 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.602+0000 7f9ff59fc640 1 -- start start 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.602+0000 7f9ff59fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 0x7f9ff0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010e580 con 0x7f9ff0102a40 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010e400 con 0x7f9ff0103ba0 2024-09-10T20:43:14.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff010e700 con 0x7f9ff0104560 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56672/0 (socket says 172.21.15.67:56672) 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 -- 172.21.15.67:0/896502363 learned_addr learned my addr 172.21.15.67:0/896502363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9fef7fe640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 0x7f9ff0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9fe7fff640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 -- 172.21.15.67:0/896502363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 msgr2=0x7f9ff0199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 0x7f9ff0199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 -- 172.21.15.67:0/896502363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 msgr2=0x7f9ff0199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 -- 172.21.15.67:0/896502363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff019a860 con 0x7f9ff0102a40 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9fe7fff640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:43:14.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9feeffd640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e9f0 tx=0x7f9fe000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:14.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000cd80 con 0x7f9ff0102a40 2024-09-10T20:43:14.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff019ab50 con 0x7f9ff0102a40 2024-09-10T20:43:14.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9fe00108c0 con 0x7f9ff0102a40 2024-09-10T20:43:14.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00187d0 con 0x7f9ff0102a40 2024-09-10T20:43:14.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.603+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01a1230 con 0x7f9ff0102a40 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.605+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff0102e40 con 0x7f9ff0102a40 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.605+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f9fe0010430 con 0x7f9ff0102a40 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.606+0000 7f9ff49fa640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 0x7f9fdc07c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.606+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9fe009c240 con 0x7f9ff0102a40 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.606+0000 7f9fe7fff640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 0x7f9fdc07c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.606+0000 7f9fe7fff640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 0x7f9fdc07c870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000c00 tx=0x7f9fd8009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:14.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.610+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fe0064fb0 con 0x7f9ff0102a40 2024-09-10T20:43:14.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.642+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f9fe0060b20 con 0x7f9ff0102a40 2024-09-10T20:43:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/359384379' entity='client.admin' 2024-09-10T20:43:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: Standby manager daemon y started 2024-09-10T20:43:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T20:43:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:14.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T20:43:14.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:14 smithi172 ceph-mon[35265]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:14.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.797+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f9ff0063d50 con 0x7f9ff0102a40 2024-09-10T20:43:14.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.801+0000 7f9ff49fa640 1 -- 172.21.15.67:0/896502363 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f9fe00b17b0 con 0x7f9ff0102a40 2024-09-10T20:43:14.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 msgr2=0x7f9fdc07c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 0x7f9fdc07c870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000c00 tx=0x7f9fd8009560 comp rx=0 tx=0).stop 2024-09-10T20:43:14.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 msgr2=0x7f9ff0198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000e9f0 tx=0x7f9fe000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 shutdown_connections 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fdc07a3b0 0x7f9fdc07c870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ff0104560 0x7f9ff0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ff0103ba0 0x7f9ff0199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 --2- 172.21.15.67:0/896502363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ff0102a40 0x7f9ff0198d30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 >> 172.21.15.67:0/896502363 conn(0x7f9ff00fe2f0 msgr2=0x7f9ff0106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 shutdown_connections 2024-09-10T20:43:14.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.803+0000 7f9ff59fc640 1 -- 172.21.15.67:0/896502363 wait complete. 2024-09-10T20:43:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/359384379' entity='client.admin' 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: Standby manager daemon y started 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T20:43:14.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:14 smithi083 ceph-mon[35058]: from='mgr.? 172.21.15.83:0/64862501' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 -- 172.21.15.67:0/3895628482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd0108770 msgr2=0x7f0cd010ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/3895628482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd0108770 0x7f0cd010ac30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ca0 tx=0x7f0cc802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 -- 172.21.15.67:0/3895628482 shutdown_connections 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/3895628482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd0108770 0x7f0cd010ac30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/3895628482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0105bc0 0x7f0cd0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/3895628482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 -- 172.21.15.67:0/3895628482 >> 172.21.15.67:0/3895628482 conn(0x7f0cd00fd200 msgr2=0x7f0cd00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 -- 172.21.15.67:0/3895628482 shutdown_connections 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.890+0000 7f0cd66c3640 1 -- 172.21.15.67:0/3895628482 wait complete. 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 Processor -- start 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 -- start start 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0105bc0 0x7f0cd0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0108770 0x7f0cd0199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd010e580 con 0x7f0cd006c0c0 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd010e400 con 0x7f0cd0108770 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd66c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd010e700 con 0x7f0cd0105bc0 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56688/0 (socket says 172.21.15.67:56688) 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 -- 172.21.15.67:0/165709490 learned_addr learned my addr 172.21.15.67:0/165709490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccf7fe640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0105bc0 0x7f0cd0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0cd4c60640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0108770 0x7f0cd0199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 -- 172.21.15.67:0/165709490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0105bc0 msgr2=0x7f0cd0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0105bc0 0x7f0cd0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 -- 172.21.15.67:0/165709490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0108770 msgr2=0x7f0cd0199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0108770 0x7f0cd0199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.891+0000 7f0ccffff640 1 -- 172.21.15.67:0/165709490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd019a770 con 0x7f0cd006c0c0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0ccffff640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c890 tx=0x7f0cc000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004220 con 0x7f0cd006c0c0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0cc0007e40 con 0x7f0cd006c0c0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd019aa60 con 0x7f0cd006c0c0 2024-09-10T20:43:14.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00047a0 con 0x7f0cd006c0c0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.892+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a1140 con 0x7f0cd006c0c0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.893+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0106020 con 0x7f0cd006c0c0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.894+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f0cc00079b0 con 0x7f0cd006c0c0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.895+0000 7f0ccd7fa640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 0x7f0cb80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.895+0000 7f0ccf7fe640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 0x7f0cb80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.895+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0cc00e3ec0 con 0x7f0cd006c0c0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.895+0000 7f0ccf7fe640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 0x7f0cb80b7790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cd006c570 tx=0x7f0cc400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:14.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:14.898+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0cc0014030 con 0x7f0cd006c0c0 2024-09-10T20:43:15.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.086+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f0cd00fecf0 con 0x7f0cd006c0c0 2024-09-10T20:43:15.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.089+0000 7f0ccd7fa640 1 -- 172.21.15.67:0/165709490 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f0cc00acad0 con 0x7f0cd006c0c0 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 msgr2=0x7f0cb80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 0x7f0cb80b7790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cd006c570 tx=0x7f0cc400a2d0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 msgr2=0x7f0cd0198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c890 tx=0x7f0cc000cc90 comp rx=0 tx=0).stop 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 shutdown_connections 2024-09-10T20:43:15.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0108770 0x7f0cd0199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0cb80b52d0 0x7f0cb80b7790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cd0105bc0 0x7f0cd0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 --2- 172.21.15.67:0/165709490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0cd006c0c0 0x7f0cd0198c40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 >> 172.21.15.67:0/165709490 conn(0x7f0cd00fd200 msgr2=0x7f0cd0103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 shutdown_connections 2024-09-10T20:43:15.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.092+0000 7f0cd66c3640 1 -- 172.21.15.67:0/165709490 wait complete. 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 -- 172.21.15.67:0/2868809212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d8108760 msgr2=0x7fa7d810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 --2- 172.21.15.67:0/2868809212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d8108760 0x7fa7d810ac20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009ca0 tx=0x7fa7d002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 -- 172.21.15.67:0/2868809212 shutdown_connections 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 --2- 172.21.15.67:0/2868809212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d8108760 0x7fa7d810ac20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 --2- 172.21.15.67:0/2868809212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8105c10 0x7fa7d8108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 --2- 172.21.15.67:0/2868809212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d806c020 0x7fa7d81056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 -- 172.21.15.67:0/2868809212 >> 172.21.15.67:0/2868809212 conn(0x7fa7d80fd200 msgr2=0x7fa7d80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 -- 172.21.15.67:0/2868809212 shutdown_connections 2024-09-10T20:43:15.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.385+0000 7fa7dd374640 1 -- 172.21.15.67:0/2868809212 wait complete. 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.386+0000 7fa7dd374640 1 Processor -- start 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.386+0000 7fa7dd374640 1 -- start start 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.386+0000 7fa7dd374640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d8105c10 0x7fa7d8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8108760 0x7fa7d8199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d810e5d0 con 0x7fa7d806c020 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d810e450 con 0x7fa7d8105c10 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d810e750 con 0x7fa7d8108760 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56700/0 (socket says 172.21.15.67:56700) 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 -- 172.21.15.67:0/493896582 learned_addr learned my addr 172.21.15.67:0/493896582 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d67fc640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d8105c10 0x7fa7d8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d77fe640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8108760 0x7fa7d8199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 -- 172.21.15.67:0/493896582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8108760 msgr2=0x7fa7d8199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8108760 0x7fa7d8199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 -- 172.21.15.67:0/493896582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d8105c10 msgr2=0x7fa7d8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d8105c10 0x7fa7d8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 -- 172.21.15.67:0/493896582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d819a850 con 0x7fa7d806c020 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7d6ffd640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c890 tx=0x7fa7c800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8004220 con 0x7fa7d806c020 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa7c8007e40 con 0x7fa7d806c020 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d819ab40 con 0x7fa7d806c020 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.387+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80047a0 con 0x7fa7d806c020 2024-09-10T20:43:15.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.388+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81a1220 con 0x7fa7d806c020 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.389+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d8106010 con 0x7fa7d806c020 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.390+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fa7c80079b0 con 0x7fa7d806c020 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.390+0000 7fa7bffff640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 0x7fa7c00b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.391+0000 7fa7d67fc640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 0x7fa7c00b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.391+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa7c80e3b70 con 0x7fa7d806c020 2024-09-10T20:43:15.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.391+0000 7fa7d67fc640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 0x7fa7c00b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009990 tx=0x7fa7cc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:15.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.395+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa7c8014030 con 0x7fa7d806c020 2024-09-10T20:43:15.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.583+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fa7d8063d50 con 0x7fa7d806c020 2024-09-10T20:43:15.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.587+0000 7fa7bffff640 1 -- 172.21.15.67:0/493896582 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v25)=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fa7c80ac700 con 0x7fa7d806c020 2024-09-10T20:43:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 msgr2=0x7fa7c00b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 0x7fa7c00b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009990 tx=0x7fa7cc009110 comp rx=0 tx=0).stop 2024-09-10T20:43:15.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 msgr2=0x7fa7d8198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c890 tx=0x7fa7c800cc90 comp rx=0 tx=0).stop 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 shutdown_connections 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa7c00b52d0 0x7fa7c00b7790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d8108760 0x7fa7d8199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa7d8105c10 0x7fa7d8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 --2- 172.21.15.67:0/493896582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7d806c020 0x7fa7d8198d20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.589+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 >> 172.21.15.67:0/493896582 conn(0x7fa7d80fd200 msgr2=0x7fa7d8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.590+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 shutdown_connections 2024-09-10T20:43:15.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.590+0000 7fa7dd374640 1 -- 172.21.15.67:0/493896582 wait complete. 2024-09-10T20:43:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- 172.21.15.67:0/3706611739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c103440 msgr2=0x7f238c109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 --2- 172.21.15.67:0/3706611739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c103440 0x7f238c109dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2384009cd0 tx=0x7f238402a8e0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- 172.21.15.67:0/3706611739 shutdown_connections 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 --2- 172.21.15.67:0/3706611739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c103440 0x7f238c109dc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 --2- 172.21.15.67:0/3706611739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c102a80 0x7f238c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 --2- 172.21.15.67:0/3706611739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 0x7f238c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- 172.21.15.67:0/3706611739 >> 172.21.15.67:0/3706611739 conn(0x7f238c0fd210 msgr2=0x7f238c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- 172.21.15.67:0/3706611739 shutdown_connections 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- 172.21.15.67:0/3706611739 wait complete. 2024-09-10T20:43:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 Processor -- start 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.624+0000 7f2392798640 1 -- start start 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 0x7f238c1056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 0x7f238c104490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10d440 con 0x7f238c102a80 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10d2c0 con 0x7f238c103440 2024-09-10T20:43:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2392798640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f238c10d5c0 con 0x7f238c101920 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56708/0 (socket says 172.21.15.67:56708) 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 -- 172.21.15.67:0/2168421953 learned_addr learned my addr 172.21.15.67:0/2168421953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2390d35640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 0x7f238c104490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238bfff640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 0x7f238c1056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 -- 172.21.15.67:0/2168421953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 msgr2=0x7f238c1056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 0x7f238c1056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 -- 172.21.15.67:0/2168421953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 msgr2=0x7f238c104490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 0x7f238c104490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 -- 172.21.15.67:0/2168421953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c104d50 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f2390d35640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 0x7f238c104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.625+0000 7f238b7fe640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f238000d950 tx=0x7f238000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.626+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2380017030 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.626+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c1a2d40 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.626+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2380004020 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.626+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23800055e0 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.626+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1a31f0 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.627+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c101d20 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.628+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f2380009a30 con 0x7f238c102a80 2024-09-10T20:43:15.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.629+0000 7f23897fa640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 0x7f23740b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.629+0000 7f238bfff640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 0x7f23740b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.629+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f23800e3f40 con 0x7f238c102a80 2024-09-10T20:43:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.629+0000 7f238bfff640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 0x7f23740b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f237c005e10 tx=0x7f237c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.632+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f23800acad0 con 0x7f238c102a80 2024-09-10T20:43:15.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T20:43:15.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T20:43:15.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:15.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/896502363' entity='client.admin' 2024-09-10T20:43:15.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/165709490' entity='client.admin' 2024-09-10T20:43:15.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/493896582' entity='client.admin' 2024-09-10T20:43:15.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.820+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f238c1a3480 con 0x7f238c102a80 2024-09-10T20:43:15.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.824+0000 7f23897fa640 1 -- 172.21.15.67:0/2168421953 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7f23800ac3d0 con 0x7f238c102a80 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.826+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 msgr2=0x7f23740b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.826+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 0x7f23740b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f237c005e10 tx=0x7f237c005da0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.826+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 msgr2=0x7f238c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.826+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f238000d950 tx=0x7f238000de10 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 shutdown_connections 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f238c103440 0x7f238c104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f238c102a80 0x7f238c103f50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f23740b5250 0x7f23740b7710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 --2- 172.21.15.67:0/2168421953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f238c101920 0x7f238c1056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 >> 172.21.15.67:0/2168421953 conn(0x7f238c0fd210 msgr2=0x7f238c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:15.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 shutdown_connections 2024-09-10T20:43:15.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:15.827+0000 7f2392798640 1 -- 172.21.15.67:0/2168421953 wait complete. 2024-09-10T20:43:15.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T20:43:15.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T20:43:15.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:15.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/896502363' entity='client.admin' 2024-09-10T20:43:15.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/165709490' entity='client.admin' 2024-09-10T20:43:15.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/493896582' entity='client.admin' 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: mgrmap e15: x(active, since 67s), standbys: z, y 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/896502363' entity='client.admin' 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/165709490' entity='client.admin' 2024-09-10T20:43:16.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/493896582' entity='client.admin' 2024-09-10T20:43:17.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:16 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2168421953' entity='client.admin' 2024-09-10T20:43:17.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:16 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2168421953' entity='client.admin' 2024-09-10T20:43:17.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:16 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2168421953' entity='client.admin' 2024-09-10T20:43:18.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:17 smithi083 ceph-mon[35058]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:18.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:17 smithi172 ceph-mon[35265]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:18.248 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:17 smithi067 ceph-mon[30891]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:18.284 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.885+0000 7ff79055a640 1 -- 172.21.15.67:0/790998052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 msgr2=0x7ff788105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.885+0000 7ff79055a640 1 --2- 172.21.15.67:0/790998052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788105620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff784009900 tx=0x7ff78402a410 comp rx=0 tx=0).stop 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 -- 172.21.15.67:0/790998052 shutdown_connections 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 --2- 172.21.15.67:0/790998052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788108760 0x7ff78810ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 --2- 172.21.15.67:0/790998052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788105bb0 0x7ff788108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:18.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 --2- 172.21.15.67:0/790998052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788105620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 -- 172.21.15.67:0/790998052 >> 172.21.15.67:0/790998052 conn(0x7ff7880fd210 msgr2=0x7ff7880ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 -- 172.21.15.67:0/790998052 shutdown_connections 2024-09-10T20:43:18.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 -- 172.21.15.67:0/790998052 wait complete. 2024-09-10T20:43:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.886+0000 7ff79055a640 1 Processor -- start 2024-09-10T20:43:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 -- start start 2024-09-10T20:43:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788105bb0 0x7ff788199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:18.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788108760 0x7ff788199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810e5f0 con 0x7ff78806c0c0 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810e470 con 0x7ff788108760 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff79055a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff78810e770 con 0x7ff788105bb0 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56726/0 (socket says 172.21.15.67:56726) 2024-09-10T20:43:18.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 -- 172.21.15.67:0/293465988 learned_addr learned my addr 172.21.15.67:0/293465988 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78eaf7640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788108760 0x7ff788199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78daf5640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788105bb0 0x7ff788199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 -- 172.21.15.67:0/293465988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788105bb0 msgr2=0x7ff788199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788105bb0 0x7ff788199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 -- 172.21.15.67:0/293465988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788108760 msgr2=0x7ff788199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:18.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788108760 0x7ff788199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 -- 172.21.15.67:0/293465988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78819a850 con 0x7ff78806c0c0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.887+0000 7ff78e2f6640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff784005ab0 tx=0x7ff784003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.888+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78403f070 con 0x7ff78806c0c0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.888+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78819aae0 con 0x7ff78806c0c0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.888+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff784031d80 con 0x7ff78806c0c0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.888+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784035030 con 0x7ff78806c0c0 2024-09-10T20:43:18.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.888+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881a1050 con 0x7ff78806c0c0 2024-09-10T20:43:18.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.889+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff788106010 con 0x7ff78806c0c0 2024-09-10T20:43:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.890+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7ff78403b560 con 0x7ff78806c0c0 2024-09-10T20:43:18.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.891+0000 7ff77f7fe640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 0x7ff7740b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:18.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.891+0000 7ff78daf5640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 0x7ff7740b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:18.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.891+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff784105170 con 0x7ff78806c0c0 2024-09-10T20:43:18.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.891+0000 7ff78daf5640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 0x7ff7740b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7780058c0 tx=0x7ff77800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:18.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:18.894+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff7840cdd00 con 0x7ff78806c0c0 2024-09-10T20:43:19.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.085+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff78802e5c0 con 0x7ff78806c0c0 2024-09-10T20:43:19.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.090+0000 7ff77f7fe640 1 -- 172.21.15.67:0/293465988 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7ff7840cd600 con 0x7ff78806c0c0 2024-09-10T20:43:19.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 msgr2=0x7ff7740b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 0x7ff7740b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7780058c0 tx=0x7ff77800a4c0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 msgr2=0x7ff788198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff784005ab0 tx=0x7ff784003cd0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 shutdown_connections 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff788108760 0x7ff788199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7740b5250 0x7ff7740b7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff788105bb0 0x7ff788199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 --2- 172.21.15.67:0/293465988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff78806c0c0 0x7ff788198d20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 >> 172.21.15.67:0/293465988 conn(0x7ff7880fd210 msgr2=0x7ff788103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 shutdown_connections 2024-09-10T20:43:19.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:19.093+0000 7ff79055a640 1 -- 172.21.15.67:0/293465988 wait complete. 2024-09-10T20:43:20.279 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:20 smithi067 ceph-mon[30891]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:20.279 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:20 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/293465988' entity='client.admin' 2024-09-10T20:43:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:20 smithi083 ceph-mon[35058]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:20 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/293465988' entity='client.admin' 2024-09-10T20:43:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:20 smithi172 ceph-mon[35265]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:20 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/293465988' entity='client.admin' 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 -- 172.21.15.67:0/1618659287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8102a40 msgr2=0x7f76f8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 --2- 172.21.15.67:0/1618659287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8102a40 0x7f76f8102e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009930 tx=0x7f76e802a420 comp rx=0 tx=0).stop 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 -- 172.21.15.67:0/1618659287 shutdown_connections 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 --2- 172.21.15.67:0/1618659287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8104560 0x7f76f810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 --2- 172.21.15.67:0/1618659287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8103ba0 0x7f76f8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:21.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 --2- 172.21.15.67:0/1618659287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8102a40 0x7f76f8102e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 -- 172.21.15.67:0/1618659287 >> 172.21.15.67:0/1618659287 conn(0x7f76f80fe2f0 msgr2=0x7f76f8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 -- 172.21.15.67:0/1618659287 shutdown_connections 2024-09-10T20:43:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.826+0000 7f76fe78b640 1 -- 172.21.15.67:0/1618659287 wait complete. 2024-09-10T20:43:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 Processor -- start 2024-09-10T20:43:21.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 -- start start 2024-09-10T20:43:21.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 0x7f76f819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8104560 0x7f76f819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76f810e5d0 con 0x7f76f8103ba0 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76f810e450 con 0x7f76f8104560 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.827+0000 7f76fe78b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76f810e750 con 0x7f76f8102a40 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 0x7f76f819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56744/0 (socket says 172.21.15.67:56744) 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 -- 172.21.15.67:0/3744219194 learned_addr learned my addr 172.21.15.67:0/3744219194 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76fcd28640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8104560 0x7f76f819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 -- 172.21.15.67:0/3744219194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 msgr2=0x7f76f819af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 0x7f76f819af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:21.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 -- 172.21.15.67:0/3744219194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8104560 msgr2=0x7f76f819c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8104560 0x7f76f819c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 -- 172.21.15.67:0/3744219194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f819ca80 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f7fff640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 0x7f76f819af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f77fe640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d950 tx=0x7f76ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec017070 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f76ec009c30 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00f620 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.828+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f819cd70 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.829+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f81a3450 con 0x7f76f8103ba0 2024-09-10T20:43:21.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.830+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f8102e40 con 0x7f76f8103ba0 2024-09-10T20:43:21.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.832+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f76ec010460 con 0x7f76f8103ba0 2024-09-10T20:43:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.833+0000 7f76f57fa640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 0x7f76e00b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.833+0000 7f76f7fff640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 0x7f76e00b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.833+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f76ec0e3990 con 0x7f76f8103ba0 2024-09-10T20:43:21.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.833+0000 7f76f7fff640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 0x7f76e00b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005ab0 tx=0x7f76e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:21.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:21.836+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76ec009de0 con 0x7f76f8103ba0 2024-09-10T20:43:22.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.029+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f76f81a3620 con 0x7f76f8103ba0 2024-09-10T20:43:22.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.032+0000 7f76f57fa640 1 -- 172.21.15.67:0/3744219194 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f76ec0abf50 con 0x7f76f8103ba0 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 msgr2=0x7f76e00b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 0x7f76e00b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76e8005ab0 tx=0x7f76e8005a20 comp rx=0 tx=0).stop 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 msgr2=0x7f76f819b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d950 tx=0x7f76ec00de10 comp rx=0 tx=0).stop 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 shutdown_connections 2024-09-10T20:43:22.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f8104560 0x7f76f819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f8103ba0 0x7f76f819b5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76e00b52d0 0x7f76e00b7790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 --2- 172.21.15.67:0/3744219194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f8102a40 0x7f76f819af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 >> 172.21.15.67:0/3744219194 conn(0x7f76f80fe2f0 msgr2=0x7f76f8109330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 shutdown_connections 2024-09-10T20:43:22.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.035+0000 7f76fe78b640 1 -- 172.21.15.67:0/3744219194 wait complete. 2024-09-10T20:43:22.283 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:22 smithi067 ceph-mon[30891]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:22.283 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:22 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3744219194' entity='client.admin' 2024-09-10T20:43:22.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:22 smithi083 ceph-mon[35058]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:22.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:22 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3744219194' entity='client.admin' 2024-09-10T20:43:22.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:22 smithi172 ceph-mon[35265]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:22.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:22 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3744219194' entity='client.admin' 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 -- 172.21.15.67:0/439268246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb94108730 msgr2=0x7fbb9410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/439268246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb94108730 0x7fbb9410abf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009ca0 tx=0x7fbb8c02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 -- 172.21.15.67:0/439268246 shutdown_connections 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/439268246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb94108730 0x7fbb9410abf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/439268246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94105b80 0x7fbb94107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/439268246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb9406b6e0 0x7fbb941055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 -- 172.21.15.67:0/439268246 >> 172.21.15.67:0/439268246 conn(0x7fbb940fd1e0 msgr2=0x7fbb940ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 -- 172.21.15.67:0/439268246 shutdown_connections 2024-09-10T20:43:23.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 -- 172.21.15.67:0/439268246 wait complete. 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.472+0000 7fbb9a89b640 1 Processor -- start 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 -- start start 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 0x7fbb94101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94108730 0x7fbb94101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9410e570 con 0x7fbb9406b6e0 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9410e3f0 con 0x7fbb94105b80 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb9a89b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9410e6f0 con 0x7fbb94108730 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:23.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56050/0 (socket says 172.21.15.67:56050) 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 -- 172.21.15.67:0/80888132 learned_addr learned my addr 172.21.15.67:0/80888132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb98e38640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94108730 0x7fbb94101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb937fe640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 0x7fbb94101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 -- 172.21.15.67:0/80888132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94108730 msgr2=0x7fbb94101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94108730 0x7fbb94101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 -- 172.21.15.67:0/80888132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 msgr2=0x7fbb94101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 0x7fbb94101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb93fff640 1 -- 172.21.15.67:0/80888132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb94102390 con 0x7fbb9406b6e0 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.473+0000 7fbb937fe640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 0x7fbb94101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb93fff640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d950 tx=0x7fbb8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:23.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84017070 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbb84009c30 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb941a2d90 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400f620 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.474+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb941a31e0 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.475+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb94105fe0 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.477+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fbb84005030 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.478+0000 7fbb917fa640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 0x7fbb7c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.478+0000 7fbb937fe640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 0x7fbb7c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.478+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbb840e3ad0 con 0x7fbb9406b6e0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.478+0000 7fbb937fe640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 0x7fbb7c0b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406bb90 tx=0x7fbb88005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:23.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.481+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbb840ac660 con 0x7fbb9406b6e0 2024-09-10T20:43:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.669+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fbb94063d50 con 0x7fbb9406b6e0 2024-09-10T20:43:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.674+0000 7fbb917fa640 1 -- 172.21.15.67:0/80888132 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7fbb84009de0 con 0x7fbb9406b6e0 2024-09-10T20:43:23.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 msgr2=0x7fbb7c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:23.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 0x7fbb7c0b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406bb90 tx=0x7fbb88005e50 comp rx=0 tx=0).stop 2024-09-10T20:43:23.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 msgr2=0x7fbb94102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:23.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d950 tx=0x7fbb8400de10 comp rx=0 tx=0).stop 2024-09-10T20:43:23.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 shutdown_connections 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbb7c0b5250 0x7fbb7c0b7710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb94108730 0x7fbb94101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb94105b80 0x7fbb94101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 --2- 172.21.15.67:0/80888132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb9406b6e0 0x7fbb94102d20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 >> 172.21.15.67:0/80888132 conn(0x7fbb940fd1e0 msgr2=0x7fbb94103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 shutdown_connections 2024-09-10T20:43:23.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:23.677+0000 7fbb9a89b640 1 -- 172.21.15.67:0/80888132 wait complete. 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1515539742' entity='client.admin' 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:23.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1515539742' entity='client.admin' 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:23.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:23.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1515539742' entity='client.admin' 2024-09-10T20:43:23.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:23.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:23.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:23.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:23.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:23.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 -- 172.21.15.67:0/3613025762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18101910 msgr2=0x7fbd18101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:24.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 --2- 172.21.15.67:0/3613025762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18101910 0x7fbd18101d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009930 tx=0x7fbd1402a420 comp rx=0 tx=0).stop 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 -- 172.21.15.67:0/3613025762 shutdown_connections 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 --2- 172.21.15.67:0/3613025762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 --2- 172.21.15.67:0/3613025762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18102a70 0x7fbd18102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 --2- 172.21.15.67:0/3613025762 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18101910 0x7fbd18101d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 -- 172.21.15.67:0/3613025762 >> 172.21.15.67:0/3613025762 conn(0x7fbd180fd1e0 msgr2=0x7fbd180ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 -- 172.21.15.67:0/3613025762 shutdown_connections 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 -- 172.21.15.67:0/3613025762 wait complete. 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.365+0000 7fbd20412640 1 Processor -- start 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 -- start start 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18101910 0x7fbd181056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:24.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1810d580 con 0x7fbd18102a70 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1810d400 con 0x7fbd18101910 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd20412640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1810d700 con 0x7fbd18103430 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56034/0 (socket says 172.21.15.67:56034) 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 -- 172.21.15.67:0/1515539742 learned_addr learned my addr 172.21.15.67:0/1515539742 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1e1ae640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18101910 0x7fbd181056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1e9af640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 -- 172.21.15.67:0/1515539742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 msgr2=0x7fbd18104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 -- 172.21.15.67:0/1515539742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18101910 msgr2=0x7fbd181056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18101910 0x7fbd181056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 -- 172.21.15.67:0/1515539742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd18104d40 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1e9af640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.366+0000 7fbd1d9ad640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800b4a0 tx=0x7fbd0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.367+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08014070 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.367+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbd08010aa0 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.367+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd181a2f90 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.367+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08017b80 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.367+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd181a34c0 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.368+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd18101d90 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.369+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fbd08010610 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.370+0000 7fbd0f7fe640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 0x7fbd040b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.371+0000 7fbd1e1ae640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 0x7fbd040b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.371+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbd080e3810 con 0x7fbd18102a70 2024-09-10T20:43:24.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.371+0000 7fbd1e1ae640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 0x7fbd040b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005ab0 tx=0x7fbd14005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.373+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd080ac300 con 0x7fbd18102a70 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.566+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fbd181a3870 con 0x7fbd18102a70 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.572+0000 7fbd0f7fe640 1 -- 172.21.15.67:0/1515539742 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7fbd080abc00 con 0x7fbd18102a70 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 msgr2=0x7fbd040b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 0x7fbd040b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd14005ab0 tx=0x7fbd14005a20 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 msgr2=0x7fbd18103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800b4a0 tx=0x7fbd0800b960 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 shutdown_connections 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd040b5250 0x7fbd040b7710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.574+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd18103430 0x7fbd18104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.575+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd18102a70 0x7fbd18103f40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.575+0000 7fbd20412640 1 --2- 172.21.15.67:0/1515539742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd18101910 0x7fbd181056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:24.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.575+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 >> 172.21.15.67:0/1515539742 conn(0x7fbd180fd1e0 msgr2=0x7fbd180fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.575+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 shutdown_connections 2024-09-10T20:43:24.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:22.575+0000 7fbd20412640 1 -- 172.21.15.67:0/1515539742 wait complete. 2024-09-10T20:43:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:24 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/80888132' entity='client.admin' 2024-09-10T20:43:24.950 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:24 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/80888132' entity='client.admin' 2024-09-10T20:43:25.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:24 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/80888132' entity='client.admin' 2024-09-10T20:43:25.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- 172.21.15.67:0/2320059827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac101910 msgr2=0x7ffbac101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 --2- 172.21.15.67:0/2320059827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac101910 0x7ffbac101d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009930 tx=0x7ffb9c02a420 comp rx=0 tx=0).stop 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- 172.21.15.67:0/2320059827 shutdown_connections 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 --2- 172.21.15.67:0/2320059827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac103430 0x7ffbac109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 --2- 172.21.15.67:0/2320059827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac102a70 0x7ffbac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 --2- 172.21.15.67:0/2320059827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac101910 0x7ffbac101d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- 172.21.15.67:0/2320059827 >> 172.21.15.67:0/2320059827 conn(0x7ffbac0fd1e0 msgr2=0x7ffbac0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- 172.21.15.67:0/2320059827 shutdown_connections 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- 172.21.15.67:0/2320059827 wait complete. 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 Processor -- start 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.501+0000 7ffbb2324640 1 -- start start 2024-09-10T20:43:25.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 0x7ffbac10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 0x7ffbac10af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac10e5a0 con 0x7ffbac102a70 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac10e420 con 0x7ffbac101910 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb2324640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac10e720 con 0x7ffbac103430 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56064/0 (socket says 172.21.15.67:56064) 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 -- 172.21.15.67:0/3250460332 learned_addr learned my addr 172.21.15.67:0/3250460332 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbabfff640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 0x7ffbac10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb08c1640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 0x7ffbac10af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 -- 172.21.15.67:0/3250460332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 msgr2=0x7ffbac10af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 0x7ffbac10af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 -- 172.21.15.67:0/3250460332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 msgr2=0x7ffbac10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 0x7ffbac10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 -- 172.21.15.67:0/3250460332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac10b800 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbabfff640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 0x7ffbac10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbb08c1640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 0x7ffbac10af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.502+0000 7ffbab7fe640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba000d770 tx=0x7ffba000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.503+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0017070 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.503+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffba00054b0 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.503+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac1a2e90 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.503+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba0004c70 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.503+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac1a32f0 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.504+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac101d10 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.505+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7ffba0004e10 con 0x7ffbac102a70 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.506+0000 7ffba97fa640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 0x7ffb940b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:25.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.506+0000 7ffbabfff640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 0x7ffb940b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:25.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.506+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffba00e3a10 con 0x7ffbac102a70 2024-09-10T20:43:25.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.507+0000 7ffbabfff640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 0x7ffb940b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000c00 tx=0x7ffb9c005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:25.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.510+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffba00ac5a0 con 0x7ffbac102a70 2024-09-10T20:43:25.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.704+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ffbac063d50 con 0x7ffbac102a70 2024-09-10T20:43:25.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.709+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 123+0+0 (secure 0 0 0) 0x7ffba00abea0 con 0x7ffbac102a70 2024-09-10T20:43:25.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.710+0000 7ffba97fa640 1 -- 172.21.15.67:0/3250460332 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba00e9080 con 0x7ffbac102a70 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.711+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 msgr2=0x7ffb940b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.711+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 0x7ffb940b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c000c00 tx=0x7ffb9c005720 comp rx=0 tx=0).stop 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.711+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 msgr2=0x7ffbac10aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.711+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba000d770 tx=0x7ffba000dc30 comp rx=0 tx=0).stop 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 shutdown_connections 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b5250 0x7ffb940b7710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac103430 0x7ffbac10af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac102a70 0x7ffbac10aa00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 --2- 172.21.15.67:0/3250460332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac101910 0x7ffbac10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:25.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 >> 172.21.15.67:0/3250460332 conn(0x7ffbac0fd1e0 msgr2=0x7ffbac105f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:25.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 shutdown_connections 2024-09-10T20:43:25.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:25.712+0000 7ffbb2324640 1 -- 172.21.15.67:0/3250460332 wait complete. 2024-09-10T20:43:25.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:25 smithi172 ceph-mon[35265]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:25.998 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:25 smithi067 ceph-mon[30891]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:26.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:25 smithi083 ceph-mon[35058]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:26.951 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.951 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.951 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.951 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.951 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.952 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.953 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd92bf05e-6fb4-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi067') 2024-09-10T20:43:26.954 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T20:43:26.954 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:43:26.954 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:43:26.972 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:43:26.972 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-10T20:43:27.029 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-10 20:42:21.504322399 +0000 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-10 20:37:17.676885125 +0000 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-10 20:37:17.676885125 +0000 2024-09-10T20:43:27.030 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-10 20:37:17.676885125 +0000 2024-09-10T20:43:27.030 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:43:27.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:26 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3250460332' entity='client.admin' 2024-09-10T20:43:27.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-10T20:43:27.071 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-10T20:43:27.072 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000200888 s, 2.5 MB/s 2024-09-10T20:43:27.073 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:43:27.130 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-10T20:43:27.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:26 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3250460332' entity='client.admin' 2024-09-10T20:43:27.187 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:43:27.187 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.187 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-10T20:43:27.187 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.188 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.188 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-10 20:42:21.539321662 +0000 2024-09-10T20:43:27.188 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-10 20:37:18.020877839 +0000 2024-09-10T20:43:27.188 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-10 20:37:18.020877839 +0000 2024-09-10T20:43:27.188 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-10 20:37:18.020877839 +0000 2024-09-10T20:43:27.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:43:27.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:26 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3250460332' entity='client.admin' 2024-09-10T20:43:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-10T20:43:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-10T20:43:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000229137 s, 2.2 MB/s 2024-09-10T20:43:27.254 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:43:27.312 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-10T20:43:27.368 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 709 Links: 1 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-10 20:42:21.573320947 +0000 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-10 20:37:18.372870383 +0000 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-10 20:37:18.372870383 +0000 2024-09-10T20:43:27.369 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-10 20:37:18.372870383 +0000 2024-09-10T20:43:27.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:43:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-10T20:43:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-10T20:43:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000205337 s, 2.5 MB/s 2024-09-10T20:43:27.434 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:43:27.491 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-10T20:43:27.547 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:43:27.547 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-10 20:42:21.609320190 +0000 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-10 20:37:18.713863159 +0000 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-10 20:37:18.713863159 +0000 2024-09-10T20:43:27.548 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-10 20:37:18.713863159 +0000 2024-09-10T20:43:27.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:43:27.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-10T20:43:27.612 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-10T20:43:27.612 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225981 s, 2.3 MB/s 2024-09-10T20:43:27.614 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:43:27.670 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-10T20:43:27.670 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:43:27.690 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:43:27.690 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-10 20:43:08.697188797 +0000 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-10 20:37:28.376001130 +0000 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-10 20:37:28.376001130 +0000 2024-09-10T20:43:27.749 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-10 20:37:28.376001130 +0000 2024-09-10T20:43:27.750 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:43:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-10T20:43:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-10T20:43:27.820 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000287366 s, 1.8 MB/s 2024-09-10T20:43:27.821 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:43:27.879 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-09-10T20:43:27.937 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:43:27.937 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-10 20:43:08.697188797 +0000 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-10 20:37:28.726992831 +0000 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-10 20:37:28.726992831 +0000 2024-09-10T20:43:27.938 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-10 20:37:28.726992831 +0000 2024-09-10T20:43:27.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:43:28.001 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:27 smithi083 ceph-mon[35058]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-10T20:43:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-10T20:43:28.004 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000226068 s, 2.3 MB/s 2024-09-10T20:43:28.005 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:43:28.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:27 smithi067 ceph-mon[30891]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:28.062 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-09-10T20:43:28.119 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:43:28.119 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:28.119 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-10 20:43:08.697188797 +0000 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-10 20:37:29.045985288 +0000 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-10 20:37:29.045985288 +0000 2024-09-10T20:43:28.120 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-10 20:37:29.045985288 +0000 2024-09-10T20:43:28.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:43:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-10T20:43:28.187 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-10T20:43:28.188 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000217229 s, 2.4 MB/s 2024-09-10T20:43:28.189 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:43:28.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:27 smithi172 ceph-mon[35265]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:28.250 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-09-10T20:43:28.309 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:43:28.309 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-10 20:43:08.698188773 +0000 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-10 20:37:29.381977343 +0000 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-10 20:37:29.381977343 +0000 2024-09-10T20:43:28.310 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-10 20:37:29.381977343 +0000 2024-09-10T20:43:28.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:43:28.376 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-10T20:43:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-10T20:43:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000200533 s, 2.6 MB/s 2024-09-10T20:43:28.378 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:43:28.435 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-10T20:43:28.435 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:43:28.455 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:43:28.455 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-10 20:43:06.375000268 +0000 2024-09-10T20:43:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-10 20:37:31.115586358 +0000 2024-09-10T20:43:28.516 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-10 20:37:31.115586358 +0000 2024-09-10T20:43:28.516 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-10 20:37:31.115586358 +0000 2024-09-10T20:43:28.516 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:43:28.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-10T20:43:28.587 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-10T20:43:28.587 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000232777 s, 2.2 MB/s 2024-09-10T20:43:28.588 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:43:28.647 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-10 20:43:06.375000268 +0000 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-10 20:37:31.455578320 +0000 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-10 20:37:31.455578320 +0000 2024-09-10T20:43:28.705 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-10 20:37:31.455578320 +0000 2024-09-10T20:43:28.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:43:28.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-10T20:43:28.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-10T20:43:28.771 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000206438 s, 2.5 MB/s 2024-09-10T20:43:28.772 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:43:28.829 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-10T20:43:28.886 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:43:28.886 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:28.886 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T20:43:28.886 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:28.886 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:28.887 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-10 20:43:06.376000245 +0000 2024-09-10T20:43:28.887 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-10 20:37:31.793570328 +0000 2024-09-10T20:43:28.887 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-10 20:37:31.793570328 +0000 2024-09-10T20:43:28.887 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-10 20:37:31.793570328 +0000 2024-09-10T20:43:28.888 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:43:28.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-10T20:43:28.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-10T20:43:28.952 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000196846 s, 2.6 MB/s 2024-09-10T20:43:28.953 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:43:29.010 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-10 20:43:06.376000245 +0000 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-10 20:37:32.110562833 +0000 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-10 20:37:32.110562833 +0000 2024-09-10T20:43:29.067 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-10 20:37:32.110562833 +0000 2024-09-10T20:43:29.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:43:29.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-10T20:43:29.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-10T20:43:29.131 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000215751 s, 2.4 MB/s 2024-09-10T20:43:29.132 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:43:29.189 INFO:tasks.cephadm:Deploying osd.0 on smithi067 with /dev/vg_nvme/lv_4... 2024-09-10T20:43:29.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T20:43:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:29.874 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:29 smithi067 ceph-mon[30891]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:30.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:29 smithi083 ceph-mon[35058]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:30.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:29 smithi172 ceph-mon[35265]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:31.926 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:31 smithi067 ceph-mon[30891]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:31.930 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:43:31.956 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2024-09-10T20:43:32.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:31 smithi083 ceph-mon[35058]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:32.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:31 smithi172 ceph-mon[35265]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- 172.21.15.67:0/2772579754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20103430 msgr2=0x7fda20109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 --2- 172.21.15.67:0/2772579754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20103430 0x7fda20109db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda18009cd0 tx=0x7fda1802a8f0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- 172.21.15.67:0/2772579754 shutdown_connections 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 --2- 172.21.15.67:0/2772579754 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20103430 0x7fda20109db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 --2- 172.21.15.67:0/2772579754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20102a70 0x7fda20102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 --2- 172.21.15.67:0/2772579754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20101910 0x7fda20101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- 172.21.15.67:0/2772579754 >> 172.21.15.67:0/2772579754 conn(0x7fda200fd1e0 msgr2=0x7fda200ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- 172.21.15.67:0/2772579754 shutdown_connections 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- 172.21.15.67:0/2772579754 wait complete. 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 Processor -- start 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.619+0000 7fda267d7640 1 -- start start 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20101910 0x7fda20198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20103430 0x7fda20199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fda2010e720 con 0x7fda20102a70 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fda2010e5a0 con 0x7fda20101910 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda267d7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda2010e8a0 con 0x7fda20103430 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51208/0 (socket says 172.21.15.67:51208) 2024-09-10T20:43:32.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 -- 172.21.15.67:0/44962779 learned_addr learned my addr 172.21.15.67:0/44962779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda24d74640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20103430 0x7fda20199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1ffff640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20101910 0x7fda20198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 -- 172.21.15.67:0/44962779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20103430 msgr2=0x7fda20199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20103430 0x7fda20199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 -- 172.21.15.67:0/44962779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20101910 msgr2=0x7fda20198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20101910 0x7fda20198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 -- 172.21.15.67:0/44962779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2019a830 con 0x7fda20102a70 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.620+0000 7fda1f7fe640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c920 tx=0x7fda1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.621+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14007c70 con 0x7fda20102a70 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.621+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda14007e10 con 0x7fda20102a70 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.621+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14018820 con 0x7fda20102a70 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.621+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2019ab20 con 0x7fda20102a70 2024-09-10T20:43:32.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.621+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda201a1200 con 0x7fda20102a70 2024-09-10T20:43:32.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.622+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda20108ba0 con 0x7fda20102a70 2024-09-10T20:43:32.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.623+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fda1400f450 con 0x7fda20102a70 2024-09-10T20:43:32.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.624+0000 7fda1d7fa640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 0x7fda080b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:32.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.624+0000 7fda1ffff640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 0x7fda080b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:32.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.624+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fda140e41f0 con 0x7fda20102a70 2024-09-10T20:43:32.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.624+0000 7fda1ffff640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 0x7fda080b7710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda100058c0 tx=0x7fda1000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:32.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.627+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda14014030 con 0x7fda20102a70 2024-09-10T20:43:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:32.824+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fda20063590 con 0x7fda080b5250 2024-09-10T20:43:33.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:33 smithi067 ceph-mon[30891]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:33 smithi067 ceph-mon[30891]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:34.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:33 smithi083 ceph-mon[35058]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:34.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:33 smithi083 ceph-mon[35058]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:34.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:34.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:34.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:34.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:33 smithi172 ceph-mon[35265]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:34.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:33 smithi172 ceph-mon[35265]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:34.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:34.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:34.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"} : dispatch 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"}]': finished 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:36.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1206254326' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"} : dispatch 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"}]': finished 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:36.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1206254326' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:43:36.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:36.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"} : dispatch 2024-09-10T20:43:36.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/679035188' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccf7e4d5-d677-4722-8ca8-ce5156a1d333"}]': finished 2024-09-10T20:43:36.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T20:43:36.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:36.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1206254326' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:43:38.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:37 smithi067 ceph-mon[30891]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:38.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:37 smithi083 ceph-mon[35058]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:38.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:37 smithi172 ceph-mon[35265]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:40.032 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:39 smithi067 ceph-mon[30891]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:40.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:39 smithi083 ceph-mon[35058]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:40.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:39 smithi172 ceph-mon[35265]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:42.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:41 smithi067 ceph-mon[30891]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:41 smithi083 ceph-mon[35058]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:42.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:41 smithi172 ceph-mon[35265]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:43 smithi067 ceph-mon[30891]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:43.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T20:43:43.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:43 smithi083 ceph-mon[35058]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T20:43:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:43 smithi172 ceph-mon[35265]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T20:43:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:45.001 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:44 smithi067 ceph-mon[30891]: Deploying daemon osd.0 on smithi067 2024-09-10T20:43:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:44 smithi083 ceph-mon[35058]: Deploying daemon osd.0 on smithi067 2024-09-10T20:43:45.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:44 smithi172 ceph-mon[35265]: Deploying daemon osd.0 on smithi067 2024-09-10T20:43:45.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:45 smithi067 ceph-mon[30891]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:45 smithi083 ceph-mon[35058]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:45 smithi172 ceph-mon[35265]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:48.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:47 smithi067 ceph-mon[30891]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:48.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:47 smithi083 ceph-mon[35058]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:47 smithi172 ceph-mon[35265]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:49.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:49 smithi067 ceph-mon[30891]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:50.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:49 smithi083 ceph-mon[35058]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:50.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:49 smithi172 ceph-mon[35265]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:51.042 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:51.042 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:51.043 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:51.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:51.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:51.101 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:51 smithi172 ceph-mon[35265]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:52.253 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:51 smithi067 ceph-mon[30891]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:51 smithi083 ceph-mon[35058]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:53.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:53.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.806 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:53.806 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:53.806 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:53.806 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.108+0000 7fda1d7fa640 1 -- 172.21.15.67:0/44962779 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fda20063590 con 0x7fda080b5250 2024-09-10T20:43:54.113 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 0 on host 'smithi067' 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.110+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 msgr2=0x7fda080b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.110+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 0x7fda080b7710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda100058c0 tx=0x7fda1000a2d0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.110+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 msgr2=0x7fda20199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.110+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c920 tx=0x7fda1400cde0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 shutdown_connections 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fda080b5250 0x7fda080b7710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda20103430 0x7fda20199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fda20102a70 0x7fda20199350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 --2- 172.21.15.67:0/44962779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda20101910 0x7fda20198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 >> 172.21.15.67:0/44962779 conn(0x7fda200fd1e0 msgr2=0x7fda20105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 shutdown_connections 2024-09-10T20:43:54.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:43:54.111+0000 7fda267d7640 1 -- 172.21.15.67:0/44962779 wait complete. 2024-09-10T20:43:54.458 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:54 smithi067 ceph-mon[30891]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:54.459 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:54 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:54.459 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:54 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.459 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:54 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:54 smithi083 ceph-mon[35058]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:54 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:54 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:54 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:54 smithi172 ceph-mon[35265]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:54 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:43:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:54 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:54 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:54.829 DEBUG:teuthology.orchestra.run.smithi067:osd.0> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T20:43:54.831 INFO:tasks.cephadm:Deploying osd.1 on smithi083 with /dev/vg_nvme/lv_4... 2024-09-10T20:43:54.831 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T20:43:55.082 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:43:56.131 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:43:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T20:43:55.907+0000 7f839aeb3640 -1 osd.0 0 log_to_monitors true 2024-09-10T20:43:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:56 smithi083 ceph-mon[35058]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:56 smithi083 ceph-mon[35058]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T20:43:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:56 smithi067 ceph-mon[30891]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:56 smithi067 ceph-mon[30891]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T20:43:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:56 smithi172 ceph-mon[35265]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:56 smithi172 ceph-mon[35265]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T20:43:57.491 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:57 smithi083 ceph-mon[35058]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T20:43:57.491 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:57 smithi083 ceph-mon[35058]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T20:43:57.491 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:57 smithi083 ceph-mon[35058]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:43:57.492 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:57.492 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:57 smithi083 ceph-mon[35058]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:43:57.494 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:43:57.503 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T20:43:57.328+0000 7f8396e36640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T20:43:57.503 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T20:43:57.332+0000 7f8392c5d640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:43:57.504 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-mon[30891]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T20:43:57.504 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-mon[30891]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T20:43:57.504 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-mon[30891]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:43:57.504 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:57.504 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:57 smithi067 ceph-mon[30891]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:43:57.520 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_4 2024-09-10T20:43:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:57 smithi172 ceph-mon[35265]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T20:43:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:57 smithi172 ceph-mon[35265]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T20:43:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:57 smithi172 ceph-mon[35265]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:43:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:57 smithi172 ceph-mon[35265]: from='osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:43:57.778 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:43:58.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 -- 172.21.15.83:0/1276606106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4102a70 msgr2=0x7f88d4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:58.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1276606106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4102a70 0x7f88d4102ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009930 tx=0x7f88bc02a420 comp rx=0 tx=0).stop 2024-09-10T20:43:58.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 -- 172.21.15.83:0/1276606106 shutdown_connections 2024-09-10T20:43:58.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1276606106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:58.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1276606106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4102a70 0x7f88d4102ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1276606106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88d4101910 0x7f88d4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 -- 172.21.15.83:0/1276606106 >> 172.21.15.83:0/1276606106 conn(0x7f88d40fd1e0 msgr2=0x7f88d40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 -- 172.21.15.83:0/1276606106 shutdown_connections 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.202+0000 7f88d9f20640 1 -- 172.21.15.83:0/1276606106 wait complete. 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 Processor -- start 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 -- start start 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88d4102a70 0x7f88d4103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410d590 con 0x7f88d4102a70 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410d410 con 0x7f88d4101910 2024-09-10T20:43:58.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d9f20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410d710 con 0x7f88d4103430 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58434/0 (socket says 172.21.15.83:58434) 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 -- 172.21.15.83:0/1039862097 learned_addr learned my addr 172.21.15.83:0/1039862097 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d3fff640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 -- 172.21.15.83:0/1039862097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 msgr2=0x7f88d4104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 -- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88d4102a70 msgr2=0x7f88d4103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88d4102a70 0x7f88d4103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d37fe640 1 -- 172.21.15.83:0/1039862097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d4104d40 con 0x7f88d4101910 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.203+0000 7f88d3fff640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d37fe640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00eab0 tx=0x7f88cc00ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:58.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00ce40 con 0x7f88d4101910 2024-09-10T20:43:58.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88cc011920 con 0x7f88d4101910 2024-09-10T20:43:58.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d41a2ef0 con 0x7f88d4101910 2024-09-10T20:43:58.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc010a30 con 0x7f88d4101910 2024-09-10T20:43:58.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.204+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d41a32f0 con 0x7f88d4101910 2024-09-10T20:43:58.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.205+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d41a3580 con 0x7f88d4101910 2024-09-10T20:43:58.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.206+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f88cc00f040 con 0x7f88d4101910 2024-09-10T20:43:58.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.207+0000 7f88d0ff9640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 0x7f88c00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:43:58.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.207+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f88cc0e4350 con 0x7f88d4101910 2024-09-10T20:43:58.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.207+0000 7f88d2ffd640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 0x7f88c00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:43:58.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.208+0000 7f88d2ffd640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 0x7f88c00b7710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0096c0 tx=0x7f88bc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:43:58.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.210+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88cc016030 con 0x7f88d4101910 2024-09-10T20:43:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T20:43:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:43:58.409+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f88d40ff390 con 0x7f88c00b5250 2024-09-10T20:43:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:43:58.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:43:58.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi067 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] boot 2024-09-10T20:43:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T20:43:59.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:59.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:59.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:59.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:59.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:43:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi067 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] boot 2024-09-10T20:43:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T20:43:59.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:59.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:59.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:59.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:59.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:43:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:43:59.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi067 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi067 to 17088M 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: osd.0 [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] boot 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:43:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:43:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:00 smithi083 ceph-mon[35058]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:44:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:00 smithi083 ceph-mon[35058]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T20:44:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:00 smithi172 ceph-mon[35265]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:44:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:00 smithi172 ceph-mon[35265]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T20:44:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:00 smithi067 ceph-mon[30891]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T20:44:00.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:00 smithi067 ceph-mon[30891]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T20:44:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/1357622168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"}]': finished 2024-09-10T20:44:01.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T20:44:01.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:01.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:01 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/1560245477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/1357622168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"}]': finished 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:01.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:01 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/1560245477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/1357622168' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"} : dispatch 2024-09-10T20:44:01.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c974252b-1bb0-4ca1-81e7-33a82fe76300"}]': finished 2024-09-10T20:44:01.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T20:44:01.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:01.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:01 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/1560245477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:02 smithi083 ceph-mon[35058]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:02 smithi172 ceph-mon[35265]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:02 smithi067 ceph-mon[30891]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:04 smithi083 ceph-mon[35058]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:04 smithi172 ceph-mon[35265]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:04.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:04 smithi067 ceph-mon[30891]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:06 smithi083 ceph-mon[35058]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:06 smithi172 ceph-mon[35265]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:06 smithi067 ceph-mon[30891]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:08.636 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:08 smithi083 ceph-mon[35058]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:08 smithi172 ceph-mon[35265]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:08.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:08 smithi067 ceph-mon[30891]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:09.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T20:44:09.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:09.697 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T20:44:09.697 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:09.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T20:44:09.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:10 smithi083 ceph-mon[35058]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:10 smithi083 ceph-mon[35058]: Deploying daemon osd.1 on smithi083 2024-09-10T20:44:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:10 smithi172 ceph-mon[35265]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:10 smithi172 ceph-mon[35265]: Deploying daemon osd.1 on smithi083 2024-09-10T20:44:10.713 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:10 smithi067 ceph-mon[30891]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:10.713 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:10 smithi067 ceph-mon[30891]: Deploying daemon osd.1 on smithi083 2024-09-10T20:44:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:12 smithi083 ceph-mon[35058]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:12 smithi172 ceph-mon[35265]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:12 smithi067 ceph-mon[30891]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:14.510 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:14 smithi083 ceph-mon[35058]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:14 smithi172 ceph-mon[35265]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:14.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:14 smithi067 ceph-mon[30891]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:16.509 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:16 smithi083 ceph-mon[35058]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:16.510 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:16.510 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:16.510 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:16 smithi172 ceph-mon[35265]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:16 smithi067 ceph-mon[30891]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:16.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:16.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:18.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:18.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:18.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:18.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:18.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:18.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:18.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:18.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:19.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.843+0000 7f88d0ff9640 1 -- 172.21.15.83:0/1039862097 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f88d40ff390 con 0x7f88c00b5250 2024-09-10T20:44:19.848 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 1 on host 'smithi083' 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 msgr2=0x7f88c00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 0x7f88c00b7710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0096c0 tx=0x7f88bc000bc0 comp rx=0 tx=0).stop 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 msgr2=0x7f88d41056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00eab0 tx=0x7f88cc00ef70 comp rx=0 tx=0).stop 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 shutdown_connections 2024-09-10T20:44:19.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f88c00b5250 0x7f88c00b7710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4103430 0x7f88d4104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88d4102a70 0x7f88d4103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.845+0000 7f88d9f20640 1 --2- 172.21.15.83:0/1039862097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d4101910 0x7f88d41056d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.846+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 >> 172.21.15.83:0/1039862097 conn(0x7f88d40fd1e0 msgr2=0x7f88d40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.846+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 shutdown_connections 2024-09-10T20:44:19.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:44:19.846+0000 7f88d9f20640 1 -- 172.21.15.83:0/1039862097 wait complete. 2024-09-10T20:44:20.478 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:20 smithi083 ceph-mon[35058]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:20.478 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:20.478 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:20.478 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:20.504 DEBUG:teuthology.orchestra.run.smithi083:osd.1> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T20:44:20.506 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-10T20:44:20.506 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T20:44:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:20 smithi172 ceph-mon[35265]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:20.761 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:44:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:20 smithi067 ceph-mon[30891]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:20.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:20.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:20.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:22.141 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:22 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T20:44:22.072+0000 7fe060542640 -1 osd.1 0 log_to_monitors true 2024-09-10T20:44:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:22 smithi083 ceph-mon[35058]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:22 smithi083 ceph-mon[35058]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:22 smithi083 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:22 smithi172 ceph-mon[35265]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:22 smithi172 ceph-mon[35265]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:22 smithi172 ceph-mon[35265]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:22.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:22 smithi067 ceph-mon[30891]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:22.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:22 smithi067 ceph-mon[30891]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:22.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:22 smithi067 ceph-mon[30891]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T20:44:23.031 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:44:23.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-10T20:44:23.304 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:44:23.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T20:44:23.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T20:44:23.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.674 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T20:44:23.674 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T20:44:23.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:23.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.675 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.676 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:23.676 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.676 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:23.676 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:23.676 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 -- 172.21.15.172:0/172799880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4102a30 msgr2=0x7f9ad4102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/172799880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4102a30 0x7f9ad4102e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009960 tx=0x7f9ac402a460 comp rx=0 tx=0).stop 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 -- 172.21.15.172:0/172799880 shutdown_connections 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/172799880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4104550 0x7f9ad410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/172799880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4103b90 0x7f9ad4104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/172799880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4102a30 0x7f9ad4102e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 -- 172.21.15.172:0/172799880 >> 172.21.15.172:0/172799880 conn(0x7f9ad40fe320 msgr2=0x7f9ad4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:44:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 -- 172.21.15.172:0/172799880 shutdown_connections 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.755+0000 7f9adbeb6640 1 -- 172.21.15.172:0/172799880 wait complete. 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 Processor -- start 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 -- start start 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 0x7f9ad4198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e690 con 0x7f9ad4102a30 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e510 con 0x7f9ad4103b90 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9adbeb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad410e810 con 0x7f9ad4104550 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:23.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9451640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9c52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 0x7f9ad4198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9451640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.172:51738/0 (socket says 172.21.15.172:51738) 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9c52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 0x7f9ad4198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.172:33116/0 (socket says 172.21.15.172:33116) 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40242/0 (socket says 172.21.15.172:40242) 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9451640 1 -- 172.21.15.172:0/3202869727 learned_addr learned my addr 172.21.15.172:0/3202869727 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 -- 172.21.15.172:0/3202869727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 msgr2=0x7f9ad41994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 -- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 msgr2=0x7f9ad4198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 0x7f9ad4198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ada453640 1 -- 172.21.15.172:0/3202869727 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad419a980 con 0x7f9ad4104550 2024-09-10T20:44:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.756+0000 7f9ad9451640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9ada453640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00da10 tx=0x7f9acc00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00bd70 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad419ac70 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9acc003e20 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0106c0 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.757+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad41a1350 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.758+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad4109e00 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.759+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f9acc024060 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.760+0000 7f9acaffd640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 0x7f9ac00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.760+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f9acc0e46a0 con 0x7f9ad4104550 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.760+0000 7f9ad9c52640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 0x7f9ac00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.761+0000 7f9ad9c52640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 0x7f9ac00b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac4005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:44:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.764+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9acc0aceb0 con 0x7f9ad4104550 2024-09-10T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T20:44:23.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:23.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:23.952+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9ad4063590 con 0x7f9ac00b5250 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi083 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.585 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:24.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:24.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:24.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:24 smithi172 ceph-mon[35265]: from='osd.1 ' entity='osd.1' 2024-09-10T20:44:24.641 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T20:44:24.308+0000 7fe05c4c5640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T20:44:24.641 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T20:44:24.436+0000 7fe0542e4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi083 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:24.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:24.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:24 smithi083 ceph-mon[35058]: from='osd.1 ' entity='osd.1' 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi083 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:24.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:24 smithi067 ceph-mon[30891]: from='osd.1 ' entity='osd.1' 2024-09-10T20:44:25.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:25 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:44:25.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:25 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:44:25.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:25 smithi172 ceph-mon[35265]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:25.615 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:25 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:25.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:25 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:44:25.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:25 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:44:25.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:25 smithi067 ceph-mon[30891]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:25.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:25 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:25.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:25 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:44:25.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:25 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:44:25.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:25 smithi083 ceph-mon[35058]: from='client.24265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:25.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:25 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] boot 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/3017532639' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"}]': finished 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T20:44:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] boot 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/3017532639' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"}]': finished 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T20:44:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: osd.1 [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] boot 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/3017532639' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"} : dispatch 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84efdf2d-6565-4a34-89a6-8e825e3c1d12"}]': finished 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T20:44:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:27.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:27 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/2251947772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:27 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/2251947772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:27 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/2251947772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:28.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:28 smithi067 ceph-mon[30891]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:28 smithi083 ceph-mon[35058]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:28 smithi172 ceph-mon[35265]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:30 smithi067 ceph-mon[30891]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:30.872 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:30 smithi172 ceph-mon[35265]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:30 smithi083 ceph-mon[35058]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:32.532 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:32 smithi172 ceph-mon[35265]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:32 smithi067 ceph-mon[30891]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:32 smithi083 ceph-mon[35058]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:34 smithi172 ceph-mon[35265]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T20:44:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:34 smithi067 ceph-mon[30891]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T20:44:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:34 smithi083 ceph-mon[35058]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T20:44:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:35.724 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:35 smithi172 ceph-mon[35265]: Deploying daemon osd.2 on smithi172 2024-09-10T20:44:35.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:35 smithi067 ceph-mon[30891]: Deploying daemon osd.2 on smithi172 2024-09-10T20:44:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:35 smithi083 ceph-mon[35058]: Deploying daemon osd.2 on smithi172 2024-09-10T20:44:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:36 smithi172 ceph-mon[35265]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:36 smithi067 ceph-mon[30891]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:36 smithi083 ceph-mon[35058]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:38 smithi067 ceph-mon[30891]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:38 smithi083 ceph-mon[35058]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:38 smithi172 ceph-mon[35265]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:40 smithi172 ceph-mon[35265]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:40.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:40 smithi067 ceph-mon[30891]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:40 smithi083 ceph-mon[35058]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:41.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:41.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:42.568 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:42 smithi172 ceph-mon[35265]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:42.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:42 smithi067 ceph-mon[30891]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:42 smithi083 ceph-mon[35058]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:44.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:44.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:44.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.863+0000 7f9acaffd640 1 -- 172.21.15.172:0/3202869727 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ad4063590 con 0x7f9ac00b5250 2024-09-10T20:44:44.867 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 msgr2=0x7f9ac00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 0x7f9ac00b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac4005d50 comp rx=0 tx=0).stop 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 msgr2=0x7f9ad419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00da10 tx=0x7f9acc00ded0 comp rx=0 tx=0).stop 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 shutdown_connections 2024-09-10T20:44:44.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9ac00b5250 0x7f9ac00b7710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ad4104550 0x7f9ad419a0e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad4103b90 0x7f9ad41994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 --2- 172.21.15.172:0/3202869727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ad4102a30 0x7f9ad4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 >> 172.21.15.172:0/3202869727 conn(0x7f9ad40fe320 msgr2=0x7f9ad4106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 shutdown_connections 2024-09-10T20:44:44.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:44:44.865+0000 7f9adbeb6640 1 -- 172.21.15.172:0/3202869727 wait complete. 2024-09-10T20:44:45.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:45.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:44 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:44 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:45.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:44 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:44 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:44 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:44:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:44 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:44 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:45.464 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T20:44:45.466 INFO:tasks.cephadm:Deploying osd.3 on smithi067 with /dev/vg_nvme/lv_3... 2024-09-10T20:44:45.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T20:44:45.730 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:44:46.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:45 smithi067 ceph-mon[30891]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:45 smithi172 ceph-mon[35265]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:45 smithi083 ceph-mon[35058]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:46.851 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T20:44:46.726+0000 7f256ff78640 -1 osd.2 0 log_to_monitors true 2024-09-10T20:44:47.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:46 smithi067 ceph-mon[30891]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:46 smithi067 ceph-mon[30891]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:46 smithi172 ceph-mon[35265]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:46 smithi172 ceph-mon[35265]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:47.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:46 smithi083 ceph-mon[35058]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:47.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:46 smithi083 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T20:44:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T20:44:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T20:44:48.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:48.135 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:47 smithi172 ceph-mon[35265]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.172 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:48.173 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T20:44:48.173 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.173 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T20:44:48.173 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:48.173 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:47 smithi067 ceph-mon[30891]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.175 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:44:48.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2024-09-10T20:44:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T20:44:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: from='osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T20:44:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:48.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:47 smithi083 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:44:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/1031405297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c406c0a0 msgr2=0x7fe7c4105670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/1031405297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4105670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009900 tx=0x7fe7b402a3f0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/1031405297 shutdown_connections 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/1031405297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c4108740 0x7fe7c410ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/1031405297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 0x7fe7c4108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/1031405297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4105670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/1031405297 >> 172.21.15.67:0/1031405297 conn(0x7fe7c40fd220 msgr2=0x7fe7c40ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/1031405297 shutdown_connections 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.918+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/1031405297 wait complete. 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 Processor -- start 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 -- start start 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 0x7fe7c4101610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.919+0000 7fe7c9ad3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c410e6d0 con 0x7fe7c4108740 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c9ad3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c410e550 con 0x7fe7c4105bb0 2024-09-10T20:44:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c9ad3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c410e850 con 0x7fe7c406c0a0 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52940/0 (socket says 172.21.15.67:52940) 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52394/0 (socket says 172.21.15.67:52394) 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c3fff640 1 -- 172.21.15.67:0/568790787 learned_addr learned my addr 172.21.15.67:0/568790787 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c2ffd640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 0x7fe7c4101610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 -- 172.21.15.67:0/568790787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 msgr2=0x7fe7c4101610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 0x7fe7c4101610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 -- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 msgr2=0x7fe7c4101b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 -- 172.21.15.67:0/568790787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c4102410 con 0x7fe7c406c0a0 2024-09-10T20:44:48.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c3fff640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c37fe640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a9e0 tx=0x7fe7b4003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b403f070 con 0x7fe7c406c0a0 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b403b460 con 0x7fe7c406c0a0 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.920+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4035030 con 0x7fe7c406c0a0 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.921+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c41a2d90 con 0x7fe7c406c0a0 2024-09-10T20:44:48.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.921+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c41a3190 con 0x7fe7c406c0a0 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.922+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c40fed10 con 0x7fe7c406c0a0 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.923+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fe7b40319b0 con 0x7fe7c406c0a0 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.923+0000 7fe7c0ff9640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 0x7fe7ac0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.924+0000 7fe7c2ffd640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 0x7fe7ac0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.924+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fe7b4104fc0 con 0x7fe7c406c0a0 2024-09-10T20:44:48.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.924+0000 7fe7c2ffd640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 0x7fe7ac0b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800abe0 tx=0x7fe7b800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:44:48.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:48.928+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe7b40cd5d0 con 0x7fe7c406c0a0 2024-09-10T20:44:49.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:49.124+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe7c4063590 con 0x7fe7ac0b5250 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi172 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.129 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.130 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:48 smithi067 ceph-mon[30891]: from='osd.2 ' entity='osd.2' 2024-09-10T20:44:49.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T20:44:48.813+0000 7f256befb640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T20:44:49.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T20:44:48.999+0000 7f2563d1a640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:44:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi172 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:48 smithi172 ceph-mon[35265]: from='osd.2 ' entity='osd.2' 2024-09-10T20:44:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:44:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T20:44:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi172 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:49.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:48 smithi083 ceph-mon[35058]: from='osd.2 ' entity='osd.2' 2024-09-10T20:44:50.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:50.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:50.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:44:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:44:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:50.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:44:50.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:44:50.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:44:50.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:44:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:50 smithi067 ceph-mon[30891]: osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] boot 2024-09-10T20:44:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:50 smithi067 ceph-mon[30891]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T20:44:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:50 smithi172 ceph-mon[35265]: osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] boot 2024-09-10T20:44:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:50 smithi172 ceph-mon[35265]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T20:44:51.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:51.292 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:50 smithi083 ceph-mon[35058]: osd.2 [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] boot 2024-09-10T20:44:51.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:50 smithi083 ceph-mon[35058]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T20:44:51.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T20:44:52.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:52.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"} : dispatch 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"}]': finished 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:52.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"} : dispatch 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"}]': finished 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T20:44:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:52.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T20:44:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T20:44:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"} : dispatch 2024-09-10T20:44:52.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:52.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1546038422' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "428aeca1-57f7-4b42-888c-21fbfdbc9c6e"}]': finished 2024-09-10T20:44:52.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T20:44:52.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:52.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51869]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51872]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51872]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.046 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51872]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1585566485' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51875]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51875]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:52 smithi067 sudo[51875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 sudo[51875]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 sudo[51878]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 sudo[51878]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 sudo[51878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 sudo[51878]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43684]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43684]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43684]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43687]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43687]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.142 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 20:44:52 smithi083 sudo[43687]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1585566485' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:52 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43690]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43690]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43690]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43693]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43693]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 sudo[43693]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43861]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43861]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43861]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.199 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43864]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.200 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43864]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.200 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.200 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 20:44:52 smithi172 sudo[43864]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1585566485' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:52 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43867]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T20:44:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43867]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43867]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43870]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43870]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T20:44:53.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 sudo[43870]: pam_unix(sudo:session): session closed for user root 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T20:44:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:53 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:54.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:54.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T20:44:54.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:53 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:54.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T20:44:54.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:53 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:44:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:44:54.994+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe7b4031cd0 con 0x7fe7c406c0a0 2024-09-10T20:44:56.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:55 smithi067 ceph-mon[30891]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:56.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:55 smithi067 ceph-mon[30891]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T20:44:56.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:55 smithi083 ceph-mon[35058]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:56.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:55 smithi083 ceph-mon[35058]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T20:44:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:55 smithi172 ceph-mon[35265]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:55 smithi172 ceph-mon[35265]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T20:44:58.161 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:57 smithi067 ceph-mon[30891]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:57 smithi083 ceph-mon[35058]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:44:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:57 smithi172 ceph-mon[35265]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:00.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:44:59 smithi067 ceph-mon[30891]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:00.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:44:59 smithi083 ceph-mon[35058]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:00.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:44:59 smithi172 ceph-mon[35265]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T20:45:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:01 smithi067 ceph-mon[30891]: Deploying daemon osd.3 on smithi067 2024-09-10T20:45:01.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T20:45:01.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:01.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:01 smithi083 ceph-mon[35058]: Deploying daemon osd.3 on smithi067 2024-09-10T20:45:01.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T20:45:01.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:01.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:01 smithi172 ceph-mon[35265]: Deploying daemon osd.3 on smithi067 2024-09-10T20:45:02.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:02 smithi067 ceph-mon[30891]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:02.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:02 smithi083 ceph-mon[35058]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:02.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:02 smithi172 ceph-mon[35265]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:04.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:04 smithi067 ceph-mon[30891]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:04.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:04 smithi083 ceph-mon[35058]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:04 smithi172 ceph-mon[35265]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:06 smithi067 ceph-mon[30891]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:06.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:06 smithi083 ceph-mon[35058]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:06.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:06 smithi172 ceph-mon[35265]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:07.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:07.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:07.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:07.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:07.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:07.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:07.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:07.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:07.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:08 smithi067 ceph-mon[30891]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:08 smithi083 ceph-mon[35058]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:08 smithi172 ceph-mon[35265]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:10.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.078+0000 7fe7c0ff9640 1 -- 172.21.15.67:0/568790787 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe7c4063590 con 0x7fe7ac0b5250 2024-09-10T20:45:10.082 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 3 on host 'smithi067' 2024-09-10T20:45:10.082 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:10.082 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.083 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.083 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:10.083 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:10.083 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 msgr2=0x7fe7ac0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:10.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 0x7fe7ac0b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800abe0 tx=0x7fe7b800a2d0 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 msgr2=0x7fe7c4102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a9e0 tx=0x7fe7b4003d50 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 shutdown_connections 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c4108740 0x7fe7c4101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7c4105bb0 0x7fe7c4101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7ac0b5250 0x7fe7ac0b7710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 --2- 172.21.15.67:0/568790787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7c406c0a0 0x7fe7c4102da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 >> 172.21.15.67:0/568790787 conn(0x7fe7c40fd220 msgr2=0x7fe7c4103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 shutdown_connections 2024-09-10T20:45:10.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:45:10.080+0000 7fe7c9ad3640 1 -- 172.21.15.67:0/568790787 wait complete. 2024-09-10T20:45:10.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:10.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.722 DEBUG:teuthology.orchestra.run.smithi067:osd.3> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T20:45:10.729 INFO:tasks.cephadm:Deploying osd.4 on smithi083 with /dev/vg_nvme/lv_3... 2024-09-10T20:45:10.729 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T20:45:10.961 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:10.961 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.961 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:10.984 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:45:11.104 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:11.105 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:11.105 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:11.900 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 20:45:11 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T20:45:11.792+0000 7f5092f21640 -1 osd.3 0 log_to_monitors true 2024-09-10T20:45:12.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:12 smithi067 ceph-mon[30891]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:12.210 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:12 smithi067 ceph-mon[30891]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T20:45:12.355 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:12 smithi083 ceph-mon[35058]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:12.355 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:12 smithi083 ceph-mon[35058]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T20:45:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:12 smithi172 ceph-mon[35265]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:12 smithi172 ceph-mon[35265]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T20:45:13.252 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T20:45:13.252 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T20:45:13.252 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:45:13.252 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.252 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:45:13.253 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T20:45:13.253 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:13 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.273 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T20:45:13.089+0000 7f508eea4640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T20:45:13.273 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T20:45:13.096+0000 7f508accb640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T20:45:13.274 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:13 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: from='osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:45:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T20:45:13.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:13 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:13.523 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:45:13.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_3 2024-09-10T20:45:13.805 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 -- 172.21.15.83:0/2087797863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8101910 msgr2=0x7f5dc8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2087797863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8101910 0x7f5dc8101d10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009930 tx=0x7f5dc002a420 comp rx=0 tx=0).stop 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 -- 172.21.15.83:0/2087797863 shutdown_connections 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2087797863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2087797863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8102a70 0x7f5dc8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2087797863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8101910 0x7f5dc8101d10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 -- 172.21.15.83:0/2087797863 >> 172.21.15.83:0/2087797863 conn(0x7f5dc80fd1e0 msgr2=0x7f5dc80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:45:14.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 -- 172.21.15.83:0/2087797863 shutdown_connections 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.305+0000 7f5dccad2640 1 -- 172.21.15.83:0/2087797863 wait complete. 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 Processor -- start 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 -- start start 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8101910 0x7f5dc81056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810d5f0 con 0x7f5dc8103430 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810d470 con 0x7f5dc8102a70 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dccad2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc810d770 con 0x7f5dc8101910 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:14.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42142/0 (socket says 172.21.15.83:42142) 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 -- 172.21.15.83:0/2993943577 learned_addr learned my addr 172.21.15.83:0/2993943577 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc6d9d640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc659c640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8101910 0x7f5dc81056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 -- 172.21.15.83:0/2993943577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8101910 msgr2=0x7f5dc81056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8101910 0x7f5dc81056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 -- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 msgr2=0x7f5dc8104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc5d9b640 1 -- 172.21.15.83:0/2993943577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc8104d40 con 0x7f5dc8102a70 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.306+0000 7f5dc6d9d640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5dc5d9b640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00ba50 tx=0x7f5dbc00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc019070 con 0x7f5dc8102a70 2024-09-10T20:45:14.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc81a2f80 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dbc00cbe0 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0075d0 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.307+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc81a33e0 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.308+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc81a3670 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.309+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5dbc007830 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.310+0000 7f5db77fe640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 0x7f5db00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.310+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f5dbc0e4270 con 0x7f5dc8102a70 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.310+0000 7f5dc659c640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 0x7f5db00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.311+0000 7f5dc659c640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 0x7f5db00b77a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0006010 tx=0x7f5dc0031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:45:14.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.314+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5dbc0ac330 con 0x7f5dc8102a70 2024-09-10T20:45:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] boot 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T20:45:14.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] boot 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T20:45:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:14.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:14.507+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5dc81a3840 con 0x7f5db00b52e0 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: osd.3 [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] boot 2024-09-10T20:45:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T20:45:14.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T20:45:15.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:45:15.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:45:15.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi067 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:15.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:15 smithi083 ceph-mon[35058]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T20:45:15.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:45:15.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:45:15.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi067 2024-09-10T20:45:15.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-10T20:45:15.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:15.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:15.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:15.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:15.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:15 smithi172 ceph-mon[35265]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T20:45:15.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi067 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi067 to 8544M 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:15.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:15 smithi067 ceph-mon[30891]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T20:45:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:16 smithi083 ceph-mon[35058]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:16 smithi083 ceph-mon[35058]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T20:45:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:16 smithi172 ceph-mon[35265]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:16 smithi172 ceph-mon[35265]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T20:45:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:16 smithi067 ceph-mon[30891]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:16 smithi067 ceph-mon[30891]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T20:45:17.370 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:17 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/2144436196' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.370 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:17 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.370 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:17 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"}]': finished 2024-09-10T20:45:17.371 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:17 smithi083 ceph-mon[35058]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T20:45:17.371 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:17 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:17 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/2144436196' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:17 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:17 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"}]': finished 2024-09-10T20:45:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:17 smithi172 ceph-mon[35265]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T20:45:17.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:17 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:17.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:17 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/2144436196' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:17 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"} : dispatch 2024-09-10T20:45:17.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:17 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f98c5f-21d4-4013-8d85-70510054e05a"}]': finished 2024-09-10T20:45:17.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:17 smithi067 ceph-mon[30891]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T20:45:17.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:17 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:18 smithi083 ceph-mon[35058]: pgmap v111: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:18 smithi083 ceph-mon[35058]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T20:45:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:18 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/2090641100' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:18 smithi172 ceph-mon[35265]: pgmap v111: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:18 smithi172 ceph-mon[35265]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T20:45:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:18 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/2090641100' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:18 smithi067 ceph-mon[30891]: pgmap v111: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:18 smithi067 ceph-mon[30891]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-10T20:45:18.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/2090641100' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:20 smithi083 ceph-mon[35058]: pgmap v113: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:20 smithi172 ceph-mon[35265]: pgmap v113: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:20.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:20 smithi067 ceph-mon[30891]: pgmap v113: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:22.279 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:22 smithi083 ceph-mon[35058]: pgmap v114: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:22.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:22 smithi067 ceph-mon[30891]: pgmap v114: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:22 smithi172 ceph-mon[35265]: pgmap v114: 1 pgs: 1 activating+degraded; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T20:45:23.358 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:23 smithi083 ceph-mon[35058]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T20:45:23.358 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:23 smithi083 ceph-mon[35058]: Cluster is now healthy 2024-09-10T20:45:23.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:23 smithi172 ceph-mon[35265]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T20:45:23.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:23 smithi172 ceph-mon[35265]: Cluster is now healthy 2024-09-10T20:45:23.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:23 smithi067 ceph-mon[30891]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-10T20:45:23.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:23 smithi067 ceph-mon[30891]: Cluster is now healthy 2024-09-10T20:45:24.251 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:24 smithi083 ceph-mon[35058]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:45:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:24 smithi172 ceph-mon[35265]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:45:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:24 smithi067 ceph-mon[30891]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:45:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:26 smithi083 ceph-mon[35058]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:45:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T20:45:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:26 smithi083 ceph-mon[35058]: Deploying daemon osd.4 on smithi083 2024-09-10T20:45:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:26 smithi172 ceph-mon[35265]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:45:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T20:45:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:26 smithi172 ceph-mon[35265]: Deploying daemon osd.4 on smithi083 2024-09-10T20:45:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:26 smithi067 ceph-mon[30891]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:45:26.613 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T20:45:26.613 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:26.614 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:26 smithi067 ceph-mon[30891]: Deploying daemon osd.4 on smithi083 2024-09-10T20:45:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:28 smithi172 ceph-mon[35265]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:45:28.534 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:28 smithi083 ceph-mon[35058]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:45:28.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:28 smithi067 ceph-mon[30891]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:45:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:30 smithi172 ceph-mon[35265]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:30.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:30 smithi083 ceph-mon[35058]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:30.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:30 smithi067 ceph-mon[30891]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:32.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:32 smithi172 ceph-mon[35265]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:32.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:32 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:32.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:32 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:32.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:32 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:32 smithi067 ceph-mon[30891]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:32.625 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:32 smithi083 ceph-mon[35058]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:32.625 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:32 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:32.625 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:32 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:32.625 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:32 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:34.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:34.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:45:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:35.271 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 4 on host 'smithi083' 2024-09-10T20:45:35.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.266+0000 7f5db77fe640 1 -- 172.21.15.83:0/2993943577 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5dc81a3840 con 0x7f5db00b52e0 2024-09-10T20:45:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 msgr2=0x7f5db00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 0x7f5db00b77a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0006010 tx=0x7f5dc0031430 comp rx=0 tx=0).stop 2024-09-10T20:45:35.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 msgr2=0x7f5dc8103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00ba50 tx=0x7f5dbc00bf10 comp rx=0 tx=0).stop 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 shutdown_connections 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dc8103430 0x7f5dc8104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dc8102a70 0x7f5dc8103f40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5db00b52e0 0x7f5db00b77a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 --2- 172.21.15.83:0/2993943577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc8101910 0x7f5dc81056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 >> 172.21.15.83:0/2993943577 conn(0x7f5dc80fd1e0 msgr2=0x7f5dc80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 shutdown_connections 2024-09-10T20:45:35.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:45:35.269+0000 7f5dccad2640 1 -- 172.21.15.83:0/2993943577 wait complete. 2024-09-10T20:45:35.935 DEBUG:teuthology.orchestra.run.smithi083:osd.4> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T20:45:35.937 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-10T20:45:35.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T20:45:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:45:36.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:36 smithi172 ceph-mon[35265]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:36.313 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:36.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:36.314 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:36 smithi067 ceph-mon[30891]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:36 smithi083 ceph-mon[35058]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:37.997 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 20:45:37 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T20:45:37.716+0000 7f4cd0edc640 -1 osd.4 0 log_to_monitors true 2024-09-10T20:45:38.319 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:38 smithi083 ceph-mon[35058]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:38.319 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:38 smithi083 ceph-mon[35058]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.319 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:38 smithi083 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:38 smithi172 ceph-mon[35265]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:38.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:38 smithi172 ceph-mon[35265]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:38 smithi172 ceph-mon[35265]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:38 smithi067 ceph-mon[30891]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:38.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:38 smithi067 ceph-mon[30891]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:38 smithi067 ceph-mon[30891]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T20:45:38.638 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:45:38.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-10T20:45:38.922 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.331 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:39.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:39.332 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- 172.21.15.172:0/4171060497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c102a40 msgr2=0x7fd19c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:39.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 --2- 172.21.15.172:0/4171060497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c102a40 0x7fd19c102e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009960 tx=0x7fd18c02a460 comp rx=0 tx=0).stop 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- 172.21.15.172:0/4171060497 shutdown_connections 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 --2- 172.21.15.172:0/4171060497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c104560 0x7fd19c10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 --2- 172.21.15.172:0/4171060497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 0x7fd19c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 --2- 172.21.15.172:0/4171060497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c102a40 0x7fd19c102e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- 172.21.15.172:0/4171060497 >> 172.21.15.172:0/4171060497 conn(0x7fd19c0fe2f0 msgr2=0x7fd19c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- 172.21.15.172:0/4171060497 shutdown_connections 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- 172.21.15.172:0/4171060497 wait complete. 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 Processor -- start 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.410+0000 7fd1a2499640 1 -- start start 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c102a40 0x7fd19c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 0x7fd19c1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:39.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c10e6a0 con 0x7fd19c103ba0 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c10e520 con 0x7fd19c102a40 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a2499640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c10e820 con 0x7fd19c104560 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd19bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c102a40 0x7fd19c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58712/0 (socket says 172.21.15.172:58712) 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 -- 172.21.15.172:0/3591693662 learned_addr learned my addr 172.21.15.172:0/3591693662 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd19b7fe640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 0x7fd19c1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 -- 172.21.15.172:0/3591693662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c102a40 msgr2=0x7fd19c198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c102a40 0x7fd19c198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 -- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 msgr2=0x7fd19c1994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:45:39.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 0x7fd19c1994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 -- 172.21.15.172:0/3591693662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c19a980 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.411+0000 7fd1a0a36640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19400eaa0 tx=0x7fd19400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.412+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400cdb0 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.412+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd194005020 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.412+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c19ac70 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.412+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940116d0 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.412+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1a1350 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.413+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd19c109dc0 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.414+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd19400f040 con 0x7fd19c104560 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.415+0000 7fd1997fa640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 0x7fd1840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:45:39.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.415+0000 7fd19bfff640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 0x7fd1840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:45:39.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.415+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fd1940e48f0 con 0x7fd19c104560 2024-09-10T20:45:39.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.416+0000 7fd19bfff640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 0x7fd1840b77a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000c00 tx=0x7fd18c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:45:39.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.419+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd194016030 con 0x7fd19c104560 2024-09-10T20:45:39.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:39.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:45:39.603+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd19c063590 con 0x7fd1840b52e0 2024-09-10T20:45:39.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T20:45:39.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:45:39.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:40.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi083 2024-09-10T20:45:40.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-10T20:45:40.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:40.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:45:40.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='osd.4 ' entity='osd.4' 2024-09-10T20:45:40.334 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.391 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T20:45:40.098+0000 7f4ccce5f640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T20:45:40.391 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T20:45:40.188+0000 7f4cc4c7e640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:45:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi083 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='osd.4 ' entity='osd.4' 2024-09-10T20:45:40.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi083 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='osd.4 ' entity='osd.4' 2024-09-10T20:45:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:45:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:45:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:41.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] boot 2024-09-10T20:45:41.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T20:45:41.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:41.572 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:45:41.572 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:45:41.573 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:41.573 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] boot 2024-09-10T20:45:41.573 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T20:45:41.573 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:45:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:45:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:45:41.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: osd.4 [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] boot 2024-09-10T20:45:41.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T20:45:41.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T20:45:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/4059534355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"}]': finished 2024-09-10T20:45:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T20:45:42.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:45:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/4059534355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"}]': finished 2024-09-10T20:45:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T20:45:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:45:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-10T20:45:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/4059534355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"} : dispatch 2024-09-10T20:45:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68176cbf-20a3-44c1-82bb-2a78c8faf6fe"}]': finished 2024-09-10T20:45:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T20:45:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:45:43.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:43 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/746893246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:43 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/746893246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:43.702 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:43 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/746893246' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:45:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:44 smithi067 ceph-mon[30891]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:44 smithi083 ceph-mon[35058]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:44 smithi172 ceph-mon[35265]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:46.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:46 smithi067 ceph-mon[30891]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:46 smithi083 ceph-mon[35058]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:46 smithi172 ceph-mon[35265]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:48.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:48 smithi172 ceph-mon[35265]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:48.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:48 smithi067 ceph-mon[30891]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:48 smithi083 ceph-mon[35058]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:50.341 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:50 smithi172 ceph-mon[35265]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:50.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:50 smithi067 ceph-mon[30891]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:50 smithi083 ceph-mon[35058]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:51.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T20:45:51.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:51.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:51 smithi172 ceph-mon[35265]: Deploying daemon osd.5 on smithi172 2024-09-10T20:45:51.543 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T20:45:51.543 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:51.543 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:51 smithi083 ceph-mon[35058]: Deploying daemon osd.5 on smithi172 2024-09-10T20:45:51.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T20:45:51.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:45:51.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:51 smithi067 ceph-mon[30891]: Deploying daemon osd.5 on smithi172 2024-09-10T20:45:52.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:52 smithi172 ceph-mon[35265]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:52 smithi067 ceph-mon[30891]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:52 smithi083 ceph-mon[35058]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:54 smithi067 ceph-mon[30891]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:54 smithi083 ceph-mon[35058]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:54 smithi172 ceph-mon[35265]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:56 smithi067 ceph-mon[30891]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:56 smithi083 ceph-mon[35058]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:56 smithi172 ceph-mon[35265]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:57.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:57.729 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:57.729 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:57.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:45:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:58 smithi172 ceph-mon[35265]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:58 smithi067 ceph-mon[30891]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:45:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:58 smithi083 ceph-mon[35058]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:00.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:00.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:00.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:00.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:45:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:00.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:00.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:00.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:45:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:45:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:00.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.350+0000 7fd1997fa640 1 -- 172.21.15.172:0/3591693662 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd19c063590 con 0x7fd1840b52e0 2024-09-10T20:46:00.355 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-10T20:46:00.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 msgr2=0x7fd1840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:00.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 0x7fd1840b77a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd18c000c00 tx=0x7fd18c005d50 comp rx=0 tx=0).stop 2024-09-10T20:46:00.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 msgr2=0x7fd19c19a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:00.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd19400eaa0 tx=0x7fd19400ef60 comp rx=0 tx=0).stop 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 shutdown_connections 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1840b52e0 0x7fd1840b77a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c104560 0x7fd19c19a0e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd19c103ba0 0x7fd19c1994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.352+0000 7fd1a2499640 1 --2- 172.21.15.172:0/3591693662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd19c102a40 0x7fd19c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.353+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 >> 172.21.15.172:0/3591693662 conn(0x7fd19c0fe2f0 msgr2=0x7fd19c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.353+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 shutdown_connections 2024-09-10T20:46:00.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:00.353+0000 7fd1a2499640 1 -- 172.21.15.172:0/3591693662 wait complete. 2024-09-10T20:46:00.933 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T20:46:00.935 INFO:tasks.cephadm:Deploying osd.6 on smithi067 with /dev/vg_nvme/lv_2... 2024-09-10T20:46:00.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T20:46:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:01.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.069 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:01.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:46:02.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:02 smithi172 ceph-mon[35265]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:02.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:02 smithi172 ceph-mon[35265]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:02.553 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:02 smithi172 ceph-mon[35265]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:02.553 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 20:46:02 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T20:46:02.225+0000 7f2c71580640 -1 osd.5 0 log_to_monitors true 2024-09-10T20:46:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:02 smithi083 ceph-mon[35058]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:02.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:02 smithi083 ceph-mon[35058]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:02.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:02 smithi083 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:02.653 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:02 smithi067 ceph-mon[30891]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:02.653 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:02 smithi067 ceph-mon[30891]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:02.653 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:02 smithi067 ceph-mon[30891]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T20:46:03.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:03 smithi083 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T20:46:03.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:03 smithi083 ceph-mon[35058]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T20:46:03.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:03 smithi083 ceph-mon[35058]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:03.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:03 smithi083 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.691 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-mon[35265]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T20:46:03.691 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-mon[35265]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T20:46:03.691 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-mon[35265]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.691 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:03.691 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-mon[35265]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.691 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T20:46:03.367+0000 7f2c6d503640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T20:46:03.691 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 20:46:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T20:46:03.374+0000 7f2c6932a640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:46:03.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:03 smithi067 ceph-mon[30891]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T20:46:03.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:03 smithi067 ceph-mon[30891]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T20:46:03.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:03 smithi067 ceph-mon[30891]: from='osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:03.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:03 smithi067 ceph-mon[30891]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:46:03.749 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:46:03.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2024-09-10T20:46:04.042 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.443 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.443 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:04.443 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:04.443 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:04 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 -- 172.21.15.67:0/3194436473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 msgr2=0x7f8920107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 --2- 172.21.15.67:0/3194436473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f8920107ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8910009900 tx=0x7f891002a410 comp rx=0 tx=0).stop 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 -- 172.21.15.67:0/3194436473 shutdown_connections 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 --2- 172.21.15.67:0/3194436473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 0x7f892010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 --2- 172.21.15.67:0/3194436473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 0x7f892010a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:04.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 --2- 172.21.15.67:0/3194436473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f8920107ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 -- 172.21.15.67:0/3194436473 >> 172.21.15.67:0/3194436473 conn(0x7f89200fd200 msgr2=0x7f89200ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 -- 172.21.15.67:0/3194436473 shutdown_connections 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.524+0000 7f8925631640 1 -- 172.21.15.67:0/3194436473 wait complete. 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 Processor -- start 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 -- start start 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 0x7f892019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 0x7f892019c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89201108d0 con 0x7f892006bf30 2024-09-10T20:46:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8920110750 con 0x7f892010a9a0 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.525+0000 7f8925631640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8920110a50 con 0x7f8920107ff0 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35170/0 (socket says 172.21.15.67:35170) 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 -- 172.21.15.67:0/168901160 learned_addr learned my addr 172.21.15.67:0/168901160 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891e7fc640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 0x7f892019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891f7fe640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 0x7f892019c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 -- 172.21.15.67:0/168901160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 msgr2=0x7f892019b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 0x7f892019b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 -- 172.21.15.67:0/168901160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 msgr2=0x7f892019c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 0x7f892019c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 -- 172.21.15.67:0/168901160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892019cb30 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f891effd640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8910005940 tx=0x7f8910004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891003f030 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892019cdc0 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8910003cb0 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910035070 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.526+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89201a3500 con 0x7f892006bf30 2024-09-10T20:46:04.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.527+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8920107ab0 con 0x7f892006bf30 2024-09-10T20:46:04.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.530+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f891003b460 con 0x7f892006bf30 2024-09-10T20:46:04.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.530+0000 7f8907fff640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 0x7f89080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:04.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.531+0000 7f891e7fc640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 0x7f89080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:04.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.531+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4566+0+0 (secure 0 0 0) 0x7f8910105b90 con 0x7f892006bf30 2024-09-10T20:46:04.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.531+0000 7f891e7fc640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 0x7f89080b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8914005d00 tx=0x7f891400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:04.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.534+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8910003e60 con 0x7f892006bf30 2024-09-10T20:46:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:04.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:04 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:46:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T20:46:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:04.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:04 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:04.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:04.730+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8920063590 con 0x7f89080b52e0 2024-09-10T20:46:05.477 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi172 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] boot 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:05.478 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:05 smithi067 ceph-mon[30891]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T20:46:05.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:46:05.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:46:05.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi172 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] boot 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:05.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:05 smithi083 ceph-mon[35058]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi172 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: osd.5 [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] boot 2024-09-10T20:46:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T20:46:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T20:46:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:05 smithi172 ceph-mon[35265]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T20:46:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:06 smithi083 ceph-mon[35058]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:06 smithi083 ceph-mon[35058]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:06 smithi083 ceph-mon[35058]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T20:46:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:06 smithi172 ceph-mon[35265]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:06 smithi172 ceph-mon[35265]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:06 smithi172 ceph-mon[35265]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T20:46:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:06 smithi067 ceph-mon[30891]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-10T20:46:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:06 smithi067 ceph-mon[30891]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:06 smithi067 ceph-mon[30891]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T20:46:07.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:07 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"} : dispatch 2024-09-10T20:46:07.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:07 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"}]': finished 2024-09-10T20:46:07.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:07 smithi083 ceph-mon[35058]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T20:46:07.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:07.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:07 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"} : dispatch 2024-09-10T20:46:07.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:07 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"}]': finished 2024-09-10T20:46:07.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:07 smithi172 ceph-mon[35265]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T20:46:07.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:07.787 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:07 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"} : dispatch 2024-09-10T20:46:07.787 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:07 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1878596961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc804584-08bf-4d2d-9d84-88f3d964c37d"}]': finished 2024-09-10T20:46:07.787 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:07 smithi067 ceph-mon[30891]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T20:46:07.788 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:08 smithi172 ceph-mon[35265]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T20:46:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:08 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/961398884' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:08.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:08 smithi067 ceph-mon[30891]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T20:46:08.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:08 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/961398884' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:08 smithi083 ceph-mon[35058]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T20:46:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:08 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/961398884' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:10 smithi172 ceph-mon[35265]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T20:46:10.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:10 smithi067 ceph-mon[30891]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T20:46:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:10 smithi083 ceph-mon[35058]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-10T20:46:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:12 smithi172 ceph-mon[35265]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:46:12.749 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:12 smithi067 ceph-mon[30891]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:46:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:12 smithi083 ceph-mon[35058]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:46:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:14 smithi172 ceph-mon[35265]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:46:14.748 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:14 smithi067 ceph-mon[30891]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:46:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:14 smithi083 ceph-mon[35058]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T20:46:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:16 smithi172 ceph-mon[35265]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:46:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T20:46:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:16.784 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:16 smithi067 ceph-mon[30891]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:46:16.784 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T20:46:16.784 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:16 smithi083 ceph-mon[35058]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T20:46:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T20:46:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:17.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:17 smithi067 ceph-mon[30891]: Deploying daemon osd.6 on smithi067 2024-09-10T20:46:17.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:17 smithi172 ceph-mon[35265]: Deploying daemon osd.6 on smithi067 2024-09-10T20:46:17.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:17 smithi083 ceph-mon[35058]: Deploying daemon osd.6 on smithi067 2024-09-10T20:46:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:18 smithi067 ceph-mon[30891]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:18 smithi172 ceph-mon[35265]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:18 smithi083 ceph-mon[35058]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:20.789 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:20 smithi067 ceph-mon[30891]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:20 smithi083 ceph-mon[35058]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:20 smithi172 ceph-mon[35265]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:22.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:22 smithi067 ceph-mon[30891]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:22.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:22.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:22.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:22.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:22 smithi172 ceph-mon[35265]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:22.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:22.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:22.752 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:22 smithi083 ceph-mon[35058]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:24 smithi067 ceph-mon[30891]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:24 smithi083 ceph-mon[35058]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:24 smithi172 ceph-mon[35265]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:26.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.288+0000 7f8907fff640 1 -- 172.21.15.67:0/168901160 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8920063590 con 0x7f89080b52e0 2024-09-10T20:46:26.292 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 6 on host 'smithi067' 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 msgr2=0x7f89080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 0x7f89080b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8914005d00 tx=0x7f891400b410 comp rx=0 tx=0).stop 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 msgr2=0x7f892019b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8910005940 tx=0x7f8910004430 comp rx=0 tx=0).stop 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 shutdown_connections 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f892010a9a0 0x7f892019c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89080b52e0 0x7f89080b77a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:26.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8920107ff0 0x7f892019b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:26.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 --2- 172.21.15.67:0/168901160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f892006bf30 0x7f892019b000 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:26.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.290+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 >> 172.21.15.67:0/168901160 conn(0x7f89200fd200 msgr2=0x7f892010b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:26.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.291+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 shutdown_connections 2024-09-10T20:46:26.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:46:26.291+0000 7f8925631640 1 -- 172.21.15.67:0/168901160 wait complete. 2024-09-10T20:46:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:26 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:26.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:26.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:26 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:26 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:26.973 DEBUG:teuthology.orchestra.run.smithi067:osd.6> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T20:46:26.976 INFO:tasks.cephadm:Deploying osd.7 on smithi083 with /dev/vg_nvme/lv_2... 2024-09-10T20:46:26.976 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T20:46:27.232 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:46:27.352 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:27.353 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:27.353 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:27.483 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:27.483 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:27.483 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:28.491 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:28 smithi067 ceph-mon[30891]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:28.491 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:28 smithi067 ceph-mon[30891]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T20:46:28.492 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 20:46:28 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T20:46:28.217+0000 7f9666fda640 -1 osd.6 0 log_to_monitors true 2024-09-10T20:46:28.567 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:28 smithi083 ceph-mon[35058]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:28.567 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:28 smithi083 ceph-mon[35058]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T20:46:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:28 smithi172 ceph-mon[35265]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:28 smithi172 ceph-mon[35265]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T20:46:29.461 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T20:46:29.461 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T20:46:29.461 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:46:29.461 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.462 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:46:29.462 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T20:46:29.462 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:29 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T20:46:29.298+0000 7f9662f5d640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T20:46:29.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T20:46:29.308+0000 7f965ed84640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T20:46:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:29 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: from='osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T20:46:29.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:29 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:29.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:46:29.854 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_2 2024-09-10T20:46:30.112 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.494 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.495 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.495 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:30.495 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:30.495 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.495 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 -- 172.21.15.83:0/3456734585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70105bb0 msgr2=0x7fbc70107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 --2- 172.21.15.83:0/3456734585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70105bb0 0x7fbc70107fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009900 tx=0x7fbc5802a410 comp rx=0 tx=0).stop 2024-09-10T20:46:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 -- 172.21.15.83:0/3456734585 shutdown_connections 2024-09-10T20:46:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 --2- 172.21.15.83:0/3456734585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc70108720 0x7fbc7010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:30.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 --2- 172.21.15.83:0/3456734585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70105bb0 0x7fbc70107fe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 --2- 172.21.15.83:0/3456734585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc7006b660 0x7fbc70105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 -- 172.21.15.83:0/3456734585 >> 172.21.15.83:0/3456734585 conn(0x7fbc700fd1e0 msgr2=0x7fbc700ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 -- 172.21.15.83:0/3456734585 shutdown_connections 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 -- 172.21.15.83:0/3456734585 wait complete. 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.573+0000 7fbc74b37640 1 Processor -- start 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 -- start start 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc7006b660 0x7fbc7019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 0x7fbc7019b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7010e670 con 0x7fbc70105bb0 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7010e4f0 con 0x7fbc70108720 2024-09-10T20:46:30.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc74b37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7010e7f0 con 0x7fbc7006b660 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54026/0 (socket says 172.21.15.83:54026) 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 -- 172.21.15.83:0/1089976037 learned_addr learned my addr 172.21.15.83:0/1089976037 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc65d9b640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 0x7fbc7019b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6e59c640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc7006b660 0x7fbc7019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 -- 172.21.15.83:0/1089976037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc7006b660 msgr2=0x7fbc7019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc7006b660 0x7fbc7019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 -- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 msgr2=0x7fbc7019b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 0x7fbc7019b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 -- 172.21.15.83:0/1089976037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7019ca90 con 0x7fbc70108720 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc65d9b640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 0x7fbc7019b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:46:30.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc6ed9d640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800d750 tx=0x7fbc6800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.574+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68017070 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.575+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7019cd80 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.575+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc680054d0 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.575+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68004c60 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.575+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc701a3460 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.576+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7010a2b0 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.577+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fbc68004e00 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.577+0000 7fbc67fff640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 0x7fbc5c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.578+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4965+0+0 (secure 0 0 0) 0x7fbc680e4950 con 0x7fbc70108720 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.578+0000 7fbc6e59c640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 0x7fbc5c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.578+0000 7fbc6e59c640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 0x7fbc5c0b77a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc60007350 tx=0x7fbc600072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:30.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.582+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbc680ac520 con 0x7fbc70108720 2024-09-10T20:46:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:30.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:30.767+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbc70063590 con 0x7fbc5c0b52e0 2024-09-10T20:46:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:30.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:31.522 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:46:31.522 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi067 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] boot 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:31.523 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:46:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:46:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi067 2024-09-10T20:46:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] boot 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:31.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:31.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi067 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi067 to 5696M 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: osd.6 [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] boot 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T20:46:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T20:46:31.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:31.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:31.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:32.497 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:32 smithi083 ceph-mon[35058]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:32.497 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:32 smithi083 ceph-mon[35058]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:32.497 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:32 smithi083 ceph-mon[35058]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T20:46:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:32 smithi172 ceph-mon[35265]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:32 smithi172 ceph-mon[35265]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:32 smithi172 ceph-mon[35265]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T20:46:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:32 smithi067 ceph-mon[30891]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-10T20:46:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:32 smithi067 ceph-mon[30891]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:32 smithi067 ceph-mon[30891]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T20:46:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:33 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/2627579494' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:33 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:33 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"}]': finished 2024-09-10T20:46:33.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:33 smithi083 ceph-mon[35058]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T20:46:33.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:33 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/2627579494' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:33 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:33 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"}]': finished 2024-09-10T20:46:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:33 smithi172 ceph-mon[35265]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T20:46:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:33.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:33 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/2627579494' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:33 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"} : dispatch 2024-09-10T20:46:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:33 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b82fc4-1c68-44a1-8288-cf19eb6b81e4"}]': finished 2024-09-10T20:46:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:33 smithi067 ceph-mon[30891]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T20:46:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:34 smithi172 ceph-mon[35265]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:34 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/3827609084' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:34 smithi083 ceph-mon[35058]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:34 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/3827609084' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:34 smithi067 ceph-mon[30891]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/3827609084' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:36 smithi083 ceph-mon[35058]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:36 smithi172 ceph-mon[35265]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:36 smithi067 ceph-mon[30891]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:38.609 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:38 smithi083 ceph-mon[35058]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:38 smithi172 ceph-mon[35265]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:38 smithi067 ceph-mon[30891]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:40.610 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:40 smithi067 ceph-mon[30891]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:40.624 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:40 smithi083 ceph-mon[35058]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:40 smithi172 ceph-mon[35265]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:42.560 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:42 smithi083 ceph-mon[35058]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:42.560 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T20:46:42.560 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:42 smithi172 ceph-mon[35265]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T20:46:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:42 smithi067 ceph-mon[30891]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T20:46:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:43.539 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:43 smithi083 ceph-mon[35058]: Deploying daemon osd.7 on smithi083 2024-09-10T20:46:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:43 smithi172 ceph-mon[35265]: Deploying daemon osd.7 on smithi083 2024-09-10T20:46:43.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:43 smithi067 ceph-mon[30891]: Deploying daemon osd.7 on smithi083 2024-09-10T20:46:44.553 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:44 smithi083 ceph-mon[35058]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:44 smithi172 ceph-mon[35265]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:44 smithi067 ceph-mon[30891]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:46.550 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:46 smithi083 ceph-mon[35058]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:46 smithi172 ceph-mon[35265]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:46 smithi067 ceph-mon[30891]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:48 smithi083 ceph-mon[35058]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:48 smithi172 ceph-mon[35265]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:48 smithi067 ceph-mon[30891]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:48.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:48.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:48.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:50 smithi083 ceph-mon[35058]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:50 smithi172 ceph-mon[35265]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:50 smithi067 ceph-mon[30891]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:51.396 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 7 on host 'smithi083' 2024-09-10T20:46:51.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.391+0000 7fbc67fff640 1 -- 172.21.15.83:0/1089976037 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbc70063590 con 0x7fbc5c0b52e0 2024-09-10T20:46:51.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 msgr2=0x7fbc5c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:51.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 0x7fbc5c0b77a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc60007350 tx=0x7fbc600072e0 comp rx=0 tx=0).stop 2024-09-10T20:46:51.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 msgr2=0x7fbc7019c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:51.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800d750 tx=0x7fbc6800dc10 comp rx=0 tx=0).stop 2024-09-10T20:46:51.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 shutdown_connections 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbc70108720 0x7fbc7019c1f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc70105bb0 0x7fbc7019b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbc5c0b52e0 0x7fbc5c0b77a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 --2- 172.21.15.83:0/1089976037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc7006b660 0x7fbc7019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 >> 172.21.15.83:0/1089976037 conn(0x7fbc700fd1e0 msgr2=0x7fbc70103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 shutdown_connections 2024-09-10T20:46:51.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:46:51.394+0000 7fbc74b37640 1 -- 172.21.15.83:0/1089976037 wait complete. 2024-09-10T20:46:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:51.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:51.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:52.048 DEBUG:teuthology.orchestra.run.smithi083:osd.7> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T20:46:52.050 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-10T20:46:52.050 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T20:46:52.309 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:46:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:52 smithi083 ceph-mon[35058]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:52 smithi172 ceph-mon[35265]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:52 smithi067 ceph-mon[30891]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:53.784 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 20:46:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T20:46:53.741+0000 7fdb6f82f640 -1 osd.7 0 log_to_monitors true 2024-09-10T20:46:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:54 smithi083 ceph-mon[35058]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:54.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:54 smithi083 ceph-mon[35058]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:54 smithi083 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:46:54.693 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:54 smithi172 ceph-mon[35265]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:54.693 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:54 smithi172 ceph-mon[35265]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.693 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:54 smithi172 ceph-mon[35265]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-10T20:46:54.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:54 smithi067 ceph-mon[30891]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:54.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:54 smithi067 ceph-mon[30891]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:54 smithi067 ceph-mon[30891]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T20:46:54.941 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 -- 172.21.15.172:0/3373634211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 msgr2=0x7efecc10ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 --2- 172.21.15.172:0/3373634211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc10ac30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ca0 tx=0x7efec402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 -- 172.21.15.172:0/3373634211 shutdown_connections 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 --2- 172.21.15.172:0/3373634211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc10ac30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 --2- 172.21.15.172:0/3373634211 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 --2- 172.21.15.172:0/3373634211 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 -- 172.21.15.172:0/3373634211 >> 172.21.15.172:0/3373634211 conn(0x7efecc0fd200 msgr2=0x7efecc0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 -- 172.21.15.172:0/3373634211 shutdown_connections 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.366+0000 7efed20e5640 1 -- 172.21.15.172:0/3373634211 wait complete. 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.367+0000 7efed20e5640 1 Processor -- start 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.367+0000 7efed20e5640 1 -- start start 2024-09-10T20:46:55.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.367+0000 7efed20e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efecc10e6c0 con 0x7efecc06c0c0 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efecc10e540 con 0x7efecc105bc0 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efecc10e840 con 0x7efecc108770 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39822/0 (socket says 172.21.15.172:39822) 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 -- 172.21.15.172:0/938900847 learned_addr learned my addr 172.21.15.172:0/938900847 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecb7fe640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecaffd640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 -- 172.21.15.172:0/938900847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 msgr2=0x7efecc199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:55.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 -- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 msgr2=0x7efecc198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 -- 172.21.15.172:0/938900847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc19a860 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecb7fe640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecaffd640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efecbfff640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efec40097b0 tx=0x7efec4003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4004240 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efec40317c0 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efecc19aaf0 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec402fd80 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.368+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efecc1a1230 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.369+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efecc106020 con 0x7efecc108770 2024-09-10T20:46:55.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.372+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7efec40043e0 con 0x7efecc108770 2024-09-10T20:46:55.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.372+0000 7efec8ff9640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 0x7efeb80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:46:55.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.372+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5101+0+0 (secure 0 0 0) 0x7efec4106830 con 0x7efecc108770 2024-09-10T20:46:55.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.373+0000 7efecb7fe640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 0x7efeb80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:46:55.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.373+0000 7efecb7fe640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 0x7efeb80b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efeb400baa0 tx=0x7efeb4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:46:55.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.375+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efec40ce380 con 0x7efecc108770 2024-09-10T20:46:55.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:46:55.566+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7efecc063590 con 0x7efeb80b52e0 2024-09-10T20:46:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T20:46:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T20:46:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T20:46:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T20:46:55.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T20:46:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:46:55.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:46:55.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T20:46:55.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T20:46:56.307+0000 7fdb6bfc6640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T20:46:56.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T20:46:56.416+0000 7fdb635d1640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi083 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='osd.7 ' entity='osd.7' 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:56 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.667 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi083 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='osd.7 ' entity='osd.7' 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.668 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:56 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi083 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='osd.7 ' entity='osd.7' 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:56 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] boot 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T20:46:57.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:57.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:46:57.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:46:57.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:57.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] boot 2024-09-10T20:46:57.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T20:46:57.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: osd.7 [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] boot 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T20:46:57.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/1862440311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"}]': finished 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T20:46:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:46:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:58.942 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/1862440311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.943 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.943 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"}]': finished 2024-09-10T20:46:58.943 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T20:46:58.943 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:46:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-10T20:46:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/1862440311' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"} : dispatch 2024-09-10T20:46:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21f45657-f851-4a79-a825-3cab9b319417"}]': finished 2024-09-10T20:46:58.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T20:46:58.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:46:59.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:59 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/3772478805' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:59.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:59 smithi067 ceph-mon[30891]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T20:46:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:46:59 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:46:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:59 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/3772478805' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:59 smithi083 ceph-mon[35058]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T20:46:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:46:59 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:46:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:59 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/3772478805' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:46:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:59 smithi172 ceph-mon[35265]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T20:46:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:46:59 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:00 smithi067 ceph-mon[30891]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:00 smithi083 ceph-mon[35058]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:00 smithi172 ceph-mon[35265]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:02 smithi067 ceph-mon[30891]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:02 smithi083 ceph-mon[35058]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:02 smithi172 ceph-mon[35265]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:04 smithi083 ceph-mon[35058]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:47:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:04 smithi172 ceph-mon[35265]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:47:04.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:04 smithi067 ceph-mon[30891]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T20:47:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:06 smithi172 ceph-mon[35265]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T20:47:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:06 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T20:47:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:06 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:06 smithi067 ceph-mon[30891]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T20:47:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T20:47:06.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:06 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:06 smithi083 ceph-mon[35058]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T20:47:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:06 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T20:47:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:06 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:07.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:07 smithi067 ceph-mon[30891]: Deploying daemon osd.8 on smithi172 2024-09-10T20:47:07.813 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:07 smithi172 ceph-mon[35265]: Deploying daemon osd.8 on smithi172 2024-09-10T20:47:07.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:07 smithi083 ceph-mon[35058]: Deploying daemon osd.8 on smithi172 2024-09-10T20:47:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:08 smithi172 ceph-mon[35265]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T20:47:08.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:08 smithi067 ceph-mon[30891]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T20:47:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:08 smithi083 ceph-mon[35058]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T20:47:10.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:10 smithi067 ceph-mon[30891]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:47:10.870 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:10 smithi172 ceph-mon[35265]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:47:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:10 smithi083 ceph-mon[35058]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:47:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:12 smithi067 ceph-mon[30891]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T20:47:12.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:12 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:12.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:12 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:12.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:12 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:12.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:12 smithi172 ceph-mon[35265]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T20:47:12.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:12 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:12.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:12 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:12.823 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:12 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:12 smithi083 ceph-mon[35058]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T20:47:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:12 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:12 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:12 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:14.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:14 smithi172 ceph-mon[35265]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:14.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:14 smithi067 ceph-mon[30891]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:14 smithi083 ceph-mon[35058]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.844+0000 7efec8ff9640 1 -- 172.21.15.172:0/938900847 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efecc063590 con 0x7efeb80b52e0 2024-09-10T20:47:15.849 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 msgr2=0x7efeb80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 0x7efeb80b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efeb400baa0 tx=0x7efeb4005d90 comp rx=0 tx=0).stop 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 msgr2=0x7efecc199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efec40097b0 tx=0x7efec4003c20 comp rx=0 tx=0).stop 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 shutdown_connections 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efeb80b52e0 0x7efeb80b77a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efecc108770 0x7efecc199fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efecc105bc0 0x7efecc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 --2- 172.21.15.172:0/938900847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efecc06c0c0 0x7efecc198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:15.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 >> 172.21.15.172:0/938900847 conn(0x7efecc0fd200 msgr2=0x7efecc103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:47:15.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 shutdown_connections 2024-09-10T20:47:15.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:47:15.847+0000 7efed20e5640 1 -- 172.21.15.172:0/938900847 wait complete. 2024-09-10T20:47:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:16.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:16.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:15 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:15 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:15 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:16.622 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T20:47:16.625 INFO:tasks.cephadm:Deploying osd.9 on smithi067 with /dev/vg_nvme/lv_1... 2024-09-10T20:47:16.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T20:47:16.894 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:47:18.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:17 smithi172 ceph-mon[35265]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:18.243 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:17 smithi067 ceph-mon[30891]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:17 smithi083 ceph-mon[35058]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:18.568 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 20:47:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T20:47:18.232+0000 7f017fec5640 -1 osd.8 0 log_to_monitors true 2024-09-10T20:47:19.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:18 smithi172 ceph-mon[35265]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:18 smithi172 ceph-mon[35265]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.277 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:18 smithi067 ceph-mon[30891]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.277 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:18 smithi067 ceph-mon[30891]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:18 smithi083 ceph-mon[35058]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:18 smithi083 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T20:47:19.411 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:47:19.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi067:vg_nvme/lv_1 2024-09-10T20:47:19.705 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:47:20.096 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:20.096 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T20:47:20.096 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi172 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:20.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:19 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 -- 172.21.15.67:0/3967601386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f645006b6e0 msgr2=0x7f64501055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:20.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 --2- 172.21.15.67:0/3967601386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f645006b6e0 0x7f64501055f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6440009900 tx=0x7f644002a410 comp rx=0 tx=0).stop 2024-09-10T20:47:20.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 -- 172.21.15.67:0/3967601386 shutdown_connections 2024-09-10T20:47:20.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 --2- 172.21.15.67:0/3967601386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6450108730 0x7f645010abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:20.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 --2- 172.21.15.67:0/3967601386 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f6450107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:20.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 --2- 172.21.15.67:0/3967601386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f645006b6e0 0x7f64501055f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:20.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 -- 172.21.15.67:0/3967601386 >> 172.21.15.67:0/3967601386 conn(0x7f64500fd1e0 msgr2=0x7f64500ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 -- 172.21.15.67:0/3967601386 shutdown_connections 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.177+0000 7f6456356640 1 -- 172.21.15.67:0/3967601386 wait complete. 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.178+0000 7f6456356640 1 Processor -- start 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.178+0000 7f6456356640 1 -- start start 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.178+0000 7f6456356640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 0x7f6450198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:20.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.178+0000 7f6456356640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f64501994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f645010e750 con 0x7f6450108730 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f645010e5d0 con 0x7f6450105b80 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f645010e8d0 con 0x7f645006b6e0 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:20.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 0x7f6450198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:20.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45536/0 (socket says 172.21.15.67:45536) 2024-09-10T20:47:20.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 0x7f6450198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:53152/0 (socket says 172.21.15.67:53152) 2024-09-10T20:47:20.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 -- 172.21.15.67:0/3011510809 learned_addr learned my addr 172.21.15.67:0/3011510809 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:47:20.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644f7fe640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f64501994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:20.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 -- 172.21.15.67:0/3011510809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 msgr2=0x7f6450198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 0x7f6450198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 -- 172.21.15.67:0/3011510809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 msgr2=0x7f64501994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f64501994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 -- 172.21.15.67:0/3011510809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645019a9d0 con 0x7f6450108730 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644f7fe640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f64501994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:47:20.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f64548f3640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f644800eaa0 tx=0x7f644800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644800cdb0 con 0x7f6450108730 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645019acc0 con 0x7f6450108730 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6448005020 con 0x7f6450108730 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480116d0 con 0x7f6450108730 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.179+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501a13a0 con 0x7f6450108730 2024-09-10T20:47:20.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.180+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6450105fc0 con 0x7f6450108730 2024-09-10T20:47:20.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.182+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f644800f040 con 0x7f6450108730 2024-09-10T20:47:20.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.183+0000 7f644d7fa640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 0x7f64380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:20.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.183+0000 7f644ffff640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 0x7f64380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:20.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.183+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5582+0+0 (secure 0 0 0) 0x7f64480e53a0 con 0x7f6450108730 2024-09-10T20:47:20.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.184+0000 7f644ffff640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 0x7f64380b77a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6440031500 tx=0x7f6440005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:47:20.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.186+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6448016030 con 0x7f6450108730 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi172 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-10T20:47:20.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:20.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:20.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:19 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:20.383+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6450063590 con 0x7f64380b52e0 2024-09-10T20:47:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T20:47:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi172 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:20.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:20.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:19 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.141 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:21.142 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:21.142 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:21.142 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:21.142 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:20 smithi067 ceph-mon[30891]: from='osd.8 ' entity='osd.8' 2024-09-10T20:47:21.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T20:47:20.830+0000 7f017c65c640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T20:47:21.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T20:47:21.051+0000 7f0173c67640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:47:21.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:21.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:20 smithi172 ceph-mon[35265]: from='osd.8 ' entity='osd.8' 2024-09-10T20:47:21.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:47:21.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T20:47:21.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:21.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:20 smithi083 ceph-mon[35058]: from='osd.8 ' entity='osd.8' 2024-09-10T20:47:22.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:47:22.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:47:22.197 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:22.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:22.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T20:47:22.198 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T20:47:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T20:47:22.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:22 smithi172 ceph-mon[35265]: osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] boot 2024-09-10T20:47:23.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:22 smithi172 ceph-mon[35265]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T20:47:23.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.257 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.258 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:22 smithi067 ceph-mon[30891]: osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] boot 2024-09-10T20:47:23.258 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:22 smithi067 ceph-mon[30891]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T20:47:23.258 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:22 smithi083 ceph-mon[35058]: osd.8 [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] boot 2024-09-10T20:47:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:22 smithi083 ceph-mon[35058]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T20:47:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T20:47:24.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:24.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"} : dispatch 2024-09-10T20:47:24.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"}]': finished 2024-09-10T20:47:24.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T20:47:24.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:24.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2037234890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:24.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"} : dispatch 2024-09-10T20:47:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"}]': finished 2024-09-10T20:47:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T20:47:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:24.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2037234890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T20:47:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"} : dispatch 2024-09-10T20:47:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3992875954' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1523fce3-7f24-44fc-a1e2-e5369e8a87c9"}]': finished 2024-09-10T20:47:24.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T20:47:24.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:24.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2037234890' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:25.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:25 smithi083 ceph-mon[35058]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T20:47:25.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:25 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:25.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:25 smithi172 ceph-mon[35265]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T20:47:25.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:25 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:25.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:25 smithi067 ceph-mon[30891]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T20:47:25.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:25 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:26 smithi083 ceph-mon[35058]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:26 smithi172 ceph-mon[35265]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:26 smithi067 ceph-mon[30891]: pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:28.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:28 smithi083 ceph-mon[35058]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:28.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:28 smithi067 ceph-mon[30891]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:28 smithi172 ceph-mon[35265]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:30.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:30 smithi067 ceph-mon[30891]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T20:47:30.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:30 smithi083 ceph-mon[35058]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T20:47:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:30 smithi172 ceph-mon[35265]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T20:47:32.372 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:32 smithi067 ceph-mon[30891]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T20:47:32.372 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T20:47:32.373 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:32 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:32 smithi083 ceph-mon[35058]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T20:47:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:32 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T20:47:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:32 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:32 smithi172 ceph-mon[35265]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T20:47:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:32 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T20:47:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:32 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:33.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:33 smithi172 ceph-mon[35265]: Deploying daemon osd.9 on smithi067 2024-09-10T20:47:33.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:33 smithi083 ceph-mon[35058]: Deploying daemon osd.9 on smithi067 2024-09-10T20:47:33.402 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:33 smithi067 ceph-mon[30891]: Deploying daemon osd.9 on smithi067 2024-09-10T20:47:34.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:34 smithi083 ceph-mon[35058]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T20:47:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:34 smithi172 ceph-mon[35265]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T20:47:34.458 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:34 smithi067 ceph-mon[30891]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-10T20:47:36.382 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:36 smithi067 ceph-mon[30891]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T20:47:36.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:36 smithi083 ceph-mon[35058]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T20:47:36.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:36 smithi172 ceph-mon[35265]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T20:47:38.382 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:38 smithi067 ceph-mon[30891]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:38.382 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:38.382 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:38.382 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:38.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:38 smithi083 ceph-mon[35058]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:38.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:38.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:38.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:38 smithi172 ceph-mon[35265]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:40 smithi083 ceph-mon[35058]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:40.403 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:40 smithi067 ceph-mon[30891]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:40 smithi172 ceph-mon[35265]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:47:41.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.267+0000 7f644d7fa640 1 -- 172.21.15.67:0/3011510809 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6450063590 con 0x7f64380b52e0 2024-09-10T20:47:41.272 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 9 on host 'smithi067' 2024-09-10T20:47:41.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 msgr2=0x7f64380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:41.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 0x7f64380b77a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6440031500 tx=0x7f6440005a20 comp rx=0 tx=0).stop 2024-09-10T20:47:41.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 msgr2=0x7f645019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:41.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f644800eaa0 tx=0x7f644800ef60 comp rx=0 tx=0).stop 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 shutdown_connections 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6450108730 0x7f645019a130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6450105b80 0x7f64501994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64380b52e0 0x7f64380b77a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 --2- 172.21.15.67:0/3011510809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f645006b6e0 0x7f6450198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 >> 172.21.15.67:0/3011510809 conn(0x7f64500fd1e0 msgr2=0x7f6450103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 shutdown_connections 2024-09-10T20:47:41.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:47:41.271+0000 7f6456356640 1 -- 172.21.15.67:0/3011510809 wait complete. 2024-09-10T20:47:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.903 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.903 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.904 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.930 DEBUG:teuthology.orchestra.run.smithi067:osd.9> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T20:47:41.932 INFO:tasks.cephadm:Deploying osd.10 on smithi083 with /dev/vg_nvme/lv_1... 2024-09-10T20:47:41.932 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:41.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:47:41.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:41.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:42.189 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:47:43.871 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:43 smithi083 ceph-mon[35058]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:44.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:43 smithi067 ceph-mon[30891]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:44.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 20:47:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T20:47:43.785+0000 7f6b1520a640 -1 osd.9 0 log_to_monitors true 2024-09-10T20:47:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:43 smithi172 ceph-mon[35265]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:44.867 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:44 smithi067 ceph-mon[30891]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T20:47:44.953 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-10T20:47:44.992 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi083:vg_nvme/lv_1 2024-09-10T20:47:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:44 smithi083 ceph-mon[35058]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T20:47:45.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:44 smithi172 ceph-mon[35265]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T20:47:45.247 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T20:47:45.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 -- 172.21.15.83:0/2126747275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 msgr2=0x7f43fc10ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:45.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 --2- 172.21.15.83:0/2126747275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc10ac20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009ca0 tx=0x7f43f402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 -- 172.21.15.83:0/2126747275 shutdown_connections 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 --2- 172.21.15.83:0/2126747275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc10ac20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 --2- 172.21.15.83:0/2126747275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 0x7f43fc108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 --2- 172.21.15.83:0/2126747275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 0x7f43fc1056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 -- 172.21.15.83:0/2126747275 >> 172.21.15.83:0/2126747275 conn(0x7f43fc0fd200 msgr2=0x7f43fc0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 -- 172.21.15.83:0/2126747275 shutdown_connections 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.716+0000 7f4401235640 1 -- 172.21.15.83:0/2126747275 wait complete. 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 Processor -- start 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 -- start start 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 0x7f43fc198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 0x7f43fc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:45.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e690 con 0x7f43fc105c10 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e510 con 0x7f43fc108760 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.717+0000 7f4401235640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc10e810 con 0x7f43fc06c020 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60800/0 (socket says 172.21.15.83:60800) 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 -- 172.21.15.83:0/1427103132 learned_addr learned my addr 172.21.15.83:0/1427103132 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43f3fff640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 0x7f43fc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fad9d640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 0x7f43fc198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:45.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 -- 172.21.15.83:0/1427103132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 msgr2=0x7f43fc198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 0x7f43fc198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 -- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 msgr2=0x7f43fc1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 0x7f43fc1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 -- 172.21.15.83:0/1427103132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc19a890 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43fb59e640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43f40097b0 tx=0x7f43f4003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4004240 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc19ab20 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f40317c0 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f402fd80 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.718+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a1260 con 0x7f43fc108760 2024-09-10T20:47:45.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.719+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc0fecf0 con 0x7f43fc108760 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.720+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f43f40043e0 con 0x7f43fc108760 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.722+0000 7f43f8d99640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 0x7f43e80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.722+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5965+0+0 (secure 0 0 0) 0x7f43f41068a0 con 0x7f43fc108760 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.722+0000 7f43fad9d640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 0x7f43e80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.723+0000 7f43fad9d640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 0x7f43e80b77a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bbe0 tx=0x7f43ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:47:45.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.726+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43f40ce090 con 0x7f43fc108760 2024-09-10T20:47:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T20:47:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T20:47:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:47:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi067 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:45.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:45.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:47:45.916+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f43fc063590 con 0x7f43e80b52e0 2024-09-10T20:47:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi067 2024-09-10T20:47:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-10T20:47:46.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:46.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:46.202 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:46.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T20:47:46.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T20:47:46.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi067 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi067 to 4272M 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:47:46.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:47.026 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:47.027 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' 2024-09-10T20:47:47.027 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T20:47:46.751+0000 7f6b119a1640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T20:47:47.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T20:47:46.793+0000 7f6b08fac640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' 2024-09-10T20:47:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:47:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:47:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2024-09-10T20:47:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854]' entity='osd.9' 2024-09-10T20:47:47.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:47.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:47 smithi083 ceph-mon[35058]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:47.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:47 smithi083 ceph-mon[35058]: osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] boot 2024-09-10T20:47:47.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:47 smithi083 ceph-mon[35058]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T20:47:47.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:47 smithi172 ceph-mon[35265]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:47 smithi172 ceph-mon[35265]: osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] boot 2024-09-10T20:47:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:47 smithi172 ceph-mon[35265]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T20:47:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:48.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:47 smithi067 ceph-mon[30891]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-10T20:47:48.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:47 smithi067 ceph-mon[30891]: osd.9 [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] boot 2024-09-10T20:47:48.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:47 smithi067 ceph-mon[30891]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T20:47:48.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T20:47:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:48 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/1964166239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:48 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:48 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"}]': finished 2024-09-10T20:47:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:48 smithi083 ceph-mon[35058]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T20:47:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:47:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:48 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/1964166239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:48 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:48 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"}]': finished 2024-09-10T20:47:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:48 smithi172 ceph-mon[35265]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T20:47:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:47:49.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:48 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/1964166239' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:48 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"} : dispatch 2024-09-10T20:47:49.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:48 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd1ab16a-dfb6-446d-b9d4-67e2262b81ab"}]': finished 2024-09-10T20:47:49.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:48 smithi067 ceph-mon[30891]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T20:47:49.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:47:50.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:49 smithi083 ceph-mon[35058]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:50.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:49 smithi083 ceph-mon[35058]: from='client.? 172.21.15.83:0/2200640641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:50.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:49 smithi172 ceph-mon[35265]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:50.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:49 smithi172 ceph-mon[35265]: from='client.? 172.21.15.83:0/2200640641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:50.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:49 smithi067 ceph-mon[30891]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:50.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:49 smithi067 ceph-mon[30891]: from='client.? 172.21.15.83:0/2200640641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:47:52.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:51 smithi083 ceph-mon[35058]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:51 smithi172 ceph-mon[35265]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:52.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:51 smithi067 ceph-mon[30891]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:54.019 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:53 smithi083 ceph-mon[35058]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:54.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:53 smithi172 ceph-mon[35265]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:54.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:53 smithi067 ceph-mon[30891]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:56.052 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:55 smithi083 ceph-mon[35058]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:56.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:55 smithi172 ceph-mon[35265]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:56.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:55 smithi067 ceph-mon[30891]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:58.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:57 smithi083 ceph-mon[35058]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:58.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T20:47:58.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:57 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:57 smithi083 ceph-mon[35058]: Deploying daemon osd.10 on smithi083 2024-09-10T20:47:58.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:57 smithi172 ceph-mon[35265]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:58.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T20:47:58.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:57 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:58.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:57 smithi172 ceph-mon[35265]: Deploying daemon osd.10 on smithi083 2024-09-10T20:47:58.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:57 smithi067 ceph-mon[30891]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:47:58.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T20:47:58.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:57 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:47:58.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:57 smithi067 ceph-mon[30891]: Deploying daemon osd.10 on smithi083 2024-09-10T20:48:00.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:47:59 smithi083 ceph-mon[35058]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:00.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:47:59 smithi172 ceph-mon[35265]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:00.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:47:59 smithi067 ceph-mon[30891]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:02.140 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:01 smithi083 ceph-mon[35058]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:02.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:01 smithi172 ceph-mon[35265]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:02.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:01 smithi067 ceph-mon[30891]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:03.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:03.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:03.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:03.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:03.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:03.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:03.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:03.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:03.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:04.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:03 smithi083 ceph-mon[35058]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:04.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:03 smithi172 ceph-mon[35265]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:04.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:03 smithi067 ceph-mon[30891]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:05.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.843+0000 7f43f8d99640 1 -- 172.21.15.83:0/1427103132 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f43fc063590 con 0x7f43e80b52e0 2024-09-10T20:48:05.848 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 10 on host 'smithi083' 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 msgr2=0x7f43e80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 0x7f43e80b77a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bbe0 tx=0x7f43ec00b390 comp rx=0 tx=0).stop 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 msgr2=0x7f43fc199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43f40097b0 tx=0x7f43f4003c20 comp rx=0 tx=0).stop 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 shutdown_connections 2024-09-10T20:48:05.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43fc108760 0x7f43fc199ff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43fc105c10 0x7f43fc1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f43e80b52e0 0x7f43e80b77a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 --2- 172.21.15.83:0/1427103132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43fc06c020 0x7f43fc198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 >> 172.21.15.83:0/1427103132 conn(0x7f43fc0fd200 msgr2=0x7f43fc103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 shutdown_connections 2024-09-10T20:48:05.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-10T20:48:05.846+0000 7f4401235640 1 -- 172.21.15.83:0/1427103132 wait complete. 2024-09-10T20:48:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:05 smithi083 ceph-mon[35058]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:05 smithi172 ceph-mon[35265]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:05 smithi067 ceph-mon[30891]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:06.491 DEBUG:teuthology.orchestra.run.smithi083:osd.10> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T20:48:06.494 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-10T20:48:06.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T20:48:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:48:08.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:08 smithi172 ceph-mon[35265]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:08.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.180 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:08 smithi067 ceph-mon[30891]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:08.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:08 smithi083 ceph-mon[35058]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:08.971 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 20:48:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T20:48:08.854+0000 7ff64ff14640 -1 osd.10 0 log_to_monitors true 2024-09-10T20:48:09.275 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:09 smithi172 ceph-mon[35265]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.276 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:09 smithi172 ceph-mon[35265]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.278 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-10T20:48:09.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-10T20:48:09.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:09 smithi083 ceph-mon[35058]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:09 smithi083 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:09 smithi067 ceph-mon[30891]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:09 smithi067 ceph-mon[30891]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T20:48:09.562 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:48:10.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.027+0000 7f3b190da640 1 -- 172.21.15.172:0/155133425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 msgr2=0x7f3b14102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:10.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.027+0000 7f3b190da640 1 --2- 172.21.15.172:0/155133425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b14102ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009960 tx=0x7f3b0802a460 comp rx=0 tx=0).stop 2024-09-10T20:48:10.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.027+0000 7f3b190da640 1 -- 172.21.15.172:0/155133425 shutdown_connections 2024-09-10T20:48:10.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 --2- 172.21.15.172:0/155133425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14103430 0x7f3b14109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:10.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 --2- 172.21.15.172:0/155133425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b14102ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:10.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 --2- 172.21.15.172:0/155133425 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14101910 0x7f3b14101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:10.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 -- 172.21.15.172:0/155133425 >> 172.21.15.172:0/155133425 conn(0x7f3b140fd1e0 msgr2=0x7f3b140ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:10.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 -- 172.21.15.172:0/155133425 shutdown_connections 2024-09-10T20:48:10.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 -- 172.21.15.172:0/155133425 wait complete. 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.028+0000 7f3b190da640 1 Processor -- start 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 -- start start 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 0x7f3b14198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14103430 0x7f3b1419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1410d5e0 con 0x7f3b14103430 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1410d460 con 0x7f3b14101910 2024-09-10T20:48:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b190da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1410d760 con 0x7f3b14102a70 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b1259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b1259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33310/0 (socket says 172.21.15.172:33310) 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b1259c640 1 -- 172.21.15.172:0/2151498408 learned_addr learned my addr 172.21.15.172:0/2151498408 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b12d9d640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 0x7f3b14198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.029+0000 7f3b1359e640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14103430 0x7f3b1419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 -- 172.21.15.172:0/2151498408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 msgr2=0x7f3b14198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 0x7f3b14198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 -- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14103430 msgr2=0x7f3b1419a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14103430 0x7f3b1419a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 -- 172.21.15.172:0/2151498408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1419a980 con 0x7f3b14102a70 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b12d9d640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 0x7f3b14198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:48:10.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b1259c640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b08031460 tx=0x7f3b08003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0803f070 con 0x7f3b14102a70 2024-09-10T20:48:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b08031bb0 con 0x7f3b14102a70 2024-09-10T20:48:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1419ac10 con 0x7f3b14102a70 2024-09-10T20:48:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08035030 con 0x7f3b14102a70 2024-09-10T20:48:10.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.030+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b141a1350 con 0x7f3b14102a70 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.031+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b14101d10 con 0x7f3b14102a70 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.032+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3b0803b460 con 0x7f3b14102a70 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.033+0000 7f3afbfff640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 0x7f3afc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.033+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6398+0+0 (secure 0 0 0) 0x7f3b08105f50 con 0x7f3b14102a70 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.033+0000 7f3b12d9d640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 0x7f3afc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.034+0000 7f3b12d9d640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 0x7f3afc0b7820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b040058c0 tx=0x7f3b0400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:10.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.037+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3b080cd590 con 0x7f3b14102a70 2024-09-10T20:48:10.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:10.252+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3b140ff350 con 0x7f3afc0b5360 2024-09-10T20:48:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T20:48:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T20:48:10.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:10.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:10.392 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T20:48:10.156+0000 7ff64be97640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T20:48:10.392 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 20:48:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T20:48:10.168+0000 7ff647cbe640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:10.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:10 smithi067 ceph-mon[30891]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: from='osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:10 smithi172 ceph-mon[35265]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-10T20:48:11.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi083 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.451 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] boot 2024-09-10T20:48:11.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T20:48:11.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:11 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:48:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T20:48:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi083 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-10T20:48:11.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] boot 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T20:48:11.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:11 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi083 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: osd.10 [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] boot 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T20:48:11.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:11 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T20:48:12.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:12 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:48:12.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:12 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:48:12.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:12 smithi172 ceph-mon[35265]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:12.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:12 smithi172 ceph-mon[35265]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T20:48:12.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:12 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:48:12.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:12 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:48:12.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:12 smithi067 ceph-mon[30891]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:12 smithi067 ceph-mon[30891]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T20:48:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:12 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:48:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:12 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:48:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:12 smithi083 ceph-mon[35058]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-10T20:48:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:12 smithi083 ceph-mon[35058]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T20:48:13.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:13 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/285269023' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:13 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:13 smithi172 ceph-mon[35265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"}]': finished 2024-09-10T20:48:13.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:13 smithi172 ceph-mon[35265]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T20:48:13.336 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:13 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:13.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:13 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/285269023' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:13 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:13 smithi067 ceph-mon[30891]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"}]': finished 2024-09-10T20:48:13.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:13 smithi067 ceph-mon[30891]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T20:48:13.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:13 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:13 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/285269023' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:13 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"} : dispatch 2024-09-10T20:48:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:13 smithi083 ceph-mon[35058]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bee1a1-ca3e-42df-b858-ffe08396314c"}]': finished 2024-09-10T20:48:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:13 smithi083 ceph-mon[35058]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T20:48:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:13 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:14 smithi172 ceph-mon[35265]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:14 smithi172 ceph-mon[35265]: from='client.? 172.21.15.172:0/2057186508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:48:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:14 smithi067 ceph-mon[30891]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:14 smithi067 ceph-mon[30891]: from='client.? 172.21.15.172:0/2057186508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:48:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:14 smithi083 ceph-mon[35058]: pgmap v237: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:14 smithi083 ceph-mon[35058]: from='client.? 172.21.15.172:0/2057186508' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T20:48:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:16 smithi172 ceph-mon[35265]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:16 smithi067 ceph-mon[30891]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:16 smithi083 ceph-mon[35058]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:18 smithi172 ceph-mon[35265]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:18 smithi067 ceph-mon[30891]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:18 smithi083 ceph-mon[35058]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:20.270 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:20 smithi172 ceph-mon[35265]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T20:48:20.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:20 smithi067 ceph-mon[30891]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T20:48:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:20 smithi083 ceph-mon[35058]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-10T20:48:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:22 smithi172 ceph-mon[35265]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T20:48:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T20:48:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:22 smithi172 ceph-mon[35265]: Deploying daemon osd.11 on smithi172 2024-09-10T20:48:22.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:22 smithi067 ceph-mon[30891]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T20:48:22.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T20:48:22.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:22.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:22 smithi067 ceph-mon[30891]: Deploying daemon osd.11 on smithi172 2024-09-10T20:48:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:22 smithi083 ceph-mon[35058]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T20:48:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T20:48:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:22 smithi083 ceph-mon[35058]: Deploying daemon osd.11 on smithi172 2024-09-10T20:48:24.443 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:24 smithi083 ceph-mon[35058]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:48:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:24 smithi172 ceph-mon[35265]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:48:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:24 smithi067 ceph-mon[30891]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T20:48:26.339 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:26 smithi172 ceph-mon[35265]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:26 smithi067 ceph-mon[30891]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:26 smithi083 ceph-mon[35058]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:27.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:27.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:27.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:27 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:27.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:27.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:27.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:27 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:27 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:28.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:28 smithi172 ceph-mon[35265]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:28.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:28 smithi067 ceph-mon[30891]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:28 smithi083 ceph-mon[35058]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-09-10T20:48:30.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.214+0000 7f3afbfff640 1 -- 172.21.15.172:0/2151498408 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3b140ff350 con 0x7f3afc0b5360 2024-09-10T20:48:30.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 msgr2=0x7f3afc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 0x7f3afc0b7820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b040058c0 tx=0x7f3b0400a2d0 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 msgr2=0x7f3b141994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b08031460 tx=0x7f3b08003b90 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 shutdown_connections 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b14103430 0x7f3b1419a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3afc0b5360 0x7f3afc0b7820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b14102a70 0x7f3b141994a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 --2- 172.21.15.172:0/2151498408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b14101910 0x7f3b14198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.216+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 >> 172.21.15.172:0/2151498408 conn(0x7f3b140fd1e0 msgr2=0x7f3b140fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.217+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 shutdown_connections 2024-09-10T20:48:30.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:30.217+0000 7f3b190da640 1 -- 172.21.15.172:0/2151498408 wait complete. 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:30 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:30.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:30.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:30.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:30 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:30 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:30.858 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T20:48:30.861 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T20:48:30.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T20:48:31.135 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:31.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:31.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:31 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.528 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:31.528 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.528 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:31 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 -- 172.21.15.67:0/3095449269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 msgr2=0x7f046c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:31.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 --2- 172.21.15.67:0/3095449269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c102ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f045c009930 tx=0x7f045c02a420 comp rx=0 tx=0).stop 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 -- 172.21.15.67:0/3095449269 shutdown_connections 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 --2- 172.21.15.67:0/3095449269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c103430 0x7f046c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 --2- 172.21.15.67:0/3095449269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c102ef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 --2- 172.21.15.67:0/3095449269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c101910 0x7f046c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 -- 172.21.15.67:0/3095449269 >> 172.21.15.67:0/3095449269 conn(0x7f046c0fd1e0 msgr2=0x7f046c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 -- 172.21.15.67:0/3095449269 shutdown_connections 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.609+0000 7f0473df2640 1 -- 172.21.15.67:0/3095449269 wait complete. 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 Processor -- start 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 -- start start 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 0x7f046c19b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c103430 0x7f046c19c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:31.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f046c10d590 con 0x7f046c102a70 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f046c10d410 con 0x7f046c101910 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f0473df2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f046c10d710 con 0x7f046c103430 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f047138d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f047138d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33892/0 (socket says 172.21.15.67:33892) 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f047138d640 1 -- 172.21.15.67:0/2439342451 learned_addr learned my addr 172.21.15.67:0/2439342451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.610+0000 7f047238f640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c103430 0x7f046c19c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0471b8e640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 0x7f046c19b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 -- 172.21.15.67:0/2439342451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c103430 msgr2=0x7f046c19c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c103430 0x7f046c19c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 -- 172.21.15.67:0/2439342451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 msgr2=0x7f046c19b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:31.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 0x7f046c19b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 -- 172.21.15.67:0/2439342451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c19cb70 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0471b8e640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 0x7f046c19b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f047138d640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f045c005740 tx=0x7f045c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c03f030 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c19ce00 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045c003cb0 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c035070 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.611+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1a3540 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.612+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c101d10 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.614+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f045c003800 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.614+0000 7f0462ffd640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 0x7f04580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.615+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7f045c106280 con 0x7f046c102a70 2024-09-10T20:48:31.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.615+0000 7f0471b8e640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 0x7f04580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:31.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.615+0000 7f0471b8e640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 0x7f04580b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0468009c20 tx=0x7f0468005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:31.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.618+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f045c0cd720 con 0x7f046c102a70 2024-09-10T20:48:31.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:31.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:31 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:31.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.805+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f046c1a38d0 con 0x7f046c102a70 2024-09-10T20:48:31.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.805+0000 7f0462ffd640 1 -- 172.21.15.67:0/2439342451 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f045c0cd020 con 0x7f046c102a70 2024-09-10T20:48:31.810 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:31.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 msgr2=0x7f04580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:31.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 0x7f04580b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0468009c20 tx=0x7f0468005f90 comp rx=0 tx=0).stop 2024-09-10T20:48:31.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 msgr2=0x7f046c19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f045c005740 tx=0x7f045c0042f0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 shutdown_connections 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04580b52e0 0x7f04580b77a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f046c103430 0x7f046c19c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f046c102a70 0x7f046c19b690 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 --2- 172.21.15.67:0/2439342451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f046c101910 0x7f046c19b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 >> 172.21.15.67:0/2439342451 conn(0x7f046c0fd1e0 msgr2=0x7f046c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 shutdown_connections 2024-09-10T20:48:31.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:31.808+0000 7f0473df2640 1 -- 172.21.15.67:0/2439342451 wait complete. 2024-09-10T20:48:32.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:32 smithi172 ceph-mon[35265]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:32.333 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:32 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2439342451' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:32.524 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:32 smithi067 ceph-mon[30891]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:32.525 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:32 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2439342451' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:32.553 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726001291,"num_in_osds":12,"osd_in_since":1726001292,"num_remapped_pgs":0} 2024-09-10T20:48:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:32 smithi083 ceph-mon[35058]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:32 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2439342451' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 20:48:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T20:48:32.709+0000 7f1949fd4640 -1 osd.11 0 log_to_monitors true 2024-09-10T20:48:33.394 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:33 smithi172 ceph-mon[35265]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.394 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:33 smithi172 ceph-mon[35265]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:33 smithi067 ceph-mon[30891]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:33 smithi067 ceph-mon[30891]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.554 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T20:48:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:33 smithi083 ceph-mon[35058]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:33 smithi083 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T20:48:33.833 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:34.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/1296480380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48102a30 msgr2=0x7f7a48102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/1296480380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48102a30 0x7f7a48102e30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009930 tx=0x7f7a3802a420 comp rx=0 tx=0).stop 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/1296480380 shutdown_connections 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/1296480380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48104550 0x7f7a4810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/1296480380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48103b90 0x7f7a48104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/1296480380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48102a30 0x7f7a48102e30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/1296480380 >> 172.21.15.67:0/1296480380 conn(0x7f7a480fe320 msgr2=0x7f7a48100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/1296480380 shutdown_connections 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/1296480380 wait complete. 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 Processor -- start 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.345+0000 7f7a4dc5e640 1 -- start start 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 0x7f7a48198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:34.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48104550 0x7f7a4819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4810e6b0 con 0x7f7a48103b90 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4810e530 con 0x7f7a48102a30 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4810e830 con 0x7f7a48104550 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33984/0 (socket says 172.21.15.67:33984) 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 -- 172.21.15.67:0/916051937 learned_addr learned my addr 172.21.15.67:0/916051937 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a477fe640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 0x7f7a48198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a47fff640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48104550 0x7f7a4819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 -- 172.21.15.67:0/916051937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48104550 msgr2=0x7f7a4819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48104550 0x7f7a4819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 -- 172.21.15.67:0/916051937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 msgr2=0x7f7a48198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 0x7f7a48198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 -- 172.21.15.67:0/916051937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4819a8f0 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a477fe640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 0x7f7a48198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a46ffd640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00d770 tx=0x7f7a3c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c017070 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4819abe0 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a3c0054d0 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.346+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c004c30 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.347+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a481a12c0 con 0x7f7a48103b90 2024-09-10T20:48:34.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.347+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a48102e30 con 0x7f7a48103b90 2024-09-10T20:48:34.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.349+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7a3c004dd0 con 0x7f7a48103b90 2024-09-10T20:48:34.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.350+0000 7f7a44ff9640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 0x7f7a300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:34.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.350+0000 7f7a477fe640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 0x7f7a300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:34.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.350+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6847+0+0 (secure 0 0 0) 0x7f7a3c0e55a0 con 0x7f7a48103b90 2024-09-10T20:48:34.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.350+0000 7f7a477fe640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 0x7f7a300b77a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a38006010 tx=0x7f7a38031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:34.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.353+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a3c0aca20 con 0x7f7a48103b90 2024-09-10T20:48:34.525 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T20:48:34.228+0000 7f1945f57640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T20:48:34.525 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T20:48:34.244+0000 7f1941d7e640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:48:34.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:34.525 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.526 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.527 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:34.528 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:34.528 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.539+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7a4802e660 con 0x7f7a48103b90 2024-09-10T20:48:34.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:34.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T20:48:34.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T20:48:34.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:34.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.540+0000 7f7a44ff9640 1 -- 172.21.15.67:0/916051937 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f7a4802e660 con 0x7f7a48103b90 2024-09-10T20:48:34.546 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:34.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 msgr2=0x7f7a300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 0x7f7a300b77a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a38006010 tx=0x7f7a38031450 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 msgr2=0x7f7a48199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00d770 tx=0x7f7a3c00dc30 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 shutdown_connections 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a300b52e0 0x7f7a300b77a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a48104550 0x7f7a4819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a48103b90 0x7f7a48199480 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 --2- 172.21.15.67:0/916051937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a48102a30 0x7f7a48198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 >> 172.21.15.67:0/916051937 conn(0x7f7a480fe320 msgr2=0x7f7a48106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 shutdown_connections 2024-09-10T20:48:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:34.542+0000 7f7a4dc5e640 1 -- 172.21.15.67:0/916051937 wait complete. 2024-09-10T20:48:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T20:48:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: Detected new or changed devices on smithi172 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.267 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/916051937' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:35.268 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726001291,"num_in_osds":12,"osd_in_since":1726001292,"num_remapped_pgs":0} 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: Detected new or changed devices on smithi172 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/916051937' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: Detected new or changed devices on smithi172 2024-09-10T20:48:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-10T20:48:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-10T20:48:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T20:48:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/916051937' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:36.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T20:48:36.536 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: purged_snaps scrub starts 2024-09-10T20:48:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: purged_snaps scrub ok 2024-09-10T20:48:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] boot 2024-09-10T20:48:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T20:48:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: purged_snaps scrub starts 2024-09-10T20:48:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: purged_snaps scrub ok 2024-09-10T20:48:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:36.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] boot 2024-09-10T20:48:36.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T20:48:36.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: purged_snaps scrub starts 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: purged_snaps scrub ok 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: osd.11 [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] boot 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T20:48:36.719 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T20:48:37.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- 172.21.15.67:0/1310513201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940101950 msgr2=0x7fd940101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:37.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 --2- 172.21.15.67:0/1310513201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940101950 0x7fd940101d50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009930 tx=0x7fd93c02a420 comp rx=0 tx=0).stop 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- 172.21.15.67:0/1310513201 shutdown_connections 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 --2- 172.21.15.67:0/1310513201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940103470 0x7fd940109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 --2- 172.21.15.67:0/1310513201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940102ab0 0x7fd940102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 --2- 172.21.15.67:0/1310513201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940101950 0x7fd940101d50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- 172.21.15.67:0/1310513201 >> 172.21.15.67:0/1310513201 conn(0x7fd9400fd200 msgr2=0x7fd9400ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- 172.21.15.67:0/1310513201 shutdown_connections 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- 172.21.15.67:0/1310513201 wait complete. 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 Processor -- start 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.038+0000 7fd947e0d640 1 -- start start 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 0x7fd940198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:37.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 0x7fd94019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e700 con 0x7fd940102ab0 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e580 con 0x7fd940101950 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd94010e880 con 0x7fd940103470 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34002/0 (socket says 172.21.15.67:34002) 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 -- 172.21.15.67:0/3190428126 learned_addr learned my addr 172.21.15.67:0/3190428126 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd945ba9640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 0x7fd940198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9463aa640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 0x7fd94019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 -- 172.21.15.67:0/3190428126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 msgr2=0x7fd94019a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 0x7fd94019a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 -- 172.21.15.67:0/3190428126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 msgr2=0x7fd940198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 0x7fd940198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 -- 172.21.15.67:0/3190428126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94019a980 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd945ba9640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 0x7fd940198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9463aa640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 0x7fd94019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd9453a8640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd93000d770 tx=0x7fd93000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930017070 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9300054d0 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94019ac70 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930004c30 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.039+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9401a1350 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.040+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9401a1520 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.042+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd930004dd0 con 0x7fd940102ab0 2024-09-10T20:48:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.042+0000 7fd936ffd640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 0x7fd92c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:37.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.043+0000 7fd945ba9640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 0x7fd92c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:37.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.043+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fd9300e5640 con 0x7fd940102ab0 2024-09-10T20:48:37.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.043+0000 7fd945ba9640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 0x7fd92c0b7820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd93c006010 tx=0x7fd93c031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:37.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.045+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd9300aca20 con 0x7fd940102ab0 2024-09-10T20:48:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.231+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd9401a16f0 con 0x7fd940102ab0 2024-09-10T20:48:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.231+0000 7fd936ffd640 1 -- 172.21.15.67:0/3190428126 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fd9300ac320 con 0x7fd940102ab0 2024-09-10T20:48:37.236 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 msgr2=0x7fd92c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 0x7fd92c0b7820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd93c006010 tx=0x7fd93c031450 comp rx=0 tx=0).stop 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 msgr2=0x7fd9401994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd93000d770 tx=0x7fd93000dc30 comp rx=0 tx=0).stop 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 shutdown_connections 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd92c0b5360 0x7fd92c0b7820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd940103470 0x7fd94019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd940102ab0 0x7fd9401994a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 --2- 172.21.15.67:0/3190428126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd940101950 0x7fd940198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 >> 172.21.15.67:0/3190428126 conn(0x7fd9400fd200 msgr2=0x7fd940103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 shutdown_connections 2024-09-10T20:48:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:37.234+0000 7fd947e0d640 1 -- 172.21.15.67:0/3190428126 wait complete. 2024-09-10T20:48:37.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:37 smithi067 ceph-mon[30891]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T20:48:37.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:37 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3190428126' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:37 smithi083 ceph-mon[35058]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T20:48:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:37 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3190428126' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:37.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:37 smithi172 ceph-mon[35265]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T20:48:37.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:37 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3190428126' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T20:48:37.870 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726001315,"num_in_osds":12,"osd_in_since":1726001292,"num_remapped_pgs":0} 2024-09-10T20:48:37.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:48:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:38 smithi067 ceph-mon[30891]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 -- 172.21.15.67:0/1873778026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f41087f0 msgr2=0x7f08f4108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 --2- 172.21.15.67:0/1873778026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f41087f0 0x7f08f4108c30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009900 tx=0x7f08dc02a410 comp rx=0 tx=0).stop 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 -- 172.21.15.67:0/1873778026 shutdown_connections 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 --2- 172.21.15.67:0/1873778026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f4109170 0x7f08f410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 --2- 172.21.15.67:0/1873778026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f41087f0 0x7f08f4108c30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 --2- 172.21.15.67:0/1873778026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f4102de0 0x7f08f41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 -- 172.21.15.67:0/1873778026 >> 172.21.15.67:0/1873778026 conn(0x7f08f40fe830 msgr2=0x7f08f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 -- 172.21.15.67:0/1873778026 shutdown_connections 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 -- 172.21.15.67:0/1873778026 wait complete. 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.543+0000 7f08f93e6640 1 Processor -- start 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 -- start start 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f41087f0 0x7f08f4199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f4109170 0x7f08f419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4112e70 con 0x7f08f4102de0 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4112cf0 con 0x7f08f4109170 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f93e6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4112ff0 con 0x7f08f41087f0 2024-09-10T20:48:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34024/0 (socket says 172.21.15.67:34024) 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 -- 172.21.15.67:0/3241999599 learned_addr learned my addr 172.21.15.67:0/3241999599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 -- 172.21.15.67:0/3241999599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f41087f0 msgr2=0x7f08f4199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f27fc640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f41087f0 0x7f08f4199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f41087f0 0x7f08f4199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 -- 172.21.15.67:0/3241999599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f4109170 msgr2=0x7f08f419ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f4109170 0x7f08f419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.544+0000 7f08f2ffd640 1 -- 172.21.15.67:0/3241999599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f419f490 con 0x7f08f4102de0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08f2ffd640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b4a0 tx=0x7f08ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec014070 con 0x7f08f4102de0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f419f780 con 0x7f08f4102de0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08ec010ac0 con 0x7f08f4102de0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec017c30 con 0x7f08f4102de0 2024-09-10T20:48:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.545+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f41a5ec0 con 0x7f08f4102de0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.546+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f4103240 con 0x7f08f4102de0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.547+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f08ec010610 con 0x7f08f4102de0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.548+0000 7f08ebfff640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 0x7f08e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.548+0000 7f08f27fc640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 0x7f08e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.548+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f08ec0e4d90 con 0x7f08f4102de0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.549+0000 7f08f27fc640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 0x7f08e00b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08dc006010 tx=0x7f08dc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.552+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f08ec0ac0f0 con 0x7f08f4102de0 2024-09-10T20:48:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:38 smithi083 ceph-mon[35058]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:38 smithi172 ceph-mon[35265]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:38.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.740+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08f402e650 con 0x7f08f4102de0 2024-09-10T20:48:38.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.741+0000 7f08ebfff640 1 -- 172.21.15.67:0/3241999599 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18409 (secure 0 0 0) 0x7f08ec0ab9f0 con 0x7f08f4102de0 2024-09-10T20:48:38.745 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:38.746 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":68,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:48:36.231201+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 msgr2=0x7f08e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 0x7f08e00b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08dc006010 tx=0x7f08dc000bc0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 msgr2=0x7f08f41993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b4a0 tx=0x7f08ec00b960 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 shutdown_connections 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08f4109170 0x7f08f419ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08e00b52e0 0x7f08e00b77a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f41087f0 0x7f08f4199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 --2- 172.21.15.67:0/3241999599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f08f4102de0 0x7f08f41993e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.743+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 >> 172.21.15.67:0/3241999599 conn(0x7f08f40fe830 msgr2=0x7f08f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.744+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 shutdown_connections 2024-09-10T20:48:38.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:38.744+0000 7f08f93e6640 1 -- 172.21.15.67:0/3241999599 wait complete. 2024-09-10T20:48:39.412 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:39 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3241999599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:48:39.441 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T20:44:51.135967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T20:48:39.441 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T20:48:39.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:39 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3241999599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:48:39.693 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:39.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:39 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3241999599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:48:40.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.129+0000 7f3e37c69640 1 -- 172.21.15.67:0/583143715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e3010f420 msgr2=0x7f3e30111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:40.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.129+0000 7f3e37c69640 1 --2- 172.21.15.67:0/583143715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e3010f420 0x7f3e30111810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009900 tx=0x7f3e2802a3f0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 -- 172.21.15.67:0/583143715 shutdown_connections 2024-09-10T20:48:40.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 --2- 172.21.15.67:0/583143715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e3010f420 0x7f3e30111810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 --2- 172.21.15.67:0/583143715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e30102190 0x7f3e3010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 --2- 172.21.15.67:0/583143715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e30101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 -- 172.21.15.67:0/583143715 >> 172.21.15.67:0/583143715 conn(0x7f3e300fd700 msgr2=0x7f3e300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 -- 172.21.15.67:0/583143715 shutdown_connections 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 -- 172.21.15.67:0/583143715 wait complete. 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 Processor -- start 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.130+0000 7f3e37c69640 1 -- start start 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e3019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e3010f420 0x7f3e301a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30114f60 con 0x7f3e30102190 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3e30114de0 con 0x7f3e30101870 2024-09-10T20:48:40.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e37c69640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e301150e0 con 0x7f3e3010f420 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34044/0 (socket says 172.21.15.67:34044) 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35a05640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e3019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 -- 172.21.15.67:0/1561536237 learned_addr learned my addr 172.21.15.67:0/1561536237 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e36206640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e3010f420 0x7f3e301a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 -- 172.21.15.67:0/1561536237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e3010f420 msgr2=0x7f3e301a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e3010f420 0x7f3e301a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 -- 172.21.15.67:0/1561536237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 msgr2=0x7f3e3019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e3019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 -- 172.21.15.67:0/1561536237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e301a14e0 con 0x7f3e30102190 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35a05640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e3019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:48:40.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e35204640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c890 tx=0x7f3e2400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.131+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24004220 con 0x7f3e30102190 2024-09-10T20:48:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.132+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e301a17d0 con 0x7f3e30102190 2024-09-10T20:48:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.132+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e240043c0 con 0x7f3e30102190 2024-09-10T20:48:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.132+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24004a00 con 0x7f3e30102190 2024-09-10T20:48:40.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.132+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e301a7e90 con 0x7f3e30102190 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.133+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e30101c50 con 0x7f3e30102190 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.134+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3e240079b0 con 0x7f3e30102190 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.135+0000 7f3e2effd640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.135+0000 7f3e35a05640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.135+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f3e240e5880 con 0x7f3e30102190 2024-09-10T20:48:40.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.135+0000 7f3e35a05640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 0x7f3e180b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009fd0 tx=0x7f3e20009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.138+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e24014030 con 0x7f3e30102190 2024-09-10T20:48:40.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.323+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e301a8200 con 0x7f3e30102190 2024-09-10T20:48:40.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.323+0000 7f3e2effd640 1 -- 172.21.15.67:0/1561536237 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7f3e240acbe0 con 0x7f3e30102190 2024-09-10T20:48:40.327 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-10T20:48:40.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 msgr2=0x7f3e180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:40.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 0x7f3e180b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009fd0 tx=0x7f3e20009680 comp rx=0 tx=0).stop 2024-09-10T20:48:40.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 msgr2=0x7f3e3019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c890 tx=0x7f3e2400cd50 comp rx=0 tx=0).stop 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 shutdown_connections 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3e180b52e0 0x7f3e180b77a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e3010f420 0x7f3e301a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e30102190 0x7f3e3019b970 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 --2- 172.21.15.67:0/1561536237 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e30101870 0x7f3e3019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 >> 172.21.15.67:0/1561536237 conn(0x7f3e300fd700 msgr2=0x7f3e300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 shutdown_connections 2024-09-10T20:48:40.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:40.325+0000 7f3e37c69640 1 -- 172.21.15.67:0/1561536237 wait complete. 2024-09-10T20:48:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:40 smithi067 ceph-mon[30891]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:40 smithi083 ceph-mon[35058]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:40 smithi172 ceph-mon[35265]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:41.060 INFO:tasks.cephadm:Adding mds.a on smithi067 2024-09-10T20:48:41.060 INFO:tasks.cephadm:Adding mds.d on smithi067 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.g on smithi067 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.j on smithi067 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.b on smithi083 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.e on smithi083 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.h on smithi083 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.k on smithi083 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-09-10T20:48:41.061 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-09-10T20:48:41.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-09-10T20:48:41.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:41 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1561536237' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:48:41.322 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T20:48:41.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:41 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1561536237' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:48:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:41 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1561536237' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- 172.21.15.172:0/3790230410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841006bf00 msgr2=0x7f8410103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 --2- 172.21.15.172:0/3790230410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841006bf00 0x7f8410103410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).stop 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- 172.21.15.172:0/3790230410 shutdown_connections 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 --2- 172.21.15.172:0/3790230410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8410106550 0x7f8410106a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 --2- 172.21.15.172:0/3790230410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84101039a0 0x7f8410105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 --2- 172.21.15.172:0/3790230410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841006bf00 0x7f8410103410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- 172.21.15.172:0/3790230410 >> 172.21.15.172:0/3790230410 conn(0x7f84100fd210 msgr2=0x7f84100ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- 172.21.15.172:0/3790230410 shutdown_connections 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- 172.21.15.172:0/3790230410 wait complete. 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 Processor -- start 2024-09-10T20:48:41.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 -- start start 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.748+0000 7f841770c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841006bf00 0x7f841019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 0x7f841019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8410114ca0 con 0x7f84101039a0 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8410114b20 con 0x7f841006bf00 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8410114e20 con 0x7f8410106550 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53376/0 (socket says 172.21.15.172:53376) 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 -- 172.21.15.172:0/3977624265 learned_addr learned my addr 172.21.15.172:0/3977624265 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8414ca7640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 0x7f841019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f84154a8640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841006bf00 0x7f841019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:41.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 -- 172.21.15.172:0/3977624265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841006bf00 msgr2=0x7f841019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841006bf00 0x7f841019f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 -- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 msgr2=0x7f841019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 0x7f841019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 -- 172.21.15.172:0/3977624265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84101a0f50 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8414ca7640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 0x7f841019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f8415ca9640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f840800cad0 tx=0x7f840800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840800ae20 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8408005020 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84101a1240 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840800f6b0 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.749+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84101a7920 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.750+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84100fed00 con 0x7f8410106550 2024-09-10T20:48:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.752+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f84080054f0 con 0x7f8410106550 2024-09-10T20:48:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.753+0000 7f84067fc640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 0x7f83fc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.753+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f84080e5b00 con 0x7f8410106550 2024-09-10T20:48:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.753+0000 7f84154a8640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 0x7f83fc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.754+0000 7f84154a8640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 0x7f83fc0b7820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f840c005c40 tx=0x7f840c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.756+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8408014030 con 0x7f8410106550 2024-09-10T20:48:41.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.944+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7f8410063690 con 0x7f83fc0b5360 2024-09-10T20:48:41.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.953+0000 7f84067fc640 1 -- 172.21.15.172:0/3977624265 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8410063690 con 0x7f83fc0b5360 2024-09-10T20:48:41.957 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 msgr2=0x7f83fc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 0x7f83fc0b7820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f840c005c40 tx=0x7f840c000bc0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 msgr2=0x7f84101a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f840800cad0 tx=0x7f840800cf90 comp rx=0 tx=0).stop 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 shutdown_connections 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83fc0b5360 0x7f83fc0b7820 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8410106550 0x7f84101a06b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f84101039a0 0x7f841019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 --2- 172.21.15.172:0/3977624265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f841006bf00 0x7f841019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:41.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 >> 172.21.15.172:0/3977624265 conn(0x7f84100fd210 msgr2=0x7f8410104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:41.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 shutdown_connections 2024-09-10T20:48:41.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-10T20:48:41.955+0000 7f841770c640 1 -- 172.21.15.172:0/3977624265 wait complete. 2024-09-10T20:48:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:42 smithi067 ceph-mon[30891]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:42.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:42 smithi172 ceph-mon[35265]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:42.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:42.561 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:42.589 DEBUG:teuthology.orchestra.run.smithi067:mds.a> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T20:48:42.592 DEBUG:teuthology.orchestra.run.smithi067:mds.d> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T20:48:42.636 DEBUG:teuthology.orchestra.run.smithi067:mds.g> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T20:48:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:42 smithi083 ceph-mon[35058]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:48:42.680 DEBUG:teuthology.orchestra.run.smithi067:mds.j> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T20:48:42.723 DEBUG:teuthology.orchestra.run.smithi083:mds.b> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T20:48:42.725 DEBUG:teuthology.orchestra.run.smithi083:mds.e> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T20:48:42.769 DEBUG:teuthology.orchestra.run.smithi083:mds.h> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T20:48:42.812 DEBUG:teuthology.orchestra.run.smithi083:mds.k> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T20:48:42.856 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T20:48:42.858 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T20:48:42.902 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T20:48:42.944 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T20:48:42.987 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T20:48:42.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:48:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:43.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:43.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: Saving service mds.all spec with placement smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:43.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: Saving service mds.all spec with placement smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:48:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: Saving service mds.all spec with placement smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-10T20:48:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:48:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:43.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 -- 172.21.15.67:0/4154228215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a0101cd0 msgr2=0x7f85a01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:43.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 --2- 172.21.15.67:0/4154228215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a0101cd0 0x7f85a01020b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8590009ca0 tx=0x7f859002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 -- 172.21.15.67:0/4154228215 shutdown_connections 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 --2- 172.21.15.67:0/4154228215 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 --2- 172.21.15.67:0/4154228215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a01076e0 0x7f85a0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 --2- 172.21.15.67:0/4154228215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a0101cd0 0x7f85a01020b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 -- 172.21.15.67:0/4154228215 >> 172.21.15.67:0/4154228215 conn(0x7f85a00fd720 msgr2=0x7f85a00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 -- 172.21.15.67:0/4154228215 shutdown_connections 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.742+0000 7f85a536e640 1 -- 172.21.15.67:0/4154228215 wait complete. 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 Processor -- start 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 -- start start 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a0101cd0 0x7f85a019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:43.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a01a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85a0111d20 con 0x7f85a01076e0 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f85a0111ba0 con 0x7f85a0108060 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.743+0000 7f85a536e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85a0111ea0 con 0x7f85a0101cd0 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59356/0 (socket says 172.21.15.67:59356) 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 -- 172.21.15.67:0/3912565291 learned_addr learned my addr 172.21.15.67:0/3912565291 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859effd640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a0101cd0 0x7f85a019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859f7fe640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a01a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 -- 172.21.15.67:0/3912565291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a0101cd0 msgr2=0x7f85a019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a0101cd0 0x7f85a019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 -- 172.21.15.67:0/3912565291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 msgr2=0x7f85a01a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a01a5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 -- 172.21.15.67:0/3912565291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a01a5680 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859f7fe640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a01a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f859e7fc640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9f0 tx=0x7f858800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858800cd80 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a01a5850 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85880054d0 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588010690 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.744+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a01a5d30 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.745+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a01020b0 con 0x7f85a01076e0 2024-09-10T20:48:43.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.747+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8588004e30 con 0x7f85a01076e0 2024-09-10T20:48:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.748+0000 7f8597fff640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 0x7f858c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.748+0000 7f859effd640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 0x7f858c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.748+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f85880e5d90 con 0x7f85a01076e0 2024-09-10T20:48:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.748+0000 7f859effd640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 0x7f858c0b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8590009430 tx=0x7f8590009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:43.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.750+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8588056220 con 0x7f85a01076e0 2024-09-10T20:48:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.974+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85a006b900 con 0x7f85a01076e0 2024-09-10T20:48:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.974+0000 7f8597fff640 1 -- 172.21.15.67:0/3912565291 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f85a006b900 con 0x7f85a01076e0 2024-09-10T20:48:43.979 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:43.979 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"btime":"2024-09-10T20:41:20:188828+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T20:48:43.979 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 1 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.976+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 msgr2=0x7f858c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.976+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 0x7f858c0b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8590009430 tx=0x7f8590009360 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.976+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 msgr2=0x7f85a019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.976+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9f0 tx=0x7f858800edf0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 shutdown_connections 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85a0108060 0x7f85a01a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85a01076e0 0x7f85a019a600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f858c0b52e0 0x7f858c0b77a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 --2- 172.21.15.67:0/3912565291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a0101cd0 0x7f85a019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:43.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 >> 172.21.15.67:0/3912565291 conn(0x7f85a00fd720 msgr2=0x7f85a00ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 shutdown_connections 2024-09-10T20:48:43.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:43.977+0000 7f85a536e640 1 -- 172.21.15.67:0/3912565291 wait complete. 2024-09-10T20:48:44.397 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:44 smithi172 ceph-mon[35265]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:44.397 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:44 smithi172 ceph-mon[35265]: Deploying daemon mds.l on smithi172 2024-09-10T20:48:44.397 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:44 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3912565291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:44 smithi067 ceph-mon[30891]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:44 smithi067 ceph-mon[30891]: Deploying daemon mds.l on smithi172 2024-09-10T20:48:44.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:44 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3912565291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:44 smithi083 ceph-mon[35058]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:44 smithi083 ceph-mon[35058]: Deploying daemon mds.l on smithi172 2024-09-10T20:48:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:44 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3912565291' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:44.699 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:44 smithi172 systemd[1]: Starting Ceph mds.l for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:45.034 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:44 smithi172 podman[64082]: 2024-09-10 20:48:44.682598284 +0000 UTC m=+0.015606718 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:45.034 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:44 smithi172 podman[64082]: 2024-09-10 20:48:44.800487936 +0000 UTC m=+0.133496366 container create 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T20:48:45.034 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 podman[64082]: 2024-09-10 20:48:45.027996782 +0000 UTC m=+0.361005226 container init 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:48:45.034 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 podman[64082]: 2024-09-10 20:48:45.030766089 +0000 UTC m=+0.363774526 container start 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:48:45.449 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 ceph-mds[64102]: -- 172.21.15.172:0/800887673 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55808cf35860 con 0x55808cf13000 2024-09-10T20:48:45.449 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l[64098]: starting mds.l at 2024-09-10T20:48:45.449 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 bash[64082]: 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 2024-09-10T20:48:45.449 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 20:48:45 smithi172 systemd[1]: Started Ceph mds.l for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:48:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6832/2002269630,v1:172.21.15.172:6833/2002269630] up:boot 2024-09-10T20:48:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: fsmap 1 up:standby 2024-09-10T20:48:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:46.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:46 smithi083 ceph-mon[35058]: Deploying daemon mds.k on smithi083 2024-09-10T20:48:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6832/2002269630,v1:172.21.15.172:6833/2002269630] up:boot 2024-09-10T20:48:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: fsmap 1 up:standby 2024-09-10T20:48:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:46.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:46 smithi172 ceph-mon[35265]: Deploying daemon mds.k on smithi083 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6832/2002269630,v1:172.21.15.172:6833/2002269630] up:boot 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: fsmap 1 up:standby 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:46.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:46.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:46.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:46.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:46 smithi067 ceph-mon[30891]: Deploying daemon mds.k on smithi083 2024-09-10T20:48:46.778 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:48:47.047 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:47.391 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 systemd[1]: Starting Ceph mds.k for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:47.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 -- 172.21.15.67:0/207413681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 msgr2=0x7fb89810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 --2- 172.21.15.67:0/207413681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89810e860 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb890009ca0 tx=0x7fb89002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 -- 172.21.15.67:0/207413681 shutdown_connections 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 --2- 172.21.15.67:0/207413681 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89810e860 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 --2- 172.21.15.67:0/207413681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 0x7fb898107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 --2- 172.21.15.67:0/207413681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 0x7fb8981020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 -- 172.21.15.67:0/207413681 >> 172.21.15.67:0/207413681 conn(0x7fb8980fd700 msgr2=0x7fb8980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 -- 172.21.15.67:0/207413681 shutdown_connections 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.507+0000 7fb8a0128640 1 -- 172.21.15.67:0/207413681 wait complete. 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 Processor -- start 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 -- start start 2024-09-10T20:48:47.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 0x7fb898199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 0x7fb8981997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb898111d20 con 0x7fb898108060 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb898111ba0 con 0x7fb898101cd0 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb8a0128640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb898111ea0 con 0x7fb8981076e0 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb89e6c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb89dec4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 0x7fb898199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb89e6c5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59378/0 (socket says 172.21.15.67:59378) 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb89e6c5640 1 -- 172.21.15.67:0/4231456732 learned_addr learned my addr 172.21.15.67:0/4231456732 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.508+0000 7fb89d6c3640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 0x7fb8981997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:47.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 -- 172.21.15.67:0/4231456732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 msgr2=0x7fb8981997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 0x7fb8981997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 -- 172.21.15.67:0/4231456732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 msgr2=0x7fb898199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 0x7fb898199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 -- 172.21.15.67:0/4231456732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89819f310 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb89e6c5640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb890005cc0 tx=0x7fb89002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890003bf0 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb890003d90 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89819f5a0 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89002fb20 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.509+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8981a5d40 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.510+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8981020b0 con 0x7fb898108060 2024-09-10T20:48:47.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.512+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb890004580 con 0x7fb898108060 2024-09-10T20:48:47.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.512+0000 7fb88effd640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 0x7fb8840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:47.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.512+0000 7fb89dec4640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 0x7fb8840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:47.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.512+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb890106ba0 con 0x7fb898108060 2024-09-10T20:48:47.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.513+0000 7fb89dec4640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 0x7fb8840b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb89400bbe0 tx=0x7fb89400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:47.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.515+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8900cdf00 con 0x7fb898108060 2024-09-10T20:48:47.671 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 podman[64238]: 2024-09-10 20:48:47.319135628 +0000 UTC m=+0.016007136 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:47.671 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 podman[64238]: 2024-09-10 20:48:47.420415746 +0000 UTC m=+0.117287285 container create ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:48:47.671 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 podman[64238]: 2024-09-10 20:48:47.664541364 +0000 UTC m=+0.361412860 container init ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T20:48:47.671 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 podman[64238]: 2024-09-10 20:48:47.667546812 +0000 UTC m=+0.364418309 container start ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T20:48:47.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.736+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8981a6000 con 0x7fb898108060 2024-09-10T20:48:47.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.737+0000 7fb88effd640 1 -- 172.21.15.67:0/4231456732 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fb8900cd800 con 0x7fb898108060 2024-09-10T20:48:47.741 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:47.741 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"btime":"2024-09-10T20:48:45:059380+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T20:48:47.741 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2024-09-10T20:48:47.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 msgr2=0x7fb8840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:47.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 0x7fb8840b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb89400bbe0 tx=0x7fb89400b390 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 msgr2=0x7fb89819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb890005cc0 tx=0x7fb89002f380 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 shutdown_connections 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb898108060 0x7fb89819eb40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb8840b52e0 0x7fb8840b77a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8981076e0 0x7fb8981997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 --2- 172.21.15.67:0/4231456732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb898101cd0 0x7fb898199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 >> 172.21.15.67:0/4231456732 conn(0x7fb8980fd700 msgr2=0x7fb898104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 shutdown_connections 2024-09-10T20:48:47.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:47.739+0000 7fb8a0128640 1 -- 172.21.15.67:0/4231456732 wait complete. 2024-09-10T20:48:48.072 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 ceph-mds[64257]: -- 172.21.15.83:0/1280502647 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e30c8d860 con 0x562e30c6a800 2024-09-10T20:48:48.072 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k[64253]: starting mds.k at 2024-09-10T20:48:48.072 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 bash[64238]: ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 20:48:47 smithi083 systemd[1]: Started Ceph mds.k for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4231456732' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:48.073 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:48.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:48.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4231456732' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:48.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:48.534 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:48.534 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4231456732' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:48.534 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.535 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.535 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:48.535 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:48.535 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:48.535 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:49.374 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:49 smithi067 ceph-mon[30891]: Deploying daemon mds.j on smithi067 2024-09-10T20:48:49.374 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:49 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6832/1389029488,v1:172.21.15.83:6833/1389029488] up:boot 2024-09-10T20:48:49.374 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:49 smithi067 ceph-mon[30891]: fsmap 2 up:standby 2024-09-10T20:48:49.374 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T20:48:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:49 smithi083 ceph-mon[35058]: Deploying daemon mds.j on smithi067 2024-09-10T20:48:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:49 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6832/1389029488,v1:172.21.15.83:6833/1389029488] up:boot 2024-09-10T20:48:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:49 smithi083 ceph-mon[35058]: fsmap 2 up:standby 2024-09-10T20:48:49.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T20:48:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:49 smithi172 ceph-mon[35265]: Deploying daemon mds.j on smithi067 2024-09-10T20:48:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:49 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6832/1389029488,v1:172.21.15.83:6833/1389029488] up:boot 2024-09-10T20:48:49.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:49 smithi172 ceph-mon[35265]: fsmap 2 up:standby 2024-09-10T20:48:49.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T20:48:50.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:50 smithi067 ceph-mon[30891]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:50.296 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 systemd[1]: Starting Ceph mds.j for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:50 smithi083 ceph-mon[35058]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:50 smithi172 ceph-mon[35265]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:50.563 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:48:50.604 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 podman[72673]: 2024-09-10 20:48:50.249229954 +0000 UTC m=+0.016078005 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:50.604 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 podman[72673]: 2024-09-10 20:48:50.364724028 +0000 UTC m=+0.131572065 container create 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T20:48:50.604 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 podman[72673]: 2024-09-10 20:48:50.601070054 +0000 UTC m=+0.367918094 container init 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:48:50.837 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:50.955 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 podman[72673]: 2024-09-10 20:48:50.605362365 +0000 UTC m=+0.372210405 container start 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T20:48:50.956 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 ceph-mds[72711]: -- 172.21.15.67:0/2526193030 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2faf77860 con 0x55e2faf54800 2024-09-10T20:48:50.956 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j[72689]: starting mds.j at 2024-09-10T20:48:50.956 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 bash[72673]: 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e 2024-09-10T20:48:50.956 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 20:48:50 smithi067 systemd[1]: Started Ceph mds.j for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- 172.21.15.67:0/3883324685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 msgr2=0x7ff99c10cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3883324685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c10cb90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff984009900 tx=0x7ff98402a410 comp rx=0 tx=0).stop 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- 172.21.15.67:0/3883324685 shutdown_connections 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3883324685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 0x7ff99c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3883324685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c10cb90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3883324685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- 172.21.15.67:0/3883324685 >> 172.21.15.67:0/3883324685 conn(0x7ff99c0fd700 msgr2=0x7ff99c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- 172.21.15.67:0/3883324685 shutdown_connections 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- 172.21.15.67:0/3883324685 wait complete. 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 Processor -- start 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.290+0000 7ff9a14af640 1 -- start start 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 0x7ff99c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c112da0 con 0x7ff99c1045b0 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c112c20 con 0x7ff99c10d160 2024-09-10T20:48:51.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c112f20 con 0x7ff99c103bb0 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59414/0 (socket says 172.21.15.67:59414) 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 -- 172.21.15.67:0/3142350723 learned_addr learned my addr 172.21.15.67:0/3142350723 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff99b7fe640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 0x7ff99c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff99affd640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 -- 172.21.15.67:0/3142350723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 msgr2=0x7ff99c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 -- 172.21.15.67:0/3142350723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 msgr2=0x7ff99c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 0x7ff99c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 -- 172.21.15.67:0/3142350723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c19f380 con 0x7ff99c1045b0 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff99affd640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:48:51.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff993fff640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff984005940 tx=0x7ff9840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98403f030 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff984003cb0 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c19f610 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.291+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984035070 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.292+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c1a5d30 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.293+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c103f90 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.294+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff98403bbf0 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.295+0000 7ff998ff9640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 0x7ff9880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.295+0000 7ff99affd640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 0x7ff9880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.295+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7ff984106670 con 0x7ff99c1045b0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.295+0000 7ff99affd640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 0x7ff9880b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009b40 tx=0x7ff98c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:51.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.298+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff9840cd930 con 0x7ff99c1045b0 2024-09-10T20:48:51.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.523+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff99c1081d0 con 0x7ff99c1045b0 2024-09-10T20:48:51.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.524+0000 7ff998ff9640 1 -- 172.21.15.67:0/3142350723 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7ff9840cd230 con 0x7ff99c1045b0 2024-09-10T20:48:51.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:51.529 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":4,"btime":"2024-09-10T20:48:51:075360+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T20:48:51.529 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 4 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 msgr2=0x7ff9880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 0x7ff9880b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009b40 tx=0x7ff98c005e50 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 msgr2=0x7ff99c199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff984005940 tx=0x7ff9840042f0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 shutdown_connections 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff99c10d160 0x7ff99c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff99c1045b0 0x7ff99c199810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9880b52e0 0x7ff9880b77a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 --2- 172.21.15.67:0/3142350723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99c103bb0 0x7ff99c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.526+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 >> 172.21.15.67:0/3142350723 conn(0x7ff99c0fd700 msgr2=0x7ff99c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:51.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.527+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 shutdown_connections 2024-09-10T20:48:51.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:51.527+0000 7ff9a14af640 1 -- 172.21.15.67:0/3142350723 wait complete. 2024-09-10T20:48:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:51.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: Deploying daemon mds.d on smithi067 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.67:6834/1678307285,v1:172.21.15.67:6835/1678307285] up:boot 2024-09-10T20:48:51.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: fsmap 3 up:standby 2024-09-10T20:48:51.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T20:48:51.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:51 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3142350723' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:52.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:52.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:52.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: Deploying daemon mds.d on smithi067 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.67:6834/1678307285,v1:172.21.15.67:6835/1678307285] up:boot 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: fsmap 3 up:standby 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T20:48:52.143 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:51 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3142350723' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:52.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: Deploying daemon mds.d on smithi067 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.67:6834/1678307285,v1:172.21.15.67:6835/1678307285] up:boot 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: fsmap 3 up:standby 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T20:48:52.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:51 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3142350723' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:54.039 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:53 smithi067 ceph-mon[30891]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:54.039 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:53 smithi067 systemd[1]: Starting Ceph mds.d for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:54.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:53 smithi083 ceph-mon[35058]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:54.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:53 smithi172 ceph-mon[35265]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:54.296 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 podman[73087]: 2024-09-10 20:48:53.937815435 +0000 UTC m=+0.016087607 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:54.296 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 podman[73087]: 2024-09-10 20:48:54.051002403 +0000 UTC m=+0.129274571 container create ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T20:48:54.296 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 podman[73087]: 2024-09-10 20:48:54.253110547 +0000 UTC m=+0.331382709 container init ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:48:54.296 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 podman[73087]: 2024-09-10 20:48:54.256141635 +0000 UTC m=+0.334413797 container start ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:48:54.297 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 ceph-mds[73107]: -- 172.21.15.67:0/1131129459 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cfd5da1860 con 0x55cfd5d7f400 2024-09-10T20:48:54.297 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d[73103]: starting mds.d at 2024-09-10T20:48:54.792 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:48:54.796 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 bash[73087]: ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db 2024-09-10T20:48:54.796 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 20:48:54 smithi067 systemd[1]: Started Ceph mds.d for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:48:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:55.454 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:55.455 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: Deploying daemon mds.e on smithi083 2024-09-10T20:48:55.455 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.67:6836/3722693224,v1:172.21.15.67:6837/3722693224] up:boot 2024-09-10T20:48:55.455 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: fsmap 4 up:standby 2024-09-10T20:48:55.455 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:55 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T20:48:55.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:55.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:55.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:55.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: Deploying daemon mds.e on smithi083 2024-09-10T20:48:55.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.67:6836/3722693224,v1:172.21.15.67:6837/3722693224] up:boot 2024-09-10T20:48:55.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: fsmap 4 up:standby 2024-09-10T20:48:55.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:55 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 -- 172.21.15.67:0/931549014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 msgr2=0x7fd2e81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/931549014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81031a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009900 tx=0x7fd2e402a410 comp rx=0 tx=0).stop 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 -- 172.21.15.67:0/931549014 shutdown_connections 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/931549014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 0x7fd2e810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/931549014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 0x7fd2e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/931549014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81031a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.671+0000 7fd2ef67e640 1 -- 172.21.15.67:0/931549014 >> 172.21.15.67:0/931549014 conn(0x7fd2e80fe830 msgr2=0x7fd2e8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 -- 172.21.15.67:0/931549014 shutdown_connections 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 -- 172.21.15.67:0/931549014 wait complete. 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 Processor -- start 2024-09-10T20:48:55.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 -- start start 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 0x7fd2e81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.672+0000 7fd2ef67e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 0x7fd2e819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ef67e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112e10 con 0x7fd2e8102dc0 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ef67e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112c90 con 0x7fd2e8109150 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ef67e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8112f90 con 0x7fd2e81087d0 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49480/0 (socket says 172.21.15.67:49480) 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 -- 172.21.15.67:0/1186005786 learned_addr learned my addr 172.21.15.67:0/1186005786 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ecc19640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 0x7fd2e81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2edc1b640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 0x7fd2e819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 -- 172.21.15.67:0/1186005786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 msgr2=0x7fd2e81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:55.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 0x7fd2e81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 -- 172.21.15.67:0/1186005786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 msgr2=0x7fd2e819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 0x7fd2e819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 -- 172.21.15.67:0/1186005786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e819f350 con 0x7fd2e8102dc0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ed41a640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005940 tx=0x7fd2e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403f030 con 0x7fd2e8102dc0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e819f5e0 con 0x7fd2e8102dc0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e4003aa0 con 0x7fd2e8102dc0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4035070 con 0x7fd2e8102dc0 2024-09-10T20:48:55.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.673+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81a5d00 con 0x7fd2e8102dc0 2024-09-10T20:48:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.674+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e81031a0 con 0x7fd2e8102dc0 2024-09-10T20:48:55.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.677+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd2e403ba90 con 0x7fd2e8102dc0 2024-09-10T20:48:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.677+0000 7fd2de7fc640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 0x7fd2d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.678+0000 7fd2ecc19640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 0x7fd2d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.678+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fd2e4106370 con 0x7fd2e8102dc0 2024-09-10T20:48:55.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.678+0000 7fd2ecc19640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 0x7fd2d40b77a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2e81082a0 tx=0x7fd2d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:55.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.681+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2e40cd6d0 con 0x7fd2e8102dc0 2024-09-10T20:48:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: Deploying daemon mds.e on smithi083 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.67:6836/3722693224,v1:172.21.15.67:6837/3722693224] up:boot 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: fsmap 4 up:standby 2024-09-10T20:48:55.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:55 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T20:48:55.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.905+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2e810af30 con 0x7fd2e8102dc0 2024-09-10T20:48:55.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.906+0000 7fd2de7fc640 1 -- 172.21.15.67:0/1186005786 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fd2e40ccfd0 con 0x7fd2e8102dc0 2024-09-10T20:48:55.911 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:55.911 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"btime":"2024-09-10T20:48:54:803112+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T20:48:55.912 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 5 2024-09-10T20:48:55.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 msgr2=0x7fd2d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 0x7fd2d40b77a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2e81082a0 tx=0x7fd2d800b390 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 msgr2=0x7fd2e81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005940 tx=0x7fd2e4004270 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 shutdown_connections 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e8109150 0x7fd2e819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd2d40b52e0 0x7fd2d40b77a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2e81087d0 0x7fd2e81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 --2- 172.21.15.67:0/1186005786 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd2e8102dc0 0x7fd2e81992a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.908+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 >> 172.21.15.67:0/1186005786 conn(0x7fd2e80fe830 msgr2=0x7fd2e8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.909+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 shutdown_connections 2024-09-10T20:48:55.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:55.909+0000 7fd2ef67e640 1 -- 172.21.15.67:0/1186005786 wait complete. 2024-09-10T20:48:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:56 smithi067 ceph-mon[30891]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:56 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1186005786' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:56 smithi083 ceph-mon[35058]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:56.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:56 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1186005786' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:56.642 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:56 smithi083 systemd[1]: Starting Ceph mds.e for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:56 smithi172 ceph-mon[35265]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:56 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1186005786' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:56 smithi083 podman[64541]: 2024-09-10 20:48:56.675429011 +0000 UTC m=+0.016291386 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:56 smithi083 podman[64541]: 2024-09-10 20:48:56.78326489 +0000 UTC m=+0.124127309 container create 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:56 smithi083 podman[64541]: 2024-09-10 20:48:56.994006602 +0000 UTC m=+0.334868976 container init 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:56 smithi083 podman[64541]: 2024-09-10 20:48:56.996716586 +0000 UTC m=+0.337578969 container start 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:57 smithi083 ceph-mds[64560]: -- 172.21.15.83:0/3186601103 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b68dc5860 con 0x562b68da2800 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: starting mds.e at 2024-09-10T20:48:57.123 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:57 smithi083 bash[64541]: 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f 2024-09-10T20:48:57.391 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 20:48:57 smithi083 systemd[1]: Started Ceph mds.e for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:48:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: Deploying daemon mds.f on smithi172 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6834/1348947486,v1:172.21.15.83:6835/1348947486] up:boot 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: fsmap 5 up:standby 2024-09-10T20:48:58.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:48:58 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T20:48:58.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: Deploying daemon mds.f on smithi172 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6834/1348947486,v1:172.21.15.83:6835/1348947486] up:boot 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: fsmap 5 up:standby 2024-09-10T20:48:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:48:58 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T20:48:58.627 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:48:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:48:58.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: Deploying daemon mds.f on smithi172 2024-09-10T20:48:58.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6834/1348947486,v1:172.21.15.83:6835/1348947486] up:boot 2024-09-10T20:48:58.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: fsmap 5 up:standby 2024-09-10T20:48:58.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:48:58 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T20:48:58.897 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:48:59.200 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 systemd[1]: Starting Ceph mds.f for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- 172.21.15.67:0/3455453051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc5010d140 msgr2=0x7efc5010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 --2- 172.21.15.67:0/3455453051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc5010d140 0x7efc5010f550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efc48009900 tx=0x7efc4802a410 comp rx=0 tx=0).stop 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- 172.21.15.67:0/3455453051 shutdown_connections 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 --2- 172.21.15.67:0/3455453051 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc5010d140 0x7efc5010f550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 --2- 172.21.15.67:0/3455453051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc50104590 0x7efc5010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 --2- 172.21.15.67:0/3455453051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50103b90 0x7efc50103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- 172.21.15.67:0/3455453051 >> 172.21.15.67:0/3455453051 conn(0x7efc500fd700 msgr2=0x7efc500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- 172.21.15.67:0/3455453051 shutdown_connections 2024-09-10T20:48:59.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- 172.21.15.67:0/3455453051 wait complete. 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 Processor -- start 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.345+0000 7efc5755e640 1 -- start start 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50104590 0x7efc50199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc5010d140 0x7efc5019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc50112d60 con 0x7efc50103b90 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc50112be0 con 0x7efc50104590 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc50112ee0 con 0x7efc5010d140 2024-09-10T20:48:59.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:59.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49506/0 (socket says 172.21.15.67:49506) 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 -- 172.21.15.67:0/838420064 learned_addr learned my addr 172.21.15.67:0/838420064 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc54af9640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50104590 0x7efc50199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 -- 172.21.15.67:0/838420064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc5010d140 msgr2=0x7efc5019eb30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc5010d140 0x7efc5019eb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 -- 172.21.15.67:0/838420064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50104590 msgr2=0x7efc50199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50104590 0x7efc50199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 -- 172.21.15.67:0/838420064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5019f300 con 0x7efc50103b90 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc552fa640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efc4000eab0 tx=0x7efc4000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4000ce40 con 0x7efc50103b90 2024-09-10T20:48:59.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc40011920 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5019f5f0 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40010a30 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.346+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501a5cb0 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.347+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc50103f70 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.349+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7efc4000f040 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.350+0000 7efc4e7fc640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 0x7efc380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.350+0000 7efc54af9640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 0x7efc380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.350+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7efc400e5a30 con 0x7efc50103b90 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.350+0000 7efc54af9640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 0x7efc380b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc5010f760 tx=0x7efc4400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:48:59.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.352+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc40016030 con 0x7efc50103b90 2024-09-10T20:48:59.461 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 podman[64400]: 2024-09-10 20:48:59.203512442 +0000 UTC m=+0.106459600 container create e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:48:59.462 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 podman[64400]: 2024-09-10 20:48:59.11293578 +0000 UTC m=+0.015882906 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:48:59.462 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 podman[64400]: 2024-09-10 20:48:59.430736771 +0000 UTC m=+0.333683891 container init e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T20:48:59.462 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 podman[64400]: 2024-09-10 20:48:59.433482283 +0000 UTC m=+0.336429400 container start e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:48:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.576+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc5002e5c0 con 0x7efc50103b90 2024-09-10T20:48:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.577+0000 7efc4e7fc640 1 -- 172.21.15.67:0/838420064 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7efc400acd90 con 0x7efc50103b90 2024-09-10T20:48:59.581 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:48:59.581 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":6,"btime":"2024-09-10T20:48:57:425509+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T20:48:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 6 2024-09-10T20:48:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 msgr2=0x7efc380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 0x7efc380b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc5010f760 tx=0x7efc4400b410 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 msgr2=0x7efc50199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efc4000eab0 tx=0x7efc4000ef70 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 shutdown_connections 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc380b52e0 0x7efc380b77a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc5010d140 0x7efc5019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc50104590 0x7efc50199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 --2- 172.21.15.67:0/838420064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc50103b90 0x7efc50199250 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 >> 172.21.15.67:0/838420064 conn(0x7efc500fd700 msgr2=0x7efc500fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 shutdown_connections 2024-09-10T20:48:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:48:59.579+0000 7efc5755e640 1 -- 172.21.15.67:0/838420064 wait complete. 2024-09-10T20:48:59.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 ceph-mds[64420]: -- 172.21.15.172:0/3765456579 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c89343860 con 0x562c89321400 2024-09-10T20:48:59.949 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: starting mds.f at 2024-09-10T20:48:59.950 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 bash[64400]: e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 2024-09-10T20:48:59.950 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 20:48:59 smithi172 systemd[1]: Started Ceph mds.f for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:00.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/838420064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:00.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:00 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:00.354 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:00.354 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/838420064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:00.354 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.355 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.355 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.355 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:00.355 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:00.355 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:00 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/838420064' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:00.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:00 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:01.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-mon[35265]: Deploying daemon mds.c on smithi172 2024-09-10T20:49:01.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6834/2165153315,v1:172.21.15.172:6835/2165153315] up:boot 2024-09-10T20:49:01.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-mon[35265]: fsmap 6 up:standby 2024-09-10T20:49:01.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T20:49:01.453 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 systemd[1]: Starting Ceph mds.c for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:01.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:01 smithi067 ceph-mon[30891]: Deploying daemon mds.c on smithi172 2024-09-10T20:49:01.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:01 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6834/2165153315,v1:172.21.15.172:6835/2165153315] up:boot 2024-09-10T20:49:01.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:01 smithi067 ceph-mon[30891]: fsmap 6 up:standby 2024-09-10T20:49:01.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:01 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T20:49:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:01 smithi083 ceph-mon[35058]: Deploying daemon mds.c on smithi172 2024-09-10T20:49:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:01 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6834/2165153315,v1:172.21.15.172:6835/2165153315] up:boot 2024-09-10T20:49:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:01 smithi083 ceph-mon[35058]: fsmap 6 up:standby 2024-09-10T20:49:01.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:01 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T20:49:01.881 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 podman[64699]: 2024-09-10 20:49:01.519386553 +0000 UTC m=+0.015935729 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:01.881 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 podman[64699]: 2024-09-10 20:49:01.640152946 +0000 UTC m=+0.136702162 container create 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:49:01.881 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 podman[64699]: 2024-09-10 20:49:01.85064632 +0000 UTC m=+0.347195491 container init 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:49:01.881 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 podman[64699]: 2024-09-10 20:49:01.853526207 +0000 UTC m=+0.350075387 container start 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T20:49:01.881 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-mds[64719]: -- 172.21.15.172:0/3916865336 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56283e9cf860 con 0x56283e9ac800 2024-09-10T20:49:02.199 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: starting mds.c at 2024-09-10T20:49:02.199 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 bash[64699]: 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c 2024-09-10T20:49:02.199 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 20:49:01 smithi172 systemd[1]: Started Ceph mds.c for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:02.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:02.470 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:02 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:02.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:02.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:02 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:02.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:02.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:02.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:02 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:02.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 -- 172.21.15.67:0/2240273023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af0101cb0 msgr2=0x7f4af0102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:02.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 --2- 172.21.15.67:0/2240273023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af0101cb0 0x7f4af0102090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009900 tx=0x7f4ae002a410 comp rx=0 tx=0).stop 2024-09-10T20:49:02.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 -- 172.21.15.67:0/2240273023 shutdown_connections 2024-09-10T20:49:02.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 --2- 172.21.15.67:0/2240273023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0108040 0x7f4af010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 --2- 172.21.15.67:0/2240273023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af01076c0 0x7f4af0107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 --2- 172.21.15.67:0/2240273023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af0101cb0 0x7f4af0102090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 -- 172.21.15.67:0/2240273023 >> 172.21.15.67:0/2240273023 conn(0x7f4af00fd700 msgr2=0x7f4af00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 -- 172.21.15.67:0/2240273023 shutdown_connections 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.936+0000 7f4af6993640 1 -- 172.21.15.67:0/2240273023 wait complete. 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 Processor -- start 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 -- start start 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 0x7f4af0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:02.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af0108040 0x7f4af019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0111d00 con 0x7f4af01076c0 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0111b80 con 0x7f4af0101cb0 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.937+0000 7f4af6993640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0111e80 con 0x7f4af0108040 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36472/0 (socket says 172.21.15.67:36472) 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 -- 172.21.15.67:0/3897949441 learned_addr learned my addr 172.21.15.67:0/3897949441 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4af4f30640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af0108040 0x7f4af019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aeffff640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 0x7f4af0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 -- 172.21.15.67:0/3897949441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af0108040 msgr2=0x7f4af019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af0108040 0x7f4af019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:02.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 -- 172.21.15.67:0/3897949441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 msgr2=0x7f4af0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 0x7f4af0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 -- 172.21.15.67:0/3897949441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af019f340 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aeffff640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 0x7f4af0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aef7fe640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e9f0 tx=0x7f4ae400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400cd80 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af019f630 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ae40054d0 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4010690 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.938+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af01a5cf0 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.939+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af0102090 con 0x7f4af01076c0 2024-09-10T20:49:02.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.941+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f4ae4004e30 con 0x7f4af01076c0 2024-09-10T20:49:02.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.941+0000 7f4aed7fa640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 0x7f4ad80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:02.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.942+0000 7f4aeffff640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 0x7f4ad80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:02.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.942+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f4ae40e5dc0 con 0x7f4af01076c0 2024-09-10T20:49:02.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.942+0000 7f4aeffff640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 0x7f4ad80b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0031440 tx=0x7f4ae0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:02.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:02.944+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ae4056220 con 0x7f4af01076c0 2024-09-10T20:49:03.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.172+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4af010ae90 con 0x7f4af01076c0 2024-09-10T20:49:03.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.173+0000 7f4aed7fa640 1 -- 172.21.15.67:0/3897949441 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f4ae40ad120 con 0x7f4af01076c0 2024-09-10T20:49:03.177 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:03.177 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"btime":"2024-09-10T20:49:02:192803+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T20:49:03.177 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.175+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 msgr2=0x7f4ad80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.175+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 0x7f4ad80b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0031440 tx=0x7f4ae0005a20 comp rx=0 tx=0).stop 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.175+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 msgr2=0x7f4af01997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.175+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e9f0 tx=0x7f4ae400edf0 comp rx=0 tx=0).stop 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 shutdown_connections 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4ad80b52e0 0x7f4ad80b77a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af0108040 0x7f4af019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:03.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4af01076c0 0x7f4af01997d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:03.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 --2- 172.21.15.67:0/3897949441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4af0101cb0 0x7f4af0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:03.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 >> 172.21.15.67:0/3897949441 conn(0x7f4af00fd700 msgr2=0x7f4af006b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:03.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 shutdown_connections 2024-09-10T20:49:03.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:03.176+0000 7f4af6993640 1 -- 172.21.15.67:0/3897949441 wait complete. 2024-09-10T20:49:03.475 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:03 smithi067 ceph-mon[30891]: Deploying daemon mds.h on smithi083 2024-09-10T20:49:03.475 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:03 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6836/242991911,v1:172.21.15.172:6837/242991911] up:boot 2024-09-10T20:49:03.475 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:03 smithi067 ceph-mon[30891]: fsmap 7 up:standby 2024-09-10T20:49:03.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:03 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T20:49:03.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:03 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3897949441' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:03.501 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:03 smithi083 ceph-mon[35058]: Deploying daemon mds.h on smithi083 2024-09-10T20:49:03.501 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:03 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6836/242991911,v1:172.21.15.172:6837/242991911] up:boot 2024-09-10T20:49:03.501 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:03 smithi083 ceph-mon[35058]: fsmap 7 up:standby 2024-09-10T20:49:03.502 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:03 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T20:49:03.502 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:03 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3897949441' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:03 smithi172 ceph-mon[35265]: Deploying daemon mds.h on smithi083 2024-09-10T20:49:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:03 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6836/242991911,v1:172.21.15.172:6837/242991911] up:boot 2024-09-10T20:49:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:03 smithi172 ceph-mon[35265]: fsmap 7 up:standby 2024-09-10T20:49:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:03 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T20:49:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:03 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3897949441' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:04.141 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 systemd[1]: Starting Ceph mds.h for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:04 smithi172 ceph-mon[35265]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:04.468 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:04 smithi067 ceph-mon[30891]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:04.526 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:04 smithi083 ceph-mon[35058]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:04.527 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 podman[64843]: 2024-09-10 20:49:04.182590631 +0000 UTC m=+0.015923923 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:04.527 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 podman[64843]: 2024-09-10 20:49:04.3121925 +0000 UTC m=+0.145525783 container create 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T20:49:04.527 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 podman[64843]: 2024-09-10 20:49:04.523168545 +0000 UTC m=+0.356501830 container init 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T20:49:04.891 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 podman[64843]: 2024-09-10 20:49:04.526063909 +0000 UTC m=+0.359397199 container start 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T20:49:04.891 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 ceph-mds[64862]: -- 172.21.15.83:0/3065291347 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555848ea3c20 con 0x555848e81000 2024-09-10T20:49:04.892 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: starting mds.h at 2024-09-10T20:49:04.892 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 bash[64843]: 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 2024-09-10T20:49:04.892 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 20:49:04 smithi083 systemd[1]: Started Ceph mds.h for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: Deploying daemon mds.i on smithi172 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:boot 2024-09-10T20:49:05.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: fsmap 8 up:standby 2024-09-10T20:49:05.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:05 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T20:49:05.801 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:06.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: Deploying daemon mds.i on smithi172 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:boot 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: fsmap 8 up:standby 2024-09-10T20:49:06.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:05 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T20:49:06.074 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: Deploying daemon mds.i on smithi172 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:boot 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: fsmap 8 up:standby 2024-09-10T20:49:06.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:05 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 -- 172.21.15.67:0/1568325303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 msgr2=0x7fa3bc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 --2- 172.21.15.67:0/1568325303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc102070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009900 tx=0x7fa3ac02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 -- 172.21.15.67:0/1568325303 shutdown_connections 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 --2- 172.21.15.67:0/1568325303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 0x7fa3bc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 --2- 172.21.15.67:0/1568325303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 0x7fa3bc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 --2- 172.21.15.67:0/1568325303 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc102070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 -- 172.21.15.67:0/1568325303 >> 172.21.15.67:0/1568325303 conn(0x7fa3bc0fd700 msgr2=0x7fa3bc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:06.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 -- 172.21.15.67:0/1568325303 shutdown_connections 2024-09-10T20:49:06.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.578+0000 7fa3c1143640 1 -- 172.21.15.67:0/1568325303 wait complete. 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 Processor -- start 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 -- start start 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 0x7fa3bc198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 0x7fa3bc19db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc111ce0 con 0x7fa3bc101c90 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc111b60 con 0x7fa3bc108020 2024-09-10T20:49:06.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3c1143640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc111e60 con 0x7fa3bc1076a0 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3bad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36498/0 (socket says 172.21.15.67:36498) 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3bad9d640 1 -- 172.21.15.67:0/4246388546 learned_addr learned my addr 172.21.15.67:0/4246388546 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.579+0000 7fa3ba59c640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 0x7fa3bc198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bb59e640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 0x7fa3bc19db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 -- 172.21.15.67:0/4246388546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 msgr2=0x7fa3bc198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 0x7fa3bc198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 -- 172.21.15.67:0/4246388546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 msgr2=0x7fa3bc19db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 0x7fa3bc19db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 -- 172.21.15.67:0/4246388546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc19e300 con 0x7fa3bc101c90 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3bad9d640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005940 tx=0x7fa3ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac03f030 con 0x7fa3bc101c90 2024-09-10T20:49:06.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3ac003cb0 con 0x7fa3bc101c90 2024-09-10T20:49:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc19e590 con 0x7fa3bc101c90 2024-09-10T20:49:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac035070 con 0x7fa3bc101c90 2024-09-10T20:49:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.580+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc1a4cb0 con 0x7fa3bc101c90 2024-09-10T20:49:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.581+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc102070 con 0x7fa3bc101c90 2024-09-10T20:49:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.583+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fa3ac03bbf0 con 0x7fa3bc101c90 2024-09-10T20:49:06.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.584+0000 7fa3b3fff640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 0x7fa3a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:06.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.584+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fa3ac106520 con 0x7fa3bc101c90 2024-09-10T20:49:06.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.584+0000 7fa3ba59c640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 0x7fa3a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:06.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.585+0000 7fa3ba59c640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 0x7fa3a80b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc1010e0 tx=0x7fa3a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:06.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.587+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3ac0cd880 con 0x7fa3bc101c90 2024-09-10T20:49:06.699 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:06 smithi172 systemd[1]: Starting Ceph mds.i for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.814+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3bc109e00 con 0x7fa3bc101c90 2024-09-10T20:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.815+0000 7fa3b3fff640 1 -- 172.21.15.67:0/4246388546 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fa3ac0cd180 con 0x7fa3bc101c90 2024-09-10T20:49:06.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:06.819 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":9,"btime":"2024-09-10T20:49:05:205801+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24581,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T20:49:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 9 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 msgr2=0x7fa3a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 0x7fa3a80b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc1010e0 tx=0x7fa3a400b390 comp rx=0 tx=0).stop 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 msgr2=0x7fa3bc198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005940 tx=0x7fa3ac0042f0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 shutdown_connections 2024-09-10T20:49:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3bc108020 0x7fa3bc19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa3a80b52e0 0x7fa3a80b77a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3bc1076a0 0x7fa3bc198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 --2- 172.21.15.67:0/4246388546 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3bc101c90 0x7fa3bc198250 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 >> 172.21.15.67:0/4246388546 conn(0x7fa3bc0fd700 msgr2=0x7fa3bc105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 shutdown_connections 2024-09-10T20:49:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:06.817+0000 7fa3c1143640 1 -- 172.21.15.67:0/4246388546 wait complete. 2024-09-10T20:49:07.058 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:06 smithi172 podman[65003]: 2024-09-10 20:49:06.70037712 +0000 UTC m=+0.015556642 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:07.058 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:06 smithi172 podman[65003]: 2024-09-10 20:49:06.827078359 +0000 UTC m=+0.142257923 container create c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T20:49:07.058 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 podman[65003]: 2024-09-10 20:49:07.054587516 +0000 UTC m=+0.369767044 container init c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:49:07.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 podman[65003]: 2024-09-10 20:49:07.057673354 +0000 UTC m=+0.372852879 container start c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T20:49:07.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mds[65023]: -- 172.21.15.172:0/2327475931 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f2518b860 con 0x558f25169400 2024-09-10T20:49:07.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: starting mds.i at 2024-09-10T20:49:07.450 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 bash[65003]: c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 2024-09-10T20:49:07.450 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 20:49:07 smithi172 systemd[1]: Started Ceph mds.i for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4246388546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:08.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:07 smithi067 ceph-mon[30891]: Deploying daemon mds.g on smithi067 2024-09-10T20:49:08.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:08.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4246388546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:08.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:08.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:07 smithi083 ceph-mon[35058]: Deploying daemon mds.g on smithi067 2024-09-10T20:49:08.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4246388546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:08.201 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:07 smithi172 ceph-mon[35265]: Deploying daemon mds.g on smithi067 2024-09-10T20:49:08.902 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:08 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:boot 2024-09-10T20:49:08.903 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:08 smithi067 ceph-mon[30891]: fsmap 9 up:standby 2024-09-10T20:49:08.903 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T20:49:09.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:08 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:boot 2024-09-10T20:49:09.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:08 smithi083 ceph-mon[35058]: fsmap 9 up:standby 2024-09-10T20:49:09.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T20:49:09.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:08 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:boot 2024-09-10T20:49:09.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:08 smithi172 ceph-mon[35265]: fsmap 9 up:standby 2024-09-10T20:49:09.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T20:49:09.296 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 systemd[1]: Starting Ceph mds.g for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:09.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:09.561 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 podman[73857]: 2024-09-10 20:49:09.203232664 +0000 UTC m=+0.016096362 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:09.561 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 podman[73857]: 2024-09-10 20:49:09.307229299 +0000 UTC m=+0.120093029 container create 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T20:49:09.561 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 podman[73857]: 2024-09-10 20:49:09.558336815 +0000 UTC m=+0.371200504 container init 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T20:49:09.766 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:09.823 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 podman[73857]: 2024-09-10 20:49:09.562164434 +0000 UTC m=+0.375028131 container start 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T20:49:09.823 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mds[73894]: -- 172.21.15.67:0/3234465718 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55996256b860 con 0x559962549000 2024-09-10T20:49:09.823 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g[73872]: starting mds.g at 2024-09-10T20:49:09.824 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 bash[73857]: 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 2024-09-10T20:49:09.824 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 20:49:09 smithi067 systemd[1]: Started Ceph mds.g for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:10.081 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:10.081 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.081 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.081 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.082 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:10.082 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:10.082 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:09 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:10.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:10.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:10.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:09 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:10.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:10.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:10.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:09 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 -- 172.21.15.67:0/3282216048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec10d140 msgr2=0x7f69ec10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 --2- 172.21.15.67:0/3282216048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec10d140 0x7f69ec10f5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009ca0 tx=0x7f69e402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 -- 172.21.15.67:0/3282216048 shutdown_connections 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 --2- 172.21.15.67:0/3282216048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec10d140 0x7f69ec10f5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 --2- 172.21.15.67:0/3282216048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec104600 0x7f69ec10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 --2- 172.21.15.67:0/3282216048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 0x7f69ec1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.246+0000 7f69f184c640 1 -- 172.21.15.67:0/3282216048 >> 172.21.15.67:0/3282216048 conn(0x7f69ec0fd720 msgr2=0x7f69ec0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- 172.21.15.67:0/3282216048 shutdown_connections 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- 172.21.15.67:0/3282216048 wait complete. 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 Processor -- start 2024-09-10T20:49:10.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- start start 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 0x7f69ec199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 0x7f69ec19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec112df0 con 0x7f69ec104600 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec112c70 con 0x7f69ec10d140 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69f184c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec112f70 con 0x7f69ec103ce0 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.247+0000 7f69e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36538/0 (socket says 172.21.15.67:36538) 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 -- 172.21.15.67:0/2520096520 learned_addr learned my addr 172.21.15.67:0/2520096520 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69eaffd640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 0x7f69ec199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:10.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 -- 172.21.15.67:0/2520096520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 msgr2=0x7f69ec199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 0x7f69ec199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 -- 172.21.15.67:0/2520096520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 msgr2=0x7f69ec19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69eb7fe640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 0x7f69ec19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 0x7f69ec19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 -- 172.21.15.67:0/2520096520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec19f2b0 con 0x7f69ec104600 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69eb7fe640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 0x7f69ec19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69e3fff640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c970 tx=0x7f69d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4007bb0 con 0x7f69ec104600 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69d4007d50 con 0x7f69ec104600 2024-09-10T20:49:10.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec19f5a0 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d400f7b0 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.248+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec1a5ce0 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.249+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ec1040c0 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.251+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f69d4018480 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.252+0000 7f69f084a640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 0x7f69d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.252+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f69d40e5a70 con 0x7f69ec104600 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.252+0000 7f69eaffd640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 0x7f69d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.252+0000 7f69eaffd640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 0x7f69d80b77a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009890 tx=0x7f69dc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:10.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.256+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f69d40ace60 con 0x7f69ec104600 2024-09-10T20:49:10.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.496+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69ec02e5c0 con 0x7f69ec104600 2024-09-10T20:49:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.497+0000 7f69f084a640 1 -- 172.21.15.67:0/2520096520 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8866 (secure 0 0 0) 0x7f69d40ac760 con 0x7f69ec104600 2024-09-10T20:49:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:10.501 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":11,"btime":"2024-09-10T20:49:09:814544+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24581,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T20:49:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 11 2024-09-10T20:49:10.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 msgr2=0x7f69d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 0x7f69d80b77a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009890 tx=0x7f69dc008040 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 msgr2=0x7f69ec199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c970 tx=0x7f69d400ce30 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 shutdown_connections 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69ec10d140 0x7f69ec19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f69ec104600 0x7f69ec199740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69d80b52e0 0x7f69d80b77a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 --2- 172.21.15.67:0/2520096520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69ec103ce0 0x7f69ec199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.499+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 >> 172.21.15.67:0/2520096520 conn(0x7f69ec0fd720 msgr2=0x7f69ec0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.500+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 shutdown_connections 2024-09-10T20:49:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:10.500+0000 7f69f184c640 1 -- 172.21.15.67:0/2520096520 wait complete. 2024-09-10T20:49:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:10 smithi083 ceph-mon[35058]: Deploying daemon mds.a on smithi067 2024-09-10T20:49:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:10 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.67:6838/4192230461,v1:172.21.15.67:6839/4192230461] up:boot 2024-09-10T20:49:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:10 smithi083 ceph-mon[35058]: fsmap 10 up:standby 2024-09-10T20:49:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:10 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T20:49:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:10 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2520096520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:10 smithi172 ceph-mon[35265]: Deploying daemon mds.a on smithi067 2024-09-10T20:49:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:10 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.67:6838/4192230461,v1:172.21.15.67:6839/4192230461] up:boot 2024-09-10T20:49:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:10 smithi172 ceph-mon[35265]: fsmap 10 up:standby 2024-09-10T20:49:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:10 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T20:49:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:10 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2520096520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:11.206 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:10 smithi067 ceph-mon[30891]: Deploying daemon mds.a on smithi067 2024-09-10T20:49:11.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:10 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.67:6838/4192230461,v1:172.21.15.67:6839/4192230461] up:boot 2024-09-10T20:49:11.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:10 smithi067 ceph-mon[30891]: fsmap 10 up:standby 2024-09-10T20:49:11.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:10 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T20:49:11.207 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:10 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2520096520' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:12.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:12 smithi067 ceph-mon[30891]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:12.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:12 smithi083 ceph-mon[35058]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:12 smithi172 ceph-mon[35265]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:12.740 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 systemd[1]: Starting Ceph mds.a for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:13.041 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 podman[74269]: 2024-09-10 20:49:12.639157897 +0000 UTC m=+0.016422450 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:13.041 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 podman[74269]: 2024-09-10 20:49:12.751816893 +0000 UTC m=+0.129081431 container create 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T20:49:13.041 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 podman[74269]: 2024-09-10 20:49:12.954381016 +0000 UTC m=+0.331645557 container init 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T20:49:13.041 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 podman[74269]: 2024-09-10 20:49:12.957251533 +0000 UTC m=+0.334516072 container start 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T20:49:13.041 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 ceph-mds[74289]: -- 172.21.15.67:0/423604867 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4ebca1c20 con 0x55e4ebc7e800 2024-09-10T20:49:13.042 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:12 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a[74285]: starting mds.a at 2024-09-10T20:49:13.042 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:13 smithi067 bash[74269]: 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 2024-09-10T20:49:13.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:13.295 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 20:49:13 smithi067 systemd[1]: Started Ceph mds.a for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:13.496 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 -- 172.21.15.67:0/3766965938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 msgr2=0x7f95ec1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 --2- 172.21.15.67:0/3766965938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec1031a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009900 tx=0x7f95e002a410 comp rx=0 tx=0).stop 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 -- 172.21.15.67:0/3766965938 shutdown_connections 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 --2- 172.21.15.67:0/3766965938 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 0x7f95ec10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 --2- 172.21.15.67:0/3766965938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 0x7f95ec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:13.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 --2- 172.21.15.67:0/3766965938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec1031a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 -- 172.21.15.67:0/3766965938 >> 172.21.15.67:0/3766965938 conn(0x7f95ec0fe830 msgr2=0x7f95ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 -- 172.21.15.67:0/3766965938 shutdown_connections 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.956+0000 7f95f423b640 1 -- 172.21.15.67:0/3766965938 wait complete. 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 Processor -- start 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 -- start start 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 0x7f95ec199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 0x7f95ec19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec112e10 con 0x7f95ec102dc0 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec112c90 con 0x7f95ec109150 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f423b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec112f90 con 0x7f95ec1087d0 2024-09-10T20:49:13.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f1fd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f1fd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55638/0 (socket says 172.21.15.67:55638) 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f1fd7640 1 -- 172.21.15.67:0/3654439615 learned_addr learned my addr 172.21.15.67:0/3654439615 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.957+0000 7f95f27d8640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 0x7f95ec19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f17d6640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 0x7f95ec199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 -- 172.21.15.67:0/3654439615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 msgr2=0x7f95ec199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 0x7f95ec199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 -- 172.21.15.67:0/3654439615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 msgr2=0x7f95ec19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 0x7f95ec19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 -- 172.21.15.67:0/3654439615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec19f3d0 con 0x7f95ec102dc0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f1fd7640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e0006010 tx=0x7f95e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e003f030 con 0x7f95ec102dc0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec19f660 con 0x7f95ec102dc0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e0003800 con 0x7f95ec102dc0 2024-09-10T20:49:13.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0035070 con 0x7f95ec102dc0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.958+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1a5d80 con 0x7f95ec102dc0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.959+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec1031a0 con 0x7f95ec102dc0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.961+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f95e0031b10 con 0x7f95ec102dc0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.961+0000 7f95deffd640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 0x7f95d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.961+0000 7f95f17d6640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 0x7f95d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.962+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f95e0106300 con 0x7f95ec102dc0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.962+0000 7f95f17d6640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 0x7f95d80b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95ec108270 tx=0x7f95e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:13.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:13.964+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f95e00cd660 con 0x7f95ec102dc0 2024-09-10T20:49:14.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:14.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.67:6840/2489750374,v1:172.21.15.67:6841/2489750374] up:boot 2024-09-10T20:49:14.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: fsmap 11 up:standby 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:14.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:14 smithi083 ceph-mon[35058]: Deploying daemon mds.b on smithi083 2024-09-10T20:49:14.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.190+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95ec02e5c0 con 0x7f95ec102dc0 2024-09-10T20:49:14.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:14.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.67:6840/2489750374,v1:172.21.15.67:6841/2489750374] up:boot 2024-09-10T20:49:14.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: fsmap 11 up:standby 2024-09-10T20:49:14.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T20:49:14.194 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:14.195 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:14 smithi067 ceph-mon[30891]: Deploying daemon mds.b on smithi083 2024-09-10T20:49:14.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.190+0000 7f95deffd640 1 -- 172.21.15.67:0/3654439615 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f95e00ccf60 con 0x7f95ec102dc0 2024-09-10T20:49:14.196 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:14.196 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":12,"btime":"2024-09-10T20:49:13:017614+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24581,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T20:49:14.196 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 12 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 msgr2=0x7f95d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 0x7f95d80b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f95ec108270 tx=0x7f95e8008040 comp rx=0 tx=0).stop 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 msgr2=0x7f95ec199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e0006010 tx=0x7f95e00042f0 comp rx=0 tx=0).stop 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 shutdown_connections 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95ec109150 0x7f95ec19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f95d80b52e0 0x7f95d80b77a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95ec1087d0 0x7f95ec199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:14.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 --2- 172.21.15.67:0/3654439615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ec102dc0 0x7f95ec199320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 >> 172.21.15.67:0/3654439615 conn(0x7f95ec0fe830 msgr2=0x7f95ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 shutdown_connections 2024-09-10T20:49:14.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:14.193+0000 7f95f423b640 1 -- 172.21.15.67:0/3654439615 wait complete. 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.67:6840/2489750374,v1:172.21.15.67:6841/2489750374] up:boot 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: fsmap 11 up:standby 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T20:49:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T20:49:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:14.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:14 smithi172 ceph-mon[35265]: Deploying daemon mds.b on smithi083 2024-09-10T20:49:15.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3654439615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:15.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3654439615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:15.142 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 systemd[1]: Starting Ceph mds.b for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T20:49:15.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3654439615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:15.540 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 podman[65144]: 2024-09-10 20:49:15.177650614 +0000 UTC m=+0.015556246 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T20:49:15.540 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 podman[65144]: 2024-09-10 20:49:15.299787909 +0000 UTC m=+0.137693531 container create 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T20:49:15.540 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 podman[65144]: 2024-09-10 20:49:15.510396518 +0000 UTC m=+0.348302148 container init 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T20:49:15.540 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 podman[65144]: 2024-09-10 20:49:15.513170738 +0000 UTC m=+0.351076368 container start 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T20:49:15.891 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 ceph-mds[65163]: -- 172.21.15.83:0/2896753199 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560136619c20 con 0x5601365f6800 2024-09-10T20:49:15.891 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: starting mds.b at 2024-09-10T20:49:15.891 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 bash[65144]: 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 2024-09-10T20:49:15.891 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:15 smithi083 systemd[1]: Started Ceph mds.b for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T20:49:16.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:16.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:16 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:16 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:16.429 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:16.429 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.429 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.429 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.429 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.430 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:16.430 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:16 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:16.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:17.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:17 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:boot 2024-09-10T20:49:17.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:17 smithi067 ceph-mon[30891]: fsmap 12 up:standby 2024-09-10T20:49:17.233 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:17 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T20:49:17.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:17 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:boot 2024-09-10T20:49:17.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:17 smithi083 ceph-mon[35058]: fsmap 12 up:standby 2024-09-10T20:49:17.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:17 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T20:49:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:17 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:boot 2024-09-10T20:49:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:17 smithi172 ceph-mon[35265]: fsmap 12 up:standby 2024-09-10T20:49:17.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:17 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T20:49:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/2681709740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb41077c0 msgr2=0x7fdcb410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:17.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/2681709740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb41077c0 0x7fdcb410dfc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009ca0 tx=0x7fdcac02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/2681709740 shutdown_connections 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/2681709740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb41077c0 0x7fdcb410dfc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/2681709740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb4106e40 0x7fdcb4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/2681709740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/2681709740 >> 172.21.15.67:0/2681709740 conn(0x7fdcb4076f50 msgr2=0x7fdcb4077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/2681709740 shutdown_connections 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.617+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/2681709740 wait complete. 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 Processor -- start 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 -- start start 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:17.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb41077c0 0x7fdcb419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4112dc0 con 0x7fdcb4106e40 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4112c40 con 0x7fdcb4101810 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb8ae2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4112f40 con 0x7fdcb41077c0 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55656/0 (socket says 172.21.15.67:55656) 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb1d9b640 1 -- 172.21.15.67:0/1272656487 learned_addr learned my addr 172.21.15.67:0/1272656487 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb2d9d640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb41077c0 0x7fdcb419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.618+0000 7fdcb1d9b640 1 -- 172.21.15.67:0/1272656487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb41077c0 msgr2=0x7fdcb419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb1d9b640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb41077c0 0x7fdcb419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb1d9b640 1 -- 172.21.15.67:0/1272656487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 msgr2=0x7fdcb4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:17.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb1d9b640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb1d9b640 1 -- 172.21.15.67:0/1272656487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb419f340 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb259c640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb1d9b640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdca400d950 tx=0x7fdca400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4017070 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb419f630 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdca4009c30 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca400f620 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.619+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb41a5ec0 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.620+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb41027d0 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.622+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdca4010460 con 0x7fdcb4106e40 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.623+0000 7fdcab7fe640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 0x7fdca00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.623+0000 7fdcb259c640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 0x7fdca00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:17.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.623+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fdca40e5250 con 0x7fdcb4106e40 2024-09-10T20:49:17.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.623+0000 7fdcb259c640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 0x7fdca00b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00bfd0 tx=0x7fdc9c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:17.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.625+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdca4009de0 con 0x7fdcb4106e40 2024-09-10T20:49:17.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.863+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcb41095a0 con 0x7fdcb4106e40 2024-09-10T20:49:17.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.864+0000 7fdcab7fe640 1 -- 172.21.15.67:0/1272656487 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7fdca40abf60 con 0x7fdcb4106e40 2024-09-10T20:49:17.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:17.868 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":13,"btime":"2024-09-10T20:49:16:030230+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24554,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24559,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24565,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24581,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24583,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T20:49:17.869 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 13 2024-09-10T20:49:17.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 msgr2=0x7fdca00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:17.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 0x7fdca00b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00bfd0 tx=0x7fdc9c00b390 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 msgr2=0x7fdcb41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdca400d950 tx=0x7fdca400de10 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 shutdown_connections 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdca00b52e0 0x7fdca00b77a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcb41077c0 0x7fdcb419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcb4106e40 0x7fdcb41997d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 --2- 172.21.15.67:0/1272656487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcb4101810 0x7fdcb4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.866+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 >> 172.21.15.67:0/1272656487 conn(0x7fdcb4076f50 msgr2=0x7fdcb40ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.867+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 shutdown_connections 2024-09-10T20:49:17.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:17.867+0000 7fdcb8ae2640 1 -- 172.21.15.67:0/1272656487 wait complete. 2024-09-10T20:49:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1272656487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:18.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:18 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1272656487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:18.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:18 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:18.475 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:18.475 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:18.476 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:18.477 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:18.477 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1272656487' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:18.477 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:18 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:49:18.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T20:49:19.326 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:19.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 -- 172.21.15.67:0/3102968953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c1045c0 msgr2=0x7ff33c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 --2- 172.21.15.67:0/3102968953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c1045c0 0x7ff33c10cab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff324009900 tx=0x7ff32402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 -- 172.21.15.67:0/3102968953 shutdown_connections 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 --2- 172.21.15.67:0/3102968953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c10d100 0x7ff33c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 --2- 172.21.15.67:0/3102968953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c1045c0 0x7ff33c10cab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 --2- 172.21.15.67:0/3102968953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c103ca0 0x7ff33c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 -- 172.21.15.67:0/3102968953 >> 172.21.15.67:0/3102968953 conn(0x7ff33c0fd700 msgr2=0x7ff33c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 -- 172.21.15.67:0/3102968953 shutdown_connections 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.776+0000 7ff3412c1640 1 -- 172.21.15.67:0/3102968953 wait complete. 2024-09-10T20:49:19.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.777+0000 7ff3412c1640 1 Processor -- start 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.777+0000 7ff3412c1640 1 -- start start 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 0x7ff33c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c1045c0 0x7ff33c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c112dc0 con 0x7ff33c10d100 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c112c40 con 0x7ff33c103ca0 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff3412c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c112f40 con 0x7ff33c1045c0 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:19.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 0x7ff33c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55670/0 (socket says 172.21.15.67:55670) 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 -- 172.21.15.67:0/4110875141 learned_addr learned my addr 172.21.15.67:0/4110875141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33a7fc640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c1045c0 0x7ff33c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 -- 172.21.15.67:0/4110875141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c1045c0 msgr2=0x7ff33c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c1045c0 0x7ff33c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 -- 172.21.15.67:0/4110875141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 msgr2=0x7ff33c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 0x7ff33c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 -- 172.21.15.67:0/4110875141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c19f3c0 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33affd640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 0x7ff33c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.778+0000 7ff33b7fe640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00eaa0 tx=0x7ff32c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.779+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00cdb0 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.779+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c19f6b0 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.779+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32c005020 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.779+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0116d0 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.779+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1a5d70 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.780+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c104080 con 0x7ff33c10d100 2024-09-10T20:49:19.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.781+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff32c00f040 con 0x7ff33c10d100 2024-09-10T20:49:19.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.782+0000 7ff333fff640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 0x7ff3280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:19.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.782+0000 7ff33affd640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 0x7ff3280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:19.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.782+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7ff32c0e5900 con 0x7ff33c10d100 2024-09-10T20:49:19.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.782+0000 7ff33affd640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 0x7ff3280b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3340058c0 tx=0x7ff33400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:19.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.785+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff32c016030 con 0x7ff33c10d100 2024-09-10T20:49:19.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.979+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff33c1a6000 con 0x7ff33c10d100 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.980+0000 7ff333fff640 1 -- 172.21.15.67:0/4110875141 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7ff32c0ac610 con 0x7ff33c10d100 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2024-09-10T20:49:19.984 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2024-09-10T20:49:19.985 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:49:19.985 INFO:teuthology.orchestra.run.smithi067.stdout:] 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.982+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 msgr2=0x7ff3280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.982+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 0x7ff3280b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3340058c0 tx=0x7ff33400a250 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.982+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 msgr2=0x7ff33c19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.982+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00eaa0 tx=0x7ff32c00ef60 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 shutdown_connections 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff33c10d100 0x7ff33c19ebf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3280b52e0 0x7ff3280b77a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c1045c0 0x7ff33c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 --2- 172.21.15.67:0/4110875141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33c103ca0 0x7ff33c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 >> 172.21.15.67:0/4110875141 conn(0x7ff33c0fd700 msgr2=0x7ff33c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 shutdown_connections 2024-09-10T20:49:19.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:19.983+0000 7ff3412c1640 1 -- 172.21.15.67:0/4110875141 wait complete. 2024-09-10T20:49:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:20 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4110875141' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T20:49:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:20 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4110875141' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T20:49:20.735 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:20.735 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.735 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.735 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.735 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:20.736 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:20 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4110875141' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T20:49:20.764 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T20:49:20.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T20:49:21.018 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:21.439 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.439 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.439 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:21.439 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:21.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:21 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 -- 172.21.15.67:0/3476498870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 msgr2=0x7f767810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 --2- 172.21.15.67:0/3476498870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f767810cb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7664009900 tx=0x7f766402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 -- 172.21.15.67:0/3476498870 shutdown_connections 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 --2- 172.21.15.67:0/3476498870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767810d120 0x7f767810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 --2- 172.21.15.67:0/3476498870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f767810cb50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 --2- 172.21.15.67:0/3476498870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7678103b70 0x7f7678103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 -- 172.21.15.67:0/3476498870 >> 172.21.15.67:0/3476498870 conn(0x7f76780fd700 msgr2=0x7f76780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 -- 172.21.15.67:0/3476498870 shutdown_connections 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.522+0000 7f767f13a640 1 -- 172.21.15.67:0/3476498870 wait complete. 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 Processor -- start 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 -- start start 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7678103b70 0x7f7678199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:21.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 0x7f767819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7678112da0 con 0x7f7678104570 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7678112c20 con 0x7f767810d120 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767f13a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7678112f20 con 0x7f7678103b70 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55696/0 (socket says 172.21.15.67:55696) 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 -- 172.21.15.67:0/3961934378 learned_addr learned my addr 172.21.15.67:0/3961934378 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767ced6640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7678103b70 0x7f7678199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 -- 172.21.15.67:0/3961934378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7678103b70 msgr2=0x7f7678199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7678103b70 0x7f7678199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f767d6d7640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 0x7f767819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:21.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 -- 172.21.15.67:0/3961934378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 msgr2=0x7f767819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.523+0000 7f7677fff640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 0x7f767819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f7677fff640 1 -- 172.21.15.67:0/3961934378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767819f240 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f767d6d7640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 0x7f767819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f7677fff640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7664006010 tx=0x7f76640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766403f030 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767819f4d0 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7664003800 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664035070 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.524+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76781a5bf0 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.525+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7678103f50 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.527+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7664031b10 con 0x7f7678104570 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.527+0000 7f7675ffb640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 0x7f76680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:21.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.527+0000 7f767ced6640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 0x7f76680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:21.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.527+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f76641063b0 con 0x7f7678104570 2024-09-10T20:49:21.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.528+0000 7f767ced6640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 0x7f76680b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f766c00ba40 tx=0x7f766c005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:21.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.530+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76640cd710 con 0x7f7678104570 2024-09-10T20:49:21.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:21.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:21.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:21 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:49:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:49:21.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:21 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:49:21.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:21.717+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f76781a5eb0 con 0x7f7678104570 2024-09-10T20:49:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.389+0000 7f7675ffb640 1 -- 172.21.15.67:0/3961934378 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f76640cd010 con 0x7f7678104570 2024-09-10T20:49:22.394 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2024-09-10T20:49:22.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 msgr2=0x7f76680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:22.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 0x7f76680b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f766c00ba40 tx=0x7f766c005cc0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 msgr2=0x7f76781996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7664006010 tx=0x7f76640042f0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 shutdown_connections 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f767810d120 0x7f767819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7678104570 0x7f76781996d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76680b52e0 0x7f76680b77a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 --2- 172.21.15.67:0/3961934378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7678103b70 0x7f7678199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 >> 172.21.15.67:0/3961934378 conn(0x7f76780fd700 msgr2=0x7f76780fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 shutdown_connections 2024-09-10T20:49:22.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:22.392+0000 7f767f13a640 1 -- 172.21.15.67:0/3961934378 wait complete. 2024-09-10T20:49:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:22 smithi083 ceph-mon[35058]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:22 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T20:49:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:22 smithi172 ceph-mon[35265]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:22 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T20:49:22.718 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:22 smithi067 ceph-mon[30891]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:22.718 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:22 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T20:49:23.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:49:23.311 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:23.698 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T20:49:23.698 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:23 smithi067 ceph-mon[30891]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T20:49:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T20:49:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:23 smithi172 ceph-mon[35265]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- 172.21.15.67:0/683065791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85581076a0 msgr2=0x7f8558107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 --2- 172.21.15.67:0/683065791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85581076a0 0x7f8558107ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f854c009900 tx=0x7f854c02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- 172.21.15.67:0/683065791 shutdown_connections 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 --2- 172.21.15.67:0/683065791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558108020 0x7f855810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 --2- 172.21.15.67:0/683065791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85581076a0 0x7f8558107ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 --2- 172.21.15.67:0/683065791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8558101c90 0x7f8558102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:23.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- 172.21.15.67:0/683065791 >> 172.21.15.67:0/683065791 conn(0x7f85580fd700 msgr2=0x7f85580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- 172.21.15.67:0/683065791 shutdown_connections 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- 172.21.15.67:0/683065791 wait complete. 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 Processor -- start 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.783+0000 7f855fdc9640 1 -- start start 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85581076a0 0x7f85580fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558108020 0x7f85580fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8558111c70 con 0x7f8558101c90 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8558111af0 con 0x7f85581076a0 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855fdc9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8558111df0 con 0x7f8558108020 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36268/0 (socket says 172.21.15.67:36268) 2024-09-10T20:49:23.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 -- 172.21.15.67:0/3388191437 learned_addr learned my addr 172.21.15.67:0/3388191437 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855d364640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85581076a0 0x7f85580fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 -- 172.21.15.67:0/3388191437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558108020 msgr2=0x7f85580fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558108020 0x7f85580fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 -- 172.21.15.67:0/3388191437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85581076a0 msgr2=0x7f85580fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85581076a0 0x7f85580fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 -- 172.21.15.67:0/3388191437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85581a7690 con 0x7f8558101c90 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.784+0000 7f855db65640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f855000c920 tx=0x7f855000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.785+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550007c70 con 0x7f8558101c90 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.785+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85581a7980 con 0x7f8558101c90 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.785+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8550007e10 con 0x7f8558101c90 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.785+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550018820 con 0x7f8558101c90 2024-09-10T20:49:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.785+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581a7ee0 con 0x7f8558101c90 2024-09-10T20:49:23.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.786+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8558102070 con 0x7f8558101c90 2024-09-10T20:49:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.787+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f855000f450 con 0x7f8558101c90 2024-09-10T20:49:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.788+0000 7f8556ffd640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 0x7f85400b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.788+0000 7f855d364640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 0x7f85400b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.788+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7f85500e5c90 con 0x7f8558101c90 2024-09-10T20:49:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.788+0000 7f855d364640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 0x7f85400b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f854c031440 tx=0x7f854c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:23.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.791+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8550014030 con 0x7f8558101c90 2024-09-10T20:49:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3961934378' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T20:49:23.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:23 smithi083 ceph-mon[35058]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T20:49:23.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:23.979+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f85581a8370 con 0x7f8558101c90 2024-09-10T20:49:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.403+0000 7f8556ffd640 1 -- 172.21.15.67:0/3388191437 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f85500acf90 con 0x7f8558101c90 2024-09-10T20:49:24.407 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2024-09-10T20:49:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.405+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 msgr2=0x7f85400b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 0x7f85400b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f854c031440 tx=0x7f854c0095f0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 msgr2=0x7f85580fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:24.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f855000c920 tx=0x7f855000cde0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 shutdown_connections 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85400b5360 0x7f85400b7820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8558108020 0x7f85580fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85581076a0 0x7f85580fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 --2- 172.21.15.67:0/3388191437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8558101c90 0x7f85580fdc00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 >> 172.21.15.67:0/3388191437 conn(0x7f85580fd700 msgr2=0x7f8558104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 shutdown_connections 2024-09-10T20:49:24.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:24.406+0000 7f855fdc9640 1 -- 172.21.15.67:0/3388191437 wait complete. 2024-09-10T20:49:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:24 smithi172 ceph-mon[35265]: pgmap v277: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:24 smithi172 ceph-mon[35265]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T20:49:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:24 smithi172 ceph-mon[35265]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T20:49:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:24 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T20:49:24.718 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:24 smithi067 ceph-mon[30891]: pgmap v277: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:24.718 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:24 smithi067 ceph-mon[30891]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T20:49:24.719 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:24 smithi067 ceph-mon[30891]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T20:49:24.719 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:24 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T20:49:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:24 smithi083 ceph-mon[35058]: pgmap v277: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:24 smithi083 ceph-mon[35058]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T20:49:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:24 smithi083 ceph-mon[35058]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T20:49:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:24 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T20:49:25.075 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T20:49:25.334 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:25.696 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:25 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T20:49:25.697 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:25 smithi067 ceph-mon[30891]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T20:49:25.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:25 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T20:49:25.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:25 smithi172 ceph-mon[35265]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T20:49:25.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 -- 172.21.15.67:0/1003988172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 msgr2=0x7face0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:25.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 --2- 172.21.15.67:0/1003988172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0102070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7facd8009900 tx=0x7facd802a410 comp rx=0 tx=0).stop 2024-09-10T20:49:25.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 -- 172.21.15.67:0/1003988172 shutdown_connections 2024-09-10T20:49:25.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 --2- 172.21.15.67:0/1003988172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 0x7face010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 --2- 172.21.15.67:0/1003988172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 --2- 172.21.15.67:0/1003988172 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0102070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 -- 172.21.15.67:0/1003988172 >> 172.21.15.67:0/1003988172 conn(0x7face00fd700 msgr2=0x7face00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 -- 172.21.15.67:0/1003988172 shutdown_connections 2024-09-10T20:49:25.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.778+0000 7face4ebf640 1 -- 172.21.15.67:0/1003988172 wait complete. 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 Processor -- start 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 -- start start 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 0x7face019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7face0111d30 con 0x7face0101c90 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7face0111bb0 con 0x7face0108020 2024-09-10T20:49:25.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7face4ebf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7face0111eb0 con 0x7face01076a0 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36286/0 (socket says 172.21.15.67:36286) 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 -- 172.21.15.67:0/920104650 learned_addr learned my addr 172.21.15.67:0/920104650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facddd9b640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facded9d640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 0x7face019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 -- 172.21.15.67:0/920104650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 msgr2=0x7face0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 -- 172.21.15.67:0/920104650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 msgr2=0x7face019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 0x7face019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facde59c640 1 -- 172.21.15.67:0/920104650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face019f3d0 con 0x7face0101c90 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.779+0000 7facddd9b640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:49:25.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7facde59c640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facd8005ab0 tx=0x7facd8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd803f070 con 0x7face0101c90 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd8031d60 con 0x7face0101c90 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face019f660 con 0x7face0101c90 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8035030 con 0x7face0101c90 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.780+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face01a5d80 con 0x7face0101c90 2024-09-10T20:49:25.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.781+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face0102070 con 0x7face0101c90 2024-09-10T20:49:25.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.782+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7facd803b4f0 con 0x7face0101c90 2024-09-10T20:49:25.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.783+0000 7facd77fe640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 0x7faccc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:25.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.784+0000 7facddd9b640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 0x7faccc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:25.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.784+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7facd8106ae0 con 0x7face0101c90 2024-09-10T20:49:25.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.784+0000 7facddd9b640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 0x7faccc0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7face0106d80 tx=0x7facc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:25.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:25.787+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7facd80cd500 con 0x7face0101c90 2024-09-10T20:49:25.792 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:25 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3388191437' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T20:49:25.793 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:25 smithi083 ceph-mon[35058]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T20:49:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.009+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7face019a450 con 0x7face0101c90 2024-09-10T20:49:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.411+0000 7facd77fe640 1 -- 172.21.15.67:0/920104650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7facd80d1f30 con 0x7face0101c90 2024-09-10T20:49:26.416 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T20:49:26.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 msgr2=0x7faccc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 0x7faccc0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7face0106d80 tx=0x7facc8005f90 comp rx=0 tx=0).stop 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 msgr2=0x7face0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7facd8005ab0 tx=0x7facd8003c80 comp rx=0 tx=0).stop 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 shutdown_connections 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7face0108020 0x7face019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faccc0b52e0 0x7faccc0b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:26.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face01076a0 0x7face0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:26.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 --2- 172.21.15.67:0/920104650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7face0101c90 0x7face0199320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:26.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 >> 172.21.15.67:0/920104650 conn(0x7face00fd700 msgr2=0x7face006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:26.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 shutdown_connections 2024-09-10T20:49:26.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:26.414+0000 7face4ebf640 1 -- 172.21.15.67:0/920104650 wait complete. 2024-09-10T20:49:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:26 smithi172 ceph-mon[35265]: pgmap v280: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:26 smithi172 ceph-mon[35265]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T20:49:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:26 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T20:49:26.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:26 smithi172 ceph-mon[35265]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T20:49:26.742 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:26 smithi067 ceph-mon[30891]: pgmap v280: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:26.742 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:26 smithi067 ceph-mon[30891]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T20:49:26.743 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:26 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T20:49:26.743 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:26 smithi067 ceph-mon[30891]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T20:49:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:26 smithi083 ceph-mon[35058]: pgmap v280: 97 pgs: 12 creating+peering, 3 active+clean, 82 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:26 smithi083 ceph-mon[35058]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T20:49:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:26 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T20:49:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:26 smithi083 ceph-mon[35058]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T20:49:27.084 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:49:27.347 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:27 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T20:49:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:27 smithi172 ceph-mon[35265]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T20:49:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:27 smithi172 ceph-mon[35265]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T20:49:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:27 smithi172 ceph-mon[35265]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T20:49:27.754 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:27 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T20:49:27.754 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:27 smithi067 ceph-mon[30891]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T20:49:27.754 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:27 smithi067 ceph-mon[30891]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T20:49:27.754 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:27 smithi067 ceph-mon[30891]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T20:49:27.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 -- 172.21.15.67:0/401645115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c108060 msgr2=0x7f135c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:27.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 --2- 172.21.15.67:0/401645115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c108060 0x7f135c10e860 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1354009ca0 tx=0x7f135402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 -- 172.21.15.67:0/401645115 shutdown_connections 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 --2- 172.21.15.67:0/401645115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c108060 0x7f135c10e860 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 --2- 172.21.15.67:0/401645115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c1076e0 0x7f135c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 --2- 172.21.15.67:0/401645115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c101cd0 0x7f135c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 -- 172.21.15.67:0/401645115 >> 172.21.15.67:0/401645115 conn(0x7f135c0fd700 msgr2=0x7f135c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 -- 172.21.15.67:0/401645115 shutdown_connections 2024-09-10T20:49:27.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.833+0000 7f13643bb640 1 -- 172.21.15.67:0/401645115 wait complete. 2024-09-10T20:49:27.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 Processor -- start 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 -- start start 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 0x7f135c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c108060 0x7f135c19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f135c111d70 con 0x7f135c1076e0 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f135c111bf0 con 0x7f135c108060 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.834+0000 7f13643bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f135c111ef0 con 0x7f135c101cd0 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36296/0 (socket says 172.21.15.67:36296) 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 -- 172.21.15.67:0/4282091508 learned_addr learned my addr 172.21.15.67:0/4282091508 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1362958640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c108060 0x7f135c19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:27.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1362157640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 0x7f135c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 -- 172.21.15.67:0/4282091508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 msgr2=0x7f135c198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 0x7f135c198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 -- 172.21.15.67:0/4282091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c108060 msgr2=0x7f135c19db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c108060 0x7f135c19db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 -- 172.21.15.67:0/4282091508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c19e2d0 con 0x7f135c1076e0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1362157640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 0x7f135c198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f1361956640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f134c00b4a0 tx=0x7f134c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c014070 con 0x7f135c1076e0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f134c010ac0 con 0x7f135c1076e0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c19e5c0 con 0x7f135c1076e0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c017c30 con 0x7f135c1076e0 2024-09-10T20:49:27.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.835+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c1a4c80 con 0x7f135c1076e0 2024-09-10T20:49:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.836+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c1020b0 con 0x7f135c1076e0 2024-09-10T20:49:27.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.838+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f134c010610 con 0x7f135c1076e0 2024-09-10T20:49:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.839+0000 7f13537fe640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 0x7f13480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.839+0000 7f1362157640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 0x7f13480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:27.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.839+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f134c0e5350 con 0x7f135c1076e0 2024-09-10T20:49:27.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.839+0000 7f1362157640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 0x7f13480b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13580058c0 tx=0x7f1358005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:27.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:27.842+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f134c0ac360 con 0x7f135c1076e0 2024-09-10T20:49:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:27 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/920104650' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T20:49:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:27 smithi083 ceph-mon[35058]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T20:49:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:27 smithi083 ceph-mon[35058]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T20:49:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:27 smithi083 ceph-mon[35058]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T20:49:28.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.030+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f135c199350 con 0x7f135c1076e0 2024-09-10T20:49:28.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.031+0000 7f13537fe640 1 -- 172.21.15.67:0/4282091508 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22220 (secure 0 0 0) 0x7f134c0abc60 con 0x7f135c1076e0 2024-09-10T20:49:28.037 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:28.037 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":73,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:49:26.010962+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:49:28.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 msgr2=0x7f13480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:28.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 0x7f13480b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13580058c0 tx=0x7f1358005ec0 comp rx=0 tx=0).stop 2024-09-10T20:49:28.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 msgr2=0x7f135c198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:28.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f134c00b4a0 tx=0x7f134c00b960 comp rx=0 tx=0).stop 2024-09-10T20:49:28.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 shutdown_connections 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f135c108060 0x7f135c19db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f135c1076e0 0x7f135c198760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13480b52e0 0x7f13480b77a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 --2- 172.21.15.67:0/4282091508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f135c101cd0 0x7f135c198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 >> 172.21.15.67:0/4282091508 conn(0x7f135c0fd700 msgr2=0x7f135c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 shutdown_connections 2024-09-10T20:49:28.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:28.034+0000 7f13643bb640 1 -- 172.21.15.67:0/4282091508 wait complete. 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: pgmap v283: 97 pgs: 17 creating+peering, 50 active+clean, 30 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: Cluster is now healthy 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:active 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:28 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4282091508' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: pgmap v283: 97 pgs: 17 creating+peering, 50 active+clean, 30 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: Cluster is now healthy 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:active 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.725 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:28 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4282091508' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:28.756 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:49:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: pgmap v283: 97 pgs: 17 creating+peering, 50 active+clean, 30 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T20:49:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T20:49:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: Cluster is now healthy 2024-09-10T20:49:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] up:active 2024-09-10T20:49:28.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:28.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:28 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4282091508' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:29.014 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 -- 172.21.15.67:0/2769216892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde101076e0 msgr2=0x7fde10107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 --2- 172.21.15.67:0/2769216892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde101076e0 0x7fde10107b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009ca0 tx=0x7fde0c02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 -- 172.21.15.67:0/2769216892 shutdown_connections 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 --2- 172.21.15.67:0/2769216892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde1010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 --2- 172.21.15.67:0/2769216892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde101076e0 0x7fde10107b20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 --2- 172.21.15.67:0/2769216892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde10101cd0 0x7fde101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 -- 172.21.15.67:0/2769216892 >> 172.21.15.67:0/2769216892 conn(0x7fde100fd700 msgr2=0x7fde100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 -- 172.21.15.67:0/2769216892 shutdown_connections 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.506+0000 7fde1732e640 1 -- 172.21.15.67:0/2769216892 wait complete. 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 Processor -- start 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 -- start start 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 0x7fde101983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde10198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111d20 con 0x7fde10101cd0 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111ba0 con 0x7fde101076e0 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde1732e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde10111ea0 con 0x7fde10108060 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36320/0 (socket says 172.21.15.67:36320) 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 -- 172.21.15.67:0/1605569723 learned_addr learned my addr 172.21.15.67:0/1605569723 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:29.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde158cb640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde10198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde148c9640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 0x7fde101983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 -- 172.21.15.67:0/1605569723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 msgr2=0x7fde10198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde10198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 -- 172.21.15.67:0/1605569723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 msgr2=0x7fde101983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 0x7fde101983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde150ca640 1 -- 172.21.15.67:0/1605569723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1019d230 con 0x7fde10101cd0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde148c9640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 0x7fde101983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.507+0000 7fde158cb640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde10198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde150ca640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fde0400c890 tx=0x7fde0400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04004220 con 0x7fde10101cd0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1019d520 con 0x7fde10101cd0 2024-09-10T20:49:29.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde040043c0 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04004a00 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.508+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1019dab0 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.509+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde101020b0 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.510+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fde040079b0 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.511+0000 7fde027fc640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 0x7fddfc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.511+0000 7fde148c9640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 0x7fddfc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.512+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fde040e5c80 con 0x7fde10101cd0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.512+0000 7fde148c9640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 0x7fddfc0b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde1006c0b0 tx=0x7fde0c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:29.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.514+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fde04014030 con 0x7fde10101cd0 2024-09-10T20:49:29.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.701+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde1006b8c0 con 0x7fde10101cd0 2024-09-10T20:49:29.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.703+0000 7fde027fc640 1 -- 172.21.15.67:0/1605569723 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22220 (secure 0 0 0) 0x7fde1006b8c0 con 0x7fde10101cd0 2024-09-10T20:49:29.707 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:29.707 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":73,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:49:26.010962+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:49:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 msgr2=0x7fddfc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 0x7fddfc0b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde1006c0b0 tx=0x7fde0c009360 comp rx=0 tx=0).stop 2024-09-10T20:49:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 msgr2=0x7fde10197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fde0400c890 tx=0x7fde0400cd50 comp rx=0 tx=0).stop 2024-09-10T20:49:29.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 shutdown_connections 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fddfc0b52e0 0x7fddfc0b77a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde10108060 0x7fde10198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fde101076e0 0x7fde101983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 --2- 172.21.15.67:0/1605569723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde10101cd0 0x7fde10197e60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 >> 172.21.15.67:0/1605569723 conn(0x7fde100fd700 msgr2=0x7fde100ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 shutdown_connections 2024-09-10T20:49:29.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:29.705+0000 7fde1732e640 1 -- 172.21.15.67:0/1605569723 wait complete. 2024-09-10T20:49:30.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T20:49:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:30 smithi172 ceph-mon[35265]: pgmap v284: 97 pgs: 5 creating+peering, 76 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 382 B/s wr, 4 op/s 2024-09-10T20:49:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:30 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1605569723' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:30.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:30 smithi067 ceph-mon[30891]: pgmap v284: 97 pgs: 5 creating+peering, 76 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 382 B/s wr, 4 op/s 2024-09-10T20:49:30.722 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:30 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1605569723' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:30 smithi083 ceph-mon[35058]: pgmap v284: 97 pgs: 5 creating+peering, 76 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 382 B/s wr, 4 op/s 2024-09-10T20:49:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:30 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1605569723' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1540812069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58104600 msgr2=0x7f8f5810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1540812069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58104600 0x7f8f5810caf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009900 tx=0x7f8f5402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1540812069 shutdown_connections 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1540812069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f5810d140 0x7f8f5810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1540812069 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58104600 0x7f8f5810caf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1540812069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f58103ce0 0x7f8f581040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1540812069 >> 172.21.15.67:0/1540812069 conn(0x7f8f580fd720 msgr2=0x7f8f580ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1540812069 shutdown_connections 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.074+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1540812069 wait complete. 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 Processor -- start 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 -- start start 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 0x7f8f58199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 0x7f8f5819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58112e70 con 0x7f8f58103ce0 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58112cf0 con 0x7f8f58104600 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5ff63640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f58112ff0 con 0x7f8f5810d140 2024-09-10T20:49:31.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36346/0 (socket says 172.21.15.67:36346) 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 -- 172.21.15.67:0/1180049813 learned_addr learned my addr 172.21.15.67:0/1180049813 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5e500640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 0x7f8f5819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5d4fe640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 0x7f8f58199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 -- 172.21.15.67:0/1180049813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 msgr2=0x7f8f5819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 0x7f8f5819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 -- 172.21.15.67:0/1180049813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 msgr2=0x7f8f58199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 0x7f8f58199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5dcff640 1 -- 172.21.15.67:0/1180049813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5819f570 con 0x7f8f58103ce0 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5e500640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 0x7f8f5819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:31.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.075+0000 7f8f5d4fe640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 0x7f8f58199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f5dcff640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b4a0 tx=0x7f8f4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c014070 con 0x7f8f58103ce0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c010ac0 con 0x7f8f58103ce0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5819f860 con 0x7f8f58103ce0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c017c30 con 0x7f8f58103ce0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.076+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f581a5f20 con 0x7f8f58103ce0 2024-09-10T20:49:31.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.077+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f58104140 con 0x7f8f58103ce0 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.079+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8f4c010610 con 0x7f8f58103ce0 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.080+0000 7f8f4affd640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 0x7f8f440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.080+0000 7f8f5d4fe640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 0x7f8f440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.080+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f8f4c0e5440 con 0x7f8f58103ce0 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.080+0000 7f8f5d4fe640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 0x7f8f440b7820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005ab0 tx=0x7f8f54031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:31.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.083+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8f4c0ac450 con 0x7f8f58103ce0 2024-09-10T20:49:31.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.308+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8f5802e5c0 con 0x7f8f58103ce0 2024-09-10T20:49:31.391 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:31 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: 2024-09-10T20:49:31.041+0000 7f621408b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:49:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.434+0000 7f8f4affd640 1 -- 172.21.15.67:0/1180049813 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f8f4c0abd50 con 0x7f8f58103ce0 2024-09-10T20:49:31.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 msgr2=0x7f8f440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 0x7f8f440b7820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005ab0 tx=0x7f8f54031400 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 msgr2=0x7f8f581994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b4a0 tx=0x7f8f4c00b960 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 shutdown_connections 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f440b5360 0x7f8f440b7820 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5810d140 0x7f8f5819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f58104600 0x7f8f58199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 --2- 172.21.15.67:0/1180049813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f58103ce0 0x7f8f581994c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.436+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 >> 172.21.15.67:0/1180049813 conn(0x7f8f580fd720 msgr2=0x7f8f580fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.437+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 shutdown_connections 2024-09-10T20:49:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:31.437+0000 7f8f5ff63640 1 -- 172.21.15.67:0/1180049813 wait complete. 2024-09-10T20:49:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:31 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T20:49:31.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:31 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T20:49:31.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:31 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T20:49:32.237 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-10T20:49:32.237 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T20:49:32.499 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:32 smithi067 ceph-mon[30891]: pgmap v285: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s wr, 4 op/s 2024-09-10T20:49:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:32 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T20:49:32.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:32 smithi067 ceph-mon[30891]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:32 smithi172 ceph-mon[35265]: pgmap v285: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s wr, 4 op/s 2024-09-10T20:49:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:32 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T20:49:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:32 smithi172 ceph-mon[35265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:32 smithi083 ceph-mon[35058]: pgmap v285: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 644 B/s wr, 4 op/s 2024-09-10T20:49:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:32 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1180049813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T20:49:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:32 smithi083 ceph-mon[35058]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:32.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- 172.21.15.67:0/3337878861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f171410d100 msgr2=0x7f171410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 --2- 172.21.15.67:0/3337878861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f171410d100 0x7f171410f560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1704009ca0 tx=0x7f170402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- 172.21.15.67:0/3337878861 shutdown_connections 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 --2- 172.21.15.67:0/3337878861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f171410d100 0x7f171410f560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 --2- 172.21.15.67:0/3337878861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 0x7f171410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 --2- 172.21.15.67:0/3337878861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1714103ca0 0x7f1714104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- 172.21.15.67:0/3337878861 >> 172.21.15.67:0/3337878861 conn(0x7f17140fd700 msgr2=0x7f17140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- 172.21.15.67:0/3337878861 shutdown_connections 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- 172.21.15.67:0/3337878861 wait complete. 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 Processor -- start 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.967+0000 7f171c6fd640 1 -- start start 2024-09-10T20:49:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 0x7f171419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f171410d100 0x7f17141a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1714112d70 con 0x7f1714103ca0 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1714112bf0 con 0x7f171410d100 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171c6fd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1714112ef0 con 0x7f17141045c0 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55064/0 (socket says 172.21.15.67:55064) 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 -- 172.21.15.67:0/1460854960 learned_addr learned my addr 172.21.15.67:0/1460854960 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f1719c98640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 0x7f171419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171ac9a640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f171410d100 0x7f17141a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 -- 172.21.15.67:0/1460854960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 msgr2=0x7f171419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:32.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 0x7f171419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 -- 172.21.15.67:0/1460854960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f171410d100 msgr2=0x7f17141a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f171410d100 0x7f17141a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 -- 172.21.15.67:0/1460854960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17141a1530 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.968+0000 7f171a499640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c920 tx=0x7f170c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.969+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c007c70 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.969+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170c007e10 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.969+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17141a1820 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.969+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c018820 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.969+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a7ee0 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.970+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1714104080 con 0x7f1714103ca0 2024-09-10T20:49:32.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.971+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f170c00f450 con 0x7f1714103ca0 2024-09-10T20:49:32.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.972+0000 7f17137fe640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 0x7f16fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:32.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.972+0000 7f1719c98640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 0x7f16fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:32.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.972+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f170c0e5d60 con 0x7f1714103ca0 2024-09-10T20:49:32.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.972+0000 7f1719c98640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 0x7f16fc0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f171410e710 tx=0x7f170800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:32.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:32.975+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f170c014030 con 0x7f1714103ca0 2024-09-10T20:49:33.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.200+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f17141a8310 con 0x7f1714103ca0 2024-09-10T20:49:33.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.441+0000 7f17137fe640 1 -- 172.21.15.67:0/1460854960 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f170c0ace00 con 0x7f1714103ca0 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.443+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 msgr2=0x7f16fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 0x7f16fc0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f171410e710 tx=0x7f170800b2e0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 msgr2=0x7f171419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c920 tx=0x7f170c00cde0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 shutdown_connections 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f171410d100 0x7f17141a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f16fc0b52e0 0x7f16fc0b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17141045c0 0x7f171419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 --2- 172.21.15.67:0/1460854960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1714103ca0 0x7f171419b480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 >> 172.21.15.67:0/1460854960 conn(0x7f17140fd700 msgr2=0x7f171410f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 shutdown_connections 2024-09-10T20:49:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:33.444+0000 7f171c6fd640 1 -- 172.21.15.67:0/1460854960 wait complete. 2024-09-10T20:49:33.459 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:33 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T20:49:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:33 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T20:49:33.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:33 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T20:49:34.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T20:49:34.445 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T20:49:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T20:49:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T20:49:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T20:49:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T20:49:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:34 smithi172 ceph-mon[35265]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T20:49:34.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T20:49:34.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T20:49:34.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T20:49:34.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T20:49:34.730 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:34.731 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T20:49:34.731 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:34 smithi067 ceph-mon[30891]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T20:49:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T20:49:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T20:49:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1460854960' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T20:49:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T20:49:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T20:49:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T20:49:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:34 smithi083 ceph-mon[35058]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T20:49:34.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 -- 172.21.15.67:0/4171575196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c1087d0 msgr2=0x7f3b4c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/4171575196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c108c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009900 tx=0x7f3b3402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 -- 172.21.15.67:0/4171575196 shutdown_connections 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/4171575196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c109150 0x7f3b4c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/4171575196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c108c10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/4171575196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 -- 172.21.15.67:0/4171575196 >> 172.21.15.67:0/4171575196 conn(0x7f3b4c0fe830 msgr2=0x7f3b4c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 -- 172.21.15.67:0/4171575196 shutdown_connections 2024-09-10T20:49:34.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.958+0000 7f3b50d2d640 1 -- 172.21.15.67:0/4171575196 wait complete. 2024-09-10T20:49:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 Processor -- start 2024-09-10T20:49:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 -- start start 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c109150 0x7f3b4c1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c112e10 con 0x7f3b4c102dc0 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c112c90 con 0x7f3b4c1087d0 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b50d2d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c112f90 con 0x7f3b4c109150 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.959+0000 7f3b4a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55090/0 (socket says 172.21.15.67:55090) 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 -- 172.21.15.67:0/1600200954 learned_addr learned my addr 172.21.15.67:0/1600200954 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4ad9d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c109150 0x7f3b4c1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b43fff640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 -- 172.21.15.67:0/1600200954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c109150 msgr2=0x7f3b4c1a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c109150 0x7f3b4c1a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 -- 172.21.15.67:0/1600200954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c1087d0 msgr2=0x7f3b4c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 -- 172.21.15.67:0/1600200954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c1a1590 con 0x7f3b4c102dc0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b4a59c640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d770 tx=0x7f3b3c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c017070 con 0x7f3b4c102dc0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c1a1880 con 0x7f3b4c102dc0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b3c0054d0 con 0x7f3b4c102dc0 2024-09-10T20:49:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c004c30 con 0x7f3b4c102dc0 2024-09-10T20:49:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.960+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c1a7f40 con 0x7f3b4c102dc0 2024-09-10T20:49:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.961+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4c104070 con 0x7f3b4c102dc0 2024-09-10T20:49:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.963+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3b3c004dd0 con 0x7f3b4c102dc0 2024-09-10T20:49:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.963+0000 7f3b437fe640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 0x7f3b380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.964+0000 7f3b43fff640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 0x7f3b380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.964+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f3b3c0e5910 con 0x7f3b4c102dc0 2024-09-10T20:49:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.964+0000 7f3b43fff640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 0x7f3b380b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b34031440 tx=0x7f3b340095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:34.966+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3b3c0ac920 con 0x7f3b4c102dc0 2024-09-10T20:49:35.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.192+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f3b4c10f340 con 0x7f3b4c102dc0 2024-09-10T20:49:35.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.458+0000 7f3b437fe640 1 -- 172.21.15.67:0/1600200954 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f3b3c0ac220 con 0x7f3b4c102dc0 2024-09-10T20:49:35.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 msgr2=0x7f3b380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:35.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 0x7f3b380b77a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b34031440 tx=0x7f3b340095f0 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 msgr2=0x7f3b4c19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00d770 tx=0x7f3b3c00dc30 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 shutdown_connections 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b380b52e0 0x7f3b380b77a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4c109150 0x7f3b4c1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b4c1087d0 0x7f3b4c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 --2- 172.21.15.67:0/1600200954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b4c102dc0 0x7f3b4c19b4e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 >> 172.21.15.67:0/1600200954 conn(0x7f3b4c0fe830 msgr2=0x7f3b4c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 shutdown_connections 2024-09-10T20:49:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:35.460+0000 7f3b50d2d640 1 -- 172.21.15.67:0/1600200954 wait complete. 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:active 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: Cluster is now healthy 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T20:49:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T20:49:35.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T20:49:35.789 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:active 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: Cluster is now healthy 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T20:49:35.790 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T20:49:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] up:active 2024-09-10T20:49:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T20:49:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T20:49:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: Cluster is now healthy 2024-09-10T20:49:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T20:49:35.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T20:49:35.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T20:49:35.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T20:49:36.105 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T20:49:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:36.391 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: 2024-09-10T20:49:36.042+0000 7f621408b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T20:49:36.391 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: 2024-09-10T20:49:36.042+0000 7f621408b640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T20:49:36.777 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:36 smithi067 ceph-mon[30891]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T20:49:36.777 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:36 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T20:49:36.777 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:36 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:active 2024-09-10T20:49:36.777 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:36 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T20:49:36.777 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:36 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:36.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 -- 172.21.15.67:0/2969983588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c108020 msgr2=0x7fa09c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:36.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/2969983588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c108020 0x7fa09c10e820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa094009ca0 tx=0x7fa09402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 -- 172.21.15.67:0/2969983588 shutdown_connections 2024-09-10T20:49:36.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/2969983588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c108020 0x7fa09c10e820 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/2969983588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c1076a0 0x7fa09c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/2969983588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 0x7fa09c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 -- 172.21.15.67:0/2969983588 >> 172.21.15.67:0/2969983588 conn(0x7fa09c0fd700 msgr2=0x7fa09c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 -- 172.21.15.67:0/2969983588 shutdown_connections 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.858+0000 7fa0a3f89640 1 -- 172.21.15.67:0/2969983588 wait complete. 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 Processor -- start 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 -- start start 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 0x7fa09c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c108020 0x7fa09c19eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c111ca0 con 0x7fa09c1076a0 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c111b20 con 0x7fa09c101c90 2024-09-10T20:49:36.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a3f89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c111e20 con 0x7fa09c108020 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55112/0 (socket says 172.21.15.67:55112) 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 -- 172.21.15.67:0/744604779 learned_addr learned my addr 172.21.15.67:0/744604779 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1d25640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 0x7fa09c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a2526640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c108020 0x7fa09c19eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 -- 172.21.15.67:0/744604779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c108020 msgr2=0x7fa09c19eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c108020 0x7fa09c19eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 -- 172.21.15.67:0/744604779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 msgr2=0x7fa09c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 0x7fa09c1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 -- 172.21.15.67:0/744604779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c19f270 con 0x7fa09c1076a0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.859+0000 7fa0a1524640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c890 tx=0x7fa08c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.860+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c004220 con 0x7fa09c1076a0 2024-09-10T20:49:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.860+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa08c0043c0 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.860+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c19f560 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.860+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c004a00 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.860+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c1a5c20 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.861+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c102070 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.862+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fa08c0079b0 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.863+0000 7fa092ffd640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 0x7fa0880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.863+0000 7fa0a1d25640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 0x7fa0880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.864+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa08c0e5d40 con 0x7fa09c1076a0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.864+0000 7fa0a1d25640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 0x7fa0880b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa098005e10 tx=0x7fa098005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:36.867+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa08c014030 con 0x7fa09c1076a0 2024-09-10T20:49:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-mon[35058]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T20:49:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T20:49:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:active 2024-09-10T20:49:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T20:49:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:36 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:36 smithi172 ceph-mon[35265]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-10T20:49:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:36 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1600200954' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T20:49:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:36 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] up:active 2024-09-10T20:49:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:36 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T20:49:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:36 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:37.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.094+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa09c02e5c0 con 0x7fa09c1076a0 2024-09-10T20:49:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.469+0000 7fa092ffd640 1 -- 172.21.15.67:0/744604779 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fa08c0accb0 con 0x7fa09c1076a0 2024-09-10T20:49:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 msgr2=0x7fa0880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 0x7fa0880b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa098005e10 tx=0x7fa098005da0 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 msgr2=0x7fa09c199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c890 tx=0x7fa08c00cd50 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 shutdown_connections 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0880b52e0 0x7fa0880b77a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa09c108020 0x7fa09c19eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa09c1076a0 0x7fa09c199700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 --2- 172.21.15.67:0/744604779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09c101c90 0x7fa09c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 >> 172.21.15.67:0/744604779 conn(0x7fa09c0fd700 msgr2=0x7fa09c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 shutdown_connections 2024-09-10T20:49:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:37.473+0000 7fa0a3f89640 1 -- 172.21.15.67:0/744604779 wait complete. 2024-09-10T20:49:37.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:37 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T20:49:37.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:37 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T20:49:37.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:37 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T20:49:38.146 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-10T20:49:38.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T20:49:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:38 smithi067 ceph-mon[30891]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-10T20:49:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:38 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T20:49:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:38 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:38 smithi083 ceph-mon[35058]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-10T20:49:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:38 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T20:49:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:38 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:38.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 -- 172.21.15.67:0/2204615901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 msgr2=0x7fee5c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 --2- 172.21.15.67:0/2204615901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c10f950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fee54009ca0 tx=0x7fee5402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 -- 172.21.15.67:0/2204615901 shutdown_connections 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 --2- 172.21.15.67:0/2204615901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c10f950 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 --2- 172.21.15.67:0/2204615901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 --2- 172.21.15.67:0/2204615901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 0x7fee5c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 -- 172.21.15.67:0/2204615901 >> 172.21.15.67:0/2204615901 conn(0x7fee5c0fe830 msgr2=0x7fee5c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 -- 172.21.15.67:0/2204615901 shutdown_connections 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.938+0000 7fee647c3640 1 -- 172.21.15.67:0/2204615901 wait complete. 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 Processor -- start 2024-09-10T20:49:38.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 -- start start 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 0x7fee5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c112dd0 con 0x7fee5c109150 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c112c50 con 0x7fee5c1087d0 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee647c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c112f50 con 0x7fee5c102dc0 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee62d60640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee61d5e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee62d60640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55126/0 (socket says 172.21.15.67:55126) 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.939+0000 7fee62d60640 1 -- 172.21.15.67:0/1364393554 learned_addr learned my addr 172.21.15.67:0/1364393554 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee6255f640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 0x7fee5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 -- 172.21.15.67:0/1364393554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 msgr2=0x7fee5c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 0x7fee5c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 -- 172.21.15.67:0/1364393554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 msgr2=0x7fee5c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 -- 172.21.15.67:0/1364393554 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c19f310 con 0x7fee5c109150 2024-09-10T20:49:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee61d5e640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:49:38.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee62d60640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee540098d0 tx=0x7fee540317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54003b70 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee54003d10 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5402fa20 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c19f5a0 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.940+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c1a5cc0 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.941+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5c1031a0 con 0x7fee5c109150 2024-09-10T20:49:38.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.943+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fee5402fbe0 con 0x7fee5c109150 2024-09-10T20:49:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.943+0000 7fee537fe640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 0x7fee480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.943+0000 7fee6255f640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 0x7fee480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.943+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fee54106fc0 con 0x7fee5c109150 2024-09-10T20:49:38.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.944+0000 7fee6255f640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 0x7fee480b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee58009b40 tx=0x7fee58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:38 smithi172 ceph-mon[35265]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-10T20:49:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:38 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/744604779' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T20:49:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:38 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:49:38.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:38.946+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fee540cdf30 con 0x7fee5c109150 2024-09-10T20:49:39.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.159+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fee5c063590 con 0x7fee480b52e0 2024-09-10T20:49:39.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.182+0000 7fee537fe640 1 -- 172.21.15.67:0/1364393554 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fee5c063590 con 0x7fee480b52e0 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 msgr2=0x7fee480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 0x7fee480b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fee58009b40 tx=0x7fee58005f90 comp rx=0 tx=0).stop 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 msgr2=0x7fee5c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee540098d0 tx=0x7fee540317b0 comp rx=0 tx=0).stop 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 shutdown_connections 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee5c109150 0x7fee5c19eb40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:39.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee5c1087d0 0x7fee5c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee480b52e0 0x7fee480b77a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 --2- 172.21.15.67:0/1364393554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c102dc0 0x7fee5c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 >> 172.21.15.67:0/1364393554 conn(0x7fee5c0fe830 msgr2=0x7fee5c0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 shutdown_connections 2024-09-10T20:49:39.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:39.184+0000 7fee647c3640 1 -- 172.21.15.67:0/1364393554 wait complete. 2024-09-10T20:49:39.503 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:49:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:49:39.164+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:49:39.503 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:49:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:49:39.164+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:49:39.503 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:49:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:49:39.164+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:49:39.503 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:49:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:49:39.164+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:49:39.503 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:49:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:49:39.164+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:49:39.873 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T20:49:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:40.544 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:40 smithi067 ceph-mon[30891]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T20:49:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:40 smithi067 ceph-mon[30891]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 -- 172.21.15.67:0/285066815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f48103ce0 msgr2=0x7f7f481040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 --2- 172.21.15.67:0/285066815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f48103ce0 0x7f7f481040c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009900 tx=0x7f7f4402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 -- 172.21.15.67:0/285066815 shutdown_connections 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 --2- 172.21.15.67:0/285066815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f4810d140 0x7f7f4810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 --2- 172.21.15.67:0/285066815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f4810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 --2- 172.21.15.67:0/285066815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f48103ce0 0x7f7f481040c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 -- 172.21.15.67:0/285066815 >> 172.21.15.67:0/285066815 conn(0x7f7f480fd700 msgr2=0x7f7f480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 -- 172.21.15.67:0/285066815 shutdown_connections 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.628+0000 7f7f4f989640 1 -- 172.21.15.67:0/285066815 wait complete. 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 Processor -- start 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 -- start start 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 0x7f7f481992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f48199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48112db0 con 0x7f7f4810d140 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48112c30 con 0x7f7f48103ce0 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4f989640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f48112f30 con 0x7f7f48104600 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55182/0 (socket says 172.21.15.67:55182) 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 -- 172.21.15.67:0/1525853244 learned_addr learned my addr 172.21.15.67:0/1525853244 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4cf24640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f48199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4d725640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 0x7f7f481992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 -- 172.21.15.67:0/1525853244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 msgr2=0x7f7f48199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f48199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 -- 172.21.15.67:0/1525853244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 msgr2=0x7f7f481992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 0x7f7f481992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4df26640 1 -- 172.21.15.67:0/1525853244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4819f390 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4cf24640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f48199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.629+0000 7f7f4d725640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 0x7f7f481992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f4df26640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000eaa0 tx=0x7f7f4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000cdb0 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f40005020 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400116d0 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4819f680 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.630+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f481a5d40 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.631+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f481040c0 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.632+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7f4000f040 con 0x7f7f4810d140 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.633+0000 7f7f3a7fc640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 0x7f7f340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.633+0000 7f7f4d725640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 0x7f7f340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.633+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f7f400e5d40 con 0x7f7f4810d140 2024-09-10T20:49:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.634+0000 7f7f4d725640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 0x7f7f340b7820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000c00 tx=0x7f7f44031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.636+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7f40016030 con 0x7f7f4810d140 2024-09-10T20:49:40.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.852+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7f480ffa20 con 0x7f7f340b5360 2024-09-10T20:49:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.875+0000 7f7f3a7fc640 1 -- 172.21.15.67:0/1525853244 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7f480ffa20 con 0x7f7f340b5360 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 msgr2=0x7f7f340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 0x7f7f340b7820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000c00 tx=0x7f7f44031400 comp rx=0 tx=0).stop 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 msgr2=0x7f7f4819ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000eaa0 tx=0x7f7f4000ef60 comp rx=0 tx=0).stop 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 shutdown_connections 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f4810d140 0x7f7f4819ebc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7f340b5360 0x7f7f340b7820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f48104600 0x7f7f48199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 --2- 172.21.15.67:0/1525853244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f48103ce0 0x7f7f481992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:40.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 >> 172.21.15.67:0/1525853244 conn(0x7f7f480fd700 msgr2=0x7f7f480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:40.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 shutdown_connections 2024-09-10T20:49:40.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:40.878+0000 7f7f4f989640 1 -- 172.21.15.67:0/1525853244 wait complete. 2024-09-10T20:49:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:40 smithi083 ceph-mon[35058]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T20:49:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:40 smithi083 ceph-mon[35058]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:40 smithi172 ceph-mon[35265]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T20:49:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:40 smithi172 ceph-mon[35265]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:41.580 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T20:49:41.840 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:42.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 -- 172.21.15.67:0/250233863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 msgr2=0x7f33e410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:42.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 --2- 172.21.15.67:0/250233863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e410e860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009900 tx=0x7f33cc02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:42.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 -- 172.21.15.67:0/250233863 shutdown_connections 2024-09-10T20:49:42.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 --2- 172.21.15.67:0/250233863 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e410e860 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 --2- 172.21.15.67:0/250233863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 0x7f33e4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 --2- 172.21.15.67:0/250233863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 0x7f33e41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 -- 172.21.15.67:0/250233863 >> 172.21.15.67:0/250233863 conn(0x7f33e40fd700 msgr2=0x7f33e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 -- 172.21.15.67:0/250233863 shutdown_connections 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.421+0000 7f33eab33640 1 -- 172.21.15.67:0/250233863 wait complete. 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 Processor -- start 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 -- start start 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 0x7f33e4110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 0x7f33e4110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f33e4112e00 con 0x7f33e4108060 2024-09-10T20:49:42.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33e4112c80 con 0x7f33e4101cd0 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33eab33640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33e4112f80 con 0x7f33e41076e0 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46316/0 (socket says 172.21.15.67:46316) 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 -- 172.21.15.67:0/3980046584 learned_addr learned my addr 172.21.15.67:0/3980046584 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e88cf640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 0x7f33e4110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e3fff640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 0x7f33e4110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 -- 172.21.15.67:0/3980046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 msgr2=0x7f33e4110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 0x7f33e4110bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 -- 172.21.15.67:0/3980046584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 msgr2=0x7f33e4110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 0x7f33e4110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.422+0000 7f33e90d0640 1 -- 172.21.15.67:0/3980046584 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e41a75f0 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33e90d0640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009a20 tx=0x7f33cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc03f030 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e41a7880 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33cc003aa0 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc035070 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.423+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e41a7d60 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.424+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e41020b0 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.425+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f33cc0035f0 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.426+0000 7f33e1ffb640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 0x7f33d00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.426+0000 7f33e88cf640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 0x7f33d00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.426+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f33cc1066a0 con 0x7f33e4108060 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.427+0000 7f33e88cf640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 0x7f33d00b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007ec0 tx=0x7f33dc0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:42.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.430+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f33cc0cd5b0 con 0x7f33e4108060 2024-09-10T20:49:42.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.646+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f33e4063590 con 0x7f33d00b5370 2024-09-10T20:49:42.652 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:42 smithi067 ceph-mon[30891]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-10T20:49:42.652 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:42 smithi067 ceph-mon[30891]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:42.652 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:42 smithi067 ceph-mon[30891]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T20:49:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.652+0000 7f33e1ffb640 1 -- 172.21.15.67:0/3980046584 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f33e4063590 con 0x7f33d00b5370 2024-09-10T20:49:42.657 INFO:teuthology.orchestra.run.smithi067.stdout:/volumes/qa/sv_0/cb215cf4-a562-447a-bed5-ef1dc295fb43 2024-09-10T20:49:42.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 msgr2=0x7f33d00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:42.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 0x7f33d00b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33dc007ec0 tx=0x7f33dc0075b0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 msgr2=0x7f33e4111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:42.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009a20 tx=0x7f33cc004270 comp rx=0 tx=0).stop 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 shutdown_connections 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f33e4108060 0x7f33e4111110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f33d00b5370 0x7f33d00b7830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33e41076e0 0x7f33e4110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 --2- 172.21.15.67:0/3980046584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33e4101cd0 0x7f33e4110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:42.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 >> 172.21.15.67:0/3980046584 conn(0x7f33e40fd700 msgr2=0x7f33e40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:42.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 shutdown_connections 2024-09-10T20:49:42.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:42.654+0000 7f33eab33640 1 -- 172.21.15.67:0/3980046584 wait complete. 2024-09-10T20:49:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:42 smithi083 ceph-mon[35058]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-10T20:49:42.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:42 smithi083 ceph-mon[35058]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:42.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:42 smithi083 ceph-mon[35058]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T20:49:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:42 smithi172 ceph-mon[35265]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-10T20:49:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:42 smithi172 ceph-mon[35265]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:42.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:42 smithi172 ceph-mon[35265]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T20:49:43.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T20:49:43.647 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 -- 172.21.15.67:0/2118328742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 msgr2=0x7f2170102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 --2- 172.21.15.67:0/2118328742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170102070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f216c009900 tx=0x7f216c02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 -- 172.21.15.67:0/2118328742 shutdown_connections 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 --2- 172.21.15.67:0/2118328742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170108020 0x7f217010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 --2- 172.21.15.67:0/2118328742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f2170107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 --2- 172.21.15.67:0/2118328742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170102070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 -- 172.21.15.67:0/2118328742 >> 172.21.15.67:0/2118328742 conn(0x7f21700fd700 msgr2=0x7f21700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 -- 172.21.15.67:0/2118328742 shutdown_connections 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.135+0000 7f217777d640 1 -- 172.21.15.67:0/2118328742 wait complete. 2024-09-10T20:49:44.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 Processor -- start 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 -- start start 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 0x7f217019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f217019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111ca0 con 0x7f2170108020 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111b20 con 0x7f2170101c90 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f217777d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111e20 con 0x7f21701076a0 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f2175d1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f2175d1a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46344/0 (socket says 172.21.15.67:46344) 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f2175d1a640 1 -- 172.21.15.67:0/2207673469 learned_addr learned my addr 172.21.15.67:0/2207673469 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.136+0000 7f2175519640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 0x7f217019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2174d18640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f217019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:44.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 -- 172.21.15.67:0/2207673469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 msgr2=0x7f217019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f217019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 -- 172.21.15.67:0/2207673469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 msgr2=0x7f217019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 0x7f217019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 -- 172.21.15.67:0/2207673469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21701a5410 con 0x7f2170108020 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175519640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 0x7f217019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2174d18640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f217019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f2175d1a640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f216800eb10 tx=0x7f216800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168004b20 con 0x7f2170108020 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2168004cc0 con 0x7f2170108020 2024-09-10T20:49:44.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168010670 con 0x7f2170108020 2024-09-10T20:49:44.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21701a5700 con 0x7f2170108020 2024-09-10T20:49:44.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.137+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21701a5bf0 con 0x7f2170108020 2024-09-10T20:49:44.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.138+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2170102070 con 0x7f2170108020 2024-09-10T20:49:44.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.139+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2168005000 con 0x7f2170108020 2024-09-10T20:49:44.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.140+0000 7f21667fc640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 0x7f215c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:44.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.140+0000 7f2175519640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 0x7f215c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:44.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.140+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f21680e6500 con 0x7f2170108020 2024-09-10T20:49:44.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.141+0000 7f2175519640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 0x7f215c0b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f216c031440 tx=0x7f216c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:44.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.143+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2168056220 con 0x7f2170108020 2024-09-10T20:49:44.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.356+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2170063590 con 0x7f215c0b5370 2024-09-10T20:49:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.382+0000 7f21667fc640 1 -- 172.21.15.67:0/2207673469 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2170063590 con 0x7f215c0b5370 2024-09-10T20:49:44.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 msgr2=0x7f215c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 0x7f215c0b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f216c031440 tx=0x7f216c005a20 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 msgr2=0x7f217019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f216800eb10 tx=0x7f216800c2d0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 shutdown_connections 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217019aad0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5370 0x7f215c0b7830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21701076a0 0x7f217019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 --2- 172.21.15.67:0/2207673469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2170101c90 0x7f217019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 >> 172.21.15.67:0/2207673469 conn(0x7f21700fd700 msgr2=0x7f21700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 shutdown_connections 2024-09-10T20:49:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:44.384+0000 7f217777d640 1 -- 172.21.15.67:0/2207673469 wait complete. 2024-09-10T20:49:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:44 smithi067 ceph-mon[30891]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:44 smithi067 ceph-mon[30891]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T20:49:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:44 smithi083 ceph-mon[35058]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:44 smithi083 ceph-mon[35058]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T20:49:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:44 smithi172 ceph-mon[35265]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:44 smithi172 ceph-mon[35265]: pgmap v291: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T20:49:45.012 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T20:49:45.268 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:45.653 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:45 smithi067 ceph-mon[30891]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 -- 172.21.15.67:0/841518460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c108040 msgr2=0x7f158c10e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 --2- 172.21.15.67:0/841518460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c108040 0x7f158c10e840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1584009ca0 tx=0x7f158402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 -- 172.21.15.67:0/841518460 shutdown_connections 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 --2- 172.21.15.67:0/841518460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c108040 0x7f158c10e840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 --2- 172.21.15.67:0/841518460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c1076c0 0x7f158c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 --2- 172.21.15.67:0/841518460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c101cb0 0x7f158c102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 -- 172.21.15.67:0/841518460 >> 172.21.15.67:0/841518460 conn(0x7f158c0fd700 msgr2=0x7f158c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:45.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 -- 172.21.15.67:0/841518460 shutdown_connections 2024-09-10T20:49:45.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 -- 172.21.15.67:0/841518460 wait complete. 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.737+0000 7f1590fd3640 1 Processor -- start 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 -- start start 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 0x7f158c199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 0x7f158c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:45.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f158c111d40 con 0x7f158c1076c0 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f158c111bc0 con 0x7f158c108040 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1590fd3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f158c111ec0 con 0x7f158c101cb0 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f158a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 0x7f158c199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46374/0 (socket says 172.21.15.67:46374) 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 -- 172.21.15.67:0/3665328759 learned_addr learned my addr 172.21.15.67:0/3665328759 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f158ad9d640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 0x7f158c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 -- 172.21.15.67:0/3665328759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 msgr2=0x7f158c199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 0x7f158c199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 -- 172.21.15.67:0/3665328759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 msgr2=0x7f158c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 0x7f158c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f1589d9b640 1 -- 172.21.15.67:0/3665328759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c19f510 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f158a59c640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 0x7f158c199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.738+0000 7f158ad9d640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 0x7f158c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f1589d9b640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f158000b4a0 tx=0x7f158000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580015020 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1580011ce0 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c19f800 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580010dc0 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.739+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1a5ec0 con 0x7f158c1076c0 2024-09-10T20:49:45.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.740+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c102110 con 0x7f158c1076c0 2024-09-10T20:49:45.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.741+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f1580011830 con 0x7f158c1076c0 2024-09-10T20:49:45.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.742+0000 7f157b7fe640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 0x7f15740b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:45.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.742+0000 7f158a59c640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 0x7f15740b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:45.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.742+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f15800e55f0 con 0x7f158c1076c0 2024-09-10T20:49:45.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.743+0000 7f158a59c640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 0x7f15740b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f157c009d60 tx=0x7f157c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:45.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.746+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f158001f020 con 0x7f158c1076c0 2024-09-10T20:49:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:45 smithi083 ceph-mon[35058]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:45.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:45 smithi172 ceph-mon[35265]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.960+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f158c1002d0 con 0x7f15740b53f0 2024-09-10T20:49:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.965+0000 7f157b7fe640 1 -- 172.21.15.67:0/3665328759 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f158c1002d0 con 0x7f15740b53f0 2024-09-10T20:49:45.970 INFO:teuthology.orchestra.run.smithi067.stdout:/volumes/qa/sv_1/a9073dc0-5834-4153-871f-d46f72a504b3 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.967+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 msgr2=0x7f15740b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.967+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 0x7f15740b78b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f157c009d60 tx=0x7f157c009110 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.967+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 msgr2=0x7f158c1999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.967+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f158000b4a0 tx=0x7f158000b8a0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 shutdown_connections 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f158c108040 0x7f158c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f158c1076c0 0x7f158c1999a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f15740b53f0 0x7f15740b78b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 --2- 172.21.15.67:0/3665328759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c101cb0 0x7f158c199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 >> 172.21.15.67:0/3665328759 conn(0x7f158c0fd700 msgr2=0x7f158c1047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 shutdown_connections 2024-09-10T20:49:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:45.968+0000 7f1590fd3640 1 -- 172.21.15.67:0/3665328759 wait complete. 2024-09-10T20:49:46.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:46 smithi067 ceph-mon[30891]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-10T20:49:46.770 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:49:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:46 smithi083 ceph-mon[35058]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-10T20:49:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:46 smithi172 ceph-mon[35265]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-10T20:49:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:47.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- 172.21.15.67:0/2215285983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30108060 msgr2=0x7eff3010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 --2- 172.21.15.67:0/2215285983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30108060 0x7eff3010e860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7eff28009ca0 tx=0x7eff2802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- 172.21.15.67:0/2215285983 shutdown_connections 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 --2- 172.21.15.67:0/2215285983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30108060 0x7eff3010e860 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 --2- 172.21.15.67:0/2215285983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff301076e0 0x7eff30107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 --2- 172.21.15.67:0/2215285983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff30101cd0 0x7eff301020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- 172.21.15.67:0/2215285983 >> 172.21.15.67:0/2215285983 conn(0x7eff300fd700 msgr2=0x7eff300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- 172.21.15.67:0/2215285983 shutdown_connections 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- 172.21.15.67:0/2215285983 wait complete. 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 Processor -- start 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.467+0000 7eff380a4640 1 -- start start 2024-09-10T20:49:47.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 0x7eff3019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 0x7eff301a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111d20 con 0x7eff30101cd0 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111ba0 con 0x7eff30108060 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111ea0 con 0x7eff301076e0 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46392/0 (socket says 172.21.15.67:46392) 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 -- 172.21.15.67:0/3590678417 learned_addr learned my addr 172.21.15.67:0/3590678417 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff36641640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 0x7eff301a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff3563f640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 0x7eff3019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 -- 172.21.15.67:0/3590678417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 msgr2=0x7eff3019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 0x7eff3019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 -- 172.21.15.67:0/3590678417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 msgr2=0x7eff301a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:47.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 0x7eff301a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 -- 172.21.15.67:0/3590678417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff301a5550 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff3563f640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 0x7eff3019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff36641640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 0x7eff301a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff35e40640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c970 tx=0x7eff2c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c007bb0 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff2c007d50 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff301a5720 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.468+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00f450 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.469+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff301a5bb0 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.470+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff301020b0 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.471+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7eff2c004f00 con 0x7eff30101cd0 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.472+0000 7eff26ffd640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 0x7eff1c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:47.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.472+0000 7eff3563f640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 0x7eff1c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.472+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7eff2c0e5d00 con 0x7eff30101cd0 2024-09-10T20:49:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.472+0000 7eff3563f640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 0x7eff1c0b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff3006c0f0 tx=0x7eff20005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:47.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.475+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7eff2c014030 con 0x7eff30101cd0 2024-09-10T20:49:47.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.701+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff3006b900 con 0x7eff30101cd0 2024-09-10T20:49:47.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.702+0000 7eff26ffd640 1 -- 172.21.15.67:0/3590678417 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7eff2c0acc10 con 0x7eff30101cd0 2024-09-10T20:49:47.706 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:47.706 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:49:47.707 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:49:47.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 msgr2=0x7eff1c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:47.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 0x7eff1c0b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7eff3006c0f0 tx=0x7eff20005d90 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 msgr2=0x7eff30199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00c970 tx=0x7eff2c00ce30 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 shutdown_connections 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff30108060 0x7eff301a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff1c0b5370 0x7eff1c0b7830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff301076e0 0x7eff3019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 --2- 172.21.15.67:0/3590678417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff30101cd0 0x7eff30199f90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 >> 172.21.15.67:0/3590678417 conn(0x7eff300fd700 msgr2=0x7eff300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 shutdown_connections 2024-09-10T20:49:47.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:47.704+0000 7eff380a4640 1 -- 172.21.15.67:0/3590678417 wait complete. 2024-09-10T20:49:47.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:47 smithi067 ceph-mon[30891]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:47.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:47 smithi083 ceph-mon[35058]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:47.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:47 smithi172 ceph-mon[35265]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:49:48.484 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:49:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:48 smithi067 ceph-mon[30891]: pgmap v293: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-10T20:49:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:48 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3590678417' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:48 smithi083 ceph-mon[35058]: pgmap v293: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-10T20:49:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:48 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3590678417' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:48 smithi172 ceph-mon[35265]: pgmap v293: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 15 op/s 2024-09-10T20:49:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:48 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3590678417' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 -- 172.21.15.67:0/3636786742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb854101810 msgr2=0x7fb854101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3636786742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb854101810 0x7fb854101bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb844009900 tx=0x7fb84402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 -- 172.21.15.67:0/3636786742 shutdown_connections 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3636786742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85410d250 0x7fb85410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3636786742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410a920 0x7fb85410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3636786742 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb854101810 0x7fb854101bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 -- 172.21.15.67:0/3636786742 >> 172.21.15.67:0/3636786742 conn(0x7fb854076f50 msgr2=0x7fb854077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 -- 172.21.15.67:0/3636786742 shutdown_connections 2024-09-10T20:49:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.257+0000 7fb85a5df640 1 -- 172.21.15.67:0/3636786742 wait complete. 2024-09-10T20:49:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 Processor -- start 2024-09-10T20:49:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 -- start start 2024-09-10T20:49:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854101810 0x7fb8541027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410d250 0x7fb854103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb854112d90 con 0x7fb85410a920 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb854112c10 con 0x7fb85410d250 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb85a5df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb854112f10 con 0x7fb854101810 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46412/0 (socket says 172.21.15.67:46412) 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.258+0000 7fb8537fe640 1 -- 172.21.15.67:0/3719664599 learned_addr learned my addr 172.21.15.67:0/3719664599 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb858b7c640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410d250 0x7fb854103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb853fff640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854101810 0x7fb8541027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 -- 172.21.15.67:0/3719664599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854101810 msgr2=0x7fb8541027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854101810 0x7fb8541027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 -- 172.21.15.67:0/3719664599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410d250 msgr2=0x7fb854103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410d250 0x7fb854103260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 -- 172.21.15.67:0/3719664599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8541a76a0 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8537fe640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c920 tx=0x7fb84800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848007c70 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb848007e10 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8541a7990 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848018820 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.259+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8541a7ed0 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.260+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb854101bf0 con 0x7fb85410a920 2024-09-10T20:49:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.263+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb84800f450 con 0x7fb85410a920 2024-09-10T20:49:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.263+0000 7fb8517fa640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 0x7fb83c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:49.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.263+0000 7fb853fff640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 0x7fb83c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:49.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.263+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb8480e5e90 con 0x7fb85410a920 2024-09-10T20:49:49.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.264+0000 7fb853fff640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 0x7fb83c0b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb844031440 tx=0x7fb844005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:49.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.266+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb848014030 con 0x7fb85410a920 2024-09-10T20:49:49.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.456+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8541a8300 con 0x7fb85410a920 2024-09-10T20:49:49.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.458+0000 7fb8517fa640 1 -- 172.21.15.67:0/3719664599 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22220 (secure 0 0 0) 0x7fb8480ace30 con 0x7fb85410a920 2024-09-10T20:49:49.462 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":73,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:49:26.010962+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:49:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.460+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 msgr2=0x7fb83c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.460+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 0x7fb83c0b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb844031440 tx=0x7fb844005b50 comp rx=0 tx=0).stop 2024-09-10T20:49:49.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.460+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 msgr2=0x7fb854102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.460+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c920 tx=0x7fb84800cde0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 shutdown_connections 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb85410d250 0x7fb854103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb85410a920 0x7fb854102d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb83c0b5370 0x7fb83c0b7830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 --2- 172.21.15.67:0/3719664599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854101810 0x7fb8541027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:49.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 >> 172.21.15.67:0/3719664599 conn(0x7fb854076f50 msgr2=0x7fb8541005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:49.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 shutdown_connections 2024-09-10T20:49:49.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:49.461+0000 7fb85a5df640 1 -- 172.21.15.67:0/3719664599 wait complete. 2024-09-10T20:49:49.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:49 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3719664599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:49.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:49 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3719664599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:49.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:49 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3719664599' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:49:50.224 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T20:49:50.224 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T20:49:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:50 smithi067 ceph-mon[30891]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-10T20:49:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:50 smithi083 ceph-mon[35058]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-10T20:49:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:50 smithi172 ceph-mon[35265]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-10T20:49:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 -- 172.21.15.67:0/2198691789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30103ce0 msgr2=0x7f6c301040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 --2- 172.21.15.67:0/2198691789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30103ce0 0x7f6c301040c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009900 tx=0x7f6c2002a410 comp rx=0 tx=0).stop 2024-09-10T20:49:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 -- 172.21.15.67:0/2198691789 shutdown_connections 2024-09-10T20:49:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 --2- 172.21.15.67:0/2198691789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c3010d140 0x7f6c3010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 --2- 172.21.15.67:0/2198691789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30104600 0x7f6c3010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 --2- 172.21.15.67:0/2198691789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30103ce0 0x7f6c301040c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 -- 172.21.15.67:0/2198691789 >> 172.21.15.67:0/2198691789 conn(0x7f6c300fd720 msgr2=0x7f6c300ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 -- 172.21.15.67:0/2198691789 shutdown_connections 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 -- 172.21.15.67:0/2198691789 wait complete. 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.949+0000 7f6c36278640 1 Processor -- start 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 -- start start 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30103ce0 0x7f6c30101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c3010d140 0x7f6c30102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112e00 con 0x7f6c30104600 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112c80 con 0x7f6c30103ce0 2024-09-10T20:49:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c36278640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30112f80 con 0x7f6c3010d140 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46430/0 (socket says 172.21.15.67:46430) 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/694196581 learned_addr learned my addr 172.21.15.67:0/694196581 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2ffff640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30103ce0 0x7f6c30101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/694196581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c3010d140 msgr2=0x7f6c30102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c3010d140 0x7f6c30102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/694196581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30103ce0 msgr2=0x7f6c30101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30103ce0 0x7f6c30101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.950+0000 7f6c2f7fe640 1 -- 172.21.15.67:0/694196581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c301a7670 con 0x7f6c30104600 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c2f7fe640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c970 tx=0x7f6c2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24007bb0 con 0x7f6c30104600 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c301a7960 con 0x7f6c30104600 2024-09-10T20:49:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c24007d50 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400f720 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.951+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c301a7ef0 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.952+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c301040c0 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.953+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6c24004020 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.954+0000 7f6c2d7fa640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 0x7f6c180b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.954+0000 7f6c2ffff640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 0x7f6c180b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.954+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f6c240e6160 con 0x7f6c30104600 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.955+0000 7f6c2ffff640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 0x7f6c180b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c2002a930 tx=0x7f6c20005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:50.957+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6c240ad190 con 0x7f6c30104600 2024-09-10T20:49:51.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.138+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c300ff330 con 0x7f6c180b5370 2024-09-10T20:49:51.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.142+0000 7f6c2d7fa640 1 -- 172.21.15.67:0/694196581 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258689 (secure 0 0 0) 0x7f6c300ff330 con 0x7f6c180b5370 2024-09-10T20:49:51.150 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:51.151 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:49:51.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.145+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 msgr2=0x7f6c180b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.145+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 0x7f6c180b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6c2002a930 tx=0x7f6c20005fd0 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 msgr2=0x7f6c30101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c970 tx=0x7f6c2400ce30 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 shutdown_connections 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6c180b5370 0x7f6c180b7830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c3010d140 0x7f6c30102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c30104600 0x7f6c30101ed0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 --2- 172.21.15.67:0/694196581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c30103ce0 0x7f6c30101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 >> 172.21.15.67:0/694196581 conn(0x7f6c300fd720 msgr2=0x7f6c3010f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 shutdown_connections 2024-09-10T20:49:51.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:51.146+0000 7f6c36278640 1 -- 172.21.15.67:0/694196581 wait complete. 2024-09-10T20:49:51.878 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-10T20:49:50.761774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641403,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":170,"num_read_kb":158,"num_write":274,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381336,"kb_used_data":11288,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560488,"statfs":{"total":1151940427776,"available":1151549939712,"internally_reserved":0,"allocated":11558912,"data_stored":6431023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45813,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":75,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424613+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:49:26.424613+0000","last_peered":"2024-09-10T20:49:26.424613+0000","last_clean":"2024-09-10T20:49:26.424613+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:49:26.424613+0000","last_undegraded":"2024-09-10T20:49:26.424613+0000","last_fullsized":"2024-09-10T20:49:26.424613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423649+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:49:26.423649+0000","last_peered":"2024-09-10T20:49:26.423649+0000","last_clean":"2024-09-10T20:49:26.423649+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:49:26.423649+0000","last_undegraded":"2024-09-10T20:49:26.423649+0000","last_fullsized":"2024-09-10T20:49:26.423649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424178+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:49:26.424178+0000","last_peered":"2024-09-10T20:49:26.424178+0000","last_clean":"2024-09-10T20:49:26.424178+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:49:26.424178+0000","last_undegraded":"2024-09-10T20:49:26.424178+0000","last_fullsized":"2024-09-10T20:49:26.424178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415427+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:49:26.415427+0000","last_peered":"2024-09-10T20:49:26.415427+0000","last_clean":"2024-09-10T20:49:26.415427+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:49:26.415427+0000","last_undegraded":"2024-09-10T20:49:26.415427+0000","last_fullsized":"2024-09-10T20:49:26.415427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420019+0000","last_change":"2024-09-10T20:49:25.426865+0000","last_active":"2024-09-10T20:49:26.420019+0000","last_peered":"2024-09-10T20:49:26.420019+0000","last_clean":"2024-09-10T20:49:26.420019+0000","last_became_active":"2024-09-10T20:49:25.426542+0000","last_became_peered":"2024-09-10T20:49:25.426542+0000","last_unstale":"2024-09-10T20:49:26.420019+0000","last_undegraded":"2024-09-10T20:49:26.420019+0000","last_fullsized":"2024-09-10T20:49:26.420019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:44.462329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420167+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:49:26.420167+0000","last_peered":"2024-09-10T20:49:26.420167+0000","last_clean":"2024-09-10T20:49:26.420167+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:49:26.420167+0000","last_undegraded":"2024-09-10T20:49:26.420167+0000","last_fullsized":"2024-09-10T20:49:26.420167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423123+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:49:26.423123+0000","last_peered":"2024-09-10T20:49:26.423123+0000","last_clean":"2024-09-10T20:49:26.423123+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:49:26.423123+0000","last_undegraded":"2024-09-10T20:49:26.423123+0000","last_fullsized":"2024-09-10T20:49:26.423123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420373+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:49:26.420373+0000","last_peered":"2024-09-10T20:49:26.420373+0000","last_clean":"2024-09-10T20:49:26.420373+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:49:26.420373+0000","last_undegraded":"2024-09-10T20:49:26.420373+0000","last_fullsized":"2024-09-10T20:49:26.420373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424802+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:49:26.424802+0000","last_peered":"2024-09-10T20:49:26.424802+0000","last_clean":"2024-09-10T20:49:26.424802+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:49:26.424802+0000","last_undegraded":"2024-09-10T20:49:26.424802+0000","last_fullsized":"2024-09-10T20:49:26.424802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421436+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:49:26.421436+0000","last_peered":"2024-09-10T20:49:26.421436+0000","last_clean":"2024-09-10T20:49:26.421436+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:49:26.421436+0000","last_undegraded":"2024-09-10T20:49:26.421436+0000","last_fullsized":"2024-09-10T20:49:26.421436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423111+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:49:26.423111+0000","last_peered":"2024-09-10T20:49:26.423111+0000","last_clean":"2024-09-10T20:49:26.423111+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:49:26.423111+0000","last_undegraded":"2024-09-10T20:49:26.423111+0000","last_fullsized":"2024-09-10T20:49:26.423111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415405+0000","last_change":"2024-09-10T20:49:25.435365+0000","last_active":"2024-09-10T20:49:26.415405+0000","last_peered":"2024-09-10T20:49:26.415405+0000","last_clean":"2024-09-10T20:49:26.415405+0000","last_became_active":"2024-09-10T20:49:25.434462+0000","last_became_peered":"2024-09-10T20:49:25.434462+0000","last_unstale":"2024-09-10T20:49:26.415405+0000","last_undegraded":"2024-09-10T20:49:26.415405+0000","last_fullsized":"2024-09-10T20:49:26.415405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:24.369307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414915+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:49:26.414915+0000","last_peered":"2024-09-10T20:49:26.414915+0000","last_clean":"2024-09-10T20:49:26.414915+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:49:26.414915+0000","last_undegraded":"2024-09-10T20:49:26.414915+0000","last_fullsized":"2024-09-10T20:49:26.414915+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424267+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:49:26.424267+0000","last_peered":"2024-09-10T20:49:26.424267+0000","last_clean":"2024-09-10T20:49:26.424267+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:49:26.424267+0000","last_undegraded":"2024-09-10T20:49:26.424267+0000","last_fullsized":"2024-09-10T20:49:26.424267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423838+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:49:26.423838+0000","last_peered":"2024-09-10T20:49:26.423838+0000","last_clean":"2024-09-10T20:49:26.423838+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:49:26.423838+0000","last_undegraded":"2024-09-10T20:49:26.423838+0000","last_fullsized":"2024-09-10T20:49:26.423838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423774+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:49:26.423774+0000","last_peered":"2024-09-10T20:49:26.423774+0000","last_clean":"2024-09-10T20:49:26.423774+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:49:26.423774+0000","last_undegraded":"2024-09-10T20:49:26.423774+0000","last_fullsized":"2024-09-10T20:49:26.423774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424617+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:49:26.424617+0000","last_peered":"2024-09-10T20:49:26.424617+0000","last_clean":"2024-09-10T20:49:26.424617+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:49:26.424617+0000","last_undegraded":"2024-09-10T20:49:26.424617+0000","last_fullsized":"2024-09-10T20:49:26.424617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419704+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:49:26.419704+0000","last_peered":"2024-09-10T20:49:26.419704+0000","last_clean":"2024-09-10T20:49:26.419704+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:49:26.419704+0000","last_undegraded":"2024-09-10T20:49:26.419704+0000","last_fullsized":"2024-09-10T20:49:26.419704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415081+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:49:26.415081+0000","last_peered":"2024-09-10T20:49:26.415081+0000","last_clean":"2024-09-10T20:49:26.415081+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:49:26.415081+0000","last_undegraded":"2024-09-10T20:49:26.415081+0000","last_fullsized":"2024-09-10T20:49:26.415081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423425+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:49:26.423425+0000","last_peered":"2024-09-10T20:49:26.423425+0000","last_clean":"2024-09-10T20:49:26.423425+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:49:26.423425+0000","last_undegraded":"2024-09-10T20:49:26.423425+0000","last_fullsized":"2024-09-10T20:49:26.423425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414984+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:49:26.414984+0000","last_peered":"2024-09-10T20:49:26.414984+0000","last_clean":"2024-09-10T20:49:26.414984+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:49:26.414984+0000","last_undegraded":"2024-09-10T20:49:26.414984+0000","last_fullsized":"2024-09-10T20:49:26.414984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424118+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:49:26.424118+0000","last_peered":"2024-09-10T20:49:26.424118+0000","last_clean":"2024-09-10T20:49:26.424118+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:49:26.424118+0000","last_undegraded":"2024-09-10T20:49:26.424118+0000","last_fullsized":"2024-09-10T20:49:26.424118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421170+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:49:26.421170+0000","last_peered":"2024-09-10T20:49:26.421170+0000","last_clean":"2024-09-10T20:49:26.421170+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:49:26.421170+0000","last_undegraded":"2024-09-10T20:49:26.421170+0000","last_fullsized":"2024-09-10T20:49:26.421170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420185+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:49:26.420185+0000","last_peered":"2024-09-10T20:49:26.420185+0000","last_clean":"2024-09-10T20:49:26.420185+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:49:26.420185+0000","last_undegraded":"2024-09-10T20:49:26.420185+0000","last_fullsized":"2024-09-10T20:49:26.420185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422127+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:49:26.422127+0000","last_peered":"2024-09-10T20:49:26.422127+0000","last_clean":"2024-09-10T20:49:26.422127+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:49:26.422127+0000","last_undegraded":"2024-09-10T20:49:26.422127+0000","last_fullsized":"2024-09-10T20:49:26.422127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415213+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:49:26.415213+0000","last_peered":"2024-09-10T20:49:26.415213+0000","last_clean":"2024-09-10T20:49:26.415213+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:49:26.415213+0000","last_undegraded":"2024-09-10T20:49:26.415213+0000","last_fullsized":"2024-09-10T20:49:26.415213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424373+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:49:26.424373+0000","last_peered":"2024-09-10T20:49:26.424373+0000","last_clean":"2024-09-10T20:49:26.424373+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:49:26.424373+0000","last_undegraded":"2024-09-10T20:49:26.424373+0000","last_fullsized":"2024-09-10T20:49:26.424373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415118+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:49:26.415118+0000","last_peered":"2024-09-10T20:49:26.415118+0000","last_clean":"2024-09-10T20:49:26.415118+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:49:26.415118+0000","last_undegraded":"2024-09-10T20:49:26.415118+0000","last_fullsized":"2024-09-10T20:49:26.415118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424778+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:49:26.424778+0000","last_peered":"2024-09-10T20:49:26.424778+0000","last_clean":"2024-09-10T20:49:26.424778+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:49:26.424778+0000","last_undegraded":"2024-09-10T20:49:26.424778+0000","last_fullsized":"2024-09-10T20:49:26.424778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414704+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:49:26.414704+0000","last_peered":"2024-09-10T20:49:26.414704+0000","last_clean":"2024-09-10T20:49:26.414704+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:49:26.414704+0000","last_undegraded":"2024-09-10T20:49:26.414704+0000","last_fullsized":"2024-09-10T20:49:26.414704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414711+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:49:26.414711+0000","last_peered":"2024-09-10T20:49:26.414711+0000","last_clean":"2024-09-10T20:49:26.414711+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:49:26.414711+0000","last_undegraded":"2024-09-10T20:49:26.414711+0000","last_fullsized":"2024-09-10T20:49:26.414711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423939+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:49:26.423939+0000","last_peered":"2024-09-10T20:49:26.423939+0000","last_clean":"2024-09-10T20:49:26.423939+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:49:26.423939+0000","last_undegraded":"2024-09-10T20:49:26.423939+0000","last_fullsized":"2024-09-10T20:49:26.423939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420113+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:49:26.420113+0000","last_peered":"2024-09-10T20:49:26.420113+0000","last_clean":"2024-09-10T20:49:26.420113+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:49:26.420113+0000","last_undegraded":"2024-09-10T20:49:26.420113+0000","last_fullsized":"2024-09-10T20:49:26.420113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:48.492892+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:49:48.492892+0000","last_peered":"2024-09-10T20:49:48.492892+0000","last_clean":"2024-09-10T20:49:48.492892+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:49:48.492892+0000","last_undegraded":"2024-09-10T20:49:48.492892+0000","last_fullsized":"2024-09-10T20:49:48.492892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420354+0000","last_change":"2024-09-10T20:49:25.425906+0000","last_active":"2024-09-10T20:49:26.420354+0000","last_peered":"2024-09-10T20:49:26.420354+0000","last_clean":"2024-09-10T20:49:26.420354+0000","last_became_active":"2024-09-10T20:49:25.424393+0000","last_became_peered":"2024-09-10T20:49:25.424393+0000","last_unstale":"2024-09-10T20:49:26.420354+0000","last_undegraded":"2024-09-10T20:49:26.420354+0000","last_fullsized":"2024-09-10T20:49:26.420354+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:58.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.465759+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:49:34.465759+0000","last_peered":"2024-09-10T20:49:34.465759+0000","last_clean":"2024-09-10T20:49:34.465759+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:49:34.465759+0000","last_undegraded":"2024-09-10T20:49:34.465759+0000","last_fullsized":"2024-09-10T20:49:34.465759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466326+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:49:34.466326+0000","last_peered":"2024-09-10T20:49:34.466326+0000","last_clean":"2024-09-10T20:49:34.466326+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:49:34.466326+0000","last_undegraded":"2024-09-10T20:49:34.466326+0000","last_fullsized":"2024-09-10T20:49:34.466326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420659+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:49:26.420659+0000","last_peered":"2024-09-10T20:49:26.420659+0000","last_clean":"2024-09-10T20:49:26.420659+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:49:26.420659+0000","last_undegraded":"2024-09-10T20:49:26.420659+0000","last_fullsized":"2024-09-10T20:49:26.420659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421290+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:49:26.421290+0000","last_peered":"2024-09-10T20:49:26.421290+0000","last_clean":"2024-09-10T20:49:26.421290+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:49:26.421290+0000","last_undegraded":"2024-09-10T20:49:26.421290+0000","last_fullsized":"2024-09-10T20:49:26.421290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419832+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:49:26.419832+0000","last_peered":"2024-09-10T20:49:26.419832+0000","last_clean":"2024-09-10T20:49:26.419832+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:49:26.419832+0000","last_undegraded":"2024-09-10T20:49:26.419832+0000","last_fullsized":"2024-09-10T20:49:26.419832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:44.485703+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:49:44.485703+0000","last_peered":"2024-09-10T20:49:44.485703+0000","last_clean":"2024-09-10T20:49:44.485703+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:49:44.485703+0000","last_undegraded":"2024-09-10T20:49:44.485703+0000","last_fullsized":"2024-09-10T20:49:44.485703+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424705+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:49:26.424705+0000","last_peered":"2024-09-10T20:49:26.424705+0000","last_clean":"2024-09-10T20:49:26.424705+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:49:26.424705+0000","last_undegraded":"2024-09-10T20:49:26.424705+0000","last_fullsized":"2024-09-10T20:49:26.424705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458469+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:49:33.458469+0000","last_peered":"2024-09-10T20:49:33.458469+0000","last_clean":"2024-09-10T20:49:33.458469+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:49:33.458469+0000","last_undegraded":"2024-09-10T20:49:33.458469+0000","last_fullsized":"2024-09-10T20:49:33.458469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424251+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:49:26.424251+0000","last_peered":"2024-09-10T20:49:26.424251+0000","last_clean":"2024-09-10T20:49:26.424251+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:49:26.424251+0000","last_undegraded":"2024-09-10T20:49:26.424251+0000","last_fullsized":"2024-09-10T20:49:26.424251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458000+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:49:33.458000+0000","last_peered":"2024-09-10T20:49:33.458000+0000","last_clean":"2024-09-10T20:49:33.458000+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:49:33.458000+0000","last_undegraded":"2024-09-10T20:49:33.458000+0000","last_fullsized":"2024-09-10T20:49:33.458000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425236+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:49:26.425236+0000","last_peered":"2024-09-10T20:49:26.425236+0000","last_clean":"2024-09-10T20:49:26.425236+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:49:26.425236+0000","last_undegraded":"2024-09-10T20:49:26.425236+0000","last_fullsized":"2024-09-10T20:49:26.425236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'22","reported_seq":68,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:45.543565+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:49:45.543565+0000","last_peered":"2024-09-10T20:49:45.543565+0000","last_clean":"2024-09-10T20:49:45.543565+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:49:45.543565+0000","last_undegraded":"2024-09-10T20:49:45.543565+0000","last_fullsized":"2024-09-10T20:49:45.543565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422308+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:49:26.422308+0000","last_peered":"2024-09-10T20:49:26.422308+0000","last_clean":"2024-09-10T20:49:26.422308+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:49:26.422308+0000","last_undegraded":"2024-09-10T20:49:26.422308+0000","last_fullsized":"2024-09-10T20:49:26.422308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463920+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:49:34.463920+0000","last_peered":"2024-09-10T20:49:34.463920+0000","last_clean":"2024-09-10T20:49:34.463920+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:49:34.463920+0000","last_undegraded":"2024-09-10T20:49:34.463920+0000","last_fullsized":"2024-09-10T20:49:34.463920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414662+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:49:26.414662+0000","last_peered":"2024-09-10T20:49:26.414662+0000","last_clean":"2024-09-10T20:49:26.414662+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:49:26.414662+0000","last_undegraded":"2024-09-10T20:49:26.414662+0000","last_fullsized":"2024-09-10T20:49:26.414662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459699+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:49:33.459699+0000","last_peered":"2024-09-10T20:49:33.459699+0000","last_clean":"2024-09-10T20:49:33.459699+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:49:33.459699+0000","last_undegraded":"2024-09-10T20:49:33.459699+0000","last_fullsized":"2024-09-10T20:49:33.459699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423376+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:49:26.423376+0000","last_peered":"2024-09-10T20:49:26.423376+0000","last_clean":"2024-09-10T20:49:26.423376+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:49:26.423376+0000","last_undegraded":"2024-09-10T20:49:26.423376+0000","last_fullsized":"2024-09-10T20:49:26.423376+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:44.488103+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:49:44.488103+0000","last_peered":"2024-09-10T20:49:44.488103+0000","last_clean":"2024-09-10T20:49:44.488103+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:49:44.488103+0000","last_undegraded":"2024-09-10T20:49:44.488103+0000","last_fullsized":"2024-09-10T20:49:44.488103+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422855+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:49:26.422855+0000","last_peered":"2024-09-10T20:49:26.422855+0000","last_clean":"2024-09-10T20:49:26.422855+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:49:26.422855+0000","last_undegraded":"2024-09-10T20:49:26.422855+0000","last_fullsized":"2024-09-10T20:49:26.422855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466175+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:49:34.466175+0000","last_peered":"2024-09-10T20:49:34.466175+0000","last_clean":"2024-09-10T20:49:34.466175+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:49:34.466175+0000","last_undegraded":"2024-09-10T20:49:34.466175+0000","last_fullsized":"2024-09-10T20:49:34.466175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420679+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:49:26.420679+0000","last_peered":"2024-09-10T20:49:26.420679+0000","last_clean":"2024-09-10T20:49:26.420679+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:49:26.420679+0000","last_undegraded":"2024-09-10T20:49:26.420679+0000","last_fullsized":"2024-09-10T20:49:26.420679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:35.470728+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:49:35.470728+0000","last_peered":"2024-09-10T20:49:35.470728+0000","last_clean":"2024-09-10T20:49:35.470728+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:49:35.470728+0000","last_undegraded":"2024-09-10T20:49:35.470728+0000","last_fullsized":"2024-09-10T20:49:35.470728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423817+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:49:26.423817+0000","last_peered":"2024-09-10T20:49:26.423817+0000","last_clean":"2024-09-10T20:49:26.423817+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:49:26.423817+0000","last_undegraded":"2024-09-10T20:49:26.423817+0000","last_fullsized":"2024-09-10T20:49:26.423817+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425853+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:49:26.425853+0000","last_peered":"2024-09-10T20:49:26.425853+0000","last_clean":"2024-09-10T20:49:26.425853+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:49:26.425853+0000","last_undegraded":"2024-09-10T20:49:26.425853+0000","last_fullsized":"2024-09-10T20:49:26.425853+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423567+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:49:26.423567+0000","last_peered":"2024-09-10T20:49:26.423567+0000","last_clean":"2024-09-10T20:49:26.423567+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:49:26.423567+0000","last_undegraded":"2024-09-10T20:49:26.423567+0000","last_fullsized":"2024-09-10T20:49:26.423567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424985+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:49:26.424985+0000","last_peered":"2024-09-10T20:49:26.424985+0000","last_clean":"2024-09-10T20:49:26.424985+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:49:26.424985+0000","last_undegraded":"2024-09-10T20:49:26.424985+0000","last_fullsized":"2024-09-10T20:49:26.424985+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:27.448134+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:49:27.448134+0000","last_peered":"2024-09-10T20:49:27.448134+0000","last_clean":"2024-09-10T20:49:27.448134+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:49:27.448134+0000","last_undegraded":"2024-09-10T20:49:27.448134+0000","last_fullsized":"2024-09-10T20:49:27.448134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.464882+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:49:34.464882+0000","last_peered":"2024-09-10T20:49:34.464882+0000","last_clean":"2024-09-10T20:49:34.464882+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:49:34.464882+0000","last_undegraded":"2024-09-10T20:49:34.464882+0000","last_fullsized":"2024-09-10T20:49:34.464882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423784+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:49:26.423784+0000","last_peered":"2024-09-10T20:49:26.423784+0000","last_clean":"2024-09-10T20:49:26.423784+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:49:26.423784+0000","last_undegraded":"2024-09-10T20:49:26.423784+0000","last_fullsized":"2024-09-10T20:49:26.423784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423516+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:49:26.423516+0000","last_peered":"2024-09-10T20:49:26.423516+0000","last_clean":"2024-09-10T20:49:26.423516+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:49:26.423516+0000","last_undegraded":"2024-09-10T20:49:26.423516+0000","last_fullsized":"2024-09-10T20:49:26.423516+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:35.470403+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:49:35.470403+0000","last_peered":"2024-09-10T20:49:35.470403+0000","last_clean":"2024-09-10T20:49:35.470403+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:49:35.470403+0000","last_undegraded":"2024-09-10T20:49:35.470403+0000","last_fullsized":"2024-09-10T20:49:35.470403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421107+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:49:26.421107+0000","last_peered":"2024-09-10T20:49:26.421107+0000","last_clean":"2024-09-10T20:49:26.421107+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:49:26.421107+0000","last_undegraded":"2024-09-10T20:49:26.421107+0000","last_fullsized":"2024-09-10T20:49:26.421107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463988+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:49:34.463988+0000","last_peered":"2024-09-10T20:49:34.463988+0000","last_clean":"2024-09-10T20:49:34.463988+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:49:34.463988+0000","last_undegraded":"2024-09-10T20:49:34.463988+0000","last_fullsized":"2024-09-10T20:49:34.463988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414535+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:49:26.414535+0000","last_peered":"2024-09-10T20:49:26.414535+0000","last_clean":"2024-09-10T20:49:26.414535+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:49:26.414535+0000","last_undegraded":"2024-09-10T20:49:26.414535+0000","last_fullsized":"2024-09-10T20:49:26.414535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:44.487697+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:49:44.487697+0000","last_peered":"2024-09-10T20:49:44.487697+0000","last_clean":"2024-09-10T20:49:44.487697+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:49:44.487697+0000","last_undegraded":"2024-09-10T20:49:44.487697+0000","last_fullsized":"2024-09-10T20:49:44.487697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420203+0000","last_change":"2024-09-10T20:49:25.426111+0000","last_active":"2024-09-10T20:49:26.420203+0000","last_peered":"2024-09-10T20:49:26.420203+0000","last_clean":"2024-09-10T20:49:26.420203+0000","last_became_active":"2024-09-10T20:49:25.425584+0000","last_became_peered":"2024-09-10T20:49:25.425584+0000","last_unstale":"2024-09-10T20:49:26.420203+0000","last_undegraded":"2024-09-10T20:49:26.420203+0000","last_fullsized":"2024-09-10T20:49:26.420203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:27.800729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424235+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:49:26.424235+0000","last_peered":"2024-09-10T20:49:26.424235+0000","last_clean":"2024-09-10T20:49:26.424235+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:49:26.424235+0000","last_undegraded":"2024-09-10T20:49:26.424235+0000","last_fullsized":"2024-09-10T20:49:26.424235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419998+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:49:26.419998+0000","last_peered":"2024-09-10T20:49:26.419998+0000","last_clean":"2024-09-10T20:49:26.419998+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:49:26.419998+0000","last_undegraded":"2024-09-10T20:49:26.419998+0000","last_fullsized":"2024-09-10T20:49:26.419998+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420153+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:49:26.420153+0000","last_peered":"2024-09-10T20:49:26.420153+0000","last_clean":"2024-09-10T20:49:26.420153+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:49:26.420153+0000","last_undegraded":"2024-09-10T20:49:26.420153+0000","last_fullsized":"2024-09-10T20:49:26.420153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420048+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:49:26.420048+0000","last_peered":"2024-09-10T20:49:26.420048+0000","last_clean":"2024-09-10T20:49:26.420048+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:49:26.420048+0000","last_undegraded":"2024-09-10T20:49:26.420048+0000","last_fullsized":"2024-09-10T20:49:26.420048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.456705+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:49:33.456705+0000","last_peered":"2024-09-10T20:49:33.456705+0000","last_clean":"2024-09-10T20:49:33.456705+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:49:33.456705+0000","last_undegraded":"2024-09-10T20:49:33.456705+0000","last_fullsized":"2024-09-10T20:49:33.456705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415088+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:49:26.415088+0000","last_peered":"2024-09-10T20:49:26.415088+0000","last_clean":"2024-09-10T20:49:26.415088+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:49:26.415088+0000","last_undegraded":"2024-09-10T20:49:26.415088+0000","last_fullsized":"2024-09-10T20:49:26.415088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:44.420720+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:49:44.420720+0000","last_peered":"2024-09-10T20:49:44.420720+0000","last_clean":"2024-09-10T20:49:44.420720+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:49:44.420720+0000","last_undegraded":"2024-09-10T20:49:44.420720+0000","last_fullsized":"2024-09-10T20:49:44.420720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422382+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:49:26.422382+0000","last_peered":"2024-09-10T20:49:26.422382+0000","last_clean":"2024-09-10T20:49:26.422382+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:49:26.422382+0000","last_undegraded":"2024-09-10T20:49:26.422382+0000","last_fullsized":"2024-09-10T20:49:26.422382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459115+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:49:33.459115+0000","last_peered":"2024-09-10T20:49:33.459115+0000","last_clean":"2024-09-10T20:49:33.459115+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:49:33.459115+0000","last_undegraded":"2024-09-10T20:49:33.459115+0000","last_fullsized":"2024-09-10T20:49:33.459115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423816+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:49:26.423816+0000","last_peered":"2024-09-10T20:49:26.423816+0000","last_clean":"2024-09-10T20:49:26.423816+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:49:26.423816+0000","last_undegraded":"2024-09-10T20:49:26.423816+0000","last_fullsized":"2024-09-10T20:49:26.423816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458621+0000","last_change":"2024-09-10T20:49:23.452137+0000","last_active":"2024-09-10T20:49:33.458621+0000","last_peered":"2024-09-10T20:49:33.458621+0000","last_clean":"2024-09-10T20:49:33.458621+0000","last_became_active":"2024-09-10T20:49:23.451821+0000","last_became_peered":"2024-09-10T20:49:23.451821+0000","last_unstale":"2024-09-10T20:49:33.458621+0000","last_undegraded":"2024-09-10T20:49:33.458621+0000","last_fullsized":"2024-09-10T20:49:33.458621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:48.200662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422458+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:49:26.422458+0000","last_peered":"2024-09-10T20:49:26.422458+0000","last_clean":"2024-09-10T20:49:26.422458+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:49:26.422458+0000","last_undegraded":"2024-09-10T20:49:26.422458+0000","last_fullsized":"2024-09-10T20:49:26.422458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458648+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:49:33.458648+0000","last_peered":"2024-09-10T20:49:33.458648+0000","last_clean":"2024-09-10T20:49:33.458648+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:49:33.458648+0000","last_undegraded":"2024-09-10T20:49:33.458648+0000","last_fullsized":"2024-09-10T20:49:33.458648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424035+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:49:26.424035+0000","last_peered":"2024-09-10T20:49:26.424035+0000","last_clean":"2024-09-10T20:49:26.424035+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:49:26.424035+0000","last_undegraded":"2024-09-10T20:49:26.424035+0000","last_fullsized":"2024-09-10T20:49:26.424035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414824+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:49:26.414824+0000","last_peered":"2024-09-10T20:49:26.414824+0000","last_clean":"2024-09-10T20:49:26.414824+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:49:26.414824+0000","last_undegraded":"2024-09-10T20:49:26.414824+0000","last_fullsized":"2024-09-10T20:49:26.414824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421259+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:49:26.421259+0000","last_peered":"2024-09-10T20:49:26.421259+0000","last_clean":"2024-09-10T20:49:26.421259+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:49:26.421259+0000","last_undegraded":"2024-09-10T20:49:26.421259+0000","last_fullsized":"2024-09-10T20:49:26.421259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459485+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:49:33.459485+0000","last_peered":"2024-09-10T20:49:33.459485+0000","last_clean":"2024-09-10T20:49:33.459485+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:49:33.459485+0000","last_undegraded":"2024-09-10T20:49:33.459485+0000","last_fullsized":"2024-09-10T20:49:33.459485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423261+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:49:26.423261+0000","last_peered":"2024-09-10T20:49:26.423261+0000","last_clean":"2024-09-10T20:49:26.423261+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:49:26.423261+0000","last_undegraded":"2024-09-10T20:49:26.423261+0000","last_fullsized":"2024-09-10T20:49:26.423261+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420495+0000","last_change":"2024-09-10T20:49:25.443299+0000","last_active":"2024-09-10T20:49:26.420495+0000","last_peered":"2024-09-10T20:49:26.420495+0000","last_clean":"2024-09-10T20:49:26.420495+0000","last_became_active":"2024-09-10T20:49:25.442963+0000","last_became_peered":"2024-09-10T20:49:25.442963+0000","last_unstale":"2024-09-10T20:49:26.420495+0000","last_undegraded":"2024-09-10T20:49:26.420495+0000","last_fullsized":"2024-09-10T20:49:26.420495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:42.694718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.426929+0000","last_change":"2024-09-10T20:49:23.415345+0000","last_active":"2024-09-10T20:49:26.426929+0000","last_peered":"2024-09-10T20:49:26.426929+0000","last_clean":"2024-09-10T20:49:26.426929+0000","last_became_active":"2024-09-10T20:49:23.415010+0000","last_became_peered":"2024-09-10T20:49:23.415010+0000","last_unstale":"2024-09-10T20:49:26.426929+0000","last_undegraded":"2024-09-10T20:49:26.426929+0000","last_fullsized":"2024-09-10T20:49:26.426929+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:11.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425100+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:49:26.425100+0000","last_peered":"2024-09-10T20:49:26.425100+0000","last_clean":"2024-09-10T20:49:26.425100+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:49:26.425100+0000","last_undegraded":"2024-09-10T20:49:26.425100+0000","last_fullsized":"2024-09-10T20:49:26.425100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463509+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:49:34.463509+0000","last_peered":"2024-09-10T20:49:34.463509+0000","last_clean":"2024-09-10T20:49:34.463509+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:49:34.463509+0000","last_undegraded":"2024-09-10T20:49:34.463509+0000","last_fullsized":"2024-09-10T20:49:34.463509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424186+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:49:26.424186+0000","last_peered":"2024-09-10T20:49:26.424186+0000","last_clean":"2024-09-10T20:49:26.424186+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:49:26.424186+0000","last_undegraded":"2024-09-10T20:49:26.424186+0000","last_fullsized":"2024-09-10T20:49:26.424186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425847+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:49:26.425847+0000","last_peered":"2024-09-10T20:49:26.425847+0000","last_clean":"2024-09-10T20:49:26.425847+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:49:26.425847+0000","last_undegraded":"2024-09-10T20:49:26.425847+0000","last_fullsized":"2024-09-10T20:49:26.425847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422535+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:49:26.422535+0000","last_peered":"2024-09-10T20:49:26.422535+0000","last_clean":"2024-09-10T20:49:26.422535+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:49:26.422535+0000","last_undegraded":"2024-09-10T20:49:26.422535+0000","last_fullsized":"2024-09-10T20:49:26.422535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466460+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:49:34.466460+0000","last_peered":"2024-09-10T20:49:34.466460+0000","last_clean":"2024-09-10T20:49:34.466460+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:49:34.466460+0000","last_undegraded":"2024-09-10T20:49:34.466460+0000","last_fullsized":"2024-09-10T20:49:34.466460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50801,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":377106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972373,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1010041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":377262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708444,"statfs":{"total":95995035648,"available":95957446656,"internally_reserved":0,"allocated":1396736,"data_stored":969192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":376731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":968485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":377559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":377042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":418937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":423324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":378002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:49:51.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T20:49:52.142 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:52 smithi067 ceph-mon[30891]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-10T20:49:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:52 smithi067 ceph-mon[30891]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 -- 172.21.15.67:0/1952019865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 msgr2=0x7f08281031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 --2- 172.21.15.67:0/1952019865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08281031a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0824009900 tx=0x7f082402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 -- 172.21.15.67:0/1952019865 shutdown_connections 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 --2- 172.21.15.67:0/1952019865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0828109150 0x7f082810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 --2- 172.21.15.67:0/1952019865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08281087d0 0x7f0828108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 --2- 172.21.15.67:0/1952019865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08281031a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 -- 172.21.15.67:0/1952019865 >> 172.21.15.67:0/1952019865 conn(0x7f08280fe870 msgr2=0x7f0828100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:52.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 -- 172.21.15.67:0/1952019865 shutdown_connections 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.664+0000 7f08301d5640 1 -- 172.21.15.67:0/1952019865 wait complete. 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 Processor -- start 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 -- start start 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08281087d0 0x7f08280759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:52.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0828109150 0x7f0828075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0828112dd0 con 0x7f0828102dc0 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0828112c50 con 0x7f08281087d0 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f08301d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0828112f50 con 0x7f0828109150 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f082df71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f082df71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48906/0 (socket says 172.21.15.67:48906) 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f082df71640 1 -- 172.21.15.67:0/1102130749 learned_addr learned my addr 172.21.15.67:0/1102130749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.665+0000 7f082d770640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08281087d0 0x7f08280759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082e772640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0828109150 0x7f0828075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 -- 172.21.15.67:0/1102130749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0828109150 msgr2=0x7f0828075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0828109150 0x7f0828075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 -- 172.21.15.67:0/1102130749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08281087d0 msgr2=0x7f08280759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08281087d0 0x7f08280759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 -- 172.21.15.67:0/1102130749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08281a76a0 con 0x7f0828102dc0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f082df71640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0824005940 tx=0x7f08240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082403f030 con 0x7f0828102dc0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08281a7930 con 0x7f0828102dc0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0824003cb0 con 0x7f0828102dc0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824035070 con 0x7f0828102dc0 2024-09-10T20:49:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.666+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08281a7e10 con 0x7f0828102dc0 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.667+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08281031a0 con 0x7f0828102dc0 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.669+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f082403bbf0 con 0x7f0828102dc0 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.669+0000 7f081effd640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 0x7f08140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.669+0000 7f082d770640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 0x7f08140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.669+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f0824106730 con 0x7f0828102dc0 2024-09-10T20:49:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.670+0000 7f082d770640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 0x7f08140b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0828076f90 tx=0x7f081800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:52.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.673+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f08240cd640 con 0x7f0828102dc0 2024-09-10T20:49:52.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.860+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0828063590 con 0x7f08140b5370 2024-09-10T20:49:52.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.864+0000 7f081effd640 1 -- 172.21.15.67:0/1102130749 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258692 (secure 0 0 0) 0x7f0828063590 con 0x7f08140b5370 2024-09-10T20:49:52.871 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:52.872 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 msgr2=0x7f08140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 0x7f08140b7830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0828076f90 tx=0x7f081800a2d0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 msgr2=0x7f08280754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0824005940 tx=0x7f08240042f0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 shutdown_connections 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08140b5370 0x7f08140b7830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0828109150 0x7f0828075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08281087d0 0x7f08280759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 --2- 172.21.15.67:0/1102130749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0828102dc0 0x7f08280754a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 >> 172.21.15.67:0/1102130749 conn(0x7f08280fe870 msgr2=0x7f0828100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 shutdown_connections 2024-09-10T20:49:52.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:52.867+0000 7f08301d5640 1 -- 172.21.15.67:0/1102130749 wait complete. 2024-09-10T20:49:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:52 smithi083 ceph-mon[35058]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-10T20:49:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:52 smithi083 ceph-mon[35058]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:52 smithi172 ceph-mon[35265]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-10T20:49:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:52 smithi172 ceph-mon[35265]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:53.582 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-10T20:49:52.762201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651543,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":196,"num_read_kb":179,"num_write":278,"num_write_kb":2256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381360,"kb_used_data":11312,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560464,"statfs":{"total":1151940427776,"available":1151549915136,"internally_reserved":0,"allocated":11583488,"data_stored":6452637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55953,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":92,"num_write":30,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002925"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424613+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:49:26.424613+0000","last_peered":"2024-09-10T20:49:26.424613+0000","last_clean":"2024-09-10T20:49:26.424613+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:49:26.424613+0000","last_undegraded":"2024-09-10T20:49:26.424613+0000","last_fullsized":"2024-09-10T20:49:26.424613+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423649+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:49:26.423649+0000","last_peered":"2024-09-10T20:49:26.423649+0000","last_clean":"2024-09-10T20:49:26.423649+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:49:26.423649+0000","last_undegraded":"2024-09-10T20:49:26.423649+0000","last_fullsized":"2024-09-10T20:49:26.423649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424178+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:49:26.424178+0000","last_peered":"2024-09-10T20:49:26.424178+0000","last_clean":"2024-09-10T20:49:26.424178+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:49:26.424178+0000","last_undegraded":"2024-09-10T20:49:26.424178+0000","last_fullsized":"2024-09-10T20:49:26.424178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415427+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:49:26.415427+0000","last_peered":"2024-09-10T20:49:26.415427+0000","last_clean":"2024-09-10T20:49:26.415427+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:49:26.415427+0000","last_undegraded":"2024-09-10T20:49:26.415427+0000","last_fullsized":"2024-09-10T20:49:26.415427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420019+0000","last_change":"2024-09-10T20:49:25.426865+0000","last_active":"2024-09-10T20:49:26.420019+0000","last_peered":"2024-09-10T20:49:26.420019+0000","last_clean":"2024-09-10T20:49:26.420019+0000","last_became_active":"2024-09-10T20:49:25.426542+0000","last_became_peered":"2024-09-10T20:49:25.426542+0000","last_unstale":"2024-09-10T20:49:26.420019+0000","last_undegraded":"2024-09-10T20:49:26.420019+0000","last_fullsized":"2024-09-10T20:49:26.420019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:44.462329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420167+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:49:26.420167+0000","last_peered":"2024-09-10T20:49:26.420167+0000","last_clean":"2024-09-10T20:49:26.420167+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:49:26.420167+0000","last_undegraded":"2024-09-10T20:49:26.420167+0000","last_fullsized":"2024-09-10T20:49:26.420167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423123+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:49:26.423123+0000","last_peered":"2024-09-10T20:49:26.423123+0000","last_clean":"2024-09-10T20:49:26.423123+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:49:26.423123+0000","last_undegraded":"2024-09-10T20:49:26.423123+0000","last_fullsized":"2024-09-10T20:49:26.423123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420373+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:49:26.420373+0000","last_peered":"2024-09-10T20:49:26.420373+0000","last_clean":"2024-09-10T20:49:26.420373+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:49:26.420373+0000","last_undegraded":"2024-09-10T20:49:26.420373+0000","last_fullsized":"2024-09-10T20:49:26.420373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424802+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:49:26.424802+0000","last_peered":"2024-09-10T20:49:26.424802+0000","last_clean":"2024-09-10T20:49:26.424802+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:49:26.424802+0000","last_undegraded":"2024-09-10T20:49:26.424802+0000","last_fullsized":"2024-09-10T20:49:26.424802+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421436+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:49:26.421436+0000","last_peered":"2024-09-10T20:49:26.421436+0000","last_clean":"2024-09-10T20:49:26.421436+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:49:26.421436+0000","last_undegraded":"2024-09-10T20:49:26.421436+0000","last_fullsized":"2024-09-10T20:49:26.421436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423111+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:49:26.423111+0000","last_peered":"2024-09-10T20:49:26.423111+0000","last_clean":"2024-09-10T20:49:26.423111+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:49:26.423111+0000","last_undegraded":"2024-09-10T20:49:26.423111+0000","last_fullsized":"2024-09-10T20:49:26.423111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415405+0000","last_change":"2024-09-10T20:49:25.435365+0000","last_active":"2024-09-10T20:49:26.415405+0000","last_peered":"2024-09-10T20:49:26.415405+0000","last_clean":"2024-09-10T20:49:26.415405+0000","last_became_active":"2024-09-10T20:49:25.434462+0000","last_became_peered":"2024-09-10T20:49:25.434462+0000","last_unstale":"2024-09-10T20:49:26.415405+0000","last_undegraded":"2024-09-10T20:49:26.415405+0000","last_fullsized":"2024-09-10T20:49:26.415405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:39:24.369307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414915+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:49:26.414915+0000","last_peered":"2024-09-10T20:49:26.414915+0000","last_clean":"2024-09-10T20:49:26.414915+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:49:26.414915+0000","last_undegraded":"2024-09-10T20:49:26.414915+0000","last_fullsized":"2024-09-10T20:49:26.414915+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424267+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:49:26.424267+0000","last_peered":"2024-09-10T20:49:26.424267+0000","last_clean":"2024-09-10T20:49:26.424267+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:49:26.424267+0000","last_undegraded":"2024-09-10T20:49:26.424267+0000","last_fullsized":"2024-09-10T20:49:26.424267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423838+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:49:26.423838+0000","last_peered":"2024-09-10T20:49:26.423838+0000","last_clean":"2024-09-10T20:49:26.423838+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:49:26.423838+0000","last_undegraded":"2024-09-10T20:49:26.423838+0000","last_fullsized":"2024-09-10T20:49:26.423838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423774+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:49:26.423774+0000","last_peered":"2024-09-10T20:49:26.423774+0000","last_clean":"2024-09-10T20:49:26.423774+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:49:26.423774+0000","last_undegraded":"2024-09-10T20:49:26.423774+0000","last_fullsized":"2024-09-10T20:49:26.423774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424617+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:49:26.424617+0000","last_peered":"2024-09-10T20:49:26.424617+0000","last_clean":"2024-09-10T20:49:26.424617+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:49:26.424617+0000","last_undegraded":"2024-09-10T20:49:26.424617+0000","last_fullsized":"2024-09-10T20:49:26.424617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419704+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:49:26.419704+0000","last_peered":"2024-09-10T20:49:26.419704+0000","last_clean":"2024-09-10T20:49:26.419704+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:49:26.419704+0000","last_undegraded":"2024-09-10T20:49:26.419704+0000","last_fullsized":"2024-09-10T20:49:26.419704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415081+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:49:26.415081+0000","last_peered":"2024-09-10T20:49:26.415081+0000","last_clean":"2024-09-10T20:49:26.415081+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:49:26.415081+0000","last_undegraded":"2024-09-10T20:49:26.415081+0000","last_fullsized":"2024-09-10T20:49:26.415081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423425+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:49:26.423425+0000","last_peered":"2024-09-10T20:49:26.423425+0000","last_clean":"2024-09-10T20:49:26.423425+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:49:26.423425+0000","last_undegraded":"2024-09-10T20:49:26.423425+0000","last_fullsized":"2024-09-10T20:49:26.423425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414984+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:49:26.414984+0000","last_peered":"2024-09-10T20:49:26.414984+0000","last_clean":"2024-09-10T20:49:26.414984+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:49:26.414984+0000","last_undegraded":"2024-09-10T20:49:26.414984+0000","last_fullsized":"2024-09-10T20:49:26.414984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424118+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:49:26.424118+0000","last_peered":"2024-09-10T20:49:26.424118+0000","last_clean":"2024-09-10T20:49:26.424118+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:49:26.424118+0000","last_undegraded":"2024-09-10T20:49:26.424118+0000","last_fullsized":"2024-09-10T20:49:26.424118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421170+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:49:26.421170+0000","last_peered":"2024-09-10T20:49:26.421170+0000","last_clean":"2024-09-10T20:49:26.421170+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:49:26.421170+0000","last_undegraded":"2024-09-10T20:49:26.421170+0000","last_fullsized":"2024-09-10T20:49:26.421170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420185+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:49:26.420185+0000","last_peered":"2024-09-10T20:49:26.420185+0000","last_clean":"2024-09-10T20:49:26.420185+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:49:26.420185+0000","last_undegraded":"2024-09-10T20:49:26.420185+0000","last_fullsized":"2024-09-10T20:49:26.420185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422127+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:49:26.422127+0000","last_peered":"2024-09-10T20:49:26.422127+0000","last_clean":"2024-09-10T20:49:26.422127+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:49:26.422127+0000","last_undegraded":"2024-09-10T20:49:26.422127+0000","last_fullsized":"2024-09-10T20:49:26.422127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415213+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:49:26.415213+0000","last_peered":"2024-09-10T20:49:26.415213+0000","last_clean":"2024-09-10T20:49:26.415213+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:49:26.415213+0000","last_undegraded":"2024-09-10T20:49:26.415213+0000","last_fullsized":"2024-09-10T20:49:26.415213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424373+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:49:26.424373+0000","last_peered":"2024-09-10T20:49:26.424373+0000","last_clean":"2024-09-10T20:49:26.424373+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:49:26.424373+0000","last_undegraded":"2024-09-10T20:49:26.424373+0000","last_fullsized":"2024-09-10T20:49:26.424373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415118+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:49:26.415118+0000","last_peered":"2024-09-10T20:49:26.415118+0000","last_clean":"2024-09-10T20:49:26.415118+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:49:26.415118+0000","last_undegraded":"2024-09-10T20:49:26.415118+0000","last_fullsized":"2024-09-10T20:49:26.415118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424778+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:49:26.424778+0000","last_peered":"2024-09-10T20:49:26.424778+0000","last_clean":"2024-09-10T20:49:26.424778+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:49:26.424778+0000","last_undegraded":"2024-09-10T20:49:26.424778+0000","last_fullsized":"2024-09-10T20:49:26.424778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414704+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:49:26.414704+0000","last_peered":"2024-09-10T20:49:26.414704+0000","last_clean":"2024-09-10T20:49:26.414704+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:49:26.414704+0000","last_undegraded":"2024-09-10T20:49:26.414704+0000","last_fullsized":"2024-09-10T20:49:26.414704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414711+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:49:26.414711+0000","last_peered":"2024-09-10T20:49:26.414711+0000","last_clean":"2024-09-10T20:49:26.414711+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:49:26.414711+0000","last_undegraded":"2024-09-10T20:49:26.414711+0000","last_fullsized":"2024-09-10T20:49:26.414711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423939+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:49:26.423939+0000","last_peered":"2024-09-10T20:49:26.423939+0000","last_clean":"2024-09-10T20:49:26.423939+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:49:26.423939+0000","last_undegraded":"2024-09-10T20:49:26.423939+0000","last_fullsized":"2024-09-10T20:49:26.423939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420113+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:49:26.420113+0000","last_peered":"2024-09-10T20:49:26.420113+0000","last_clean":"2024-09-10T20:49:26.420113+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:49:26.420113+0000","last_undegraded":"2024-09-10T20:49:26.420113+0000","last_fullsized":"2024-09-10T20:49:26.420113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:48.492892+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:49:48.492892+0000","last_peered":"2024-09-10T20:49:48.492892+0000","last_clean":"2024-09-10T20:49:48.492892+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:49:48.492892+0000","last_undegraded":"2024-09-10T20:49:48.492892+0000","last_fullsized":"2024-09-10T20:49:48.492892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420354+0000","last_change":"2024-09-10T20:49:25.425906+0000","last_active":"2024-09-10T20:49:26.420354+0000","last_peered":"2024-09-10T20:49:26.420354+0000","last_clean":"2024-09-10T20:49:26.420354+0000","last_became_active":"2024-09-10T20:49:25.424393+0000","last_became_peered":"2024-09-10T20:49:25.424393+0000","last_unstale":"2024-09-10T20:49:26.420354+0000","last_undegraded":"2024-09-10T20:49:26.420354+0000","last_fullsized":"2024-09-10T20:49:26.420354+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:01:58.789951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.465759+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:49:34.465759+0000","last_peered":"2024-09-10T20:49:34.465759+0000","last_clean":"2024-09-10T20:49:34.465759+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:49:34.465759+0000","last_undegraded":"2024-09-10T20:49:34.465759+0000","last_fullsized":"2024-09-10T20:49:34.465759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466326+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:49:34.466326+0000","last_peered":"2024-09-10T20:49:34.466326+0000","last_clean":"2024-09-10T20:49:34.466326+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:49:34.466326+0000","last_undegraded":"2024-09-10T20:49:34.466326+0000","last_fullsized":"2024-09-10T20:49:34.466326+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420659+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:49:26.420659+0000","last_peered":"2024-09-10T20:49:26.420659+0000","last_clean":"2024-09-10T20:49:26.420659+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:49:26.420659+0000","last_undegraded":"2024-09-10T20:49:26.420659+0000","last_fullsized":"2024-09-10T20:49:26.420659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421290+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:49:26.421290+0000","last_peered":"2024-09-10T20:49:26.421290+0000","last_clean":"2024-09-10T20:49:26.421290+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:49:26.421290+0000","last_undegraded":"2024-09-10T20:49:26.421290+0000","last_fullsized":"2024-09-10T20:49:26.421290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419832+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:49:26.419832+0000","last_peered":"2024-09-10T20:49:26.419832+0000","last_clean":"2024-09-10T20:49:26.419832+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:49:26.419832+0000","last_undegraded":"2024-09-10T20:49:26.419832+0000","last_fullsized":"2024-09-10T20:49:26.419832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:49.493867+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:49:49.493867+0000","last_peered":"2024-09-10T20:49:49.493867+0000","last_clean":"2024-09-10T20:49:49.493867+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:49:49.493867+0000","last_undegraded":"2024-09-10T20:49:49.493867+0000","last_fullsized":"2024-09-10T20:49:49.493867+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424705+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:49:26.424705+0000","last_peered":"2024-09-10T20:49:26.424705+0000","last_clean":"2024-09-10T20:49:26.424705+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:49:26.424705+0000","last_undegraded":"2024-09-10T20:49:26.424705+0000","last_fullsized":"2024-09-10T20:49:26.424705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458469+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:49:33.458469+0000","last_peered":"2024-09-10T20:49:33.458469+0000","last_clean":"2024-09-10T20:49:33.458469+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:49:33.458469+0000","last_undegraded":"2024-09-10T20:49:33.458469+0000","last_fullsized":"2024-09-10T20:49:33.458469+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424251+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:49:26.424251+0000","last_peered":"2024-09-10T20:49:26.424251+0000","last_clean":"2024-09-10T20:49:26.424251+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:49:26.424251+0000","last_undegraded":"2024-09-10T20:49:26.424251+0000","last_fullsized":"2024-09-10T20:49:26.424251+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458000+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:49:33.458000+0000","last_peered":"2024-09-10T20:49:33.458000+0000","last_clean":"2024-09-10T20:49:33.458000+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:49:33.458000+0000","last_undegraded":"2024-09-10T20:49:33.458000+0000","last_fullsized":"2024-09-10T20:49:33.458000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425236+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:49:26.425236+0000","last_peered":"2024-09-10T20:49:26.425236+0000","last_clean":"2024-09-10T20:49:26.425236+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:49:26.425236+0000","last_undegraded":"2024-09-10T20:49:26.425236+0000","last_fullsized":"2024-09-10T20:49:26.425236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'26","reported_seq":83,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:50.546166+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:49:50.546166+0000","last_peered":"2024-09-10T20:49:50.546166+0000","last_clean":"2024-09-10T20:49:50.546166+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:49:50.546166+0000","last_undegraded":"2024-09-10T20:49:50.546166+0000","last_fullsized":"2024-09-10T20:49:50.546166+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":64,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422308+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:49:26.422308+0000","last_peered":"2024-09-10T20:49:26.422308+0000","last_clean":"2024-09-10T20:49:26.422308+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:49:26.422308+0000","last_undegraded":"2024-09-10T20:49:26.422308+0000","last_fullsized":"2024-09-10T20:49:26.422308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463920+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:49:34.463920+0000","last_peered":"2024-09-10T20:49:34.463920+0000","last_clean":"2024-09-10T20:49:34.463920+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:49:34.463920+0000","last_undegraded":"2024-09-10T20:49:34.463920+0000","last_fullsized":"2024-09-10T20:49:34.463920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414662+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:49:26.414662+0000","last_peered":"2024-09-10T20:49:26.414662+0000","last_clean":"2024-09-10T20:49:26.414662+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:49:26.414662+0000","last_undegraded":"2024-09-10T20:49:26.414662+0000","last_fullsized":"2024-09-10T20:49:26.414662+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459699+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:49:33.459699+0000","last_peered":"2024-09-10T20:49:33.459699+0000","last_clean":"2024-09-10T20:49:33.459699+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:49:33.459699+0000","last_undegraded":"2024-09-10T20:49:33.459699+0000","last_fullsized":"2024-09-10T20:49:33.459699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423376+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:49:26.423376+0000","last_peered":"2024-09-10T20:49:26.423376+0000","last_clean":"2024-09-10T20:49:26.423376+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:49:26.423376+0000","last_undegraded":"2024-09-10T20:49:26.423376+0000","last_fullsized":"2024-09-10T20:49:26.423376+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":42,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:49.494672+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:49:49.494672+0000","last_peered":"2024-09-10T20:49:49.494672+0000","last_clean":"2024-09-10T20:49:49.494672+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:49:49.494672+0000","last_undegraded":"2024-09-10T20:49:49.494672+0000","last_fullsized":"2024-09-10T20:49:49.494672+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422855+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:49:26.422855+0000","last_peered":"2024-09-10T20:49:26.422855+0000","last_clean":"2024-09-10T20:49:26.422855+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:49:26.422855+0000","last_undegraded":"2024-09-10T20:49:26.422855+0000","last_fullsized":"2024-09-10T20:49:26.422855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466175+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:49:34.466175+0000","last_peered":"2024-09-10T20:49:34.466175+0000","last_clean":"2024-09-10T20:49:34.466175+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:49:34.466175+0000","last_undegraded":"2024-09-10T20:49:34.466175+0000","last_fullsized":"2024-09-10T20:49:34.466175+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420679+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:49:26.420679+0000","last_peered":"2024-09-10T20:49:26.420679+0000","last_clean":"2024-09-10T20:49:26.420679+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:49:26.420679+0000","last_undegraded":"2024-09-10T20:49:26.420679+0000","last_fullsized":"2024-09-10T20:49:26.420679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:35.470728+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:49:35.470728+0000","last_peered":"2024-09-10T20:49:35.470728+0000","last_clean":"2024-09-10T20:49:35.470728+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:49:35.470728+0000","last_undegraded":"2024-09-10T20:49:35.470728+0000","last_fullsized":"2024-09-10T20:49:35.470728+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423817+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:49:26.423817+0000","last_peered":"2024-09-10T20:49:26.423817+0000","last_clean":"2024-09-10T20:49:26.423817+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:49:26.423817+0000","last_undegraded":"2024-09-10T20:49:26.423817+0000","last_fullsized":"2024-09-10T20:49:26.423817+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425853+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:49:26.425853+0000","last_peered":"2024-09-10T20:49:26.425853+0000","last_clean":"2024-09-10T20:49:26.425853+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:49:26.425853+0000","last_undegraded":"2024-09-10T20:49:26.425853+0000","last_fullsized":"2024-09-10T20:49:26.425853+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423567+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:49:26.423567+0000","last_peered":"2024-09-10T20:49:26.423567+0000","last_clean":"2024-09-10T20:49:26.423567+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:49:26.423567+0000","last_undegraded":"2024-09-10T20:49:26.423567+0000","last_fullsized":"2024-09-10T20:49:26.423567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424985+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:49:26.424985+0000","last_peered":"2024-09-10T20:49:26.424985+0000","last_clean":"2024-09-10T20:49:26.424985+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:49:26.424985+0000","last_undegraded":"2024-09-10T20:49:26.424985+0000","last_fullsized":"2024-09-10T20:49:26.424985+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:27.448134+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:49:27.448134+0000","last_peered":"2024-09-10T20:49:27.448134+0000","last_clean":"2024-09-10T20:49:27.448134+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:49:27.448134+0000","last_undegraded":"2024-09-10T20:49:27.448134+0000","last_fullsized":"2024-09-10T20:49:27.448134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.464882+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:49:34.464882+0000","last_peered":"2024-09-10T20:49:34.464882+0000","last_clean":"2024-09-10T20:49:34.464882+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:49:34.464882+0000","last_undegraded":"2024-09-10T20:49:34.464882+0000","last_fullsized":"2024-09-10T20:49:34.464882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423784+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:49:26.423784+0000","last_peered":"2024-09-10T20:49:26.423784+0000","last_clean":"2024-09-10T20:49:26.423784+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:49:26.423784+0000","last_undegraded":"2024-09-10T20:49:26.423784+0000","last_fullsized":"2024-09-10T20:49:26.423784+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423516+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:49:26.423516+0000","last_peered":"2024-09-10T20:49:26.423516+0000","last_clean":"2024-09-10T20:49:26.423516+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:49:26.423516+0000","last_undegraded":"2024-09-10T20:49:26.423516+0000","last_fullsized":"2024-09-10T20:49:26.423516+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:35.470403+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:49:35.470403+0000","last_peered":"2024-09-10T20:49:35.470403+0000","last_clean":"2024-09-10T20:49:35.470403+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:49:35.470403+0000","last_undegraded":"2024-09-10T20:49:35.470403+0000","last_fullsized":"2024-09-10T20:49:35.470403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421107+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:49:26.421107+0000","last_peered":"2024-09-10T20:49:26.421107+0000","last_clean":"2024-09-10T20:49:26.421107+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:49:26.421107+0000","last_undegraded":"2024-09-10T20:49:26.421107+0000","last_fullsized":"2024-09-10T20:49:26.421107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463988+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:49:34.463988+0000","last_peered":"2024-09-10T20:49:34.463988+0000","last_clean":"2024-09-10T20:49:34.463988+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:49:34.463988+0000","last_undegraded":"2024-09-10T20:49:34.463988+0000","last_fullsized":"2024-09-10T20:49:34.463988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414535+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:49:26.414535+0000","last_peered":"2024-09-10T20:49:26.414535+0000","last_clean":"2024-09-10T20:49:26.414535+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:49:26.414535+0000","last_undegraded":"2024-09-10T20:49:26.414535+0000","last_fullsized":"2024-09-10T20:49:26.414535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:49.494197+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:49:49.494197+0000","last_peered":"2024-09-10T20:49:49.494197+0000","last_clean":"2024-09-10T20:49:49.494197+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:49:49.494197+0000","last_undegraded":"2024-09-10T20:49:49.494197+0000","last_fullsized":"2024-09-10T20:49:49.494197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420203+0000","last_change":"2024-09-10T20:49:25.426111+0000","last_active":"2024-09-10T20:49:26.420203+0000","last_peered":"2024-09-10T20:49:26.420203+0000","last_clean":"2024-09-10T20:49:26.420203+0000","last_became_active":"2024-09-10T20:49:25.425584+0000","last_became_peered":"2024-09-10T20:49:25.425584+0000","last_unstale":"2024-09-10T20:49:26.420203+0000","last_undegraded":"2024-09-10T20:49:26.420203+0000","last_fullsized":"2024-09-10T20:49:26.420203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:27.800729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424235+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:49:26.424235+0000","last_peered":"2024-09-10T20:49:26.424235+0000","last_clean":"2024-09-10T20:49:26.424235+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:49:26.424235+0000","last_undegraded":"2024-09-10T20:49:26.424235+0000","last_fullsized":"2024-09-10T20:49:26.424235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.419998+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:49:26.419998+0000","last_peered":"2024-09-10T20:49:26.419998+0000","last_clean":"2024-09-10T20:49:26.419998+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:49:26.419998+0000","last_undegraded":"2024-09-10T20:49:26.419998+0000","last_fullsized":"2024-09-10T20:49:26.419998+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420153+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:49:26.420153+0000","last_peered":"2024-09-10T20:49:26.420153+0000","last_clean":"2024-09-10T20:49:26.420153+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:49:26.420153+0000","last_undegraded":"2024-09-10T20:49:26.420153+0000","last_fullsized":"2024-09-10T20:49:26.420153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420048+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:49:26.420048+0000","last_peered":"2024-09-10T20:49:26.420048+0000","last_clean":"2024-09-10T20:49:26.420048+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:49:26.420048+0000","last_undegraded":"2024-09-10T20:49:26.420048+0000","last_fullsized":"2024-09-10T20:49:26.420048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.456705+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:49:33.456705+0000","last_peered":"2024-09-10T20:49:33.456705+0000","last_clean":"2024-09-10T20:49:33.456705+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:49:33.456705+0000","last_undegraded":"2024-09-10T20:49:33.456705+0000","last_fullsized":"2024-09-10T20:49:33.456705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.415088+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:49:26.415088+0000","last_peered":"2024-09-10T20:49:26.415088+0000","last_clean":"2024-09-10T20:49:26.415088+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:49:26.415088+0000","last_undegraded":"2024-09-10T20:49:26.415088+0000","last_fullsized":"2024-09-10T20:49:26.415088+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:44.420720+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:49:44.420720+0000","last_peered":"2024-09-10T20:49:44.420720+0000","last_clean":"2024-09-10T20:49:44.420720+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:49:44.420720+0000","last_undegraded":"2024-09-10T20:49:44.420720+0000","last_fullsized":"2024-09-10T20:49:44.420720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422382+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:49:26.422382+0000","last_peered":"2024-09-10T20:49:26.422382+0000","last_clean":"2024-09-10T20:49:26.422382+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:49:26.422382+0000","last_undegraded":"2024-09-10T20:49:26.422382+0000","last_fullsized":"2024-09-10T20:49:26.422382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459115+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:49:33.459115+0000","last_peered":"2024-09-10T20:49:33.459115+0000","last_clean":"2024-09-10T20:49:33.459115+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:49:33.459115+0000","last_undegraded":"2024-09-10T20:49:33.459115+0000","last_fullsized":"2024-09-10T20:49:33.459115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423816+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:49:26.423816+0000","last_peered":"2024-09-10T20:49:26.423816+0000","last_clean":"2024-09-10T20:49:26.423816+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:49:26.423816+0000","last_undegraded":"2024-09-10T20:49:26.423816+0000","last_fullsized":"2024-09-10T20:49:26.423816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458621+0000","last_change":"2024-09-10T20:49:23.452137+0000","last_active":"2024-09-10T20:49:33.458621+0000","last_peered":"2024-09-10T20:49:33.458621+0000","last_clean":"2024-09-10T20:49:33.458621+0000","last_became_active":"2024-09-10T20:49:23.451821+0000","last_became_peered":"2024-09-10T20:49:23.451821+0000","last_unstale":"2024-09-10T20:49:33.458621+0000","last_undegraded":"2024-09-10T20:49:33.458621+0000","last_fullsized":"2024-09-10T20:49:33.458621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:40:48.200662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422458+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:49:26.422458+0000","last_peered":"2024-09-10T20:49:26.422458+0000","last_clean":"2024-09-10T20:49:26.422458+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:49:26.422458+0000","last_undegraded":"2024-09-10T20:49:26.422458+0000","last_fullsized":"2024-09-10T20:49:26.422458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.458648+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:49:33.458648+0000","last_peered":"2024-09-10T20:49:33.458648+0000","last_clean":"2024-09-10T20:49:33.458648+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:49:33.458648+0000","last_undegraded":"2024-09-10T20:49:33.458648+0000","last_fullsized":"2024-09-10T20:49:33.458648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424035+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:49:26.424035+0000","last_peered":"2024-09-10T20:49:26.424035+0000","last_clean":"2024-09-10T20:49:26.424035+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:49:26.424035+0000","last_undegraded":"2024-09-10T20:49:26.424035+0000","last_fullsized":"2024-09-10T20:49:26.424035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.414824+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:49:26.414824+0000","last_peered":"2024-09-10T20:49:26.414824+0000","last_clean":"2024-09-10T20:49:26.414824+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:49:26.414824+0000","last_undegraded":"2024-09-10T20:49:26.414824+0000","last_fullsized":"2024-09-10T20:49:26.414824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.421259+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:49:26.421259+0000","last_peered":"2024-09-10T20:49:26.421259+0000","last_clean":"2024-09-10T20:49:26.421259+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:49:26.421259+0000","last_undegraded":"2024-09-10T20:49:26.421259+0000","last_fullsized":"2024-09-10T20:49:26.421259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:33.459485+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:49:33.459485+0000","last_peered":"2024-09-10T20:49:33.459485+0000","last_clean":"2024-09-10T20:49:33.459485+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:49:33.459485+0000","last_undegraded":"2024-09-10T20:49:33.459485+0000","last_fullsized":"2024-09-10T20:49:33.459485+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.423261+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:49:26.423261+0000","last_peered":"2024-09-10T20:49:26.423261+0000","last_clean":"2024-09-10T20:49:26.423261+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:49:26.423261+0000","last_undegraded":"2024-09-10T20:49:26.423261+0000","last_fullsized":"2024-09-10T20:49:26.423261+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.420495+0000","last_change":"2024-09-10T20:49:25.443299+0000","last_active":"2024-09-10T20:49:26.420495+0000","last_peered":"2024-09-10T20:49:26.420495+0000","last_clean":"2024-09-10T20:49:26.420495+0000","last_became_active":"2024-09-10T20:49:25.442963+0000","last_became_peered":"2024-09-10T20:49:25.442963+0000","last_unstale":"2024-09-10T20:49:26.420495+0000","last_undegraded":"2024-09-10T20:49:26.420495+0000","last_fullsized":"2024-09-10T20:49:26.420495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:42.694718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.426929+0000","last_change":"2024-09-10T20:49:23.415345+0000","last_active":"2024-09-10T20:49:26.426929+0000","last_peered":"2024-09-10T20:49:26.426929+0000","last_clean":"2024-09-10T20:49:26.426929+0000","last_became_active":"2024-09-10T20:49:23.415010+0000","last_became_peered":"2024-09-10T20:49:23.415010+0000","last_unstale":"2024-09-10T20:49:26.426929+0000","last_undegraded":"2024-09-10T20:49:26.426929+0000","last_fullsized":"2024-09-10T20:49:26.426929+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:11.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425100+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:49:26.425100+0000","last_peered":"2024-09-10T20:49:26.425100+0000","last_clean":"2024-09-10T20:49:26.425100+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:49:26.425100+0000","last_undegraded":"2024-09-10T20:49:26.425100+0000","last_fullsized":"2024-09-10T20:49:26.425100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.463509+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:49:34.463509+0000","last_peered":"2024-09-10T20:49:34.463509+0000","last_clean":"2024-09-10T20:49:34.463509+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:49:34.463509+0000","last_undegraded":"2024-09-10T20:49:34.463509+0000","last_fullsized":"2024-09-10T20:49:34.463509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.424186+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:49:26.424186+0000","last_peered":"2024-09-10T20:49:26.424186+0000","last_clean":"2024-09-10T20:49:26.424186+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:49:26.424186+0000","last_undegraded":"2024-09-10T20:49:26.424186+0000","last_fullsized":"2024-09-10T20:49:26.424186+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.425847+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:49:26.425847+0000","last_peered":"2024-09-10T20:49:26.425847+0000","last_clean":"2024-09-10T20:49:26.425847+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:49:26.425847+0000","last_undegraded":"2024-09-10T20:49:26.425847+0000","last_fullsized":"2024-09-10T20:49:26.425847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:26.422535+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:49:26.422535+0000","last_peered":"2024-09-10T20:49:26.422535+0000","last_clean":"2024-09-10T20:49:26.422535+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:49:26.422535+0000","last_undegraded":"2024-09-10T20:49:26.422535+0000","last_fullsized":"2024-09-10T20:49:26.422535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T20:49:34.466460+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:49:34.466460+0000","last_peered":"2024-09-10T20:49:34.466460+0000","last_clean":"2024-09-10T20:49:34.466460+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:49:34.466460+0000","last_undegraded":"2024-09-10T20:49:34.466460+0000","last_fullsized":"2024-09-10T20:49:34.466460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60941,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":120,"num_read_kb":115,"num_write":153,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":182823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808850,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":377106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1470464,"data_stored":1015778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":802816,"data_stored":377262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708444,"statfs":{"total":95995035648,"available":95957446656,"internally_reserved":0,"allocated":1396736,"data_stored":969192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":376731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":968485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":794624,"data_stored":377559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":377042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444096,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":424674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":433464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":378002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:49:53.586 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T20:49:53.587 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T20:49:53.587 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T20:49:53.849 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:54.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 -- 172.21.15.67:0/518811947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c06c0c0 msgr2=0x7f803c105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 --2- 172.21.15.67:0/518811947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c06c0c0 0x7f803c105630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f802c009900 tx=0x7f802c02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 -- 172.21.15.67:0/518811947 shutdown_connections 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 --2- 172.21.15.67:0/518811947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c108770 0x7f803c10ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 --2- 172.21.15.67:0/518811947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c105bc0 0x7f803c108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 --2- 172.21.15.67:0/518811947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c06c0c0 0x7f803c105630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 -- 172.21.15.67:0/518811947 >> 172.21.15.67:0/518811947 conn(0x7f803c0fd200 msgr2=0x7f803c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 -- 172.21.15.67:0/518811947 shutdown_connections 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.365+0000 7f80422db640 1 -- 172.21.15.67:0/518811947 wait complete. 2024-09-10T20:49:54.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 Processor -- start 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 -- start start 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c06c0c0 0x7f803c198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c105bc0 0x7f803c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10e6f0 con 0x7f803c108770 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10e570 con 0x7f803c105bc0 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f80422db640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f803c10e870 con 0x7f803c06c0c0 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f8040878640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f8040878640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48928/0 (socket says 172.21.15.67:48928) 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.366+0000 7f8040878640 1 -- 172.21.15.67:0/3850637880 learned_addr learned my addr 172.21.15.67:0/3850637880 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f803bfff640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c06c0c0 0x7f803c198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:54.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f803b7fe640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c105bc0 0x7f803c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 -- 172.21.15.67:0/3850637880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c06c0c0 msgr2=0x7f803c198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c06c0c0 0x7f803c198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 -- 172.21.15.67:0/3850637880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c105bc0 msgr2=0x7f803c1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c105bc0 0x7f803c1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 -- 172.21.15.67:0/3850637880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c19a9a0 con 0x7f803c108770 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f8040878640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8034009fd0 tx=0x7f803400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034017070 con 0x7f803c108770 2024-09-10T20:49:54.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c19ac90 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8034003e20 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034010460 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.367+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803c1a1370 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.368+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f803c0fecf0 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.370+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8034003970 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.370+0000 7f80397fa640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 0x7f80240b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.371+0000 7f803bfff640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 0x7f80240b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.371+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f80340e5880 con 0x7f803c108770 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.371+0000 7f803bfff640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 0x7f80240b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f802c000c00 tx=0x7f802c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:54.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.373+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80340ac140 con 0x7f803c108770 2024-09-10T20:49:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:54 smithi067 ceph-mon[30891]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-10T20:49:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:54 smithi067 ceph-mon[30891]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:54.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.631+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f803c02e5c0 con 0x7f803c108770 2024-09-10T20:49:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.633+0000 7f80397fa640 1 -- 172.21.15.67:0/3850637880 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f80340b0b70 con 0x7f803c108770 2024-09-10T20:49:54.637 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-10T20:49:54.637 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDysOBm2SC7JRAA/mRHh2uSAuXbJuUfk3EP7A== 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 msgr2=0x7f80240b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 0x7f80240b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f802c000c00 tx=0x7f802c0314a0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 msgr2=0x7f803c19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8034009fd0 tx=0x7f803400b260 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 shutdown_connections 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f803c108770 0x7f803c19a100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f803c105bc0 0x7f803c1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80240b5370 0x7f80240b7830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.636+0000 7f80422db640 1 --2- 172.21.15.67:0/3850637880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f803c06c0c0 0x7f803c198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.637+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 >> 172.21.15.67:0/3850637880 conn(0x7f803c0fd200 msgr2=0x7f803c103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.637+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 shutdown_connections 2024-09-10T20:49:54.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:54.637+0000 7f80422db640 1 -- 172.21.15.67:0/3850637880 wait complete. 2024-09-10T20:49:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:54 smithi083 ceph-mon[35058]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-10T20:49:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:54 smithi083 ceph-mon[35058]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:54 smithi172 ceph-mon[35265]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 9 op/s 2024-09-10T20:49:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:54 smithi172 ceph-mon[35265]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:49:55.329 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:49:55.330 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T20:49:55.330 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T20:49:55.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T20:49:55.667 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:55.788 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:55 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T20:49:55.788 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:55 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T20:49:55.792 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:55 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T20:49:55.792 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:55 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T20:49:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:55 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T20:49:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:55 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3850637880' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T20:49:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 -- 172.21.15.67:0/3938438824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 msgr2=0x7f2d6c107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/3938438824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c107940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009900 tx=0x7f2d5402a410 comp rx=0 tx=0).stop 2024-09-10T20:49:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 -- 172.21.15.67:0/3938438824 shutdown_connections 2024-09-10T20:49:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/3938438824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c107e80 0x7f2d6c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/3938438824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c107940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/3938438824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c101af0 0x7f2d6c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 -- 172.21.15.67:0/3938438824 >> 172.21.15.67:0/3938438824 conn(0x7f2d6c0fd560 msgr2=0x7f2d6c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 -- 172.21.15.67:0/3938438824 shutdown_connections 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.157+0000 7f2d6bfff640 1 -- 172.21.15.67:0/3938438824 wait complete. 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 Processor -- start 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 -- start start 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 0x7f2d6c199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 0x7f2d6c1a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c111b40 con 0x7f2d6c107500 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1119c0 con 0x7f2d6c101af0 2024-09-10T20:49:56.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6bfff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c111cc0 con 0x7f2d6c107e80 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48950/0 (socket says 172.21.15.67:48950) 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 -- 172.21.15.67:0/4268776572 learned_addr learned my addr 172.21.15.67:0/4268776572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6affd640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 0x7f2d6c199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6b7fe640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 0x7f2d6c1a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 -- 172.21.15.67:0/4268776572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 msgr2=0x7f2d6c1a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 0x7f2d6c1a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 -- 172.21.15.67:0/4268776572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 msgr2=0x7f2d6c199dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 0x7f2d6c199dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d63fff640 1 -- 172.21.15.67:0/4268776572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c1a5390 con 0x7f2d6c107500 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6b7fe640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 0x7f2d6c1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:56.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.158+0000 7f2d6affd640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 0x7f2d6c199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d63fff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d54006010 tx=0x7f2d540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5403f030 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1a5560 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d54003800 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54035070 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.159+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1a5a30 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.160+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c101ed0 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.161+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2d54031b10 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.162+0000 7f2d68ff9640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 0x7f2d580b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.162+0000 7f2d6affd640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 0x7f2d580b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.162+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f2d54106810 con 0x7f2d6c107500 2024-09-10T20:49:56.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.163+0000 7f2d6affd640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 0x7f2d580b78d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00abe0 tx=0x7f2d5c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:56.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.165+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2d540cd720 con 0x7f2d6c107500 2024-09-10T20:49:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.351+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2d6c1a5f30 con 0x7f2d6c107500 2024-09-10T20:49:56.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.351+0000 7f2d68ff9640 1 -- 172.21.15.67:0/4268776572 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7f2d540cd020 con 0x7f2d6c107500 2024-09-10T20:49:56.356 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:56.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 msgr2=0x7f2d580b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 0x7f2d580b78d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00abe0 tx=0x7f2d5c00a5c0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 msgr2=0x7f2d6c19a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d54006010 tx=0x7f2d540042f0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 shutdown_connections 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2d580b5410 0x7f2d580b78d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d6c107e80 0x7f2d6c1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2d6c107500 0x7f2d6c19a310 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 --2- 172.21.15.67:0/4268776572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6c101af0 0x7f2d6c199dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 >> 172.21.15.67:0/4268776572 conn(0x7f2d6c0fd560 msgr2=0x7f2d6c105be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 shutdown_connections 2024-09-10T20:49:56.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:56.354+0000 7f2d6bfff640 1 -- 172.21.15.67:0/4268776572 wait complete. 2024-09-10T20:49:56.657 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:56 smithi067 ceph-mon[30891]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-10T20:49:56.657 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:56 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4268776572' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T20:49:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:56 smithi083 ceph-mon[35058]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-10T20:49:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:56 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4268776572' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T20:49:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:56 smithi172 ceph-mon[35265]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-10T20:49:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:56 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4268776572' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T20:49:57.130 INFO:teuthology.orchestra.run.smithi067.stdout:[{"version":50,"timestamp":"2024-09-10T20:49:15.680877+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T20:49:57.131 INFO:tasks.ceph_manager:config epoch is 50 2024-09-10T20:49:57.131 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T20:49:57.131 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T20:49:57.131 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T20:49:57.393 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 -- 172.21.15.67:0/3850624618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c109150 msgr2=0x7fb06c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 --2- 172.21.15.67:0/3850624618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c109150 0x7fb06c10f950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb064009ca0 tx=0x7fb06402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 -- 172.21.15.67:0/3850624618 shutdown_connections 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 --2- 172.21.15.67:0/3850624618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c109150 0x7fb06c10f950 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 --2- 172.21.15.67:0/3850624618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c1087d0 0x7fb06c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 --2- 172.21.15.67:0/3850624618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 -- 172.21.15.67:0/3850624618 >> 172.21.15.67:0/3850624618 conn(0x7fb06c0fe830 msgr2=0x7fb06c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 -- 172.21.15.67:0/3850624618 shutdown_connections 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.934+0000 7fb071cda640 1 -- 172.21.15.67:0/3850624618 wait complete. 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 Processor -- start 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 -- start start 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c109150 0x7fb06c075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c112e60 con 0x7fb06c1087d0 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c112ce0 con 0x7fb06c109150 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb071cda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c112fe0 con 0x7fb06c102dc0 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48972/0 (socket says 172.21.15.67:48972) 2024-09-10T20:49:57.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 -- 172.21.15.67:0/2246979986 learned_addr learned my addr 172.21.15.67:0/2246979986 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb06bfff640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c109150 0x7fb06c075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb06b7fe640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 -- 172.21.15.67:0/2246979986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 msgr2=0x7fb06c076f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c076f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 -- 172.21.15.67:0/2246979986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c109150 msgr2=0x7fb06c075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c109150 0x7fb06c075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb063fff640 1 -- 172.21.15.67:0/2246979986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c1abb30 con 0x7fb06c1087d0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.935+0000 7fb06b7fe640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb063fff640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c920 tx=0x7fb05400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054007c70 con 0x7fb06c1087d0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c1abd00 con 0x7fb06c1087d0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb054007e10 con 0x7fb06c1087d0 2024-09-10T20:49:57.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054018820 con 0x7fb06c1087d0 2024-09-10T20:49:57.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.936+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c1ac200 con 0x7fb06c1087d0 2024-09-10T20:49:57.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.937+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c1031a0 con 0x7fb06c1087d0 2024-09-10T20:49:57.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.938+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb05400f450 con 0x7fb06c1087d0 2024-09-10T20:49:57.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.939+0000 7fb0697fa640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 0x7fb0580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:57.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.939+0000 7fb06b7fe640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 0x7fb0580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:57.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.939+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb0540e5fc0 con 0x7fb06c1087d0 2024-09-10T20:49:57.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.940+0000 7fb06b7fe640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 0x7fb0580b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009b40 tx=0x7fb05c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:57.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:57.942+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb054014030 con 0x7fb06c1087d0 2024-09-10T20:49:58.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.176+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb06c1ac650 con 0x7fb06c1087d0 2024-09-10T20:49:58.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.180+0000 7fb0697fa640 1 -- 172.21.15.67:0/2246979986 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294213 (secure 0 0 0) 0x7fb0540acf60 con 0x7fb06c1087d0 2024-09-10T20:49:58.188 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 msgr2=0x7fb0580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 0x7fb0580b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009b40 tx=0x7fb05c005e50 comp rx=0 tx=0).stop 2024-09-10T20:49:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 msgr2=0x7fb06c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb05400c920 tx=0x7fb05400cde0 comp rx=0 tx=0).stop 2024-09-10T20:49:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 shutdown_connections 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb06c109150 0x7fb06c075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb06c1087d0 0x7fb06c0754a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb0580b5370 0x7fb0580b7830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 --2- 172.21.15.67:0/2246979986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb06c102dc0 0x7fb06c076f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 >> 172.21.15.67:0/2246979986 conn(0x7fb06c0fe830 msgr2=0x7fb06c101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 shutdown_connections 2024-09-10T20:49:58.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:58.184+0000 7fb071cda640 1 -- 172.21.15.67:0/2246979986 wait complete. 2024-09-10T20:49:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:58 smithi067 ceph-mon[30891]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-10T20:49:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:49:58 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2246979986' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T20:49:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:58 smithi083 ceph-mon[35058]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-10T20:49:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:49:58 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2246979986' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T20:49:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:58 smithi172 ceph-mon[35265]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-10T20:49:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:49:58 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2246979986' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T20:49:58.971 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1712569035},{"type":"v1","addr":"172.21.15.67:6801","nonce":1712569035}]},"active_addr":"172.21.15.67:6801/1712569035","active_change":"2024-09-10T20:42:06.670693+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.67:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3852801234}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":55258694}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1253346143}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3687331287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":910419522}]}]} 2024-09-10T20:49:58.978 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T20:49:58.978 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T20:49:58.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:49:59.235 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:49:59.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 -- 172.21.15.67:0/1988586641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c101cd0 msgr2=0x7fc75c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:59.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 --2- 172.21.15.67:0/1988586641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c101cd0 0x7fc75c1020b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009900 tx=0x7fc74c02a410 comp rx=0 tx=0).stop 2024-09-10T20:49:59.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 -- 172.21.15.67:0/1988586641 shutdown_connections 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 --2- 172.21.15.67:0/1988586641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c108060 0x7fc75c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 --2- 172.21.15.67:0/1988586641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c1076e0 0x7fc75c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 --2- 172.21.15.67:0/1988586641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c101cd0 0x7fc75c1020b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 -- 172.21.15.67:0/1988586641 >> 172.21.15.67:0/1988586641 conn(0x7fc75c0fd700 msgr2=0x7fc75c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 -- 172.21.15.67:0/1988586641 shutdown_connections 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.683+0000 7fc760efc640 1 -- 172.21.15.67:0/1988586641 wait complete. 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 Processor -- start 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 -- start start 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 0x7fc75c19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c108060 0x7fc75c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c111d70 con 0x7fc75c1076e0 2024-09-10T20:49:59.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c111bf0 con 0x7fc75c108060 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.684+0000 7fc760efc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c111ef0 con 0x7fc75c101cd0 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48994/0 (socket says 172.21.15.67:48994) 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 -- 172.21.15.67:0/2162664991 learned_addr learned my addr 172.21.15.67:0/2162664991 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc75a59c640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 0x7fc75c19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 -- 172.21.15.67:0/2162664991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 msgr2=0x7fc75c19a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 0x7fc75c19a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc75ad9d640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c108060 0x7fc75c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 -- 172.21.15.67:0/2162664991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c108060 msgr2=0x7fc75c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c108060 0x7fc75c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 -- 172.21.15.67:0/2162664991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c1a5480 con 0x7fc75c1076e0 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc75a59c640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 0x7fc75c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:49:59.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc753fff640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d950 tx=0x7fc74400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744017070 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc744009c30 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c1a5770 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74400f620 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.685+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c1a5cb0 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.686+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c1020b0 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.688+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc744010460 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.689+0000 7fc7537fe640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 0x7fc7480b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.689+0000 7fc75a59c640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 0x7fc7480b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.689+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fc7440e5900 con 0x7fc75c1076e0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.689+0000 7fc75a59c640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 0x7fc7480b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000c00 tx=0x7fc74c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:49:59.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.693+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc7440ac810 con 0x7fc75c1076e0 2024-09-10T20:49:59.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.878+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc75c1098b0 con 0x7fc75c1076e0 2024-09-10T20:49:59.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.879+0000 7fc7537fe640 1 -- 172.21.15.67:0/2162664991 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22220 (secure 0 0 0) 0x7fc744009de0 con 0x7fc75c1076e0 2024-09-10T20:49:59.883 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:49:59.883 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":73,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:49:26.010962+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:49:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 msgr2=0x7fc7480b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 0x7fc7480b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000c00 tx=0x7fc74c005a20 comp rx=0 tx=0).stop 2024-09-10T20:49:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 msgr2=0x7fc75c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:49:59.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d950 tx=0x7fc74400de10 comp rx=0 tx=0).stop 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 shutdown_connections 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc75c108060 0x7fc75c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc75c1076e0 0x7fc75c19a5e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc7480b5370 0x7fc7480b7830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 --2- 172.21.15.67:0/2162664991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75c101cd0 0x7fc75c19a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 >> 172.21.15.67:0/2162664991 conn(0x7fc75c0fd700 msgr2=0x7fc75c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 shutdown_connections 2024-09-10T20:49:59.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:49:59.881+0000 7fc760efc640 1 -- 172.21.15.67:0/2162664991 wait complete. 2024-09-10T20:50:00.660 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T20:50:00.660 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:50:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:00 smithi067 ceph-mon[30891]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T20:50:00.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:00 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2162664991' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:00.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:00 smithi067 ceph-mon[30891]: overall HEALTH_OK 2024-09-10T20:50:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:00 smithi083 ceph-mon[35058]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T20:50:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:00 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2162664991' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:00 smithi083 ceph-mon[35058]: overall HEALTH_OK 2024-09-10T20:50:00.921 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:00 smithi172 ceph-mon[35265]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-10T20:50:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:00 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2162664991' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:00 smithi172 ceph-mon[35265]: overall HEALTH_OK 2024-09-10T20:50:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 -- 172.21.15.67:0/1959727498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe81087a0 msgr2=0x7f9fe8108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 --2- 172.21.15.67:0/1959727498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe81087a0 0x7f9fe8108be0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009900 tx=0x7f9fd002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 -- 172.21.15.67:0/1959727498 shutdown_connections 2024-09-10T20:50:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 --2- 172.21.15.67:0/1959727498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe8109120 0x7f9fe810f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 --2- 172.21.15.67:0/1959727498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe81087a0 0x7f9fe8108be0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 --2- 172.21.15.67:0/1959727498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 -- 172.21.15.67:0/1959727498 >> 172.21.15.67:0/1959727498 conn(0x7f9fe80fe820 msgr2=0x7f9fe8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 -- 172.21.15.67:0/1959727498 shutdown_connections 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.425+0000 7f9fed74d640 1 -- 172.21.15.67:0/1959727498 wait complete. 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 Processor -- start 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 -- start start 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 0x7f9fe8199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8112e70 con 0x7f9fe8109120 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8112cf0 con 0x7f9fe81087a0 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fed74d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8112ff0 con 0x7f9fe8102d90 2024-09-10T20:50:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.426+0000 7f9fe77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49024/0 (socket says 172.21.15.67:49024) 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 -- 172.21.15.67:0/2639467407 learned_addr learned my addr 172.21.15.67:0/2639467407 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fdffff640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 0x7f9fe8199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe6ffd640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 -- 172.21.15.67:0/2639467407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 msgr2=0x7f9fe8199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 -- 172.21.15.67:0/2639467407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 msgr2=0x7f9fe8199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 0x7f9fe8199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 -- 172.21.15.67:0/2639467407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe819f4b0 con 0x7f9fe8109120 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fdffff640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 0x7f9fe8199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe6ffd640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe77fe640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000b970 tx=0x7f9fe000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0019070 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe819f7a0 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fe0014440 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00075d0 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.427+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe81a5ee0 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.428+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe81031f0 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.430+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9fe000cb40 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.430+0000 7f9fe4ff9640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 0x7f9fd40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.430+0000 7f9fe6ffd640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 0x7f9fd40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.431+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f9fe00e5400 con 0x7f9fe8109120 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.431+0000 7f9fe6ffd640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 0x7f9fd40b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009930 tx=0x7f9fd8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.434+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fe00ac310 con 0x7f9fe8109120 2024-09-10T20:50:01.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.621+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fe810af30 con 0x7f9fe8109120 2024-09-10T20:50:01.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.622+0000 7f9fe4ff9640 1 -- 172.21.15.67:0/2639467407 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22220 (secure 0 0 0) 0x7f9fe00abc10 con 0x7f9fe8109120 2024-09-10T20:50:01.626 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:01.627 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":73,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:49:26.010962+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:50:01.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 msgr2=0x7f9fd40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:01.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 0x7f9fd40b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009930 tx=0x7f9fd8008040 comp rx=0 tx=0).stop 2024-09-10T20:50:01.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 msgr2=0x7f9fe819ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000b970 tx=0x7f9fe000be30 comp rx=0 tx=0).stop 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 shutdown_connections 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9fe8109120 0x7f9fe819ece0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe81087a0 0x7f9fe8199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9fd40b5370 0x7f9fd40b7830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 --2- 172.21.15.67:0/2639467407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fe8102d90 0x7f9fe8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 >> 172.21.15.67:0/2639467407 conn(0x7f9fe80fe820 msgr2=0x7f9fe8100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 shutdown_connections 2024-09-10T20:50:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:01.624+0000 7f9fed74d640 1 -- 172.21.15.67:0/2639467407 wait complete. 2024-09-10T20:50:02.430 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T20:50:02.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T20:50:02.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T20:50:02.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T20:50:02.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T20:50:02.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T20:50:02.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T20:50:02.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T20:50:02.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T20:50:02.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T20:50:02.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T20:50:02.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T20:50:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:02 smithi067 ceph-mon[30891]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T20:50:02.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:02 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2639467407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:02 smithi083 ceph-mon[35058]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T20:50:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:02 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2639467407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:02 smithi172 ceph-mon[35265]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-10T20:50:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:02 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2639467407' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:03.164 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.266 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.266 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.269 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.271 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:03.277 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4130997912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa74101c90 msgr2=0x7ffa74102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4130997912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa74101c90 0x7ffa74102070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009900 tx=0x7ffa6802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4130997912 shutdown_connections 2024-09-10T20:50:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4130997912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 0x7ffa7410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4130997912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa741076a0 0x7ffa74107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4130997912 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa74101c90 0x7ffa74102070 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.166+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4130997912 >> 172.21.15.67:0/4130997912 conn(0x7ffa740fd700 msgr2=0x7ffa740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.167+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4130997912 shutdown_connections 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.167+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4130997912 wait complete. 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.167+0000 7ffa7b14f640 1 Processor -- start 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.167+0000 7ffa7b14f640 1 -- start start 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa74101c90 0x7ffa7419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 0x7ffa7419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 0x7ffa7419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74111ca0 con 0x7ffa741076a0 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74111b20 con 0x7ffa74101c90 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa7b14f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74111e20 con 0x7ffa74108020 2024-09-10T20:50:04.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 0x7ffa7419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 0x7ffa7419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53854/0 (socket says 172.21.15.67:53854) 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 -- 172.21.15.67:0/4186926719 learned_addr learned my addr 172.21.15.67:0/4186926719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa78eeb640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa74101c90 0x7ffa7419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa796ec640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 0x7ffa7419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 -- 172.21.15.67:0/4186926719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 msgr2=0x7ffa7419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 0x7ffa7419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 -- 172.21.15.67:0/4186926719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa74101c90 msgr2=0x7ffa7419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa74101c90 0x7ffa7419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa73fff640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa741a5430 con 0x7ffa741076a0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.168+0000 7ffa796ec640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74108020 0x7ffa7419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa73fff640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 0x7ffa7419a590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c920 tx=0x7ffa6000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007c70 con 0x7ffa741076a0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa60007e10 con 0x7ffa741076a0 2024-09-10T20:50:04.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa741a5720 con 0x7ffa741076a0 2024-09-10T20:50:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60018820 con 0x7ffa741076a0 2024-09-10T20:50:04.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.169+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa741a5cb0 con 0x7ffa741076a0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.170+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa740638e0 con 0x7ffa741076a0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.172+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ffa6000f450 con 0x7ffa741076a0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.172+0000 7ffa71ffb640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffa640b53f0 0x7ffa640b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.172+0000 7ffa78eeb640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffa640b53f0 0x7ffa640b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.172+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7ffa600e6080 con 0x7ffa741076a0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa71ffb640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] conn(0x7ffa640beb30 0x7ffa640c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa640c1600 con 0x7ffa640beb30 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7ffa600e6560 con 0x7ffa741076a0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa796ec640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] conn(0x7ffa640beb30 0x7ffa640c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:04.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa78eeb640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffa640b53f0 0x7ffa640b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa68031440 tx=0x7ffa68005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.173+0000 7ffa796ec640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] conn(0x7ffa640beb30 0x7ffa640c0f50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:04.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.174+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== osd.0 v2:172.21.15.67:6802/363534915 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa640c1600 con 0x7ffa640beb30 2024-09-10T20:50:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.188+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 --> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa74063ce0 con 0x7ffa640beb30 2024-09-10T20:50:04.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa71ffb640 1 -- 172.21.15.67:0/4186926719 <== osd.0 v2:172.21.15.67:6802/363534915 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa74063ce0 con 0x7ffa640beb30 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] conn(0x7ffa640beb30 msgr2=0x7ffa640c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] conn(0x7ffa640beb30 0x7ffa640c0f50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffa640b53f0 msgr2=0x7ffa640b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffa640b53f0 0x7ffa640b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa68031440 tx=0x7ffa68005b50 comp rx=0 tx=0).stop 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 msgr2=0x7ffa7419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa7b14f640 1 --2- 172.21.15.67:0/4186926719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa741076a0 0x7ffa7419a590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c920 tx=0x7ffa6000cde0 comp rx=0 tx=0).stop 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.189+0000 7ffa796ec640 1 -- 172.21.15.67:0/4186926719 reap_dead start 2024-09-10T20:50:04.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.190+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 shutdown_connections 2024-09-10T20:50:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.190+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 >> 172.21.15.67:0/4186926719 conn(0x7ffa740fd700 msgr2=0x7ffa740ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.190+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 shutdown_connections 2024-09-10T20:50:04.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.190+0000 7ffa7b14f640 1 -- 172.21.15.67:0/4186926719 wait complete. 2024-09-10T20:50:04.541 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:04 smithi067 ceph-mon[30891]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T20:50:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:04 smithi083 ceph-mon[35058]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T20:50:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:04 smithi172 ceph-mon[35265]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T20:50:04.984 INFO:teuthology.orchestra.run.smithi067.stdout:34359738444 2024-09-10T20:50:04.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 -- 172.21.15.67:0/695878660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c104530 msgr2=0x7f415c10cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 --2- 172.21.15.67:0/695878660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c104530 0x7f415c10cb10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f414c009900 tx=0x7f414c02a410 comp rx=0 tx=0).stop 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 -- 172.21.15.67:0/695878660 shutdown_connections 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 --2- 172.21.15.67:0/695878660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f415c10d0e0 0x7f415c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 --2- 172.21.15.67:0/695878660 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c104530 0x7f415c10cb10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 --2- 172.21.15.67:0/695878660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415c103b30 0x7f415c103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 -- 172.21.15.67:0/695878660 >> 172.21.15.67:0/695878660 conn(0x7f415c0fd700 msgr2=0x7f415c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 -- 172.21.15.67:0/695878660 shutdown_connections 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 -- 172.21.15.67:0/695878660 wait complete. 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.149+0000 7f4163449640 1 Processor -- start 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 -- start start 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f415c103b30 0x7f415c1019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415c104530 0x7f415c101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 0x7f415c102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f415c112d60 con 0x7f415c10d0e0 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f415c112be0 con 0x7f415c103b30 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f4163449640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f415c112ee0 con 0x7f415c104530 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 0x7f415c102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:05.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 0x7f415c102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53880/0 (socket says 172.21.15.67:53880) 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 -- 172.21.15.67:0/1736693064 learned_addr learned my addr 172.21.15.67:0/1736693064 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41609e4640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415c104530 0x7f415c101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41611e5640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f415c103b30 0x7f415c1019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 -- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415c104530 msgr2=0x7f415c101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f415c104530 0x7f415c101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 -- 172.21.15.67:0/1736693064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f415c103b30 msgr2=0x7f415c1019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f415c103b30 0x7f415c1019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c1a7690 con 0x7f415c10d0e0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.150+0000 7f41619e6640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 0x7f415c102430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f415400cce0 tx=0x7f415400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.151+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415400f450 con 0x7f415c10d0e0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.151+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415c1a7980 con 0x7f415c10d0e0 2024-09-10T20:50:05.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.151+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f415400faa0 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.151+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154018b70 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.151+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415c1a7e40 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.152+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f415c0638e0 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.153+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f415400f5f0 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41527fc640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f41480b5370 0x7f41480b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41611e5640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f41480b5370 0x7f41480b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f41540e6470 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41527fc640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] conn(0x7f41480beab0 0x7f41480c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f415401ae50 con 0x7f41480beab0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.154+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f41540e6950 con 0x7f415c10d0e0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.155+0000 7f41611e5640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f41480b5370 0x7f41480b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f415800bbe0 tx=0x7f415800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.155+0000 7f41609e4640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] conn(0x7f41480beab0 0x7f41480c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.155+0000 7f41609e4640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] conn(0x7f41480beab0 0x7f41480c0ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:05.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.156+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== osd.11 v2:172.21.15.172:6824/4044336910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f415401ae50 con 0x7f41480beab0 2024-09-10T20:50:05.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.170+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 --> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f415c063d60 con 0x7f41480beab0 2024-09-10T20:50:05.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.170+0000 7f41527fc640 1 -- 172.21.15.67:0/1736693064 <== osd.11 v2:172.21.15.172:6824/4044336910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f415c063d60 con 0x7f41480beab0 2024-09-10T20:50:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] conn(0x7f41480beab0 msgr2=0x7f41480c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] conn(0x7f41480beab0 0x7f41480c0ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f41480b5370 msgr2=0x7f41480b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f41480b5370 0x7f41480b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f415800bbe0 tx=0x7f415800b390 comp rx=0 tx=0).stop 2024-09-10T20:50:05.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 msgr2=0x7f415c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 --2- 172.21.15.67:0/1736693064 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f415c10d0e0 0x7f415c102430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f415400cce0 tx=0x7f415400a620 comp rx=0 tx=0).stop 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f41619e6640 1 -- 172.21.15.67:0/1736693064 reap_dead start 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 shutdown_connections 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 >> 172.21.15.67:0/1736693064 conn(0x7f415c0fd700 msgr2=0x7f415c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 shutdown_connections 2024-09-10T20:50:05.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:05.171+0000 7f4163449640 1 -- 172.21.15.67:0/1736693064 wait complete. 2024-09-10T20:50:05.949 INFO:teuthology.orchestra.run.smithi067.stdout:287762808853 2024-09-10T20:50:05.950 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T20:50:06.132 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:06.708 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:06 smithi067 ceph-mon[30891]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T20:50:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:06 smithi083 ceph-mon[35058]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T20:50:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:06 smithi172 ceph-mon[35265]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.010+0000 7f6f78a58640 1 -- 172.21.15.67:0/1633371588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74102d90 msgr2=0x7f6f74103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.010+0000 7f6f78a58640 1 --2- 172.21.15.67:0/1633371588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74102d90 0x7f6f74103170 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009900 tx=0x7f6f6402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 -- 172.21.15.67:0/1633371588 shutdown_connections 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 --2- 172.21.15.67:0/1633371588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f74109120 0x7f6f7410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 --2- 172.21.15.67:0/1633371588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f741087a0 0x7f6f74108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 --2- 172.21.15.67:0/1633371588 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74102d90 0x7f6f74103170 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 -- 172.21.15.67:0/1633371588 >> 172.21.15.67:0/1633371588 conn(0x7f6f740fe820 msgr2=0x7f6f74100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 -- 172.21.15.67:0/1633371588 shutdown_connections 2024-09-10T20:50:07.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 -- 172.21.15.67:0/1633371588 wait complete. 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 Processor -- start 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.011+0000 7f6f78a58640 1 -- start start 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f74102d90 0x7f6f740754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f741087a0 0x7f6f740759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 0x7f6f74075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74112e20 con 0x7f6f74109120 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74112ca0 con 0x7f6f741087a0 2024-09-10T20:50:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f78a58640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f74112fa0 con 0x7f6f74102d90 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 0x7f6f74075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 0x7f6f74075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53898/0 (socket says 172.21.15.67:53898) 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f6bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f741087a0 0x7f6f740759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 -- 172.21.15.67:0/3229262276 learned_addr learned my addr 172.21.15.67:0/3229262276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f7259c640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f74102d90 0x7f6f740754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 -- 172.21.15.67:0/3229262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f74102d90 msgr2=0x7f6f740754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f74102d90 0x7f6f740754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 -- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f741087a0 msgr2=0x7f6f740759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f741087a0 0x7f6f740759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f741a77f0 con 0x7f6f74109120 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.012+0000 7f6f72d9d640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 0x7f6f74075f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b970 tx=0x7f6f6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.013+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c019070 con 0x7f6f74109120 2024-09-10T20:50:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.013+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c014440 con 0x7f6f74109120 2024-09-10T20:50:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.013+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f741a7ae0 con 0x7f6f74109120 2024-09-10T20:50:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.013+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0075d0 con 0x7f6f74109120 2024-09-10T20:50:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.013+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f741a8020 con 0x7f6f74109120 2024-09-10T20:50:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.014+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f740638a0 con 0x7f6f74109120 2024-09-10T20:50:07.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.015+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6f6c026050 con 0x7f6f74109120 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f6b7fe640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6f600b5370 0x7f6f600b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f7259c640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6f600b5370 0x7f6f600b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f6f6c0e5790 con 0x7f6f74109120 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f6b7fe640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] conn(0x7f6f600beab0 0x7f6f600c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f6c025ea0 con 0x7f6f600beab0 2024-09-10T20:50:07.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f6f6c0e5c70 con 0x7f6f74109120 2024-09-10T20:50:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.016+0000 7f6f7259c640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6f600b5370 0x7f6f600b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f64031440 tx=0x7f6f64005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.017+0000 7f6f6bfff640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] conn(0x7f6f600beab0 0x7f6f600c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:07.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.017+0000 7f6f6bfff640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] conn(0x7f6f600beab0 0x7f6f600c0ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:07.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.018+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== osd.4 v2:172.21.15.83:6808/451760367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f6c025ea0 con 0x7f6f600beab0 2024-09-10T20:50:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.031+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 --> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f74063d20 con 0x7f6f600beab0 2024-09-10T20:50:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f6b7fe640 1 -- 172.21.15.67:0/3229262276 <== osd.4 v2:172.21.15.83:6808/451760367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6f74063d20 con 0x7f6f600beab0 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] conn(0x7f6f600beab0 msgr2=0x7f6f600c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] conn(0x7f6f600beab0 0x7f6f600c0ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6f600b5370 msgr2=0x7f6f600b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6f600b5370 0x7f6f600b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f64031440 tx=0x7f6f64005e80 comp rx=0 tx=0).stop 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 msgr2=0x7f6f74075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 --2- 172.21.15.67:0/3229262276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f74109120 0x7f6f74075f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b970 tx=0x7f6f6c00bd70 comp rx=0 tx=0).stop 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f72d9d640 1 -- 172.21.15.67:0/3229262276 reap_dead start 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 shutdown_connections 2024-09-10T20:50:07.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.032+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 >> 172.21.15.67:0/3229262276 conn(0x7f6f740fe820 msgr2=0x7f6f74100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.033+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 shutdown_connections 2024-09-10T20:50:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:07.033+0000 7f6f78a58640 1 -- 172.21.15.67:0/3229262276 wait complete. 2024-09-10T20:50:07.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-10T20:50:07.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:07 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-10T20:50:07.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T20:50:07.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T20:50:07.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-10T20:50:07.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T20:50:07.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T20:50:07.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-10T20:50:07.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:07 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-10T20:50:07.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2024-09-10T20:50:07.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:07 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 -- 172.21.15.67:0/3530737855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570101cd0 msgr2=0x7f05701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 --2- 172.21.15.67:0/3530737855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570101cd0 0x7f05701020b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0560009900 tx=0x7f056002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 -- 172.21.15.67:0/3530737855 shutdown_connections 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 --2- 172.21.15.67:0/3530737855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0570108060 0x7f057010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 --2- 172.21.15.67:0/3530737855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05701076e0 0x7f0570107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 --2- 172.21.15.67:0/3530737855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570101cd0 0x7f05701020b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 -- 172.21.15.67:0/3530737855 >> 172.21.15.67:0/3530737855 conn(0x7f05700fd720 msgr2=0x7f05700ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 -- 172.21.15.67:0/3530737855 shutdown_connections 2024-09-10T20:50:08.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.219+0000 7f057494e640 1 -- 172.21.15.67:0/3530737855 wait complete. 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 Processor -- start 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 -- start start 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0570101cd0 0x7f0570197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05701076e0 0x7f0570198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 0x7f0570198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0570111d20 con 0x7f0570108060 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0570111ba0 con 0x7f05701076e0 2024-09-10T20:50:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.220+0000 7f057494e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0570111ea0 con 0x7f0570101cd0 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 0x7f0570198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 0x7f0570198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53918/0 (socket says 172.21.15.67:53918) 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 -- 172.21.15.67:0/2007899359 learned_addr learned my addr 172.21.15.67:0/2007899359 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056e59c640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0570101cd0 0x7f0570197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056dd9b640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05701076e0 0x7f0570198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 -- 172.21.15.67:0/2007899359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0570101cd0 msgr2=0x7f0570197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0570101cd0 0x7f0570197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 -- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05701076e0 msgr2=0x7f0570198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f05701076e0 0x7f0570198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05701a76c0 con 0x7f0570108060 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f056ed9d640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 0x7f0570198960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f056800d750 tx=0x7f056800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568017070 con 0x7f0570108060 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05680054d0 con 0x7f0570108060 2024-09-10T20:50:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05701a79b0 con 0x7f0570108060 2024-09-10T20:50:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.221+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568004c60 con 0x7f0570108060 2024-09-10T20:50:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.222+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05701a7ef0 con 0x7f0570108060 2024-09-10T20:50:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.223+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05700638e0 con 0x7f0570108060 2024-09-10T20:50:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.224+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0568004e00 con 0x7f0570108060 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f05677fe640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f055c0b5370 0x7f055c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f056e59c640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f055c0b5370 0x7f055c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8182+0+0 (secure 0 0 0) 0x7f05680e5a60 con 0x7f0570108060 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f05677fe640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] conn(0x7f055c0bed90 0x7f055c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0568021e50 con 0x7f055c0bed90 2024-09-10T20:50:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.225+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f05680e5eb0 con 0x7f0570108060 2024-09-10T20:50:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.226+0000 7f056e59c640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f055c0b5370 0x7f055c0b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0560031440 tx=0x7f0560005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.226+0000 7f056dd9b640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] conn(0x7f055c0bed90 0x7f055c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.226+0000 7f056dd9b640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] conn(0x7f055c0bed90 0x7f055c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.227+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== osd.1 v2:172.21.15.83:6800/459488332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0568021e50 con 0x7f055c0bed90 2024-09-10T20:50:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.241+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 --> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0570063d60 con 0x7f055c0bed90 2024-09-10T20:50:08.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.241+0000 7f05677fe640 1 -- 172.21.15.67:0/2007899359 <== osd.1 v2:172.21.15.83:6800/459488332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0570063d60 con 0x7f055c0bed90 2024-09-10T20:50:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] conn(0x7f055c0bed90 msgr2=0x7f055c0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] conn(0x7f055c0bed90 0x7f055c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f055c0b5370 msgr2=0x7f055c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f055c0b5370 0x7f055c0b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0560031440 tx=0x7f0560005b50 comp rx=0 tx=0).stop 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 msgr2=0x7f0570198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 --2- 172.21.15.67:0/2007899359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0570108060 0x7f0570198960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f056800d750 tx=0x7f056800dc10 comp rx=0 tx=0).stop 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f056ed9d640 1 -- 172.21.15.67:0/2007899359 reap_dead start 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 shutdown_connections 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 >> 172.21.15.67:0/2007899359 conn(0x7f05700fd720 msgr2=0x7f05700ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 shutdown_connections 2024-09-10T20:50:08.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.242+0000 7f057494e640 1 -- 172.21.15.67:0/2007899359 wait complete. 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T20:50:08.763 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T20:50:08.764 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T20:50:08.764 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-10T20:50:08.764 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:08 smithi067 ceph-mon[30891]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T20:50:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 -- 172.21.15.67:0/2027884571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c103b70 msgr2=0x7f120c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 --2- 172.21.15.67:0/2027884571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c103b70 0x7f120c103f50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1208009900 tx=0x7f120802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 -- 172.21.15.67:0/2027884571 shutdown_connections 2024-09-10T20:50:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 --2- 172.21.15.67:0/2027884571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120c10d120 0x7f120c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 --2- 172.21.15.67:0/2027884571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c104570 0x7f120c10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 --2- 172.21.15.67:0/2027884571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c103b70 0x7f120c103f50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 -- 172.21.15.67:0/2027884571 >> 172.21.15.67:0/2027884571 conn(0x7f120c0fd700 msgr2=0x7f120c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 -- 172.21.15.67:0/2027884571 shutdown_connections 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.759+0000 7f1214055640 1 -- 172.21.15.67:0/2027884571 wait complete. 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 Processor -- start 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 -- start start 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c103b70 0x7f120c1019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 0x7f120c101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120c10d120 0x7f120c102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f120c112da0 con 0x7f120c104570 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f120c112c20 con 0x7f120c103b70 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f1214055640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f120c112f20 con 0x7f120c10d120 2024-09-10T20:50:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f12115f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 0x7f120c101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f12115f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 0x7f120c101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53936/0 (socket says 172.21.15.67:53936) 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.760+0000 7f12115f0640 1 -- 172.21.15.67:0/2338048165 learned_addr learned my addr 172.21.15.67:0/2338048165 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1211df1640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c103b70 0x7f120c1019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12125f2640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120c10d120 0x7f120c102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 -- 172.21.15.67:0/2338048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120c10d120 msgr2=0x7f120c102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120c10d120 0x7f120c102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 -- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c103b70 msgr2=0x7f120c1019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c103b70 0x7f120c1019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c1a7670 con 0x7f120c104570 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1211df1640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f120c103b70 0x7f120c1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f12115f0640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 0x7f120c101f30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00b4a0 tx=0x7f11fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc014070 con 0x7f120c104570 2024-09-10T20:50:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11fc010ac0 con 0x7f120c104570 2024-09-10T20:50:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120c1a7960 con 0x7f120c104570 2024-09-10T20:50:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc017c30 con 0x7f120c104570 2024-09-10T20:50:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.761+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120c1a7f20 con 0x7f120c104570 2024-09-10T20:50:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.763+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f120c0ff620 con 0x7f120c104570 2024-09-10T20:50:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.764+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f11fc010610 con 0x7f120c104570 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.764+0000 7f1202ffd640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f11f80b5370 0x7f11f80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1211df1640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f11f80b5370 0x7f11f80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f11fc0e56d0 con 0x7f120c104570 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1202ffd640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] conn(0x7f11f80bed90 0x7f11f80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11fc012e80 con 0x7f11f80bed90 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f11fc0ec050 con 0x7f120c104570 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f12125f2640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] conn(0x7f11f80bed90 0x7f11f80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.765+0000 7f1211df1640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f11f80b5370 0x7f11f80b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1208031440 tx=0x7f12080095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.766+0000 7f12125f2640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] conn(0x7f11f80bed90 0x7f11f80c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:08.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.767+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== osd.10 v2:172.21.15.83:6824/2093574925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11fc012e80 con 0x7f11f80bed90 2024-09-10T20:50:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.781+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 --> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f120c06b110 con 0x7f11f80bed90 2024-09-10T20:50:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.781+0000 7f1202ffd640 1 -- 172.21.15.67:0/2338048165 <== osd.10 v2:172.21.15.83:6824/2093574925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f120c06b110 con 0x7f11f80bed90 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] conn(0x7f11f80bed90 msgr2=0x7f11f80c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] conn(0x7f11f80bed90 0x7f11f80c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f11f80b5370 msgr2=0x7f11f80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f11f80b5370 0x7f11f80b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1208031440 tx=0x7f12080095f0 comp rx=0 tx=0).stop 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 msgr2=0x7f120c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 --2- 172.21.15.67:0/2338048165 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f120c104570 0x7f120c101f30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00b4a0 tx=0x7f11fc00b960 comp rx=0 tx=0).stop 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f12125f2640 1 -- 172.21.15.67:0/2338048165 reap_dead start 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 shutdown_connections 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 >> 172.21.15.67:0/2338048165 conn(0x7f120c0fd700 msgr2=0x7f120c10f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 shutdown_connections 2024-09-10T20:50:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:08.782+0000 7f1214055640 1 -- 172.21.15.67:0/2338048165 wait complete. 2024-09-10T20:50:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-10T20:50:08.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:08 smithi083 ceph-mon[35058]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T20:50:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-10T20:50:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T20:50:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-10T20:50:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-10T20:50:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-10T20:50:08.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-10T20:50:08.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-10T20:50:08.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2024-09-10T20:50:08.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:08 smithi172 ceph-mon[35265]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- 172.21.15.67:0/3360682987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b41045c0 msgr2=0x7f93b410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 --2- 172.21.15.67:0/3360682987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b41045c0 0x7f93b410cab0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009900 tx=0x7f93a802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- 172.21.15.67:0/3360682987 shutdown_connections 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 --2- 172.21.15.67:0/3360682987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b410d100 0x7f93b410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 --2- 172.21.15.67:0/3360682987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b41045c0 0x7f93b410cab0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 --2- 172.21.15.67:0/3360682987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93b4103ca0 0x7f93b4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- 172.21.15.67:0/3360682987 >> 172.21.15.67:0/3360682987 conn(0x7f93b40fd700 msgr2=0x7f93b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- 172.21.15.67:0/3360682987 shutdown_connections 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- 172.21.15.67:0/3360682987 wait complete. 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 Processor -- start 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.358+0000 7f93ba958640 1 -- start start 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b4103ca0 0x7f93b41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93b41045c0 0x7f93b41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 0x7f93b419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4112d70 con 0x7f93b410d100 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4112bf0 con 0x7f93b41045c0 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93ba958640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4112ef0 con 0x7f93b4103ca0 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 0x7f93b419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b4103ca0 0x7f93b41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 0x7f93b419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53868/0 (socket says 172.21.15.67:53868) 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 -- 172.21.15.67:0/2501991060 learned_addr learned my addr 172.21.15.67:0/2501991060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b37fe640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93b41045c0 0x7f93b41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 -- 172.21.15.67:0/2501991060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b4103ca0 msgr2=0x7f93b41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b4103ca0 0x7f93b41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 -- 172.21.15.67:0/2501991060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93b41045c0 msgr2=0x7f93b41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93b41045c0 0x7f93b41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.359+0000 7f93b8ef5640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b419f350 con 0x7f93b410d100 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93b8ef5640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 0x7f93b419eb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00eaa0 tx=0x7f93ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00cdb0 con 0x7f93b410d100 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b419f640 con 0x7f93b410d100 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ac005020 con 0x7f93b410d100 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac0116d0 con 0x7f93b410d100 2024-09-10T20:50:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.360+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41a5d00 con 0x7f93b410d100 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.361+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93b40638e0 con 0x7f93b410d100 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.362+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f93ac00f040 con 0x7f93b410d100 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.363+0000 7f93b17fa640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f939c0b5370 0x7f939c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.363+0000 7f93b3fff640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f939c0b5370 0x7f939c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.363+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f93ac0e5eb0 con 0x7f93b410d100 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b17fa640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] conn(0x7f939c0beab0 0x7f939c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93ac014ec0 con 0x7f939c0beab0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f93ac0e6390 con 0x7f93b410d100 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b37fe640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] conn(0x7f939c0beab0 0x7f939c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b3fff640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f939c0b5370 0x7f939c0b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f93a4005d00 tx=0x7f93a400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.364+0000 7f93b37fe640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] conn(0x7f939c0beab0 0x7f939c0c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.365+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== osd.6 v2:172.21.15.67:6818/1669148747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93ac014ec0 con 0x7f939c0beab0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.378+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 --> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93b4063ce0 con 0x7f939c0beab0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93b17fa640 1 -- 172.21.15.67:0/2501991060 <== osd.6 v2:172.21.15.67:6818/1669148747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93b4063ce0 con 0x7f939c0beab0 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] conn(0x7f939c0beab0 msgr2=0x7f939c0c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] conn(0x7f939c0beab0 0x7f939c0c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f939c0b5370 msgr2=0x7f939c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f939c0b5370 0x7f939c0b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f93a4005d00 tx=0x7f93a400b410 comp rx=0 tx=0).stop 2024-09-10T20:50:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 msgr2=0x7f93b419eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 --2- 172.21.15.67:0/2501991060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93b410d100 0x7f93b419eb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00eaa0 tx=0x7f93ac00ef60 comp rx=0 tx=0).stop 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93b8ef5640 1 -- 172.21.15.67:0/2501991060 reap_dead start 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 shutdown_connections 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 >> 172.21.15.67:0/2501991060 conn(0x7f93b40fd700 msgr2=0x7f93b40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 shutdown_connections 2024-09-10T20:50:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:04.379+0000 7f93ba958640 1 -- 172.21.15.67:0/2501991060 wait complete. 2024-09-10T20:50:09.787 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:09 smithi067 ceph-mon[30891]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T20:50:09.820 INFO:teuthology.orchestra.run.smithi067.stdout:171798691886 2024-09-10T20:50:09.820 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T20:50:09.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:09 smithi083 ceph-mon[35058]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T20:50:09.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:09 smithi172 ceph-mon[35265]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 -- 172.21.15.67:0/1711308825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa53010d160 msgr2=0x7fa53010f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 --2- 172.21.15.67:0/1711308825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa53010d160 0x7fa53010f590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa528009ca0 tx=0x7fa52802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 -- 172.21.15.67:0/1711308825 shutdown_connections 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 --2- 172.21.15.67:0/1711308825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa53010d160 0x7fa53010f590 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 --2- 172.21.15.67:0/1711308825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5301045b0 0x7fa53010cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 --2- 172.21.15.67:0/1711308825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 0x7fa530103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 -- 172.21.15.67:0/1711308825 >> 172.21.15.67:0/1711308825 conn(0x7fa5300fd780 msgr2=0x7fa5300ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 -- 172.21.15.67:0/1711308825 shutdown_connections 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.977+0000 7fa5359e5640 1 -- 172.21.15.67:0/1711308825 wait complete. 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 Processor -- start 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 -- start start 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 0x7fa530101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 0x7fa530101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53010d160 0x7fa5301024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112da0 con 0x7fa5301045b0 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112c20 con 0x7fa530103bb0 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa5359e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112f20 con 0x7fa53010d160 2024-09-10T20:50:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 0x7fa530101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 0x7fa530101f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53948/0 (socket says 172.21.15.67:53948) 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 -- 172.21.15.67:0/3340833439 learned_addr learned my addr 172.21.15.67:0/3340833439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52effd640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 0x7fa530101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52f7fe640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53010d160 0x7fa5301024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 -- 172.21.15.67:0/3340833439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53010d160 msgr2=0x7fa5301024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa53010d160 0x7fa5301024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 -- 172.21.15.67:0/3340833439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 msgr2=0x7fa530101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 0x7fa530101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.978+0000 7fa52e7fc640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5301a7670 con 0x7fa5301045b0 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa52effd640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa530103bb0 0x7fa530101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa52e7fc640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 0x7fa530101f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d950 tx=0x7fa52400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524017070 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5301a7960 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa524009c30 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400f620 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.979+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5301a7ef0 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.980+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5300ffdf0 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.981+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa524010460 con 0x7fa5301045b0 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa5349e3640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa5180b53f0 0x7fa5180b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa52effd640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa5180b53f0 0x7fa5180b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa5240e5d90 con 0x7fa5301045b0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa5349e3640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] conn(0x7fa5180bee10 0x7fa5180c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa524004470 con 0x7fa5180bee10 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.982+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa5240e61e0 con 0x7fa5301045b0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.983+0000 7fa52f7fe640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] conn(0x7fa5180bee10 0x7fa5180c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.983+0000 7fa52effd640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa5180b53f0 0x7fa5180b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5200058c0 tx=0x7fa520005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.983+0000 7fa52f7fe640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] conn(0x7fa5180bee10 0x7fa5180c12b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.984+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== osd.3 v2:172.21.15.67:6810/3075228399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa524004470 con 0x7fa5180bee10 2024-09-10T20:50:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.997+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 --> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa53006b930 con 0x7fa5180bee10 2024-09-10T20:50:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5349e3640 1 -- 172.21.15.67:0/3340833439 <== osd.3 v2:172.21.15.67:6810/3075228399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa53006b930 con 0x7fa5180bee10 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] conn(0x7fa5180bee10 msgr2=0x7fa5180c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] conn(0x7fa5180bee10 0x7fa5180c12b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa5180b53f0 msgr2=0x7fa5180b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa5180b53f0 0x7fa5180b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5200058c0 tx=0x7fa520005850 comp rx=0 tx=0).stop 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 msgr2=0x7fa530101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 --2- 172.21.15.67:0/3340833439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5301045b0 0x7fa530101f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d950 tx=0x7fa52400de10 comp rx=0 tx=0).stop 2024-09-10T20:50:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa52f7fe640 1 -- 172.21.15.67:0/3340833439 reap_dead start 2024-09-10T20:50:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 shutdown_connections 2024-09-10T20:50:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 >> 172.21.15.67:0/3340833439 conn(0x7fa5300fd780 msgr2=0x7fa5300fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 shutdown_connections 2024-09-10T20:50:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:09.998+0000 7fa5359e5640 1 -- 172.21.15.67:0/3340833439 wait complete. 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 -- 172.21.15.67:0/1720651992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 msgr2=0x7fe7ac10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/1720651992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac10f950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009ca0 tx=0x7fe7a402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 -- 172.21.15.67:0/1720651992 shutdown_connections 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/1720651992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac10f950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/1720651992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac1087d0 0x7fe7ac108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/1720651992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7ac102dc0 0x7fe7ac1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 -- 172.21.15.67:0/1720651992 >> 172.21.15.67:0/1720651992 conn(0x7fe7ac0fe830 msgr2=0x7fe7ac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 -- 172.21.15.67:0/1720651992 shutdown_connections 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.632+0000 7fe7b11ce640 1 -- 172.21.15.67:0/1720651992 wait complete. 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.633+0000 7fe7b11ce640 1 Processor -- start 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.633+0000 7fe7b11ce640 1 -- start start 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac102dc0 0x7fe7ac199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7ac1087d0 0x7fe7ac199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac112dd0 con 0x7fe7ac109150 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac112c50 con 0x7fe7ac1087d0 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7b11ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac112f50 con 0x7fe7ac102dc0 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53976/0 (socket says 172.21.15.67:53976) 2024-09-10T20:50:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 -- 172.21.15.67:0/477194984 learned_addr learned my addr 172.21.15.67:0/477194984 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7aa59c640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7ac1087d0 0x7fe7ac199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7aad9d640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac102dc0 0x7fe7ac199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 -- 172.21.15.67:0/477194984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac102dc0 msgr2=0x7fe7ac199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac102dc0 0x7fe7ac199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 -- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7ac1087d0 msgr2=0x7fe7ac199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7ac1087d0 0x7fe7ac199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac19f2f0 con 0x7fe7ac109150 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe7ab59e640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac19eb20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4005cc0 tx=0x7fe7a402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.634+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4003bf0 con 0x7fe7ac109150 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.635+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac19f580 con 0x7fe7ac109150 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.635+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7a4003d90 con 0x7fe7ac109150 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.635+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a402fbc0 con 0x7fe7ac109150 2024-09-10T20:50:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.635+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac075380 con 0x7fe7ac109150 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.635+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7ac0638e0 con 0x7fe7ac109150 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.637+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe7a4004610 con 0x7fe7ac109150 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe793fff640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7940b5370 0x7fe7940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe7aad9d640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7940b5370 0x7fe7940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe7a4107320 con 0x7fe7ac109150 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe793fff640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] conn(0x7fe7940bed90 0x7fe7940c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7940c1900 con 0x7fe7940bed90 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe7a4107770 con 0x7fe7ac109150 2024-09-10T20:50:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe7aad9d640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7940b5370 0x7fe7940b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00bbe0 tx=0x7fe79c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.638+0000 7fe7aa59c640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] conn(0x7fe7940bed90 0x7fe7940c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.639+0000 7fe7aa59c640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] conn(0x7fe7940bed90 0x7fe7940c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.640+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== osd.7 v2:172.21.15.83:6816/3493783526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7940c1900 con 0x7fe7940bed90 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.653+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 --> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe7ac063ce0 con 0x7fe7940bed90 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe793fff640 1 -- 172.21.15.67:0/477194984 <== osd.7 v2:172.21.15.83:6816/3493783526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe7ac063ce0 con 0x7fe7940bed90 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] conn(0x7fe7940bed90 msgr2=0x7fe7940c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] conn(0x7fe7940bed90 0x7fe7940c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7940b5370 msgr2=0x7fe7940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe7940b5370 0x7fe7940b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00bbe0 tx=0x7fe79c00b390 comp rx=0 tx=0).stop 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 msgr2=0x7fe7ac19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 --2- 172.21.15.67:0/477194984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7ac109150 0x7fe7ac19eb20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4005cc0 tx=0x7fe7a402f380 comp rx=0 tx=0).stop 2024-09-10T20:50:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7ab59e640 1 -- 172.21.15.67:0/477194984 reap_dead start 2024-09-10T20:50:10.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 shutdown_connections 2024-09-10T20:50:10.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 >> 172.21.15.67:0/477194984 conn(0x7fe7ac0fe830 msgr2=0x7fe7ac100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:10.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 shutdown_connections 2024-09-10T20:50:10.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:10.654+0000 7fe7b11ce640 1 -- 172.21.15.67:0/477194984 wait complete. 2024-09-10T20:50:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:10 smithi083 ceph-mon[35058]: pgmap v306: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T20:50:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:10 smithi172 ceph-mon[35265]: pgmap v306: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T20:50:11.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:10 smithi067 ceph-mon[30891]: pgmap v306: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 -- 172.21.15.67:0/3097916207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46081076b0 msgr2=0x7f4608107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 --2- 172.21.15.67:0/3097916207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46081076b0 0x7f4608107af0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009900 tx=0x7f45fc02a410 comp rx=0 tx=0).stop 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 -- 172.21.15.67:0/3097916207 shutdown_connections 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 --2- 172.21.15.67:0/3097916207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4608108030 0x7f460810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 --2- 172.21.15.67:0/3097916207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f46081076b0 0x7f4608107af0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 --2- 172.21.15.67:0/3097916207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 0x7f4608102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 -- 172.21.15.67:0/3097916207 >> 172.21.15.67:0/3097916207 conn(0x7f46080fd730 msgr2=0x7f46080ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 -- 172.21.15.67:0/3097916207 shutdown_connections 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 -- 172.21.15.67:0/3097916207 wait complete. 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.170+0000 7f4610520640 1 Processor -- start 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 -- start start 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 0x7f460819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46081076b0 0x7f460819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 0x7f460819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111cf0 con 0x7f4608108030 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111b70 con 0x7f4608101ca0 2024-09-10T20:50:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f4610520640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111e70 con 0x7f46081076b0 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 0x7f460819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 0x7f460819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54006/0 (socket says 172.21.15.67:54006) 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 -- 172.21.15.67:0/3128098312 learned_addr learned my addr 172.21.15.67:0/3128098312 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460e2bc640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 0x7f460819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460dabb640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46081076b0 0x7f460819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 -- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46081076b0 msgr2=0x7f460819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46081076b0 0x7f460819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 -- 172.21.15.67:0/3128098312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 msgr2=0x7f460819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 0x7f460819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081a5460 con 0x7f4608108030 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460e2bc640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4608101ca0 0x7f460819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:50:11.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.171+0000 7f460eabd640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 0x7f460819ab20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f460000d750 tx=0x7f460000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600017070 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46000054d0 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081a5750 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600004c60 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081a5c60 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.172+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46080638e0 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.174+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4600004e00 con 0x7f4608108030 2024-09-10T20:50:11.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f46077fe640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45f00b5370 0x7f45f00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f460e2bc640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45f00b5370 0x7f45f00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f46000e5a60 con 0x7f4608108030 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f46077fe640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] conn(0x7f45f00bed90 0x7f45f00c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4600021e50 con 0x7f45f00bed90 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f46000e5eb0 con 0x7f4608108030 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f460e2bc640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45f00b5370 0x7f45f00b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009fd0 tx=0x7f45f8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.175+0000 7f460dabb640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] conn(0x7f45f00bed90 0x7f45f00c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.176+0000 7f460dabb640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] conn(0x7f45f00bed90 0x7f45f00c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:11.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.176+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== osd.5 v2:172.21.15.172:6808/10580951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4600021e50 con 0x7f45f00bed90 2024-09-10T20:50:11.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.190+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 --> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4608063d60 con 0x7f45f00bed90 2024-09-10T20:50:11.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f46077fe640 1 -- 172.21.15.67:0/3128098312 <== osd.5 v2:172.21.15.172:6808/10580951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4608063d60 con 0x7f45f00bed90 2024-09-10T20:50:11.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] conn(0x7f45f00bed90 msgr2=0x7f45f00c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] conn(0x7f45f00bed90 0x7f45f00c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45f00b5370 msgr2=0x7f45f00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45f00b5370 0x7f45f00b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009fd0 tx=0x7f45f8009680 comp rx=0 tx=0).stop 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 msgr2=0x7f460819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 --2- 172.21.15.67:0/3128098312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4608108030 0x7f460819ab20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f460000d750 tx=0x7f460000dc10 comp rx=0 tx=0).stop 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f460eabd640 1 -- 172.21.15.67:0/3128098312 reap_dead start 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 shutdown_connections 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 >> 172.21.15.67:0/3128098312 conn(0x7f46080fd730 msgr2=0x7f46080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 shutdown_connections 2024-09-10T20:50:11.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:11.191+0000 7f4610520640 1 -- 172.21.15.67:0/3128098312 wait complete. 2024-09-10T20:50:11.387 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:12.130 INFO:teuthology.orchestra.run.smithi067.stdout:55834574921 2024-09-10T20:50:12.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T20:50:12.380 INFO:teuthology.orchestra.run.smithi067.stdout:128849018937 2024-09-10T20:50:12.380 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T20:50:12.711 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:12 smithi067 ceph-mon[30891]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T20:50:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:12 smithi083 ceph-mon[35058]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T20:50:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 -- 172.21.15.67:0/3533600704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba8102dc0 msgr2=0x7f6ba81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 --2- 172.21.15.67:0/3533600704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba8102dc0 0x7f6ba81031a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009900 tx=0x7f6b9802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 -- 172.21.15.67:0/3533600704 shutdown_connections 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 --2- 172.21.15.67:0/3533600704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 0x7f6ba810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 --2- 172.21.15.67:0/3533600704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ba81087d0 0x7f6ba8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 --2- 172.21.15.67:0/3533600704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba8102dc0 0x7f6ba81031a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 -- 172.21.15.67:0/3533600704 >> 172.21.15.67:0/3533600704 conn(0x7f6ba80fe830 msgr2=0x7f6ba8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 -- 172.21.15.67:0/3533600704 shutdown_connections 2024-09-10T20:50:12.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.933+0000 7f6bad1db640 1 -- 172.21.15.67:0/3533600704 wait complete. 2024-09-10T20:50:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 Processor -- start 2024-09-10T20:50:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 -- start start 2024-09-10T20:50:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ba8102dc0 0x7f6ba819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:12.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 0x7f6ba819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 0x7f6ba81a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112e10 con 0x7f6ba81087d0 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112c90 con 0x7f6ba8102dc0 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.934+0000 7f6bad1db640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8112f90 con 0x7f6ba8109150 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 0x7f6ba819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 0x7f6ba819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33360/0 (socket says 172.21.15.67:33360) 2024-09-10T20:50:12.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 -- 172.21.15.67:0/2502417564 learned_addr learned my addr 172.21.15.67:0/2502417564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba6d9d640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ba8102dc0 0x7f6ba819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:12.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba759e640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 0x7f6ba81a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 -- 172.21.15.67:0/2502417564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 msgr2=0x7f6ba81a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 0x7f6ba81a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 -- 172.21.15.67:0/2502417564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ba8102dc0 msgr2=0x7f6ba819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ba8102dc0 0x7f6ba819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba81a1550 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba759e640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ba8109150 0x7f6ba81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6ba659c640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 0x7f6ba819b9e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00d950 tx=0x7f6b9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c017070 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba81a1840 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b9c009c30 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00f620 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.935+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba81a7f00 con 0x7f6ba81087d0 2024-09-10T20:50:12.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.936+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ba8075ec0 con 0x7f6ba81087d0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.938+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6b9c010460 con 0x7f6ba81087d0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.938+0000 7f6b8ffff640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b900b5370 0x7f6b900b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6ba6d9d640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b900b5370 0x7f6b900b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6b9c0e5e20 con 0x7f6ba81087d0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6b8ffff640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] conn(0x7f6b900bed90 0x7f6b900c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b9c022e70 con 0x7f6b900bed90 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f6b9c0e6270 con 0x7f6ba81087d0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6ba759e640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] conn(0x7f6b900bed90 0x7f6b900c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6ba6d9d640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b900b5370 0x7f6b900b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031440 tx=0x7f6b98005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.939+0000 7f6ba759e640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] conn(0x7f6b900bed90 0x7f6b900c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:12.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.940+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== osd.9 v2:172.21.15.67:6826/2963981854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b9c022e70 con 0x7f6b900bed90 2024-09-10T20:50:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:12 smithi172 ceph-mon[35265]: pgmap v307: 97 pgs: 4 peering, 93 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T20:50:12.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 --> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ba8104070 con 0x7f6b900bed90 2024-09-10T20:50:12.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6b8ffff640 1 -- 172.21.15.67:0/2502417564 <== osd.9 v2:172.21.15.67:6826/2963981854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ba8104070 con 0x7f6b900bed90 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] conn(0x7f6b900bed90 msgr2=0x7f6b900c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] conn(0x7f6b900bed90 0x7f6b900c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b900b5370 msgr2=0x7f6b900b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b900b5370 0x7f6b900b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b98031440 tx=0x7f6b98005b50 comp rx=0 tx=0).stop 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 msgr2=0x7f6ba819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 --2- 172.21.15.67:0/2502417564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ba81087d0 0x7f6ba819b9e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00d950 tx=0x7f6b9c00de10 comp rx=0 tx=0).stop 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6ba759e640 1 -- 172.21.15.67:0/2502417564 reap_dead start 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 shutdown_connections 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.954+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 >> 172.21.15.67:0/2502417564 conn(0x7f6ba80fe830 msgr2=0x7f6ba8075460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.955+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 shutdown_connections 2024-09-10T20:50:12.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:12.955+0000 7f6bad1db640 1 -- 172.21.15.67:0/2502417564 wait complete. 2024-09-10T20:50:13.818 INFO:teuthology.orchestra.run.smithi067.stdout:266287972378 2024-09-10T20:50:13.818 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T20:50:14.275 INFO:teuthology.orchestra.run.smithi067.stdout:146028888117 2024-09-10T20:50:14.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T20:50:14.823 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:14 smithi067 ceph-mon[30891]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:14 smithi083 ceph-mon[35058]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:14 smithi172 ceph-mon[35265]: pgmap v308: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:15.146 INFO:teuthology.orchestra.run.smithi067.stdout:197568495658 2024-09-10T20:50:15.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 -- 172.21.15.67:0/3361185901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 msgr2=0x7f8718108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 --2- 172.21.15.67:0/3361185901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718108c10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8708009900 tx=0x7f870802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 -- 172.21.15.67:0/3361185901 shutdown_connections 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 --2- 172.21.15.67:0/3361185901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8718109150 0x7f871810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 --2- 172.21.15.67:0/3361185901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718108c10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 --2- 172.21.15.67:0/3361185901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8718102dc0 0x7f87181031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 -- 172.21.15.67:0/3361185901 >> 172.21.15.67:0/3361185901 conn(0x7f87180fe830 msgr2=0x7f8718100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 -- 172.21.15.67:0/3361185901 shutdown_connections 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.368+0000 7f871e0f2640 1 -- 172.21.15.67:0/3361185901 wait complete. 2024-09-10T20:50:15.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.369+0000 7f871e0f2640 1 Processor -- start 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.369+0000 7f871e0f2640 1 -- start start 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8718102dc0 0x7f87181992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8718109150 0x7f871819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112e10 con 0x7f87181087d0 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112c90 con 0x7f8718102dc0 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8718112f90 con 0x7f8718109150 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33378/0 (socket says 172.21.15.67:33378) 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 -- 172.21.15.67:0/748243921 learned_addr learned my addr 172.21.15.67:0/748243921 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f87177fe640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8718102dc0 0x7f87181992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:15.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8717fff640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8718109150 0x7f871819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 -- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8718109150 msgr2=0x7f871819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8718109150 0x7f871819ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 -- 172.21.15.67:0/748243921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8718102dc0 msgr2=0x7f87181992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8718102dc0 0x7f87181992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871819f3a0 con 0x7f87181087d0 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8716ffd640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718199830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8708005940 tx=0x7f87080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:15.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870803f030 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8708003cb0 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871819f630 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.370+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708035070 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.371+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87181a5d50 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.371+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87180638a0 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.373+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f870803bbf0 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8714ff9640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87000b5370 0x7f87000b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f87177fe640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87000b5370 0x7f87000b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8708106c00 con 0x7f87181087d0 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8714ff9640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] conn(0x7f87000bed90 0x7f87000c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f870804ae50 con 0x7f87000bed90 2024-09-10T20:50:15.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f8708107050 con 0x7f87181087d0 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f8717fff640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] conn(0x7f87000bed90 0x7f87000c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.374+0000 7f87177fe640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87000b5370 0x7f87000b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f870c005d00 tx=0x7f870c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.375+0000 7f8717fff640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] conn(0x7f87000bed90 0x7f87000c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.376+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== osd.2 v2:172.21.15.172:6800/1268193181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f870804ae50 con 0x7f87000bed90 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.389+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 --> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8718063d20 con 0x7f87000bed90 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f8714ff9640 1 -- 172.21.15.67:0/748243921 <== osd.2 v2:172.21.15.172:6800/1268193181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8718063d20 con 0x7f87000bed90 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] conn(0x7f87000bed90 msgr2=0x7f87000c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] conn(0x7f87000bed90 0x7f87000c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87000b5370 msgr2=0x7f87000b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87000b5370 0x7f87000b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f870c005d00 tx=0x7f870c00b410 comp rx=0 tx=0).stop 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 msgr2=0x7f8718199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 --2- 172.21.15.67:0/748243921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87181087d0 0x7f8718199830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8708005940 tx=0x7f87080042f0 comp rx=0 tx=0).stop 2024-09-10T20:50:15.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f8717fff640 1 -- 172.21.15.67:0/748243921 reap_dead start 2024-09-10T20:50:15.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 shutdown_connections 2024-09-10T20:50:15.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.390+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 >> 172.21.15.67:0/748243921 conn(0x7f87180fe830 msgr2=0x7f8718100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:15.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.391+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 shutdown_connections 2024-09-10T20:50:15.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:13.391+0000 7f871e0f2640 1 -- 172.21.15.67:0/748243921 wait complete. 2024-09-10T20:50:15.916 INFO:teuthology.orchestra.run.smithi067.stdout:73014444101 2024-09-10T20:50:15.916 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T20:50:16.412 INFO:teuthology.orchestra.run.smithi067.stdout:103079215166 2024-09-10T20:50:16.412 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T20:50:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:16 smithi067 ceph-mon[30891]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:16.822 INFO:teuthology.orchestra.run.smithi067.stdout:249108103201 2024-09-10T20:50:16.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T20:50:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:16 smithi083 ceph-mon[35058]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:16.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 -- 172.21.15.67:0/43280596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9041087d0 msgr2=0x7fd904108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/43280596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9041087d0 0x7fd904108c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009900 tx=0x7fd8f802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:16.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 -- 172.21.15.67:0/43280596 shutdown_connections 2024-09-10T20:50:16.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/43280596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904109150 0x7fd90410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/43280596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9041087d0 0x7fd904108c10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/43280596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd904102dc0 0x7fd9041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 -- 172.21.15.67:0/43280596 >> 172.21.15.67:0/43280596 conn(0x7fd9040fe830 msgr2=0x7fd904100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 -- 172.21.15.67:0/43280596 shutdown_connections 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.795+0000 7fd90a2c6640 1 -- 172.21.15.67:0/43280596 wait complete. 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.796+0000 7fd90a2c6640 1 Processor -- start 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.796+0000 7fd90a2c6640 1 -- start start 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904102dc0 0x7fd904199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9041087d0 0x7fd904199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 0x7fd90419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd904112da0 con 0x7fd904109150 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd904112c20 con 0x7fd904102dc0 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd90a2c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd904112f20 con 0x7fd9041087d0 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 0x7fd90419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:16.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd903fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904102dc0 0x7fd904199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 0x7fd90419eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33398/0 (socket says 172.21.15.67:33398) 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd903fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904102dc0 0x7fd904199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43102/0 (socket says 172.21.15.67:43102) 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 -- 172.21.15.67:0/325861603 learned_addr learned my addr 172.21.15.67:0/325861603 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd9037fe640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9041087d0 0x7fd904199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 -- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9041087d0 msgr2=0x7fd904199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9041087d0 0x7fd904199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 -- 172.21.15.67:0/325861603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904102dc0 msgr2=0x7fd904199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd904102dc0 0x7fd904199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90419f2e0 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd908863640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 0x7fd90419eb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00cad0 tx=0x7fd8fc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.797+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00ad60 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.798+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90419f5d0 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.798+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8fc005020 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.798+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00f6b0 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.798+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9041a5c90 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.798+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9040638e0 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.800+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd8fc0054f0 con 0x7fd904109150 2024-09-10T20:50:16.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd9017fa640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ec0b5370 0x7fd8ec0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd903fff640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ec0b5370 0x7fd8ec0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd8fc0e61a0 con 0x7fd904109150 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd9017fa640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] conn(0x7fd8ec0bed90 0x7fd8ec0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8fc016ec0 con 0x7fd8ec0bed90 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd8fc0e65f0 con 0x7fd904109150 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.801+0000 7fd903fff640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ec0b5370 0x7fd8ec0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400abe0 tx=0x7fd8f400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.802+0000 7fd9037fe640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] conn(0x7fd8ec0bed90 0x7fd8ec0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.802+0000 7fd9037fe640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] conn(0x7fd8ec0bed90 0x7fd8ec0c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.803+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== osd.8 v2:172.21.15.172:6816/4093279752 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8fc016ec0 con 0x7fd8ec0bed90 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.818+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 --> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd904063d60 con 0x7fd8ec0bed90 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd9017fa640 1 -- 172.21.15.67:0/325861603 <== osd.8 v2:172.21.15.172:6816/4093279752 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd904063d60 con 0x7fd8ec0bed90 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] conn(0x7fd8ec0bed90 msgr2=0x7fd8ec0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] conn(0x7fd8ec0bed90 0x7fd8ec0c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ec0b5370 msgr2=0x7fd8ec0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ec0b5370 0x7fd8ec0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400abe0 tx=0x7fd8f400a2d0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 msgr2=0x7fd90419eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.819+0000 7fd90a2c6640 1 --2- 172.21.15.67:0/325861603 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd904109150 0x7fd90419eb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00cad0 tx=0x7fd8fc00ced0 comp rx=0 tx=0).stop 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.820+0000 7fd908863640 1 -- 172.21.15.67:0/325861603 reap_dead start 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.820+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 shutdown_connections 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.820+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 >> 172.21.15.67:0/325861603 conn(0x7fd9040fe830 msgr2=0x7fd904100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.820+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 shutdown_connections 2024-09-10T20:50:16.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:14.820+0000 7fd90a2c6640 1 -- 172.21.15.67:0/325861603 wait complete. 2024-09-10T20:50:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:16 smithi172 ceph-mon[35265]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:17.141 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:17.141 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:17.141 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:17.142 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:17.603 INFO:teuthology.orchestra.run.smithi067.stdout:227633266727 2024-09-10T20:50:17.604 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T20:50:17.859 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:17 smithi067 ceph-mon[30891]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:17.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:17 smithi083 ceph-mon[35058]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:17.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:17 smithi172 ceph-mon[35265]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:18.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 -- 172.21.15.67:0/1133879377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c109150 msgr2=0x7f974c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 --2- 172.21.15.67:0/1133879377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c109150 0x7f974c10f950 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9744009ca0 tx=0x7f974402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 -- 172.21.15.67:0/1133879377 shutdown_connections 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 --2- 172.21.15.67:0/1133879377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c109150 0x7f974c10f950 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 --2- 172.21.15.67:0/1133879377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c1087d0 0x7f974c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 --2- 172.21.15.67:0/1133879377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c102dc0 0x7f974c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 -- 172.21.15.67:0/1133879377 >> 172.21.15.67:0/1133879377 conn(0x7f974c0fe830 msgr2=0x7f974c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 -- 172.21.15.67:0/1133879377 shutdown_connections 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.285+0000 7f975434f640 1 -- 172.21.15.67:0/1133879377 wait complete. 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 Processor -- start 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 -- start start 2024-09-10T20:50:18.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c102dc0 0x7f974c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c109150 0x7f974c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f974c112dd0 con 0x7f974c1087d0 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f974c112c50 con 0x7f974c102dc0 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f975434f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f974c112f50 con 0x7f974c109150 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f97518ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.286+0000 7f97518ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33408/0 (socket says 172.21.15.67:33408) 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 -- 172.21.15.67:0/1549565330 learned_addr learned my addr 172.21.15.67:0/1549565330 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97528ec640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c109150 0x7f974c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97520eb640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c102dc0 0x7f974c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 -- 172.21.15.67:0/1549565330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c109150 msgr2=0x7f974c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c109150 0x7f974c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 -- 172.21.15.67:0/1549565330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c102dc0 msgr2=0x7f974c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c102dc0 0x7f974c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 -- 172.21.15.67:0/1549565330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c1a7700 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97518ea640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f973c00d950 tx=0x7f973c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c017070 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c1a79f0 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f973c009c30 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c00f620 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.287+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c1a7f30 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.288+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c1031a0 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.290+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f973c010460 con 0x7f974c1087d0 2024-09-10T20:50:18.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.291+0000 7f97437fe640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 0x7f97380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.291+0000 7f97520eb640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 0x7f97380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.291+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f973c0e59d0 con 0x7f974c1087d0 2024-09-10T20:50:18.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.291+0000 7f97520eb640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 0x7f97380b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9748005fd0 tx=0x7f9748005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:18.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.294+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f973c0ac700 con 0x7f974c1087d0 2024-09-10T20:50:18.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.488+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f974c0767a0 con 0x7f974c1087d0 2024-09-10T20:50:18.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.488+0000 7f97437fe640 1 -- 172.21.15.67:0/1549565330 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f974c0767a0 con 0x7f974c1087d0 2024-09-10T20:50:18.493 INFO:teuthology.orchestra.run.smithi067.stdout:171798691889 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.490+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 msgr2=0x7f97380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 0x7f97380b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9748005fd0 tx=0x7f9748005850 comp rx=0 tx=0).stop 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 msgr2=0x7f974c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f973c00d950 tx=0x7f973c00de10 comp rx=0 tx=0).stop 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 shutdown_connections 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97380b5370 0x7f97380b7830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f974c109150 0x7f974c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f974c1087d0 0x7f974c0759e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 --2- 172.21.15.67:0/1549565330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f974c102dc0 0x7f974c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 >> 172.21.15.67:0/1549565330 conn(0x7f974c0fe830 msgr2=0x7f974c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 shutdown_connections 2024-09-10T20:50:18.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.491+0000 7f975434f640 1 -- 172.21.15.67:0/1549565330 wait complete. 2024-09-10T20:50:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1549565330' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T20:50:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:18 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1549565330' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T20:50:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:18 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1549565330' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T20:50:18.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 -- 172.21.15.67:0/2512002012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5314103b30 msgr2=0x7f5314103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 --2- 172.21.15.67:0/2512002012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5314103b30 0x7f5314103f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5310009900 tx=0x7f531002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:18.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 -- 172.21.15.67:0/2512002012 shutdown_connections 2024-09-10T20:50:18.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 --2- 172.21.15.67:0/2512002012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531410d0e0 0x7f531410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 --2- 172.21.15.67:0/2512002012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 --2- 172.21.15.67:0/2512002012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5314103b30 0x7f5314103f10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 -- 172.21.15.67:0/2512002012 >> 172.21.15.67:0/2512002012 conn(0x7f53140fd700 msgr2=0x7f53140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 -- 172.21.15.67:0/2512002012 shutdown_connections 2024-09-10T20:50:18.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.950+0000 7f531b314640 1 -- 172.21.15.67:0/2512002012 wait complete. 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 Processor -- start 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 -- start start 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5314103b30 0x7f531410be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5314112db0 con 0x7f531410d0e0 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5314112c30 con 0x7f5314103b30 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f531b314640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5314112f30 con 0x7f5314104530 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.951+0000 7f53198b1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53198b1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33420/0 (socket says 172.21.15.67:33420) 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53198b1640 1 -- 172.21.15.67:0/2883199668 learned_addr learned my addr 172.21.15.67:0/2883199668 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53190b0640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5314103b30 0x7f531410be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 -- 172.21.15.67:0/2883199668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5314103b30 msgr2=0x7f531410be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5314103b30 0x7f531410be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 -- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 msgr2=0x7f53141a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 -- 172.21.15.67:0/2883199668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141a5900 con 0x7f5314104530 2024-09-10T20:50:18.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53198b1640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f53188af640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410c390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f530400e9f0 tx=0x7f530400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530400ccc0 con 0x7f5314104530 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53040108e0 con 0x7f5314104530 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141a5bf0 con 0x7f5314104530 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304018880 con 0x7f5314104530 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.952+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141ac2b0 con 0x7f5314104530 2024-09-10T20:50:18.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.954+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5314103f10 con 0x7f5314104530 2024-09-10T20:50:18.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.955+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5304010430 con 0x7f5314104530 2024-09-10T20:50:18.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.956+0000 7f530a7fc640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 0x7f53000b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:18.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.956+0000 7f53190b0640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 0x7f53000b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:18.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.956+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53040e6080 con 0x7f5314104530 2024-09-10T20:50:18.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.956+0000 7f53190b0640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 0x7f53000b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5310005ab0 tx=0x7f5310005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:18.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:18.959+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53040ac7c0 con 0x7f5314104530 2024-09-10T20:50:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.147+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f53141ac620 con 0x7f5314104530 2024-09-10T20:50:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.147+0000 7f530a7fc640 1 -- 172.21.15.67:0/2883199668 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53040b11f0 con 0x7f5314104530 2024-09-10T20:50:19.151 INFO:teuthology.orchestra.run.smithi067.stdout:55834574923 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 msgr2=0x7f53000b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 0x7f53000b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5310005ab0 tx=0x7f5310005a20 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 msgr2=0x7f531410c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410c390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f530400e9f0 tx=0x7f530400eeb0 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 shutdown_connections 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f531410d0e0 0x7f53141a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f53000b5370 0x7f53000b7830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5314104530 0x7f531410c390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 --2- 172.21.15.67:0/2883199668 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5314103b30 0x7f531410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 >> 172.21.15.67:0/2883199668 conn(0x7f53140fd700 msgr2=0x7f53140fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:19.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 shutdown_connections 2024-09-10T20:50:19.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:19.150+0000 7f531b314640 1 -- 172.21.15.67:0/2883199668 wait complete. 2024-09-10T20:50:19.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691886 got 171798691889 for osd.6 2024-09-10T20:50:19.390 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:19.693 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:19 smithi067 ceph-mon[30891]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:19.693 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:19 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2883199668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T20:50:19.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:19 smithi083 ceph-mon[35058]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:19.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:19 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2883199668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T20:50:19.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:19 smithi172 ceph-mon[35265]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:19.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:19 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2883199668' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T20:50:20.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 -- 172.21.15.67:0/196671228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6101076a0 msgr2=0x7ff610107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 --2- 172.21.15.67:0/196671228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6101076a0 0x7ff610107ae0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009900 tx=0x7ff5f802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 -- 172.21.15.67:0/196671228 shutdown_connections 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 --2- 172.21.15.67:0/196671228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff610108020 0x7ff61010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 --2- 172.21.15.67:0/196671228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6101076a0 0x7ff610107ae0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 --2- 172.21.15.67:0/196671228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 0x7ff610102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 -- 172.21.15.67:0/196671228 >> 172.21.15.67:0/196671228 conn(0x7ff6100fd700 msgr2=0x7ff6100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 -- 172.21.15.67:0/196671228 shutdown_connections 2024-09-10T20:50:20.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.064+0000 7ff61617d640 1 -- 172.21.15.67:0/196671228 wait complete. 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.065+0000 7ff61617d640 1 Processor -- start 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.065+0000 7ff61617d640 1 -- start start 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.065+0000 7ff61617d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 0x7ff61019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.065+0000 7ff61617d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6101076a0 0x7ff61019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff61617d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff61617d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111c70 con 0x7ff610108020 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff61617d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111af0 con 0x7ff610101c90 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff61617d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111df0 con 0x7ff6101076a0 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33434/0 (socket says 172.21.15.67:33434) 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 -- 172.21.15.67:0/45007672 learned_addr learned my addr 172.21.15.67:0/45007672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff607fff640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6101076a0 0x7ff61019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60f7fe640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 0x7ff61019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 -- 172.21.15.67:0/45007672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6101076a0 msgr2=0x7ff61019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6101076a0 0x7ff61019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 -- 172.21.15.67:0/45007672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 msgr2=0x7ff61019a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 0x7ff61019a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 -- 172.21.15.67:0/45007672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6101a5480 con 0x7ff610108020 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60ffff640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff60800eaa0 tx=0x7ff60800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60800cdb0 con 0x7ff610108020 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff608005020 con 0x7ff610108020 2024-09-10T20:50:20.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.066+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6080116d0 con 0x7ff610108020 2024-09-10T20:50:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.067+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6101a5770 con 0x7ff610108020 2024-09-10T20:50:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.067+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6101a5c30 con 0x7ff610108020 2024-09-10T20:50:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.068+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610102070 con 0x7ff610108020 2024-09-10T20:50:20.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.069+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff60800f040 con 0x7ff610108020 2024-09-10T20:50:20.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.070+0000 7ff60d7fa640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 0x7ff5fc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.070+0000 7ff60f7fe640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 0x7ff5fc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.070+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff6080e59f0 con 0x7ff610108020 2024-09-10T20:50:20.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.070+0000 7ff60f7fe640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 0x7ff5fc0b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff600005d00 tx=0x7ff60000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:20.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.074+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff608016030 con 0x7ff610108020 2024-09-10T20:50:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.263+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff61002e5c0 con 0x7ff610108020 2024-09-10T20:50:20.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.264+0000 7ff60d7fa640 1 -- 172.21.15.67:0/45007672 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff6080ac130 con 0x7ff610108020 2024-09-10T20:50:20.268 INFO:teuthology.orchestra.run.smithi067.stdout:128849018939 2024-09-10T20:50:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 msgr2=0x7ff5fc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 0x7ff5fc0b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff600005d00 tx=0x7ff60000b410 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 msgr2=0x7ff61019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff60800eaa0 tx=0x7ff60800ef60 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 shutdown_connections 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff610108020 0x7ff61019ab40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5fc0b53f0 0x7ff5fc0b78b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6101076a0 0x7ff61019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 --2- 172.21.15.67:0/45007672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff610101c90 0x7ff61019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 >> 172.21.15.67:0/45007672 conn(0x7ff6100fd700 msgr2=0x7ff6100ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 shutdown_connections 2024-09-10T20:50:20.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7ff61617d640 1 -- 172.21.15.67:0/45007672 wait complete. 2024-09-10T20:50:20.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 -- 172.21.15.67:0/3444711293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 msgr2=0x7fa1c010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 --2- 172.21.15.67:0/3444711293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c010e820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009ca0 tx=0x7fa1b802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 -- 172.21.15.67:0/3444711293 shutdown_connections 2024-09-10T20:50:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 --2- 172.21.15.67:0/3444711293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c010e820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 --2- 172.21.15.67:0/3444711293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c01076a0 0x7fa1c0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 --2- 172.21.15.67:0/3444711293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c0101c90 0x7fa1c0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 -- 172.21.15.67:0/3444711293 >> 172.21.15.67:0/3444711293 conn(0x7fa1c00fd700 msgr2=0x7fa1c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 -- 172.21.15.67:0/3444711293 shutdown_connections 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.265+0000 7fa1c704a640 1 -- 172.21.15.67:0/3444711293 wait complete. 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7fa1c704a640 1 Processor -- start 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7fa1c704a640 1 -- start start 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7fa1c704a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.266+0000 7fa1c704a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c01076a0 0x7fa1c01975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c704a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c704a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c0110c20 con 0x7fa1c0108020 2024-09-10T20:50:20.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c704a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c0110aa0 con 0x7fa1c01076a0 2024-09-10T20:50:20.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c704a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c0110da0 con 0x7fa1c0101c90 2024-09-10T20:50:20.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52116/0 (socket says 172.21.15.67:52116) 2024-09-10T20:50:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c55e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 -- 172.21.15.67:0/623292066 learned_addr learned my addr 172.21.15.67:0/623292066 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1bffff640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c01076a0 0x7fa1c01975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 -- 172.21.15.67:0/623292066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c01076a0 msgr2=0x7fa1c01975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c01076a0 0x7fa1c01975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 -- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 msgr2=0x7fa1c019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 -- 172.21.15.67:0/623292066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c019d150 con 0x7fa1c0101c90 2024-09-10T20:50:20.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.267+0000 7fa1c4de6640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009990 tx=0x7fa1b4009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:20.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.268+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b401b070 con 0x7fa1c0101c90 2024-09-10T20:50:20.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.268+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1b4016410 con 0x7fa1c0101c90 2024-09-10T20:50:20.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.268+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c019d440 con 0x7fa1c0101c90 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.268+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4015610 con 0x7fa1c0101c90 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.268+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c01a3b00 con 0x7fa1c0101c90 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.269+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c0102070 con 0x7fa1c0101c90 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.270+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa1b400c9e0 con 0x7fa1c0101c90 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.271+0000 7fa1bdffb640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 0x7fa1b00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:20.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.271+0000 7fa1bffff640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 0x7fa1b00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.271+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa1b40e5440 con 0x7fa1c0101c90 2024-09-10T20:50:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.272+0000 7fa1bffff640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 0x7fa1b00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0104160 tx=0x7fa1ac011040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:20.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.274+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa1b40abb80 con 0x7fa1c0101c90 2024-09-10T20:50:20.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.469+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa1c01981d0 con 0x7fa1c0101c90 2024-09-10T20:50:20.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.470+0000 7fa1bdffb640 1 -- 172.21.15.67:0/623292066 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1c01981d0 con 0x7fa1c0101c90 2024-09-10T20:50:20.474 INFO:teuthology.orchestra.run.smithi067.stdout:34359738447 2024-09-10T20:50:20.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 msgr2=0x7fa1b00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 0x7fa1b00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0104160 tx=0x7fa1ac011040 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 msgr2=0x7fa1c01970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009990 tx=0x7fa1b4009e50 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 shutdown_connections 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa1c0108020 0x7fa1c019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1c01076a0 0x7fa1c01975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa1b00b5370 0x7fa1b00b7830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 --2- 172.21.15.67:0/623292066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0101c90 0x7fa1c01970a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 >> 172.21.15.67:0/623292066 conn(0x7fa1c00fd700 msgr2=0x7fa1c00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 shutdown_connections 2024-09-10T20:50:20.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:20.472+0000 7fa1c704a640 1 -- 172.21.15.67:0/623292066 wait complete. 2024-09-10T20:50:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:20 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/45007672' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T20:50:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:20 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/623292066' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T20:50:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:20 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:50:20.892 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:20 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/45007672' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T20:50:20.892 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:20 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/623292066' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T20:50:20.892 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:20 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:50:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:20 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/45007672' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T20:50:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:20 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/623292066' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T20:50:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:20 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:50:21.225 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:21.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-09-10T20:50:21.255 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:21.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:21 smithi067 ceph-mon[30891]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:21.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:21 smithi083 ceph-mon[35058]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:21.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2024-09-10T20:50:21.895 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:21.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:21 smithi172 ceph-mon[35265]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:22.321 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018937 got 128849018939 for osd.4 2024-09-10T20:50:22.321 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 -- 172.21.15.67:0/1673956849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc8103bb0 msgr2=0x7fccc8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 --2- 172.21.15.67:0/1673956849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc8103bb0 0x7fccc8103f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fccb8009900 tx=0x7fccb802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 -- 172.21.15.67:0/1673956849 shutdown_connections 2024-09-10T20:50:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 --2- 172.21.15.67:0/1673956849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 0x7fccc810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 --2- 172.21.15.67:0/1673956849 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc81045b0 0x7fccc810cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 --2- 172.21.15.67:0/1673956849 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc8103bb0 0x7fccc8103f90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 -- 172.21.15.67:0/1673956849 >> 172.21.15.67:0/1673956849 conn(0x7fccc80fd700 msgr2=0x7fccc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 -- 172.21.15.67:0/1673956849 shutdown_connections 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.810+0000 7fcccc856640 1 -- 172.21.15.67:0/1673956849 wait complete. 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 Processor -- start 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 -- start start 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc8103bb0 0x7fccc8101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 0x7fccc81024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8112de0 con 0x7fccc81045b0 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8112c60 con 0x7fccc8103bb0 2024-09-10T20:50:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fcccc856640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8112f60 con 0x7fccc810d160 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43684/0 (socket says 172.21.15.67:43684) 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 -- 172.21.15.67:0/4166097515 learned_addr learned my addr 172.21.15.67:0/4166097515 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccc6d9d640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 0x7fccc81024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccc659c640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc8103bb0 0x7fccc8101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 -- 172.21.15.67:0/4166097515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 msgr2=0x7fccc81024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 0x7fccc81024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 -- 172.21.15.67:0/4166097515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc8103bb0 msgr2=0x7fccc8101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc8103bb0 0x7fccc8101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 -- 172.21.15.67:0/4166097515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc81a7710 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.811+0000 7fccbffff640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b4a0 tx=0x7fccb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.812+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0014070 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.812+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccb0010ac0 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.812+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc81a7a00 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.812+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017c30 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.812+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc81a7f90 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.813+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc8103f90 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.815+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fccb0010610 con 0x7fccc81045b0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.816+0000 7fccbf7fe640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 0x7fccb40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.816+0000 7fccc659c640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 0x7fccb40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.816+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fccb00e5580 con 0x7fccc81045b0 2024-09-10T20:50:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.816+0000 7fccc659c640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 0x7fccb40b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fccb8031440 tx=0x7fccb80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:22.819+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fccb00ac310 con 0x7fccc81045b0 2024-09-10T20:50:22.861 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:22.862 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:22.862 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:22.863 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:22.990 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:22.990 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:22.990 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:22.990 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:22 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.028+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fccc81a8380 con 0x7fccc81045b0 2024-09-10T20:50:23.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.029+0000 7fccbf7fe640 1 -- 172.21.15.67:0/4166097515 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fccb00abc10 con 0x7fccc81045b0 2024-09-10T20:50:23.033 INFO:teuthology.orchestra.run.smithi067.stdout:146028888119 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 msgr2=0x7fccb40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 0x7fccb40b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fccb8031440 tx=0x7fccb80095f0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 msgr2=0x7fccc8101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b4a0 tx=0x7fccb000b960 comp rx=0 tx=0).stop 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 shutdown_connections 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccb40b53f0 0x7fccb40b78b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccc810d160 0x7fccc81024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccc81045b0 0x7fccc8101f70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 --2- 172.21.15.67:0/4166097515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccc8103bb0 0x7fccc8101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 >> 172.21.15.67:0/4166097515 conn(0x7fccc80fd700 msgr2=0x7fccc810f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 shutdown_connections 2024-09-10T20:50:23.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.031+0000 7fcccc856640 1 -- 172.21.15.67:0/4166097515 wait complete. 2024-09-10T20:50:23.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:22 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:22 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:23.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 -- 172.21.15.67:0/3488191031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b101076a0 msgr2=0x7f4b10107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 --2- 172.21.15.67:0/3488191031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b101076a0 0x7f4b10107ae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4b04009900 tx=0x7f4b0402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:23.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 -- 172.21.15.67:0/3488191031 shutdown_connections 2024-09-10T20:50:23.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 --2- 172.21.15.67:0/3488191031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b10108020 0x7f4b1010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 --2- 172.21.15.67:0/3488191031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b101076a0 0x7f4b10107ae0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 --2- 172.21.15.67:0/3488191031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10101c90 0x7f4b10102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 -- 172.21.15.67:0/3488191031 >> 172.21.15.67:0/3488191031 conn(0x7f4b100fd700 msgr2=0x7f4b100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 -- 172.21.15.67:0/3488191031 shutdown_connections 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 -- 172.21.15.67:0/3488191031 wait complete. 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.591+0000 7f4b15e94640 1 Processor -- start 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 -- start start 2024-09-10T20:50:23.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b101076a0 0x7f4b10199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10108020 0x7f4b1019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10111ce0 con 0x7f4b10101c90 2024-09-10T20:50:23.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10111b60 con 0x7f4b101076a0 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b15e94640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10111e60 con 0x7f4b10108020 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43714/0 (socket says 172.21.15.67:43714) 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 -- 172.21.15.67:0/14807689 learned_addr learned my addr 172.21.15.67:0/14807689 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0ffff640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10108020 0x7f4b1019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0effd640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b101076a0 0x7f4b10199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 -- 172.21.15.67:0/14807689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10108020 msgr2=0x7f4b1019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10108020 0x7f4b1019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 -- 172.21.15.67:0/14807689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b101076a0 msgr2=0x7f4b10199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b101076a0 0x7f4b10199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.592+0000 7f4b0f7fe640 1 -- 172.21.15.67:0/14807689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1019f2e0 con 0x7f4b10101c90 2024-09-10T20:50:23.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b0f7fe640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c970 tx=0x7f4b0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00007bb0 con 0x7f4b10101c90 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1019f5d0 con 0x7f4b10101c90 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b00007d50 con 0x7f4b10101c90 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000f450 con 0x7f4b10101c90 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.593+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b100fdae0 con 0x7f4b10101c90 2024-09-10T20:50:23.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.594+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b10102070 con 0x7f4b10101c90 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.595+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4b00004f00 con 0x7f4b10101c90 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.596+0000 7f4b0cff9640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 0x7f4af80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.596+0000 7f4b0effd640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 0x7f4af80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.596+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4b000e5f00 con 0x7f4b10101c90 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.597+0000 7f4b0effd640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 0x7f4af80b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b04031440 tx=0x7f4b040095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:23.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.599+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4b00014030 con 0x7f4b10101c90 2024-09-10T20:50:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.786+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4b1010ae70 con 0x7f4b10101c90 2024-09-10T20:50:23.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.787+0000 7f4b0cff9640 1 -- 172.21.15.67:0/14807689 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4b000acc90 con 0x7f4b10101c90 2024-09-10T20:50:23.791 INFO:teuthology.orchestra.run.smithi067.stdout:103079215168 2024-09-10T20:50:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 msgr2=0x7f4af80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 0x7f4af80b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b04031440 tx=0x7f4b040095f0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 msgr2=0x7f4b10199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c970 tx=0x7f4b0000ce30 comp rx=0 tx=0).stop 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 shutdown_connections 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4af80b5370 0x7f4af80b7830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10108020 0x7f4b1019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b101076a0 0x7f4b10199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 --2- 172.21.15.67:0/14807689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b10101c90 0x7f4b10199230 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 >> 172.21.15.67:0/14807689 conn(0x7f4b100fd700 msgr2=0x7f4b1006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 shutdown_connections 2024-09-10T20:50:23.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.789+0000 7f4b15e94640 1 -- 172.21.15.67:0/14807689 wait complete. 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 -- 172.21.15.67:0/896983110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c101c90 msgr2=0x7f530c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 --2- 172.21.15.67:0/896983110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c101c90 0x7f530c102070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5308009900 tx=0x7f530802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 -- 172.21.15.67:0/896983110 shutdown_connections 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 --2- 172.21.15.67:0/896983110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c108020 0x7f530c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 --2- 172.21.15.67:0/896983110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 0x7f530c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 --2- 172.21.15.67:0/896983110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c101c90 0x7f530c102070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 -- 172.21.15.67:0/896983110 >> 172.21.15.67:0/896983110 conn(0x7f530c0fd700 msgr2=0x7f530c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 -- 172.21.15.67:0/896983110 shutdown_connections 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.820+0000 7f5313a6c640 1 -- 172.21.15.67:0/896983110 wait complete. 2024-09-10T20:50:23.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 Processor -- start 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 -- start start 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c101c90 0x7f530c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 0x7f530c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f530c111ce0 con 0x7f530c108020 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f530c111b60 con 0x7f530c1076a0 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5313a6c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f530c111e60 con 0x7f530c101c90 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43742/0 (socket says 172.21.15.67:43742) 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 -- 172.21.15.67:0/2746630969 learned_addr learned my addr 172.21.15.67:0/2746630969 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5311007640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 0x7f530c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5311808640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c101c90 0x7f530c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 -- 172.21.15.67:0/2746630969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c101c90 msgr2=0x7f530c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c101c90 0x7f530c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 -- 172.21.15.67:0/2746630969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 msgr2=0x7f530c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 0x7f530c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 -- 172.21.15.67:0/2746630969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c1a5470 con 0x7f530c108020 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.821+0000 7f5312009640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f530400eaa0 tx=0x7f530400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.822+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530400cdb0 con 0x7f530c108020 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.822+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5304005020 con 0x7f530c108020 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.822+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53040116d0 con 0x7f530c108020 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.822+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c197e80 con 0x7f530c108020 2024-09-10T20:50:23.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.822+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c198410 con 0x7f530c108020 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.823+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530c102070 con 0x7f530c108020 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.825+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f530400f040 con 0x7f530c108020 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.826+0000 7f5302ffd640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 0x7f52f80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.826+0000 7f5311808640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 0x7f52f80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.826+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53040e5e50 con 0x7f530c108020 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.826+0000 7f5311808640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 0x7f52f80b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5308031440 tx=0x7f53080095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:23.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:23.829+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5304016030 con 0x7f530c108020 2024-09-10T20:50:24.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.021+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f530c06aec0 con 0x7f530c108020 2024-09-10T20:50:24.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.022+0000 7f5302ffd640 1 -- 172.21.15.67:0/2746630969 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f53040acc60 con 0x7f530c108020 2024-09-10T20:50:24.026 INFO:teuthology.orchestra.run.smithi067.stdout:287762808857 2024-09-10T20:50:24.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 msgr2=0x7f52f80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 0x7f52f80b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5308031440 tx=0x7f53080095f0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 msgr2=0x7f530c19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f530400eaa0 tx=0x7f530400ef60 comp rx=0 tx=0).stop 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 shutdown_connections 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f530c108020 0x7f530c19ab30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f530c1076a0 0x7f530c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f52f80b53f0 0x7f52f80b78b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 --2- 172.21.15.67:0/2746630969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f530c101c90 0x7f530c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 >> 172.21.15.67:0/2746630969 conn(0x7f530c0fd700 msgr2=0x7f530c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 shutdown_connections 2024-09-10T20:50:24.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.024+0000 7f5313a6c640 1 -- 172.21.15.67:0/2746630969 wait complete. 2024-09-10T20:50:24.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:23 smithi172 ceph-mon[35265]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:24.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4166097515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T20:50:24.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:23 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/14807689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T20:50:24.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:23 smithi067 ceph-mon[30891]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:24.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4166097515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T20:50:24.200 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:23 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/14807689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 -- 172.21.15.67:0/2791809366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a01055d0 msgr2=0x7f59a0105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 --2- 172.21.15.67:0/2791809366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a01055d0 0x7f59a0105a50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5994009900 tx=0x7f599402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 -- 172.21.15.67:0/2791809366 shutdown_connections 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 --2- 172.21.15.67:0/2791809366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a0105f90 0x7f59a010f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 --2- 172.21.15.67:0/2791809366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a01055d0 0x7f59a0105a50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 --2- 172.21.15.67:0/2791809366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01012b0 0x7f59a0101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.037+0000 7f59a6622640 1 -- 172.21.15.67:0/2791809366 >> 172.21.15.67:0/2791809366 conn(0x7f59a0078140 msgr2=0x7f59a00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.038+0000 7f59a6622640 1 -- 172.21.15.67:0/2791809366 shutdown_connections 2024-09-10T20:50:24.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.038+0000 7f59a6622640 1 -- 172.21.15.67:0/2791809366 wait complete. 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.038+0000 7f59a6622640 1 Processor -- start 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.038+0000 7f59a6622640 1 -- start start 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01012b0 0x7f59a0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01055d0 0x7f59a0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0112db0 con 0x7f59a0105f90 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0112c30 con 0x7f59a01055d0 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a6622640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0112f30 con 0x7f59a01012b0 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f599f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01055d0 0x7f59a0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43766/0 (socket says 172.21.15.67:43766) 2024-09-10T20:50:24.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 -- 172.21.15.67:0/1986566115 learned_addr learned my addr 172.21.15.67:0/1986566115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stdout:197568495661 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f599ffff640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01012b0 0x7f59a0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 -- 172.21.15.67:0/1986566115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01012b0 msgr2=0x7f59a0199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01012b0 0x7f59a0199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 -- 172.21.15.67:0/1986566115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01055d0 msgr2=0x7f59a0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01055d0 0x7f59a0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 -- 172.21.15.67:0/1986566115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a019f2f0 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.039+0000 7f59a4bbf640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f599800ea60 tx=0x7f599800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.040+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599800cd80 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.040+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a019f5e0 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.040+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5998005020 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.040+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998010690 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.040+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01a5ca0 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.041+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a0101690 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.042+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f59980054d0 con 0x7f59a0105f90 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.043+0000 7f599d7fa640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 0x7f59880b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.043+0000 7f599ffff640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 0x7f59880b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:24.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.043+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f59980e6220 con 0x7f59a0105f90 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.044+0000 7f599ffff640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 0x7f59880b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f599000abe0 tx=0x7f599000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.048+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f59980acfb0 con 0x7f59a0105f90 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.239+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f59a01a6000 con 0x7f59a0105f90 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.240+0000 7f599d7fa640 1 -- 172.21.15.67:0/1986566115 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f59980ac8b0 con 0x7f59a0105f90 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 msgr2=0x7f59880b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 0x7f59880b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f599000abe0 tx=0x7f599000a2d0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 msgr2=0x7f59a019eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f599800ea60 tx=0x7f599800ee60 comp rx=0 tx=0).stop 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 shutdown_connections 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59a0105f90 0x7f59a019eb20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59a01055d0 0x7f59a0199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f59880b5370 0x7f59880b7830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 --2- 172.21.15.67:0/1986566115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01012b0 0x7f59a0199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 >> 172.21.15.67:0/1986566115 conn(0x7f59a0078140 msgr2=0x7f59a0106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 shutdown_connections 2024-09-10T20:50:24.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:24.242+0000 7f59a6622640 1 -- 172.21.15.67:0/1986566115 wait complete. 2024-09-10T20:50:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:23 smithi083 ceph-mon[35058]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T20:50:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4166097515' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T20:50:24.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:23 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/14807689' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T20:50:24.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495658 got 197568495661 for osd.7 2024-09-10T20:50:24.985 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:25.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:24 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2746630969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T20:50:25.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:24 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1986566115' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T20:50:25.292 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:24 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2746630969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T20:50:25.293 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:24 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1986566115' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T20:50:25.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:24 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2746630969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T20:50:25.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:24 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1986566115' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T20:50:25.821 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888117 got 146028888119 for osd.5 2024-09-10T20:50:25.821 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:26.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:25 smithi067 ceph-mon[30891]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/1497616289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 msgr2=0x7f5f8810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/1497616289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8810f950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009ca0 tx=0x7f5f8002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/1497616289 shutdown_connections 2024-09-10T20:50:26.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/1497616289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8810f950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/1497616289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/1497616289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/1497616289 >> 172.21.15.67:0/1497616289 conn(0x7f5f880fe830 msgr2=0x7f5f88100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/1497616289 shutdown_connections 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.159+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/1497616289 wait complete. 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 Processor -- start 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 -- start start 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f88199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112e10 con 0x7f5f88109150 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112c90 con 0x7f5f88102dc0 2024-09-10T20:50:26.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f8d5ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112f90 con 0x7f5f881087d0 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.160+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f86ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f88199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43784/0 (socket says 172.21.15.67:43784) 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 -- 172.21.15.67:0/516029939 learned_addr learned my addr 172.21.15.67:0/516029939 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f867fc640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 -- 172.21.15.67:0/516029939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 msgr2=0x7f5f88199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 -- 172.21.15.67:0/516029939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 msgr2=0x7f5f88199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f88199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 -- 172.21.15.67:0/516029939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8819f2f0 con 0x7f5f88109150 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f867fc640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f86ffd640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f88199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:50:26.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f877fe640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5f800098d0 tx=0x7f5f800317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003b70 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f80003d10 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f8819f580 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8002fa20 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.161+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a5ca0 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.162+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f881031a0 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.164+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5f8002fbe0 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.164+0000 7f5f6ffff640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 0x7f5f700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.165+0000 7f5f86ffd640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 0x7f5f700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.165+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5f801071d0 con 0x7f5f88109150 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.165+0000 7f5f86ffd640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 0x7f5f700b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009fc0 tx=0x7f5f78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:26.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.168+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5f800cdf60 con 0x7f5f88109150 2024-09-10T20:50:26.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:25 smithi172 ceph-mon[35265]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:26.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.356+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5f881a5f60 con 0x7f5f88109150 2024-09-10T20:50:26.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.357+0000 7f5f6ffff640 1 -- 172.21.15.67:0/516029939 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5f800cd860 con 0x7f5f88109150 2024-09-10T20:50:26.361 INFO:teuthology.orchestra.run.smithi067.stdout:266287972381 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 msgr2=0x7f5f700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 0x7f5f700b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009fc0 tx=0x7f5f78005f90 comp rx=0 tx=0).stop 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 msgr2=0x7f5f8819eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5f800098d0 tx=0x7f5f800317b0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 shutdown_connections 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f88109150 0x7f5f8819eb20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5f700b5370 0x7f5f700b7830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f881087d0 0x7f5f88199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 --2- 172.21.15.67:0/516029939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f88102dc0 0x7f5f88199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:26.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 >> 172.21.15.67:0/516029939 conn(0x7f5f880fe830 msgr2=0x7f5f88100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:26.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 shutdown_connections 2024-09-10T20:50:26.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:26.359+0000 7f5f8d5ee640 1 -- 172.21.15.67:0/516029939 wait complete. 2024-09-10T20:50:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:25 smithi083 ceph-mon[35058]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:26.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808853 got 287762808857 for osd.11 2024-09-10T20:50:26.666 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 -- 172.21.15.67:0/958674398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac10d140 msgr2=0x7fd1ac10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/958674398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac10d140 0x7fd1ac10f5a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009ca0 tx=0x7fd1a402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 -- 172.21.15.67:0/958674398 shutdown_connections 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/958674398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac10d140 0x7fd1ac10f5a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/958674398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac104600 0x7fd1ac10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/958674398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac103ce0 0x7fd1ac1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 -- 172.21.15.67:0/958674398 >> 172.21.15.67:0/958674398 conn(0x7fd1ac0fd700 msgr2=0x7fd1ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 -- 172.21.15.67:0/958674398 shutdown_connections 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.049+0000 7fd1b08fb640 1 -- 172.21.15.67:0/958674398 wait complete. 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.050+0000 7fd1b08fb640 1 Processor -- start 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.050+0000 7fd1b08fb640 1 -- start start 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.050+0000 7fd1b08fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac103ce0 0x7fd1ac199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.050+0000 7fd1b08fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1b08fb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac10d140 0x7fd1ac19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:27.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1b08fb640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac112db0 con 0x7fd1ac104600 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1b08fb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac112c30 con 0x7fd1ac10d140 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1b08fb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac112f30 con 0x7fd1ac103ce0 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43812/0 (socket says 172.21.15.67:43812) 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 -- 172.21.15.67:0/4015169245 learned_addr learned my addr 172.21.15.67:0/4015169245 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1aad9d640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac10d140 0x7fd1ac19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1aa59c640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac103ce0 0x7fd1ac199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 -- 172.21.15.67:0/4015169245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac103ce0 msgr2=0x7fd1ac199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac103ce0 0x7fd1ac199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 -- 172.21.15.67:0/4015169245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac10d140 msgr2=0x7fd1ac19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac10d140 0x7fd1ac19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 -- 172.21.15.67:0/4015169245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac19f330 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1a9d9b640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d6b0 tx=0x7fd1a000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0017070 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1a0010460 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.051+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac19f620 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.052+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000f620 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.052+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac1a5ce0 con 0x7fd1ac104600 2024-09-10T20:50:27.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.053+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac1040c0 con 0x7fd1ac104600 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.054+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd1a0010930 con 0x7fd1ac104600 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.055+0000 7fd19b7fe640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 0x7fd1940b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.055+0000 7fd1aa59c640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 0x7fd1940b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.055+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd1a00e58b0 con 0x7fd1ac104600 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.055+0000 7fd1aa59c640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 0x7fd1940b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009bd0 tx=0x7fd19c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:27.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.058+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1a00ac070 con 0x7fd1ac104600 2024-09-10T20:50:27.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:26 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/516029939' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T20:50:27.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.246+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1ac1a6060 con 0x7fd1ac104600 2024-09-10T20:50:27.250 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:26 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/516029939' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T20:50:27.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.246+0000 7fd19b7fe640 1 -- 172.21.15.67:0/4015169245 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1a00b3e20 con 0x7fd1ac104600 2024-09-10T20:50:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:73014444104 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.248+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 msgr2=0x7fd1940b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.248+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 0x7fd1940b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009bd0 tx=0x7fd19c005f90 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.248+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 msgr2=0x7fd1ac1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.248+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d6b0 tx=0x7fd1a000db70 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 shutdown_connections 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1ac10d140 0x7fd1ac19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd1ac104600 0x7fd1ac1997c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd1940b53f0 0x7fd1940b78b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 --2- 172.21.15.67:0/4015169245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac103ce0 0x7fd1ac199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:27.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 >> 172.21.15.67:0/4015169245 conn(0x7fd1ac0fd700 msgr2=0x7fd1ac0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 shutdown_connections 2024-09-10T20:50:27.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:27.249+0000 7fd1b08fb640 1 -- 172.21.15.67:0/4015169245 wait complete. 2024-09-10T20:50:27.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:26 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/516029939' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T20:50:27.510 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215168 for osd.3 2024-09-10T20:50:27.511 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:28.145 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:27 smithi067 ceph-mon[30891]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:28.146 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:27 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4015169245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T20:50:28.173 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444101 got 73014444104 for osd.2 2024-09-10T20:50:28.173 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:28.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:27 smithi172 ceph-mon[35265]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:28.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:27 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4015169245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T20:50:28.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:27 smithi083 ceph-mon[35058]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:28.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:27 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4015169245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T20:50:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- 172.21.15.67:0/320477472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0102de0 msgr2=0x7effd01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- 172.21.15.67:0/320477472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0102de0 0x7effd01031c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effc4009900 tx=0x7effc402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- 172.21.15.67:0/320477472 shutdown_connections 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- 172.21.15.67:0/320477472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0109170 0x7effd010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- 172.21.15.67:0/320477472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 0x7effd0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- 172.21.15.67:0/320477472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0102de0 0x7effd01031c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- 172.21.15.67:0/320477472 >> 172.21.15.67:0/320477472 conn(0x7effd00fe830 msgr2=0x7effd0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- 172.21.15.67:0/320477472 shutdown_connections 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- 172.21.15.67:0/320477472 wait complete. 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 Processor -- start 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 -- start start 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0102de0 0x7effd0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:28.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.627+0000 7effd6c33640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 0x7effd0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd6c33640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd6c33640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effd0112df0 con 0x7effd0109170 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd6c33640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7effd0112c70 con 0x7effd01087f0 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd6c33640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effd0112f70 con 0x7effd0102de0 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43838/0 (socket says 172.21.15.67:43838) 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 -- 172.21.15.67:0/1522100180 learned_addr learned my addr 172.21.15.67:0/1522100180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effcffff640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 0x7effd0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd49cf640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0102de0 0x7effd0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 -- 172.21.15.67:0/1522100180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0102de0 msgr2=0x7effd0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0102de0 0x7effd0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 -- 172.21.15.67:0/1522100180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 msgr2=0x7effd0199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:28.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 0x7effd0199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 -- 172.21.15.67:0/1522100180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd019f3d0 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd51d0640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7effc800cad0 tx=0x7effc800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc800ae20 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc8005020 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd019f6c0 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.628+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc800f6b0 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.629+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd01a5d80 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.630+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd01031c0 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.631+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7effc80054f0 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.632+0000 7effcdffb640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 0x7effc00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.632+0000 7effd49cf640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 0x7effc00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.632+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7effc80e6000 con 0x7effd0109170 2024-09-10T20:50:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.632+0000 7effd49cf640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 0x7effc00b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effc4031440 tx=0x7effc4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:28.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.635+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7effc8014030 con 0x7effd0109170 2024-09-10T20:50:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.824+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7effd019a450 con 0x7effd0109170 2024-09-10T20:50:28.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.824+0000 7effcdffb640 1 -- 172.21.15.67:0/1522100180 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7effc80ac740 con 0x7effd0109170 2024-09-10T20:50:28.828 INFO:teuthology.orchestra.run.smithi067.stdout:227633266729 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 msgr2=0x7effc00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 0x7effc00b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7effc4031440 tx=0x7effc4005b50 comp rx=0 tx=0).stop 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 msgr2=0x7effd019ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7effc800cad0 tx=0x7effc800cf90 comp rx=0 tx=0).stop 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 shutdown_connections 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effd0109170 0x7effd019ec00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effd01087f0 0x7effd0199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7effc00b5370 0x7effc00b7830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 --2- 172.21.15.67:0/1522100180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effd0102de0 0x7effd0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.826+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 >> 172.21.15.67:0/1522100180 conn(0x7effd00fe830 msgr2=0x7effd0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.827+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 shutdown_connections 2024-09-10T20:50:28.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:28.827+0000 7effd6c33640 1 -- 172.21.15.67:0/1522100180 wait complete. 2024-09-10T20:50:28.949 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:29.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:28 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1522100180' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T20:50:29.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:28 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1522100180' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T20:50:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:28 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1522100180' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T20:50:29.628 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972378 got 266287972381 for osd.10 2024-09-10T20:50:29.628 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:30.161 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:29 smithi067 ceph-mon[30891]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3223720576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c1023f0 msgr2=0x7fbd4c1068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3223720576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c1068c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009900 tx=0x7fbd4002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3223720576 shutdown_connections 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3223720576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c106f10 0x7fbd4c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3223720576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c1068c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3223720576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3223720576 >> 172.21.15.67:0/3223720576 conn(0x7fbd4c0fd700 msgr2=0x7fbd4c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3223720576 shutdown_connections 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.239+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3223720576 wait complete. 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 Processor -- start 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 -- start start 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c1193a0 con 0x7fbd4c106f10 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c119220 con 0x7fbd4c101ad0 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd53c7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c119520 con 0x7fbd4c1023f0 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43862/0 (socket says 172.21.15.67:43862) 2024-09-10T20:50:30.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 -- 172.21.15.67:0/3114700675 learned_addr learned my addr 172.21.15.67:0/3114700675 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd51a1a640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd51219640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 -- 172.21.15.67:0/3114700675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c1023f0 msgr2=0x7fbd4c19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 -- 172.21.15.67:0/3114700675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 msgr2=0x7fbd4c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c19f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.240+0000 7fbd5221b640 1 -- 172.21.15.67:0/3114700675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c1a5960 con 0x7fbd4c106f10 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd51a1a640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd5221b640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c970 tx=0x7fbd4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44007bb0 con 0x7fbd4c106f10 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1a5c50 con 0x7fbd4c106f10 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd44007d50 con 0x7fbd4c106f10 2024-09-10T20:50:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44004e60 con 0x7fbd4c106f10 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.241+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c1ac310 con 0x7fbd4c106f10 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.242+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4c1068c0 con 0x7fbd4c106f10 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.243+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbd44005000 con 0x7fbd4c106f10 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.244+0000 7fbd4affd640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 0x7fbd340b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.244+0000 7fbd51a1a640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 0x7fbd340b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.244+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbd440e5e80 con 0x7fbd4c106f10 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.245+0000 7fbd51a1a640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 0x7fbd340b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c005fd0 tx=0x7fbd3c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:30.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.247+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd44014030 con 0x7fbd4c106f10 2024-09-10T20:50:30.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:29 smithi083 ceph-mon[35058]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:30.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.434+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbd4c1ac6a0 con 0x7fbd4c106f10 2024-09-10T20:50:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.435+0000 7fbd4affd640 1 -- 172.21.15.67:0/3114700675 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd440acc10 con 0x7fbd4c106f10 2024-09-10T20:50:30.440 INFO:teuthology.orchestra.run.smithi067.stdout:249108103204 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 msgr2=0x7fbd340b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 0x7fbd340b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c005fd0 tx=0x7fbd3c009500 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 msgr2=0x7fbd4c1a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400c970 tx=0x7fbd4400ce30 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 shutdown_connections 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd4c106f10 0x7fbd4c1a5190 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd340b5370 0x7fbd340b7830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c1023f0 0x7fbd4c19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 --2- 172.21.15.67:0/3114700675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd4c101ad0 0x7fbd4c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:30.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 >> 172.21.15.67:0/3114700675 conn(0x7fbd4c0fd700 msgr2=0x7fbd4c104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 shutdown_connections 2024-09-10T20:50:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:30.437+0000 7fbd53c7e640 1 -- 172.21.15.67:0/3114700675 wait complete. 2024-09-10T20:50:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:29 smithi172 ceph-mon[35265]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:31.150 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:30 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3114700675' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T20:50:31.184 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266727 got 227633266729 for osd.8 2024-09-10T20:50:31.184 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:31.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:30 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3114700675' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T20:50:31.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:30 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3114700675' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T20:50:31.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103201 got 249108103204 for osd.9 2024-09-10T20:50:31.870 DEBUG:teuthology.parallel:result is None 2024-09-10T20:50:31.870 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T20:50:31.870 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T20:50:32.149 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:32.277 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:31 smithi067 ceph-mon[30891]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:31 smithi083 ceph-mon[35058]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:31 smithi172 ceph-mon[35265]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 -- 172.21.15.67:0/3329925716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 msgr2=0x7f93e4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/3329925716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e4102070 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f93d4009900 tx=0x7f93d402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:32.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 -- 172.21.15.67:0/3329925716 shutdown_connections 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/3329925716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/3329925716 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 0x7f93e4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/3329925716 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e4102070 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 -- 172.21.15.67:0/3329925716 >> 172.21.15.67:0/3329925716 conn(0x7f93e40fd700 msgr2=0x7f93e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 -- 172.21.15.67:0/3329925716 shutdown_connections 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 -- 172.21.15.67:0/3329925716 wait complete. 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.667+0000 7f93e8ffa640 1 Processor -- start 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 -- start start 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 0x7f93e4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:32.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4112e30 con 0x7f93e4101c90 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4112cb0 con 0x7f93e41076a0 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e8ffa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93e4112fb0 con 0x7f93e4108020 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50336/0 (socket says 172.21.15.67:50336) 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 -- 172.21.15.67:0/2651002971 learned_addr learned my addr 172.21.15.67:0/2651002971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93d9d9b640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 0x7f93e4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 -- 172.21.15.67:0/2651002971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 msgr2=0x7f93e419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 -- 172.21.15.67:0/2651002971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 msgr2=0x7f93e4199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 0x7f93e4199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e259c640 1 -- 172.21.15.67:0/2651002971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e419f480 con 0x7f93e4101c90 2024-09-10T20:50:32.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.668+0000 7f93e2d9d640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93e259c640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93d4005ab0 tx=0x7f93d4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d403f070 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93d4031d60 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e419f710 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4035030 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.669+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e41a5e30 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.670+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4102f40 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.671+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f93d403b580 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.672+0000 7f93dbfff640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 0x7f93d00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.672+0000 7f93d9d9b640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 0x7f93d00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.672+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f93d4106ee0 con 0x7f93e4101c90 2024-09-10T20:50:32.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.673+0000 7f93d9d9b640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 0x7f93d00b7830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f93e4107220 tx=0x7f93cc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:32.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.675+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93d40cdc10 con 0x7f93e4101c90 2024-09-10T20:50:32.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.858+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93e4109e30 con 0x7f93d00b5370 2024-09-10T20:50:32.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.862+0000 7f93dbfff640 1 -- 172.21.15.67:0/2651002971 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258698 (secure 0 0 0) 0x7f93e4109e30 con 0x7f93d00b5370 2024-09-10T20:50:32.869 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:32.870 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 msgr2=0x7f93d00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 0x7f93d00b7830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f93e4107220 tx=0x7f93cc00b410 comp rx=0 tx=0).stop 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 msgr2=0x7f93e41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f93d4005ab0 tx=0x7f93d4003cd0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 shutdown_connections 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f93d00b5370 0x7f93d00b7830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93e4108020 0x7f93e419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93e41076a0 0x7f93e4199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 --2- 172.21.15.67:0/2651002971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f93e4101c90 0x7f93e41993d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 >> 172.21.15.67:0/2651002971 conn(0x7f93e40fd700 msgr2=0x7f93e4105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 shutdown_connections 2024-09-10T20:50:32.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:32.865+0000 7f93e8ffa640 1 -- 172.21.15.67:0/2651002971 wait complete. 2024-09-10T20:50:33.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:50:33.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:50:33.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.526 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.526 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.526 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:50:33.526 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:50:33.526 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.556 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-10T20:50:32.772684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656353,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":439,"num_read_kb":315,"num_write":287,"num_write_kb":2263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381760,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560064,"statfs":{"total":1151940427776,"available":1151549505536,"internally_reserved":0,"allocated":11907072,"data_stored":6691431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562192+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:50:08.562192+0000","last_peered":"2024-09-10T20:50:08.562192+0000","last_clean":"2024-09-10T20:50:08.562192+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:50:08.562192+0000","last_undegraded":"2024-09-10T20:50:08.562192+0000","last_fullsized":"2024-09-10T20:50:08.562192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566302+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:50:08.566302+0000","last_peered":"2024-09-10T20:50:08.566302+0000","last_clean":"2024-09-10T20:50:08.566302+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:50:08.566302+0000","last_undegraded":"2024-09-10T20:50:08.566302+0000","last_fullsized":"2024-09-10T20:50:08.566302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566099+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:50:08.566099+0000","last_peered":"2024-09-10T20:50:08.566099+0000","last_clean":"2024-09-10T20:50:08.566099+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:50:08.566099+0000","last_undegraded":"2024-09-10T20:50:08.566099+0000","last_fullsized":"2024-09-10T20:50:08.566099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569195+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:50:08.569195+0000","last_peered":"2024-09-10T20:50:08.569195+0000","last_clean":"2024-09-10T20:50:08.569195+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:50:08.569195+0000","last_undegraded":"2024-09-10T20:50:08.569195+0000","last_fullsized":"2024-09-10T20:50:08.569195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570788+0000","last_change":"2024-09-10T20:50:08.570682+0000","last_active":"2024-09-10T20:50:08.570788+0000","last_peered":"2024-09-10T20:50:08.570788+0000","last_clean":"2024-09-10T20:50:08.570788+0000","last_became_active":"2024-09-10T20:50:08.570099+0000","last_became_peered":"2024-09-10T20:50:08.570099+0000","last_unstale":"2024-09-10T20:50:08.570788+0000","last_undegraded":"2024-09-10T20:50:08.570788+0000","last_fullsized":"2024-09-10T20:50:08.570788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:09.651291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561561+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:50:08.561561+0000","last_peered":"2024-09-10T20:50:08.561561+0000","last_clean":"2024-09-10T20:50:08.561561+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:50:08.561561+0000","last_undegraded":"2024-09-10T20:50:08.561561+0000","last_fullsized":"2024-09-10T20:50:08.561561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569704+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:50:08.569704+0000","last_peered":"2024-09-10T20:50:08.569704+0000","last_clean":"2024-09-10T20:50:08.569704+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:50:08.569704+0000","last_undegraded":"2024-09-10T20:50:08.569704+0000","last_fullsized":"2024-09-10T20:50:08.569704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568521+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:50:08.568521+0000","last_peered":"2024-09-10T20:50:08.568521+0000","last_clean":"2024-09-10T20:50:08.568521+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:50:08.568521+0000","last_undegraded":"2024-09-10T20:50:08.568521+0000","last_fullsized":"2024-09-10T20:50:08.568521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564361+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:50:08.564361+0000","last_peered":"2024-09-10T20:50:08.564361+0000","last_clean":"2024-09-10T20:50:08.564361+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:50:08.564361+0000","last_undegraded":"2024-09-10T20:50:08.564361+0000","last_fullsized":"2024-09-10T20:50:08.564361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562034+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:50:08.562034+0000","last_peered":"2024-09-10T20:50:08.562034+0000","last_clean":"2024-09-10T20:50:08.562034+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:50:08.562034+0000","last_undegraded":"2024-09-10T20:50:08.562034+0000","last_fullsized":"2024-09-10T20:50:08.562034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570081+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:50:08.570081+0000","last_peered":"2024-09-10T20:50:08.570081+0000","last_clean":"2024-09-10T20:50:08.570081+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:50:08.570081+0000","last_undegraded":"2024-09-10T20:50:08.570081+0000","last_fullsized":"2024-09-10T20:50:08.570081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567782+0000","last_change":"2024-09-10T20:50:08.567682+0000","last_active":"2024-09-10T20:50:08.567782+0000","last_peered":"2024-09-10T20:50:08.567782+0000","last_clean":"2024-09-10T20:50:08.567782+0000","last_became_active":"2024-09-10T20:50:08.567302+0000","last_became_peered":"2024-09-10T20:50:08.567302+0000","last_unstale":"2024-09-10T20:50:08.567782+0000","last_undegraded":"2024-09-10T20:50:08.567782+0000","last_fullsized":"2024-09-10T20:50:08.567782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:59.818786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569308+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:50:08.569308+0000","last_peered":"2024-09-10T20:50:08.569308+0000","last_clean":"2024-09-10T20:50:08.569308+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:50:08.569308+0000","last_undegraded":"2024-09-10T20:50:08.569308+0000","last_fullsized":"2024-09-10T20:50:08.569308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565982+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:50:08.565982+0000","last_peered":"2024-09-10T20:50:08.565982+0000","last_clean":"2024-09-10T20:50:08.565982+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:50:08.565982+0000","last_undegraded":"2024-09-10T20:50:08.565982+0000","last_fullsized":"2024-09-10T20:50:08.565982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565933+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:50:08.565933+0000","last_peered":"2024-09-10T20:50:08.565933+0000","last_clean":"2024-09-10T20:50:08.565933+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:50:08.565933+0000","last_undegraded":"2024-09-10T20:50:08.565933+0000","last_fullsized":"2024-09-10T20:50:08.565933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563842+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:50:08.563842+0000","last_peered":"2024-09-10T20:50:08.563842+0000","last_clean":"2024-09-10T20:50:08.563842+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:50:08.563842+0000","last_undegraded":"2024-09-10T20:50:08.563842+0000","last_fullsized":"2024-09-10T20:50:08.563842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562187+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:50:08.562187+0000","last_peered":"2024-09-10T20:50:08.562187+0000","last_clean":"2024-09-10T20:50:08.562187+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:50:08.562187+0000","last_undegraded":"2024-09-10T20:50:08.562187+0000","last_fullsized":"2024-09-10T20:50:08.562187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563486+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:50:08.563486+0000","last_peered":"2024-09-10T20:50:08.563486+0000","last_clean":"2024-09-10T20:50:08.563486+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:50:08.563486+0000","last_undegraded":"2024-09-10T20:50:08.563486+0000","last_fullsized":"2024-09-10T20:50:08.563486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567840+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:50:08.567840+0000","last_peered":"2024-09-10T20:50:08.567840+0000","last_clean":"2024-09-10T20:50:08.567840+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:50:08.567840+0000","last_undegraded":"2024-09-10T20:50:08.567840+0000","last_fullsized":"2024-09-10T20:50:08.567840+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561826+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:50:08.561826+0000","last_peered":"2024-09-10T20:50:08.561826+0000","last_clean":"2024-09-10T20:50:08.561826+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:50:08.561826+0000","last_undegraded":"2024-09-10T20:50:08.561826+0000","last_fullsized":"2024-09-10T20:50:08.561826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569400+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:50:08.569400+0000","last_peered":"2024-09-10T20:50:08.569400+0000","last_clean":"2024-09-10T20:50:08.569400+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:50:08.569400+0000","last_undegraded":"2024-09-10T20:50:08.569400+0000","last_fullsized":"2024-09-10T20:50:08.569400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564258+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:50:08.564258+0000","last_peered":"2024-09-10T20:50:08.564258+0000","last_clean":"2024-09-10T20:50:08.564258+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:50:08.564258+0000","last_undegraded":"2024-09-10T20:50:08.564258+0000","last_fullsized":"2024-09-10T20:50:08.564258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568634+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:50:08.568634+0000","last_peered":"2024-09-10T20:50:08.568634+0000","last_clean":"2024-09-10T20:50:08.568634+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:50:08.568634+0000","last_undegraded":"2024-09-10T20:50:08.568634+0000","last_fullsized":"2024-09-10T20:50:08.568634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564240+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:50:08.564240+0000","last_peered":"2024-09-10T20:50:08.564240+0000","last_clean":"2024-09-10T20:50:08.564240+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:50:08.564240+0000","last_undegraded":"2024-09-10T20:50:08.564240+0000","last_fullsized":"2024-09-10T20:50:08.564240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568721+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:50:08.568721+0000","last_peered":"2024-09-10T20:50:08.568721+0000","last_clean":"2024-09-10T20:50:08.568721+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:50:08.568721+0000","last_undegraded":"2024-09-10T20:50:08.568721+0000","last_fullsized":"2024-09-10T20:50:08.568721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568151+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:50:08.568151+0000","last_peered":"2024-09-10T20:50:08.568151+0000","last_clean":"2024-09-10T20:50:08.568151+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:50:08.568151+0000","last_undegraded":"2024-09-10T20:50:08.568151+0000","last_fullsized":"2024-09-10T20:50:08.568151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561963+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:50:08.561963+0000","last_peered":"2024-09-10T20:50:08.561963+0000","last_clean":"2024-09-10T20:50:08.561963+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:50:08.561963+0000","last_undegraded":"2024-09-10T20:50:08.561963+0000","last_fullsized":"2024-09-10T20:50:08.561963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569035+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:50:08.569035+0000","last_peered":"2024-09-10T20:50:08.569035+0000","last_clean":"2024-09-10T20:50:08.569035+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:50:08.569035+0000","last_undegraded":"2024-09-10T20:50:08.569035+0000","last_fullsized":"2024-09-10T20:50:08.569035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566106+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:50:08.566106+0000","last_peered":"2024-09-10T20:50:08.566106+0000","last_clean":"2024-09-10T20:50:08.566106+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:50:08.566106+0000","last_undegraded":"2024-09-10T20:50:08.566106+0000","last_fullsized":"2024-09-10T20:50:08.566106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567399+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:50:08.567399+0000","last_peered":"2024-09-10T20:50:08.567399+0000","last_clean":"2024-09-10T20:50:08.567399+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:50:08.567399+0000","last_undegraded":"2024-09-10T20:50:08.567399+0000","last_fullsized":"2024-09-10T20:50:08.567399+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567899+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:50:08.567899+0000","last_peered":"2024-09-10T20:50:08.567899+0000","last_clean":"2024-09-10T20:50:08.567899+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:50:08.567899+0000","last_undegraded":"2024-09-10T20:50:08.567899+0000","last_fullsized":"2024-09-10T20:50:08.567899+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561763+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:50:08.561763+0000","last_peered":"2024-09-10T20:50:08.561763+0000","last_clean":"2024-09-10T20:50:08.561763+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:50:08.561763+0000","last_undegraded":"2024-09-10T20:50:08.561763+0000","last_fullsized":"2024-09-10T20:50:08.561763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565795+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:50:08.565795+0000","last_peered":"2024-09-10T20:50:08.565795+0000","last_clean":"2024-09-10T20:50:08.565795+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:50:08.565795+0000","last_undegraded":"2024-09-10T20:50:08.565795+0000","last_fullsized":"2024-09-10T20:50:08.565795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:28.555856+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:50:28.555856+0000","last_peered":"2024-09-10T20:50:28.555856+0000","last_clean":"2024-09-10T20:50:28.555856+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:50:28.555856+0000","last_undegraded":"2024-09-10T20:50:28.555856+0000","last_fullsized":"2024-09-10T20:50:28.555856+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570552+0000","last_change":"2024-09-10T20:50:08.570456+0000","last_active":"2024-09-10T20:50:08.570552+0000","last_peered":"2024-09-10T20:50:08.570552+0000","last_clean":"2024-09-10T20:50:08.570552+0000","last_became_active":"2024-09-10T20:50:08.570104+0000","last_became_peered":"2024-09-10T20:50:08.570104+0000","last_unstale":"2024-09-10T20:50:08.570552+0000","last_undegraded":"2024-09-10T20:50:08.570552+0000","last_fullsized":"2024-09-10T20:50:08.570552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.998765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561580+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:50:08.561580+0000","last_peered":"2024-09-10T20:50:08.561580+0000","last_clean":"2024-09-10T20:50:08.561580+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:50:08.561580+0000","last_undegraded":"2024-09-10T20:50:08.561580+0000","last_fullsized":"2024-09-10T20:50:08.561580+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568874+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:50:08.568874+0000","last_peered":"2024-09-10T20:50:08.568874+0000","last_clean":"2024-09-10T20:50:08.568874+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:50:08.568874+0000","last_undegraded":"2024-09-10T20:50:08.568874+0000","last_fullsized":"2024-09-10T20:50:08.568874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568556+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:50:08.568556+0000","last_peered":"2024-09-10T20:50:08.568556+0000","last_clean":"2024-09-10T20:50:08.568556+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:50:08.568556+0000","last_undegraded":"2024-09-10T20:50:08.568556+0000","last_fullsized":"2024-09-10T20:50:08.568556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565380+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:50:08.565380+0000","last_peered":"2024-09-10T20:50:08.565380+0000","last_clean":"2024-09-10T20:50:08.565380+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:50:08.565380+0000","last_undegraded":"2024-09-10T20:50:08.565380+0000","last_fullsized":"2024-09-10T20:50:08.565380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563282+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:50:08.563282+0000","last_peered":"2024-09-10T20:50:08.563282+0000","last_clean":"2024-09-10T20:50:08.563282+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:50:08.563282+0000","last_undegraded":"2024-09-10T20:50:08.563282+0000","last_fullsized":"2024-09-10T20:50:08.563282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.556847+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:50:29.556847+0000","last_peered":"2024-09-10T20:50:29.556847+0000","last_clean":"2024-09-10T20:50:29.556847+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:50:29.556847+0000","last_undegraded":"2024-09-10T20:50:29.556847+0000","last_fullsized":"2024-09-10T20:50:29.556847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564187+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:50:08.564187+0000","last_peered":"2024-09-10T20:50:08.564187+0000","last_clean":"2024-09-10T20:50:08.564187+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:50:08.564187+0000","last_undegraded":"2024-09-10T20:50:08.564187+0000","last_fullsized":"2024-09-10T20:50:08.564187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570157+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:50:08.570157+0000","last_peered":"2024-09-10T20:50:08.570157+0000","last_clean":"2024-09-10T20:50:08.570157+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:50:08.570157+0000","last_undegraded":"2024-09-10T20:50:08.570157+0000","last_fullsized":"2024-09-10T20:50:08.570157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566306+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:50:08.566306+0000","last_peered":"2024-09-10T20:50:08.566306+0000","last_clean":"2024-09-10T20:50:08.566306+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:50:08.566306+0000","last_undegraded":"2024-09-10T20:50:08.566306+0000","last_fullsized":"2024-09-10T20:50:08.566306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564804+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:50:08.564804+0000","last_peered":"2024-09-10T20:50:08.564804+0000","last_clean":"2024-09-10T20:50:08.564804+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:50:08.564804+0000","last_undegraded":"2024-09-10T20:50:08.564804+0000","last_fullsized":"2024-09-10T20:50:08.564804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564180+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:50:08.564180+0000","last_peered":"2024-09-10T20:50:08.564180+0000","last_clean":"2024-09-10T20:50:08.564180+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:50:08.564180+0000","last_undegraded":"2024-09-10T20:50:08.564180+0000","last_fullsized":"2024-09-10T20:50:08.564180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'29","reported_seq":173,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:30.558420+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:50:30.558420+0000","last_peered":"2024-09-10T20:50:30.558420+0000","last_clean":"2024-09-10T20:50:30.558420+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:50:30.558420+0000","last_undegraded":"2024-09-10T20:50:30.558420+0000","last_fullsized":"2024-09-10T20:50:30.558420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61750,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565750+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:50:08.565750+0000","last_peered":"2024-09-10T20:50:08.565750+0000","last_clean":"2024-09-10T20:50:08.565750+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:50:08.565750+0000","last_undegraded":"2024-09-10T20:50:08.565750+0000","last_fullsized":"2024-09-10T20:50:08.565750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567504+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:50:08.567504+0000","last_peered":"2024-09-10T20:50:08.567504+0000","last_clean":"2024-09-10T20:50:08.567504+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:50:08.567504+0000","last_undegraded":"2024-09-10T20:50:08.567504+0000","last_fullsized":"2024-09-10T20:50:08.567504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569038+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:50:08.569038+0000","last_peered":"2024-09-10T20:50:08.569038+0000","last_clean":"2024-09-10T20:50:08.569038+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:50:08.569038+0000","last_undegraded":"2024-09-10T20:50:08.569038+0000","last_fullsized":"2024-09-10T20:50:08.569038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564496+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:50:08.564496+0000","last_peered":"2024-09-10T20:50:08.564496+0000","last_clean":"2024-09-10T20:50:08.564496+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:50:08.564496+0000","last_undegraded":"2024-09-10T20:50:08.564496+0000","last_fullsized":"2024-09-10T20:50:08.564496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570014+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:50:08.570014+0000","last_peered":"2024-09-10T20:50:08.570014+0000","last_clean":"2024-09-10T20:50:08.570014+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:50:08.570014+0000","last_undegraded":"2024-09-10T20:50:08.570014+0000","last_fullsized":"2024-09-10T20:50:08.570014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.569135+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:50:29.569135+0000","last_peered":"2024-09-10T20:50:29.569135+0000","last_clean":"2024-09-10T20:50:29.569135+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:50:29.569135+0000","last_undegraded":"2024-09-10T20:50:29.569135+0000","last_fullsized":"2024-09-10T20:50:29.569135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569343+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:50:08.569343+0000","last_peered":"2024-09-10T20:50:08.569343+0000","last_clean":"2024-09-10T20:50:08.569343+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:50:08.569343+0000","last_undegraded":"2024-09-10T20:50:08.569343+0000","last_fullsized":"2024-09-10T20:50:08.569343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563927+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:50:08.563927+0000","last_peered":"2024-09-10T20:50:08.563927+0000","last_clean":"2024-09-10T20:50:08.563927+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:50:08.563927+0000","last_undegraded":"2024-09-10T20:50:08.563927+0000","last_fullsized":"2024-09-10T20:50:08.563927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564324+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:50:08.564324+0000","last_peered":"2024-09-10T20:50:08.564324+0000","last_clean":"2024-09-10T20:50:08.564324+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:50:08.564324+0000","last_undegraded":"2024-09-10T20:50:08.564324+0000","last_fullsized":"2024-09-10T20:50:08.564324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566303+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:50:08.566303+0000","last_peered":"2024-09-10T20:50:08.566303+0000","last_clean":"2024-09-10T20:50:08.566303+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:50:08.566303+0000","last_undegraded":"2024-09-10T20:50:08.566303+0000","last_fullsized":"2024-09-10T20:50:08.566303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561982+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:50:08.561982+0000","last_peered":"2024-09-10T20:50:08.561982+0000","last_clean":"2024-09-10T20:50:08.561982+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:50:08.561982+0000","last_undegraded":"2024-09-10T20:50:08.561982+0000","last_fullsized":"2024-09-10T20:50:08.561982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569541+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:50:08.569541+0000","last_peered":"2024-09-10T20:50:08.569541+0000","last_clean":"2024-09-10T20:50:08.569541+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:50:08.569541+0000","last_undegraded":"2024-09-10T20:50:08.569541+0000","last_fullsized":"2024-09-10T20:50:08.569541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570202+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:50:08.570202+0000","last_peered":"2024-09-10T20:50:08.570202+0000","last_clean":"2024-09-10T20:50:08.570202+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:50:08.570202+0000","last_undegraded":"2024-09-10T20:50:08.570202+0000","last_fullsized":"2024-09-10T20:50:08.570202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564958+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:50:08.564958+0000","last_peered":"2024-09-10T20:50:08.564958+0000","last_clean":"2024-09-10T20:50:08.564958+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:50:08.564958+0000","last_undegraded":"2024-09-10T20:50:08.564958+0000","last_fullsized":"2024-09-10T20:50:08.564958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570014+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:50:08.570014+0000","last_peered":"2024-09-10T20:50:08.570014+0000","last_clean":"2024-09-10T20:50:08.570014+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:50:08.570014+0000","last_undegraded":"2024-09-10T20:50:08.570014+0000","last_fullsized":"2024-09-10T20:50:08.570014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568133+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:50:08.568133+0000","last_peered":"2024-09-10T20:50:08.568133+0000","last_clean":"2024-09-10T20:50:08.568133+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:50:08.568133+0000","last_undegraded":"2024-09-10T20:50:08.568133+0000","last_fullsized":"2024-09-10T20:50:08.568133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570112+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:50:08.570112+0000","last_peered":"2024-09-10T20:50:08.570112+0000","last_clean":"2024-09-10T20:50:08.570112+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:50:08.570112+0000","last_undegraded":"2024-09-10T20:50:08.570112+0000","last_fullsized":"2024-09-10T20:50:08.570112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569597+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:50:08.569597+0000","last_peered":"2024-09-10T20:50:08.569597+0000","last_clean":"2024-09-10T20:50:08.569597+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:50:08.569597+0000","last_undegraded":"2024-09-10T20:50:08.569597+0000","last_fullsized":"2024-09-10T20:50:08.569597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568872+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:50:08.568872+0000","last_peered":"2024-09-10T20:50:08.568872+0000","last_clean":"2024-09-10T20:50:08.568872+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:50:08.568872+0000","last_undegraded":"2024-09-10T20:50:08.568872+0000","last_fullsized":"2024-09-10T20:50:08.568872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568876+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:50:08.568876+0000","last_peered":"2024-09-10T20:50:08.568876+0000","last_clean":"2024-09-10T20:50:08.568876+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:50:08.568876+0000","last_undegraded":"2024-09-10T20:50:08.568876+0000","last_fullsized":"2024-09-10T20:50:08.568876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569502+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:50:08.569502+0000","last_peered":"2024-09-10T20:50:08.569502+0000","last_clean":"2024-09-10T20:50:08.569502+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:50:08.569502+0000","last_undegraded":"2024-09-10T20:50:08.569502+0000","last_fullsized":"2024-09-10T20:50:08.569502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568972+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:50:08.568972+0000","last_peered":"2024-09-10T20:50:08.568972+0000","last_clean":"2024-09-10T20:50:08.568972+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:50:08.568972+0000","last_undegraded":"2024-09-10T20:50:08.568972+0000","last_fullsized":"2024-09-10T20:50:08.568972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.568601+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:50:29.568601+0000","last_peered":"2024-09-10T20:50:29.568601+0000","last_clean":"2024-09-10T20:50:29.568601+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:50:29.568601+0000","last_undegraded":"2024-09-10T20:50:29.568601+0000","last_fullsized":"2024-09-10T20:50:29.568601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569852+0000","last_change":"2024-09-10T20:50:08.569711+0000","last_active":"2024-09-10T20:50:08.569852+0000","last_peered":"2024-09-10T20:50:08.569852+0000","last_clean":"2024-09-10T20:50:08.569852+0000","last_became_active":"2024-09-10T20:50:08.569348+0000","last_became_peered":"2024-09-10T20:50:08.569348+0000","last_unstale":"2024-09-10T20:50:08.569852+0000","last_undegraded":"2024-09-10T20:50:08.569852+0000","last_fullsized":"2024-09-10T20:50:08.569852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570006+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:50:08.570006+0000","last_peered":"2024-09-10T20:50:08.570006+0000","last_clean":"2024-09-10T20:50:08.570006+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:50:08.570006+0000","last_undegraded":"2024-09-10T20:50:08.570006+0000","last_fullsized":"2024-09-10T20:50:08.570006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561723+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:50:08.561723+0000","last_peered":"2024-09-10T20:50:08.561723+0000","last_clean":"2024-09-10T20:50:08.561723+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:50:08.561723+0000","last_undegraded":"2024-09-10T20:50:08.561723+0000","last_fullsized":"2024-09-10T20:50:08.561723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563780+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:50:08.563780+0000","last_peered":"2024-09-10T20:50:08.563780+0000","last_clean":"2024-09-10T20:50:08.563780+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:50:08.563780+0000","last_undegraded":"2024-09-10T20:50:08.563780+0000","last_fullsized":"2024-09-10T20:50:08.563780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561806+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:50:08.561806+0000","last_peered":"2024-09-10T20:50:08.561806+0000","last_clean":"2024-09-10T20:50:08.561806+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:50:08.561806+0000","last_undegraded":"2024-09-10T20:50:08.561806+0000","last_fullsized":"2024-09-10T20:50:08.561806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566052+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:50:08.566052+0000","last_peered":"2024-09-10T20:50:08.566052+0000","last_clean":"2024-09-10T20:50:08.566052+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:50:08.566052+0000","last_undegraded":"2024-09-10T20:50:08.566052+0000","last_fullsized":"2024-09-10T20:50:08.566052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569339+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:50:08.569339+0000","last_peered":"2024-09-10T20:50:08.569339+0000","last_clean":"2024-09-10T20:50:08.569339+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:50:08.569339+0000","last_undegraded":"2024-09-10T20:50:08.569339+0000","last_fullsized":"2024-09-10T20:50:08.569339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563584+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:50:08.563584+0000","last_peered":"2024-09-10T20:50:08.563584+0000","last_clean":"2024-09-10T20:50:08.563584+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:50:08.563584+0000","last_undegraded":"2024-09-10T20:50:08.563584+0000","last_fullsized":"2024-09-10T20:50:08.563584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569455+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:50:08.569455+0000","last_peered":"2024-09-10T20:50:08.569455+0000","last_clean":"2024-09-10T20:50:08.569455+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:50:08.569455+0000","last_undegraded":"2024-09-10T20:50:08.569455+0000","last_fullsized":"2024-09-10T20:50:08.569455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569278+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:50:08.569278+0000","last_peered":"2024-09-10T20:50:08.569278+0000","last_clean":"2024-09-10T20:50:08.569278+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:50:08.569278+0000","last_undegraded":"2024-09-10T20:50:08.569278+0000","last_fullsized":"2024-09-10T20:50:08.569278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566203+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:50:08.566203+0000","last_peered":"2024-09-10T20:50:08.566203+0000","last_clean":"2024-09-10T20:50:08.566203+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:50:08.566203+0000","last_undegraded":"2024-09-10T20:50:08.566203+0000","last_fullsized":"2024-09-10T20:50:08.566203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.571450+0000","last_change":"2024-09-10T20:50:08.571340+0000","last_active":"2024-09-10T20:50:08.571450+0000","last_peered":"2024-09-10T20:50:08.571450+0000","last_clean":"2024-09-10T20:50:08.571450+0000","last_became_active":"2024-09-10T20:50:08.567038+0000","last_became_peered":"2024-09-10T20:50:08.567038+0000","last_unstale":"2024-09-10T20:50:08.571450+0000","last_undegraded":"2024-09-10T20:50:08.571450+0000","last_fullsized":"2024-09-10T20:50:08.571450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:56.536271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565417+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:50:08.565417+0000","last_peered":"2024-09-10T20:50:08.565417+0000","last_clean":"2024-09-10T20:50:08.565417+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:50:08.565417+0000","last_undegraded":"2024-09-10T20:50:08.565417+0000","last_fullsized":"2024-09-10T20:50:08.565417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568779+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:50:08.568779+0000","last_peered":"2024-09-10T20:50:08.568779+0000","last_clean":"2024-09-10T20:50:08.568779+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:50:08.568779+0000","last_undegraded":"2024-09-10T20:50:08.568779+0000","last_fullsized":"2024-09-10T20:50:08.568779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561826+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:50:08.561826+0000","last_peered":"2024-09-10T20:50:08.561826+0000","last_clean":"2024-09-10T20:50:08.561826+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:50:08.561826+0000","last_undegraded":"2024-09-10T20:50:08.561826+0000","last_fullsized":"2024-09-10T20:50:08.561826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567543+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:50:08.567543+0000","last_peered":"2024-09-10T20:50:08.567543+0000","last_clean":"2024-09-10T20:50:08.567543+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:50:08.567543+0000","last_undegraded":"2024-09-10T20:50:08.567543+0000","last_fullsized":"2024-09-10T20:50:08.567543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569148+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:50:08.569148+0000","last_peered":"2024-09-10T20:50:08.569148+0000","last_clean":"2024-09-10T20:50:08.569148+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:50:08.569148+0000","last_undegraded":"2024-09-10T20:50:08.569148+0000","last_fullsized":"2024-09-10T20:50:08.569148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566615+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:50:08.566615+0000","last_peered":"2024-09-10T20:50:08.566615+0000","last_clean":"2024-09-10T20:50:08.566615+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:50:08.566615+0000","last_undegraded":"2024-09-10T20:50:08.566615+0000","last_fullsized":"2024-09-10T20:50:08.566615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569871+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:50:08.569871+0000","last_peered":"2024-09-10T20:50:08.569871+0000","last_clean":"2024-09-10T20:50:08.569871+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:50:08.569871+0000","last_undegraded":"2024-09-10T20:50:08.569871+0000","last_fullsized":"2024-09-10T20:50:08.569871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570658+0000","last_change":"2024-09-10T20:50:08.570537+0000","last_active":"2024-09-10T20:50:08.570658+0000","last_peered":"2024-09-10T20:50:08.570658+0000","last_clean":"2024-09-10T20:50:08.570658+0000","last_became_active":"2024-09-10T20:50:08.570083+0000","last_became_peered":"2024-09-10T20:50:08.570083+0000","last_unstale":"2024-09-10T20:50:08.570658+0000","last_undegraded":"2024-09-10T20:50:08.570658+0000","last_fullsized":"2024-09-10T20:50:08.570658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:15.834461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.573406+0000","last_change":"2024-09-10T20:50:08.572886+0000","last_active":"2024-09-10T20:50:08.573406+0000","last_peered":"2024-09-10T20:50:08.573406+0000","last_clean":"2024-09-10T20:50:08.573406+0000","last_became_active":"2024-09-10T20:50:08.568973+0000","last_became_peered":"2024-09-10T20:50:08.568973+0000","last_unstale":"2024-09-10T20:50:08.573406+0000","last_undegraded":"2024-09-10T20:50:08.573406+0000","last_fullsized":"2024-09-10T20:50:08.573406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:09.903383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564000+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:50:08.564000+0000","last_peered":"2024-09-10T20:50:08.564000+0000","last_clean":"2024-09-10T20:50:08.564000+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:50:08.564000+0000","last_undegraded":"2024-09-10T20:50:08.564000+0000","last_fullsized":"2024-09-10T20:50:08.564000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565963+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:50:08.565963+0000","last_peered":"2024-09-10T20:50:08.565963+0000","last_clean":"2024-09-10T20:50:08.565963+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:50:08.565963+0000","last_undegraded":"2024-09-10T20:50:08.565963+0000","last_fullsized":"2024-09-10T20:50:08.565963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566302+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:50:08.566302+0000","last_peered":"2024-09-10T20:50:08.566302+0000","last_clean":"2024-09-10T20:50:08.566302+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:50:08.566302+0000","last_undegraded":"2024-09-10T20:50:08.566302+0000","last_fullsized":"2024-09-10T20:50:08.566302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569349+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:50:08.569349+0000","last_peered":"2024-09-10T20:50:08.569349+0000","last_clean":"2024-09-10T20:50:08.569349+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:50:08.569349+0000","last_undegraded":"2024-09-10T20:50:08.569349+0000","last_fullsized":"2024-09-10T20:50:08.569349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569188+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:50:08.569188+0000","last_peered":"2024-09-10T20:50:08.569188+0000","last_clean":"2024-09-10T20:50:08.569188+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:50:08.569188+0000","last_undegraded":"2024-09-10T20:50:08.569188+0000","last_fullsized":"2024-09-10T20:50:08.569188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563549+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:50:08.563549+0000","last_peered":"2024-09-10T20:50:08.563549+0000","last_clean":"2024-09-10T20:50:08.563549+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:50:08.563549+0000","last_undegraded":"2024-09-10T20:50:08.563549+0000","last_fullsized":"2024-09-10T20:50:08.563549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":363,"num_read_kb":251,"num_write":162,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808859,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":394113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1507328,"data_stored":1047735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":394349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":827392,"data_stored":394269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36736,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708416,"statfs":{"total":95995035648,"available":95957417984,"internally_reserved":0,"allocated":1421312,"data_stored":986199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":815104,"data_stored":393738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":985492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":819200,"data_stored":394566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":831488,"data_stored":394049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":456631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":455281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":395009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:50:33.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T20:50:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:50:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:50:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:50:33.819 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 -- 172.21.15.67:0/365178893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 msgr2=0x7f4948102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 --2- 172.21.15.67:0/365178893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948102070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4938009900 tx=0x7f493802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 -- 172.21.15.67:0/365178893 shutdown_connections 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 --2- 172.21.15.67:0/365178893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 --2- 172.21.15.67:0/365178893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 --2- 172.21.15.67:0/365178893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948102070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 -- 172.21.15.67:0/365178893 >> 172.21.15.67:0/365178893 conn(0x7f49480fd700 msgr2=0x7f49480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 -- 172.21.15.67:0/365178893 shutdown_connections 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.334+0000 7f494cd70640 1 -- 172.21.15.67:0/365178893 wait complete. 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 Processor -- start 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 -- start start 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4948111ce0 con 0x7f4948101c90 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4948111b60 con 0x7f4948108020 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494cd70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4948111e60 con 0x7f49481076a0 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50356/0 (socket says 172.21.15.67:50356) 2024-09-10T20:50:34.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 -- 172.21.15.67:0/1225050587 learned_addr learned my addr 172.21.15.67:0/1225050587 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f493ffff640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f4946d9d640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 -- 172.21.15.67:0/1225050587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 msgr2=0x7f4948199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 -- 172.21.15.67:0/1225050587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 msgr2=0x7f494819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.335+0000 7f494659c640 1 -- 172.21.15.67:0/1225050587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494819f3c0 con 0x7f4948101c90 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f493ffff640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f4946d9d640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:34.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f494659c640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4938005940 tx=0x7f49380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493803f030 con 0x7f4948101c90 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494819f650 con 0x7f4948101c90 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4938003cb0 con 0x7f4948101c90 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938035070 con 0x7f4948101c90 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.336+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49481a5d70 con 0x7f4948101c90 2024-09-10T20:50:34.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.337+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4948102070 con 0x7f4948101c90 2024-09-10T20:50:34.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.339+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f493803bb50 con 0x7f4948101c90 2024-09-10T20:50:34.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.339+0000 7f493f7fe640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 0x7f49340b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:34.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.340+0000 7f493ffff640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 0x7f49340b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:34.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.340+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4938106bb0 con 0x7f4948101c90 2024-09-10T20:50:34.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.340+0000 7f493ffff640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 0x7f49340b78b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4948107020 tx=0x7f4930005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:34.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.347+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49380cd940 con 0x7f4948101c90 2024-09-10T20:50:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:34 smithi172 ceph-mon[35265]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:34 smithi172 ceph-mon[35265]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:34.487 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:34 smithi067 ceph-mon[30891]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:34.487 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:34 smithi067 ceph-mon[30891]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:34.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.532+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4948063590 con 0x7f49340b53f0 2024-09-10T20:50:34.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.536+0000 7f493f7fe640 1 -- 172.21.15.67:0/1225050587 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258698 (secure 0 0 0) 0x7f4948063590 con 0x7f49340b53f0 2024-09-10T20:50:34.543 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:34.544 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:50:34.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 msgr2=0x7f49340b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 0x7f49340b78b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4948107020 tx=0x7f4930005d30 comp rx=0 tx=0).stop 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 msgr2=0x7f4948199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4938005940 tx=0x7f49380042f0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 shutdown_connections 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4948108020 0x7f494819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49340b53f0 0x7f49340b78b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49481076a0 0x7f4948199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 --2- 172.21.15.67:0/1225050587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4948101c90 0x7f4948199310 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 >> 172.21.15.67:0/1225050587 conn(0x7f49480fd700 msgr2=0x7f494806aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 shutdown_connections 2024-09-10T20:50:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:34.539+0000 7f494cd70640 1 -- 172.21.15.67:0/1225050587 wait complete. 2024-09-10T20:50:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:34 smithi083 ceph-mon[35058]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:34.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:34 smithi083 ceph-mon[35058]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:35.224 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-10T20:50:32.772684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656353,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":439,"num_read_kb":315,"num_write":287,"num_write_kb":2263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381760,"kb_used_data":11628,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560064,"statfs":{"total":1151940427776,"available":1151549505536,"internally_reserved":0,"allocated":11907072,"data_stored":6691431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562192+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:50:08.562192+0000","last_peered":"2024-09-10T20:50:08.562192+0000","last_clean":"2024-09-10T20:50:08.562192+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:50:08.562192+0000","last_undegraded":"2024-09-10T20:50:08.562192+0000","last_fullsized":"2024-09-10T20:50:08.562192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566302+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:50:08.566302+0000","last_peered":"2024-09-10T20:50:08.566302+0000","last_clean":"2024-09-10T20:50:08.566302+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:50:08.566302+0000","last_undegraded":"2024-09-10T20:50:08.566302+0000","last_fullsized":"2024-09-10T20:50:08.566302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566099+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:50:08.566099+0000","last_peered":"2024-09-10T20:50:08.566099+0000","last_clean":"2024-09-10T20:50:08.566099+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:50:08.566099+0000","last_undegraded":"2024-09-10T20:50:08.566099+0000","last_fullsized":"2024-09-10T20:50:08.566099+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569195+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:50:08.569195+0000","last_peered":"2024-09-10T20:50:08.569195+0000","last_clean":"2024-09-10T20:50:08.569195+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:50:08.569195+0000","last_undegraded":"2024-09-10T20:50:08.569195+0000","last_fullsized":"2024-09-10T20:50:08.569195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570788+0000","last_change":"2024-09-10T20:50:08.570682+0000","last_active":"2024-09-10T20:50:08.570788+0000","last_peered":"2024-09-10T20:50:08.570788+0000","last_clean":"2024-09-10T20:50:08.570788+0000","last_became_active":"2024-09-10T20:50:08.570099+0000","last_became_peered":"2024-09-10T20:50:08.570099+0000","last_unstale":"2024-09-10T20:50:08.570788+0000","last_undegraded":"2024-09-10T20:50:08.570788+0000","last_fullsized":"2024-09-10T20:50:08.570788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:09.651291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561561+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:50:08.561561+0000","last_peered":"2024-09-10T20:50:08.561561+0000","last_clean":"2024-09-10T20:50:08.561561+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:50:08.561561+0000","last_undegraded":"2024-09-10T20:50:08.561561+0000","last_fullsized":"2024-09-10T20:50:08.561561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569704+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:50:08.569704+0000","last_peered":"2024-09-10T20:50:08.569704+0000","last_clean":"2024-09-10T20:50:08.569704+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:50:08.569704+0000","last_undegraded":"2024-09-10T20:50:08.569704+0000","last_fullsized":"2024-09-10T20:50:08.569704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568521+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:50:08.568521+0000","last_peered":"2024-09-10T20:50:08.568521+0000","last_clean":"2024-09-10T20:50:08.568521+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:50:08.568521+0000","last_undegraded":"2024-09-10T20:50:08.568521+0000","last_fullsized":"2024-09-10T20:50:08.568521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564361+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:50:08.564361+0000","last_peered":"2024-09-10T20:50:08.564361+0000","last_clean":"2024-09-10T20:50:08.564361+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:50:08.564361+0000","last_undegraded":"2024-09-10T20:50:08.564361+0000","last_fullsized":"2024-09-10T20:50:08.564361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562034+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:50:08.562034+0000","last_peered":"2024-09-10T20:50:08.562034+0000","last_clean":"2024-09-10T20:50:08.562034+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:50:08.562034+0000","last_undegraded":"2024-09-10T20:50:08.562034+0000","last_fullsized":"2024-09-10T20:50:08.562034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570081+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:50:08.570081+0000","last_peered":"2024-09-10T20:50:08.570081+0000","last_clean":"2024-09-10T20:50:08.570081+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:50:08.570081+0000","last_undegraded":"2024-09-10T20:50:08.570081+0000","last_fullsized":"2024-09-10T20:50:08.570081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567782+0000","last_change":"2024-09-10T20:50:08.567682+0000","last_active":"2024-09-10T20:50:08.567782+0000","last_peered":"2024-09-10T20:50:08.567782+0000","last_clean":"2024-09-10T20:50:08.567782+0000","last_became_active":"2024-09-10T20:50:08.567302+0000","last_became_peered":"2024-09-10T20:50:08.567302+0000","last_unstale":"2024-09-10T20:50:08.567782+0000","last_undegraded":"2024-09-10T20:50:08.567782+0000","last_fullsized":"2024-09-10T20:50:08.567782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:59.818786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569308+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:50:08.569308+0000","last_peered":"2024-09-10T20:50:08.569308+0000","last_clean":"2024-09-10T20:50:08.569308+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:50:08.569308+0000","last_undegraded":"2024-09-10T20:50:08.569308+0000","last_fullsized":"2024-09-10T20:50:08.569308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565982+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:50:08.565982+0000","last_peered":"2024-09-10T20:50:08.565982+0000","last_clean":"2024-09-10T20:50:08.565982+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:50:08.565982+0000","last_undegraded":"2024-09-10T20:50:08.565982+0000","last_fullsized":"2024-09-10T20:50:08.565982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565933+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:50:08.565933+0000","last_peered":"2024-09-10T20:50:08.565933+0000","last_clean":"2024-09-10T20:50:08.565933+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:50:08.565933+0000","last_undegraded":"2024-09-10T20:50:08.565933+0000","last_fullsized":"2024-09-10T20:50:08.565933+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563842+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:50:08.563842+0000","last_peered":"2024-09-10T20:50:08.563842+0000","last_clean":"2024-09-10T20:50:08.563842+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:50:08.563842+0000","last_undegraded":"2024-09-10T20:50:08.563842+0000","last_fullsized":"2024-09-10T20:50:08.563842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.562187+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:50:08.562187+0000","last_peered":"2024-09-10T20:50:08.562187+0000","last_clean":"2024-09-10T20:50:08.562187+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:50:08.562187+0000","last_undegraded":"2024-09-10T20:50:08.562187+0000","last_fullsized":"2024-09-10T20:50:08.562187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563486+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:50:08.563486+0000","last_peered":"2024-09-10T20:50:08.563486+0000","last_clean":"2024-09-10T20:50:08.563486+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:50:08.563486+0000","last_undegraded":"2024-09-10T20:50:08.563486+0000","last_fullsized":"2024-09-10T20:50:08.563486+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567840+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:50:08.567840+0000","last_peered":"2024-09-10T20:50:08.567840+0000","last_clean":"2024-09-10T20:50:08.567840+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:50:08.567840+0000","last_undegraded":"2024-09-10T20:50:08.567840+0000","last_fullsized":"2024-09-10T20:50:08.567840+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561826+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:50:08.561826+0000","last_peered":"2024-09-10T20:50:08.561826+0000","last_clean":"2024-09-10T20:50:08.561826+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:50:08.561826+0000","last_undegraded":"2024-09-10T20:50:08.561826+0000","last_fullsized":"2024-09-10T20:50:08.561826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569400+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:50:08.569400+0000","last_peered":"2024-09-10T20:50:08.569400+0000","last_clean":"2024-09-10T20:50:08.569400+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:50:08.569400+0000","last_undegraded":"2024-09-10T20:50:08.569400+0000","last_fullsized":"2024-09-10T20:50:08.569400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564258+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:50:08.564258+0000","last_peered":"2024-09-10T20:50:08.564258+0000","last_clean":"2024-09-10T20:50:08.564258+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:50:08.564258+0000","last_undegraded":"2024-09-10T20:50:08.564258+0000","last_fullsized":"2024-09-10T20:50:08.564258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568634+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:50:08.568634+0000","last_peered":"2024-09-10T20:50:08.568634+0000","last_clean":"2024-09-10T20:50:08.568634+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:50:08.568634+0000","last_undegraded":"2024-09-10T20:50:08.568634+0000","last_fullsized":"2024-09-10T20:50:08.568634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564240+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:50:08.564240+0000","last_peered":"2024-09-10T20:50:08.564240+0000","last_clean":"2024-09-10T20:50:08.564240+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:50:08.564240+0000","last_undegraded":"2024-09-10T20:50:08.564240+0000","last_fullsized":"2024-09-10T20:50:08.564240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568721+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:50:08.568721+0000","last_peered":"2024-09-10T20:50:08.568721+0000","last_clean":"2024-09-10T20:50:08.568721+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:50:08.568721+0000","last_undegraded":"2024-09-10T20:50:08.568721+0000","last_fullsized":"2024-09-10T20:50:08.568721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568151+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:50:08.568151+0000","last_peered":"2024-09-10T20:50:08.568151+0000","last_clean":"2024-09-10T20:50:08.568151+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:50:08.568151+0000","last_undegraded":"2024-09-10T20:50:08.568151+0000","last_fullsized":"2024-09-10T20:50:08.568151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561963+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:50:08.561963+0000","last_peered":"2024-09-10T20:50:08.561963+0000","last_clean":"2024-09-10T20:50:08.561963+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:50:08.561963+0000","last_undegraded":"2024-09-10T20:50:08.561963+0000","last_fullsized":"2024-09-10T20:50:08.561963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569035+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:50:08.569035+0000","last_peered":"2024-09-10T20:50:08.569035+0000","last_clean":"2024-09-10T20:50:08.569035+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:50:08.569035+0000","last_undegraded":"2024-09-10T20:50:08.569035+0000","last_fullsized":"2024-09-10T20:50:08.569035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566106+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:50:08.566106+0000","last_peered":"2024-09-10T20:50:08.566106+0000","last_clean":"2024-09-10T20:50:08.566106+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:50:08.566106+0000","last_undegraded":"2024-09-10T20:50:08.566106+0000","last_fullsized":"2024-09-10T20:50:08.566106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567399+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:50:08.567399+0000","last_peered":"2024-09-10T20:50:08.567399+0000","last_clean":"2024-09-10T20:50:08.567399+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:50:08.567399+0000","last_undegraded":"2024-09-10T20:50:08.567399+0000","last_fullsized":"2024-09-10T20:50:08.567399+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567899+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:50:08.567899+0000","last_peered":"2024-09-10T20:50:08.567899+0000","last_clean":"2024-09-10T20:50:08.567899+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:50:08.567899+0000","last_undegraded":"2024-09-10T20:50:08.567899+0000","last_fullsized":"2024-09-10T20:50:08.567899+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561763+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:50:08.561763+0000","last_peered":"2024-09-10T20:50:08.561763+0000","last_clean":"2024-09-10T20:50:08.561763+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:50:08.561763+0000","last_undegraded":"2024-09-10T20:50:08.561763+0000","last_fullsized":"2024-09-10T20:50:08.561763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565795+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:50:08.565795+0000","last_peered":"2024-09-10T20:50:08.565795+0000","last_clean":"2024-09-10T20:50:08.565795+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:50:08.565795+0000","last_undegraded":"2024-09-10T20:50:08.565795+0000","last_fullsized":"2024-09-10T20:50:08.565795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:28.555856+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:50:28.555856+0000","last_peered":"2024-09-10T20:50:28.555856+0000","last_clean":"2024-09-10T20:50:28.555856+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:50:28.555856+0000","last_undegraded":"2024-09-10T20:50:28.555856+0000","last_fullsized":"2024-09-10T20:50:28.555856+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570552+0000","last_change":"2024-09-10T20:50:08.570456+0000","last_active":"2024-09-10T20:50:08.570552+0000","last_peered":"2024-09-10T20:50:08.570552+0000","last_clean":"2024-09-10T20:50:08.570552+0000","last_became_active":"2024-09-10T20:50:08.570104+0000","last_became_peered":"2024-09-10T20:50:08.570104+0000","last_unstale":"2024-09-10T20:50:08.570552+0000","last_undegraded":"2024-09-10T20:50:08.570552+0000","last_fullsized":"2024-09-10T20:50:08.570552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.998765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561580+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:50:08.561580+0000","last_peered":"2024-09-10T20:50:08.561580+0000","last_clean":"2024-09-10T20:50:08.561580+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:50:08.561580+0000","last_undegraded":"2024-09-10T20:50:08.561580+0000","last_fullsized":"2024-09-10T20:50:08.561580+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568874+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:50:08.568874+0000","last_peered":"2024-09-10T20:50:08.568874+0000","last_clean":"2024-09-10T20:50:08.568874+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:50:08.568874+0000","last_undegraded":"2024-09-10T20:50:08.568874+0000","last_fullsized":"2024-09-10T20:50:08.568874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568556+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:50:08.568556+0000","last_peered":"2024-09-10T20:50:08.568556+0000","last_clean":"2024-09-10T20:50:08.568556+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:50:08.568556+0000","last_undegraded":"2024-09-10T20:50:08.568556+0000","last_fullsized":"2024-09-10T20:50:08.568556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565380+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:50:08.565380+0000","last_peered":"2024-09-10T20:50:08.565380+0000","last_clean":"2024-09-10T20:50:08.565380+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:50:08.565380+0000","last_undegraded":"2024-09-10T20:50:08.565380+0000","last_fullsized":"2024-09-10T20:50:08.565380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563282+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:50:08.563282+0000","last_peered":"2024-09-10T20:50:08.563282+0000","last_clean":"2024-09-10T20:50:08.563282+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:50:08.563282+0000","last_undegraded":"2024-09-10T20:50:08.563282+0000","last_fullsized":"2024-09-10T20:50:08.563282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.556847+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:50:29.556847+0000","last_peered":"2024-09-10T20:50:29.556847+0000","last_clean":"2024-09-10T20:50:29.556847+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:50:29.556847+0000","last_undegraded":"2024-09-10T20:50:29.556847+0000","last_fullsized":"2024-09-10T20:50:29.556847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564187+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:50:08.564187+0000","last_peered":"2024-09-10T20:50:08.564187+0000","last_clean":"2024-09-10T20:50:08.564187+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:50:08.564187+0000","last_undegraded":"2024-09-10T20:50:08.564187+0000","last_fullsized":"2024-09-10T20:50:08.564187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570157+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:50:08.570157+0000","last_peered":"2024-09-10T20:50:08.570157+0000","last_clean":"2024-09-10T20:50:08.570157+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:50:08.570157+0000","last_undegraded":"2024-09-10T20:50:08.570157+0000","last_fullsized":"2024-09-10T20:50:08.570157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566306+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:50:08.566306+0000","last_peered":"2024-09-10T20:50:08.566306+0000","last_clean":"2024-09-10T20:50:08.566306+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:50:08.566306+0000","last_undegraded":"2024-09-10T20:50:08.566306+0000","last_fullsized":"2024-09-10T20:50:08.566306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564804+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:50:08.564804+0000","last_peered":"2024-09-10T20:50:08.564804+0000","last_clean":"2024-09-10T20:50:08.564804+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:50:08.564804+0000","last_undegraded":"2024-09-10T20:50:08.564804+0000","last_fullsized":"2024-09-10T20:50:08.564804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564180+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:50:08.564180+0000","last_peered":"2024-09-10T20:50:08.564180+0000","last_clean":"2024-09-10T20:50:08.564180+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:50:08.564180+0000","last_undegraded":"2024-09-10T20:50:08.564180+0000","last_fullsized":"2024-09-10T20:50:08.564180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'29","reported_seq":173,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:30.558420+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:50:30.558420+0000","last_peered":"2024-09-10T20:50:30.558420+0000","last_clean":"2024-09-10T20:50:30.558420+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:50:30.558420+0000","last_undegraded":"2024-09-10T20:50:30.558420+0000","last_fullsized":"2024-09-10T20:50:30.558420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61750,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":121,"num_read_kb":120,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565750+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:50:08.565750+0000","last_peered":"2024-09-10T20:50:08.565750+0000","last_clean":"2024-09-10T20:50:08.565750+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:50:08.565750+0000","last_undegraded":"2024-09-10T20:50:08.565750+0000","last_fullsized":"2024-09-10T20:50:08.565750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567504+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:50:08.567504+0000","last_peered":"2024-09-10T20:50:08.567504+0000","last_clean":"2024-09-10T20:50:08.567504+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:50:08.567504+0000","last_undegraded":"2024-09-10T20:50:08.567504+0000","last_fullsized":"2024-09-10T20:50:08.567504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569038+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:50:08.569038+0000","last_peered":"2024-09-10T20:50:08.569038+0000","last_clean":"2024-09-10T20:50:08.569038+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:50:08.569038+0000","last_undegraded":"2024-09-10T20:50:08.569038+0000","last_fullsized":"2024-09-10T20:50:08.569038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564496+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:50:08.564496+0000","last_peered":"2024-09-10T20:50:08.564496+0000","last_clean":"2024-09-10T20:50:08.564496+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:50:08.564496+0000","last_undegraded":"2024-09-10T20:50:08.564496+0000","last_fullsized":"2024-09-10T20:50:08.564496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570014+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:50:08.570014+0000","last_peered":"2024-09-10T20:50:08.570014+0000","last_clean":"2024-09-10T20:50:08.570014+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:50:08.570014+0000","last_undegraded":"2024-09-10T20:50:08.570014+0000","last_fullsized":"2024-09-10T20:50:08.570014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.569135+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:50:29.569135+0000","last_peered":"2024-09-10T20:50:29.569135+0000","last_clean":"2024-09-10T20:50:29.569135+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:50:29.569135+0000","last_undegraded":"2024-09-10T20:50:29.569135+0000","last_fullsized":"2024-09-10T20:50:29.569135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569343+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:50:08.569343+0000","last_peered":"2024-09-10T20:50:08.569343+0000","last_clean":"2024-09-10T20:50:08.569343+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:50:08.569343+0000","last_undegraded":"2024-09-10T20:50:08.569343+0000","last_fullsized":"2024-09-10T20:50:08.569343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563927+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:50:08.563927+0000","last_peered":"2024-09-10T20:50:08.563927+0000","last_clean":"2024-09-10T20:50:08.563927+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:50:08.563927+0000","last_undegraded":"2024-09-10T20:50:08.563927+0000","last_fullsized":"2024-09-10T20:50:08.563927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564324+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:50:08.564324+0000","last_peered":"2024-09-10T20:50:08.564324+0000","last_clean":"2024-09-10T20:50:08.564324+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:50:08.564324+0000","last_undegraded":"2024-09-10T20:50:08.564324+0000","last_fullsized":"2024-09-10T20:50:08.564324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566303+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:50:08.566303+0000","last_peered":"2024-09-10T20:50:08.566303+0000","last_clean":"2024-09-10T20:50:08.566303+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:50:08.566303+0000","last_undegraded":"2024-09-10T20:50:08.566303+0000","last_fullsized":"2024-09-10T20:50:08.566303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561982+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:50:08.561982+0000","last_peered":"2024-09-10T20:50:08.561982+0000","last_clean":"2024-09-10T20:50:08.561982+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:50:08.561982+0000","last_undegraded":"2024-09-10T20:50:08.561982+0000","last_fullsized":"2024-09-10T20:50:08.561982+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569541+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:50:08.569541+0000","last_peered":"2024-09-10T20:50:08.569541+0000","last_clean":"2024-09-10T20:50:08.569541+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:50:08.569541+0000","last_undegraded":"2024-09-10T20:50:08.569541+0000","last_fullsized":"2024-09-10T20:50:08.569541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570202+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:50:08.570202+0000","last_peered":"2024-09-10T20:50:08.570202+0000","last_clean":"2024-09-10T20:50:08.570202+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:50:08.570202+0000","last_undegraded":"2024-09-10T20:50:08.570202+0000","last_fullsized":"2024-09-10T20:50:08.570202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564958+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:50:08.564958+0000","last_peered":"2024-09-10T20:50:08.564958+0000","last_clean":"2024-09-10T20:50:08.564958+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:50:08.564958+0000","last_undegraded":"2024-09-10T20:50:08.564958+0000","last_fullsized":"2024-09-10T20:50:08.564958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570014+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:50:08.570014+0000","last_peered":"2024-09-10T20:50:08.570014+0000","last_clean":"2024-09-10T20:50:08.570014+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:50:08.570014+0000","last_undegraded":"2024-09-10T20:50:08.570014+0000","last_fullsized":"2024-09-10T20:50:08.570014+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568133+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:50:08.568133+0000","last_peered":"2024-09-10T20:50:08.568133+0000","last_clean":"2024-09-10T20:50:08.568133+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:50:08.568133+0000","last_undegraded":"2024-09-10T20:50:08.568133+0000","last_fullsized":"2024-09-10T20:50:08.568133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570112+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:50:08.570112+0000","last_peered":"2024-09-10T20:50:08.570112+0000","last_clean":"2024-09-10T20:50:08.570112+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:50:08.570112+0000","last_undegraded":"2024-09-10T20:50:08.570112+0000","last_fullsized":"2024-09-10T20:50:08.570112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569597+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:50:08.569597+0000","last_peered":"2024-09-10T20:50:08.569597+0000","last_clean":"2024-09-10T20:50:08.569597+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:50:08.569597+0000","last_undegraded":"2024-09-10T20:50:08.569597+0000","last_fullsized":"2024-09-10T20:50:08.569597+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568872+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:50:08.568872+0000","last_peered":"2024-09-10T20:50:08.568872+0000","last_clean":"2024-09-10T20:50:08.568872+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:50:08.568872+0000","last_undegraded":"2024-09-10T20:50:08.568872+0000","last_fullsized":"2024-09-10T20:50:08.568872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568876+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:50:08.568876+0000","last_peered":"2024-09-10T20:50:08.568876+0000","last_clean":"2024-09-10T20:50:08.568876+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:50:08.568876+0000","last_undegraded":"2024-09-10T20:50:08.568876+0000","last_fullsized":"2024-09-10T20:50:08.568876+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569502+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:50:08.569502+0000","last_peered":"2024-09-10T20:50:08.569502+0000","last_clean":"2024-09-10T20:50:08.569502+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:50:08.569502+0000","last_undegraded":"2024-09-10T20:50:08.569502+0000","last_fullsized":"2024-09-10T20:50:08.569502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568972+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:50:08.568972+0000","last_peered":"2024-09-10T20:50:08.568972+0000","last_clean":"2024-09-10T20:50:08.568972+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:50:08.568972+0000","last_undegraded":"2024-09-10T20:50:08.568972+0000","last_fullsized":"2024-09-10T20:50:08.568972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:29.568601+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:50:29.568601+0000","last_peered":"2024-09-10T20:50:29.568601+0000","last_clean":"2024-09-10T20:50:29.568601+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:50:29.568601+0000","last_undegraded":"2024-09-10T20:50:29.568601+0000","last_fullsized":"2024-09-10T20:50:29.568601+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569852+0000","last_change":"2024-09-10T20:50:08.569711+0000","last_active":"2024-09-10T20:50:08.569852+0000","last_peered":"2024-09-10T20:50:08.569852+0000","last_clean":"2024-09-10T20:50:08.569852+0000","last_became_active":"2024-09-10T20:50:08.569348+0000","last_became_peered":"2024-09-10T20:50:08.569348+0000","last_unstale":"2024-09-10T20:50:08.569852+0000","last_undegraded":"2024-09-10T20:50:08.569852+0000","last_fullsized":"2024-09-10T20:50:08.569852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570006+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:50:08.570006+0000","last_peered":"2024-09-10T20:50:08.570006+0000","last_clean":"2024-09-10T20:50:08.570006+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:50:08.570006+0000","last_undegraded":"2024-09-10T20:50:08.570006+0000","last_fullsized":"2024-09-10T20:50:08.570006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561723+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:50:08.561723+0000","last_peered":"2024-09-10T20:50:08.561723+0000","last_clean":"2024-09-10T20:50:08.561723+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:50:08.561723+0000","last_undegraded":"2024-09-10T20:50:08.561723+0000","last_fullsized":"2024-09-10T20:50:08.561723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563780+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:50:08.563780+0000","last_peered":"2024-09-10T20:50:08.563780+0000","last_clean":"2024-09-10T20:50:08.563780+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:50:08.563780+0000","last_undegraded":"2024-09-10T20:50:08.563780+0000","last_fullsized":"2024-09-10T20:50:08.563780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561806+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:50:08.561806+0000","last_peered":"2024-09-10T20:50:08.561806+0000","last_clean":"2024-09-10T20:50:08.561806+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:50:08.561806+0000","last_undegraded":"2024-09-10T20:50:08.561806+0000","last_fullsized":"2024-09-10T20:50:08.561806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566052+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:50:08.566052+0000","last_peered":"2024-09-10T20:50:08.566052+0000","last_clean":"2024-09-10T20:50:08.566052+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:50:08.566052+0000","last_undegraded":"2024-09-10T20:50:08.566052+0000","last_fullsized":"2024-09-10T20:50:08.566052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569339+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:50:08.569339+0000","last_peered":"2024-09-10T20:50:08.569339+0000","last_clean":"2024-09-10T20:50:08.569339+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:50:08.569339+0000","last_undegraded":"2024-09-10T20:50:08.569339+0000","last_fullsized":"2024-09-10T20:50:08.569339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563584+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:50:08.563584+0000","last_peered":"2024-09-10T20:50:08.563584+0000","last_clean":"2024-09-10T20:50:08.563584+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:50:08.563584+0000","last_undegraded":"2024-09-10T20:50:08.563584+0000","last_fullsized":"2024-09-10T20:50:08.563584+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569455+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:50:08.569455+0000","last_peered":"2024-09-10T20:50:08.569455+0000","last_clean":"2024-09-10T20:50:08.569455+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:50:08.569455+0000","last_undegraded":"2024-09-10T20:50:08.569455+0000","last_fullsized":"2024-09-10T20:50:08.569455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569278+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:50:08.569278+0000","last_peered":"2024-09-10T20:50:08.569278+0000","last_clean":"2024-09-10T20:50:08.569278+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:50:08.569278+0000","last_undegraded":"2024-09-10T20:50:08.569278+0000","last_fullsized":"2024-09-10T20:50:08.569278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566203+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:50:08.566203+0000","last_peered":"2024-09-10T20:50:08.566203+0000","last_clean":"2024-09-10T20:50:08.566203+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:50:08.566203+0000","last_undegraded":"2024-09-10T20:50:08.566203+0000","last_fullsized":"2024-09-10T20:50:08.566203+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.571450+0000","last_change":"2024-09-10T20:50:08.571340+0000","last_active":"2024-09-10T20:50:08.571450+0000","last_peered":"2024-09-10T20:50:08.571450+0000","last_clean":"2024-09-10T20:50:08.571450+0000","last_became_active":"2024-09-10T20:50:08.567038+0000","last_became_peered":"2024-09-10T20:50:08.567038+0000","last_unstale":"2024-09-10T20:50:08.571450+0000","last_undegraded":"2024-09-10T20:50:08.571450+0000","last_fullsized":"2024-09-10T20:50:08.571450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:56.536271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565417+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:50:08.565417+0000","last_peered":"2024-09-10T20:50:08.565417+0000","last_clean":"2024-09-10T20:50:08.565417+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:50:08.565417+0000","last_undegraded":"2024-09-10T20:50:08.565417+0000","last_fullsized":"2024-09-10T20:50:08.565417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568779+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:50:08.568779+0000","last_peered":"2024-09-10T20:50:08.568779+0000","last_clean":"2024-09-10T20:50:08.568779+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:50:08.568779+0000","last_undegraded":"2024-09-10T20:50:08.568779+0000","last_fullsized":"2024-09-10T20:50:08.568779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561826+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:50:08.561826+0000","last_peered":"2024-09-10T20:50:08.561826+0000","last_clean":"2024-09-10T20:50:08.561826+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:50:08.561826+0000","last_undegraded":"2024-09-10T20:50:08.561826+0000","last_fullsized":"2024-09-10T20:50:08.561826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567543+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:50:08.567543+0000","last_peered":"2024-09-10T20:50:08.567543+0000","last_clean":"2024-09-10T20:50:08.567543+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:50:08.567543+0000","last_undegraded":"2024-09-10T20:50:08.567543+0000","last_fullsized":"2024-09-10T20:50:08.567543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569148+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:50:08.569148+0000","last_peered":"2024-09-10T20:50:08.569148+0000","last_clean":"2024-09-10T20:50:08.569148+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:50:08.569148+0000","last_undegraded":"2024-09-10T20:50:08.569148+0000","last_fullsized":"2024-09-10T20:50:08.569148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566615+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:50:08.566615+0000","last_peered":"2024-09-10T20:50:08.566615+0000","last_clean":"2024-09-10T20:50:08.566615+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:50:08.566615+0000","last_undegraded":"2024-09-10T20:50:08.566615+0000","last_fullsized":"2024-09-10T20:50:08.566615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569871+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:50:08.569871+0000","last_peered":"2024-09-10T20:50:08.569871+0000","last_clean":"2024-09-10T20:50:08.569871+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:50:08.569871+0000","last_undegraded":"2024-09-10T20:50:08.569871+0000","last_fullsized":"2024-09-10T20:50:08.569871+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570658+0000","last_change":"2024-09-10T20:50:08.570537+0000","last_active":"2024-09-10T20:50:08.570658+0000","last_peered":"2024-09-10T20:50:08.570658+0000","last_clean":"2024-09-10T20:50:08.570658+0000","last_became_active":"2024-09-10T20:50:08.570083+0000","last_became_peered":"2024-09-10T20:50:08.570083+0000","last_unstale":"2024-09-10T20:50:08.570658+0000","last_undegraded":"2024-09-10T20:50:08.570658+0000","last_fullsized":"2024-09-10T20:50:08.570658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:15.834461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.573406+0000","last_change":"2024-09-10T20:50:08.572886+0000","last_active":"2024-09-10T20:50:08.573406+0000","last_peered":"2024-09-10T20:50:08.573406+0000","last_clean":"2024-09-10T20:50:08.573406+0000","last_became_active":"2024-09-10T20:50:08.568973+0000","last_became_peered":"2024-09-10T20:50:08.568973+0000","last_unstale":"2024-09-10T20:50:08.573406+0000","last_undegraded":"2024-09-10T20:50:08.573406+0000","last_fullsized":"2024-09-10T20:50:08.573406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:09.903383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564000+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:50:08.564000+0000","last_peered":"2024-09-10T20:50:08.564000+0000","last_clean":"2024-09-10T20:50:08.564000+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:50:08.564000+0000","last_undegraded":"2024-09-10T20:50:08.564000+0000","last_fullsized":"2024-09-10T20:50:08.564000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565963+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:50:08.565963+0000","last_peered":"2024-09-10T20:50:08.565963+0000","last_clean":"2024-09-10T20:50:08.565963+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:50:08.565963+0000","last_undegraded":"2024-09-10T20:50:08.565963+0000","last_fullsized":"2024-09-10T20:50:08.565963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566302+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:50:08.566302+0000","last_peered":"2024-09-10T20:50:08.566302+0000","last_clean":"2024-09-10T20:50:08.566302+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:50:08.566302+0000","last_undegraded":"2024-09-10T20:50:08.566302+0000","last_fullsized":"2024-09-10T20:50:08.566302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569349+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:50:08.569349+0000","last_peered":"2024-09-10T20:50:08.569349+0000","last_clean":"2024-09-10T20:50:08.569349+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:50:08.569349+0000","last_undegraded":"2024-09-10T20:50:08.569349+0000","last_fullsized":"2024-09-10T20:50:08.569349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569188+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:50:08.569188+0000","last_peered":"2024-09-10T20:50:08.569188+0000","last_clean":"2024-09-10T20:50:08.569188+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:50:08.569188+0000","last_undegraded":"2024-09-10T20:50:08.569188+0000","last_fullsized":"2024-09-10T20:50:08.569188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563549+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:50:08.563549+0000","last_peered":"2024-09-10T20:50:08.563549+0000","last_clean":"2024-09-10T20:50:08.563549+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:50:08.563549+0000","last_undegraded":"2024-09-10T20:50:08.563549+0000","last_fullsized":"2024-09-10T20:50:08.563549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65751,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":363,"num_read_kb":251,"num_write":162,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808859,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":811008,"data_stored":394113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1507328,"data_stored":1047735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":394349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":827392,"data_stored":394269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36736,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708416,"statfs":{"total":95995035648,"available":95957417984,"internally_reserved":0,"allocated":1421312,"data_stored":986199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":815104,"data_stored":393738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888121,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":985492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":819200,"data_stored":394566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":831488,"data_stored":394049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":456631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":455281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":395009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:50:35.228 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T20:50:35.228 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T20:50:35.228 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T20:50:35.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T20:50:35.494 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:35.507 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:35 smithi067 ceph-mon[30891]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:35.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:35 smithi083 ceph-mon[35058]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:35 smithi172 ceph-mon[35265]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:50:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 -- 172.21.15.67:0/1771237645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03901087f0 msgr2=0x7f0390108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1771237645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03901087f0 0x7f0390108c30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0380009900 tx=0x7f038002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 -- 172.21.15.67:0/1771237645 shutdown_connections 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1771237645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0390109170 0x7f039010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1771237645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f03901087f0 0x7f0390108c30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1771237645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 -- 172.21.15.67:0/1771237645 >> 172.21.15.67:0/1771237645 conn(0x7f03900fe830 msgr2=0x7f0390100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.956+0000 7f0397c5d640 1 -- 172.21.15.67:0/1771237645 shutdown_connections 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 -- 172.21.15.67:0/1771237645 wait complete. 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 Processor -- start 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 -- start start 2024-09-10T20:50:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03901087f0 0x7f0390199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.957+0000 7f0397c5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 0x7f039019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0397c5d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0390112e30 con 0x7f0390109170 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0397c5d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0390112cb0 con 0x7f03901087f0 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0397c5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0390112fb0 con 0x7f0390102de0 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03959f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 0x7f039019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03959f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34900/0 (socket says 172.21.15.67:34900) 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03959f9640 1 -- 172.21.15.67:0/1837649810 learned_addr learned my addr 172.21.15.67:0/1837649810 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03951f8640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03901087f0 0x7f0390199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 -- 172.21.15.67:0/1837649810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 msgr2=0x7f03901992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 -- 172.21.15.67:0/1837649810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03901087f0 msgr2=0x7f0390199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03901087f0 0x7f0390199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 -- 172.21.15.67:0/1837649810 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039019f390 con 0x7f0390109170 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f03961fa640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 0x7f039019ebc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f038800ca30 tx=0x7f038800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388007d90 con 0x7f0390109170 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039019f680 con 0x7f0390109170 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0388005020 con 0x7f0390109170 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.958+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038800f690 con 0x7f0390109170 2024-09-10T20:50:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.959+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03901a5d40 con 0x7f0390109170 2024-09-10T20:50:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.959+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03901031c0 con 0x7f0390109170 2024-09-10T20:50:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.961+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f03880054f0 con 0x7f0390109170 2024-09-10T20:50:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.962+0000 7f0386ffd640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 0x7f037c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.962+0000 7f03959f9640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 0x7f037c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.962+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f03880e6320 con 0x7f0390109170 2024-09-10T20:50:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.963+0000 7f03959f9640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 0x7f037c0b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f038c0058c0 tx=0x7f038c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:35.966+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0388014070 con 0x7f0390109170 2024-09-10T20:50:36.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.189+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f039010af50 con 0x7f0390109170 2024-09-10T20:50:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.190+0000 7f0386ffd640 1 -- 172.21.15.67:0/1837649810 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f03880aca00 con 0x7f0390109170 2024-09-10T20:50:36.194 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:36.194 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 msgr2=0x7f037c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 0x7f037c0b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f038c0058c0 tx=0x7f038c005f90 comp rx=0 tx=0).stop 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 msgr2=0x7f039019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 0x7f039019ebc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f038800ca30 tx=0x7f038800cef0 comp rx=0 tx=0).stop 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 shutdown_connections 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0390109170 0x7f039019ebc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f03901087f0 0x7f0390199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f037c0b5370 0x7f037c0b7830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 --2- 172.21.15.67:0/1837649810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0390102de0 0x7f03901992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 >> 172.21.15.67:0/1837649810 conn(0x7f03900fe830 msgr2=0x7f0390100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 shutdown_connections 2024-09-10T20:50:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:36.192+0000 7f0397c5d640 1 -- 172.21.15.67:0/1837649810 wait complete. 2024-09-10T20:50:36.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:36 smithi083 ceph-mon[35058]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:36.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:36 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1837649810' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T20:50:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:36 smithi067 ceph-mon[30891]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:36.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:36 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1837649810' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T20:50:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:36 smithi172 ceph-mon[35265]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:36 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1837649810' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T20:50:36.900 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T20:50:36.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:50:37.161 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 -- 172.21.15.67:0/156773637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b601076c0 msgr2=0x7f4b60107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 --2- 172.21.15.67:0/156773637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b601076c0 0x7f4b60107b00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009900 tx=0x7f4b5c02a410 comp rx=0 tx=0).stop 2024-09-10T20:50:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 -- 172.21.15.67:0/156773637 shutdown_connections 2024-09-10T20:50:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 --2- 172.21.15.67:0/156773637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b60108040 0x7f4b6010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 --2- 172.21.15.67:0/156773637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b601076c0 0x7f4b60107b00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 --2- 172.21.15.67:0/156773637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b60102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 -- 172.21.15.67:0/156773637 >> 172.21.15.67:0/156773637 conn(0x7f4b600fd700 msgr2=0x7f4b600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 -- 172.21.15.67:0/156773637 shutdown_connections 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.708+0000 7f4b67f03640 1 -- 172.21.15.67:0/156773637 wait complete. 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 Processor -- start 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 -- start start 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b601992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b601076c0 0x7f4b601997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112e20 con 0x7f4b60108040 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112ca0 con 0x7f4b601076c0 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b67f03640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60112fa0 con 0x7f4b60101cb0 2024-09-10T20:50:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50400/0 (socket says 172.21.15.67:50400) 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 -- 172.21.15.67:0/3643472906 learned_addr learned my addr 172.21.15.67:0/3643472906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b65c9f640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b601992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b6549e640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b601076c0 0x7f4b601997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 -- 172.21.15.67:0/3643472906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 msgr2=0x7f4b601992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b601992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 -- 172.21.15.67:0/3643472906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b601076c0 msgr2=0x7f4b601997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b601076c0 0x7f4b601997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 -- 172.21.15.67:0/3643472906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6019f360 con 0x7f4b60108040 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b65c9f640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.709+0000 7f4b664a0640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800eaa0 tx=0x7f4b5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.710+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800cdb0 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.710+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b58005020 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.710+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6019f650 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.710+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580116d0 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.710+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601a5d10 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.711+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b60102090 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.712+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4b5800f040 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.713+0000 7f4b52ffd640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 0x7f4b4c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.713+0000 7f4b65c9f640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 0x7f4b4c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.713+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4b580e6070 con 0x7f4b60108040 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.713+0000 7f4b65c9f640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 0x7f4b4c0b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b54005fd0 tx=0x7f4b54005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.716+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4b58016030 con 0x7f4b60108040 2024-09-10T20:50:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.938+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b6002e5c0 con 0x7f4b60108040 2024-09-10T20:50:37.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.939+0000 7f4b52ffd640 1 -- 172.21.15.67:0/3643472906 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f4b580ace00 con 0x7f4b60108040 2024-09-10T20:50:37.944 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:37.944 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:50:37.944 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:50:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 msgr2=0x7f4b4c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 0x7f4b4c0b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b54005fd0 tx=0x7f4b54005ea0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 msgr2=0x7f4b6019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800eaa0 tx=0x7f4b5800ef60 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 shutdown_connections 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b60108040 0x7f4b6019eb90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b601076c0 0x7f4b601997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4b4c0b5370 0x7f4b4c0b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 --2- 172.21.15.67:0/3643472906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b60101cb0 0x7f4b601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.941+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 >> 172.21.15.67:0/3643472906 conn(0x7f4b600fd700 msgr2=0x7f4b600ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.942+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 shutdown_connections 2024-09-10T20:50:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:37.942+0000 7f4b67f03640 1 -- 172.21.15.67:0/3643472906 wait complete. 2024-09-10T20:50:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:38 smithi067 ceph-mon[30891]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:38.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:38 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3643472906' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:38.594 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:50:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:38 smithi083 ceph-mon[35058]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:38 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3643472906' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:38 smithi172 ceph-mon[35265]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:38 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3643472906' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:38.859 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 -- 172.21.15.67:0/1878042406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 msgr2=0x7f3aa81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 --2- 172.21.15.67:0/1878042406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa81020b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009900 tx=0x7f3aa402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 -- 172.21.15.67:0/1878042406 shutdown_connections 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 --2- 172.21.15.67:0/1878042406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa8108060 0x7f3aa810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 --2- 172.21.15.67:0/1878042406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa81076e0 0x7f3aa8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 --2- 172.21.15.67:0/1878042406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa81020b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 -- 172.21.15.67:0/1878042406 >> 172.21.15.67:0/1878042406 conn(0x7f3aa80fd700 msgr2=0x7f3aa80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 -- 172.21.15.67:0/1878042406 shutdown_connections 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.323+0000 7f3ab034f640 1 -- 172.21.15.67:0/1878042406 wait complete. 2024-09-10T20:50:39.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 Processor -- start 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 -- start start 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa81076e0 0x7f3aa81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 0x7f3aa819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8111ce0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8111b60 con 0x7f3aa8108060 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3ab034f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8111e60 con 0x7f3aa81076e0 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3aae0eb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3aae0eb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50408/0 (socket says 172.21.15.67:50408) 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3aae0eb640 1 -- 172.21.15.67:0/2082859125 learned_addr learned my addr 172.21.15.67:0/2082859125 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.324+0000 7f3aad8ea640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa81076e0 0x7f3aa81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae8ec640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 0x7f3aa819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:39.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 -- 172.21.15.67:0/2082859125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa81076e0 msgr2=0x7f3aa81997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa81076e0 0x7f3aa81997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 -- 172.21.15.67:0/2082859125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 msgr2=0x7f3aa819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 0x7f3aa819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 -- 172.21.15.67:0/2082859125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa819f310 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae8ec640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 0x7f3aa819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3aae0eb640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005940 tx=0x7f3aa40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa403f030 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa819f5a0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3aa4003cb0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4035070 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.325+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa81a5cc0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.326+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa81020b0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.328+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3aa403bbf0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.328+0000 7f3a9f7fe640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 0x7f3a940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:39.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.328+0000 7f3aad8ea640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 0x7f3a940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:39.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.328+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3aa4106b30 con 0x7f3aa8101cd0 2024-09-10T20:50:39.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.329+0000 7f3aad8ea640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 0x7f3a940b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8107230 tx=0x7f3a9800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:39.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.331+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3aa40cd8c0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.555+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa802e5c0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.556+0000 7f3a9f7fe640 1 -- 172.21.15.67:0/2082859125 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f3aa40cd1c0 con 0x7f3aa8101cd0 2024-09-10T20:50:39.560 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:39.560 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:50:39.561 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:50:39.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 msgr2=0x7f3a940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:39.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 0x7f3a940b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8107230 tx=0x7f3a9800a2d0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 msgr2=0x7f3aa8199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4005940 tx=0x7f3aa40042f0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 shutdown_connections 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3aa8108060 0x7f3aa819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a940b5370 0x7f3a940b7830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aa81076e0 0x7f3aa81997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 --2- 172.21.15.67:0/2082859125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3aa8101cd0 0x7f3aa8199260 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 >> 172.21.15.67:0/2082859125 conn(0x7f3aa80fd700 msgr2=0x7f3aa806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 shutdown_connections 2024-09-10T20:50:39.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:39.558+0000 7f3ab034f640 1 -- 172.21.15.67:0/2082859125 wait complete. 2024-09-10T20:50:40.267 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:50:40.530 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:40 smithi067 ceph-mon[30891]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:40 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2082859125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:40 smithi083 ceph-mon[35058]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:40.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:40 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2082859125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:40 smithi172 ceph-mon[35265]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:40 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2082859125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 -- 172.21.15.67:0/794167699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 msgr2=0x7f7324108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 --2- 172.21.15.67:0/794167699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f7324108c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7314009900 tx=0x7f731402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 -- 172.21.15.67:0/794167699 shutdown_connections 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 --2- 172.21.15.67:0/794167699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 0x7f732410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 --2- 172.21.15.67:0/794167699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f7324108c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 --2- 172.21.15.67:0/794167699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73241031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 -- 172.21.15.67:0/794167699 >> 172.21.15.67:0/794167699 conn(0x7f73240fe830 msgr2=0x7f7324100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 -- 172.21.15.67:0/794167699 shutdown_connections 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.023+0000 7f732c387640 1 -- 172.21.15.67:0/794167699 wait complete. 2024-09-10T20:50:41.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 Processor -- start 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 -- start start 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 0x7f7324075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7324112da0 con 0x7f73241087d0 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7324112c20 con 0x7f7324102dc0 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732c387640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7324112f20 con 0x7f7324109150 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f7329922640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f7329922640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50424/0 (socket says 172.21.15.67:50424) 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f7329922640 1 -- 172.21.15.67:0/3797018717 learned_addr learned my addr 172.21.15.67:0/3797018717 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:41.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.024+0000 7f732a924640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 0x7f7324075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f732a123640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 -- 172.21.15.67:0/3797018717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 msgr2=0x7f7324075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 0x7f7324075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 -- 172.21.15.67:0/3797018717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 msgr2=0x7f73240754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73240754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 -- 172.21.15.67:0/3797018717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73241a7610 con 0x7f73241087d0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f732a123640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73240754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f7329922640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7314006010 tx=0x7f73140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731403f030 con 0x7f73241087d0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7314003800 con 0x7f73241087d0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73241a78a0 con 0x7f73241087d0 2024-09-10T20:50:41.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314035070 con 0x7f73241087d0 2024-09-10T20:50:41.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.025+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73241a7dd0 con 0x7f73241087d0 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.026+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73241031a0 con 0x7f73241087d0 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.028+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7314031b10 con 0x7f73241087d0 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.029+0000 7f731b7fe640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 0x7f73100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.029+0000 7f732a123640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 0x7f73100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.029+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f73141068a0 con 0x7f73241087d0 2024-09-10T20:50:41.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.030+0000 7f732a123640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 0x7f73100b78b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f732000abe0 tx=0x7f732000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:41.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.032+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f73140cd630 con 0x7f73241087d0 2024-09-10T20:50:41.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.220+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73240767a0 con 0x7f73241087d0 2024-09-10T20:50:41.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.222+0000 7f731b7fe640 1 -- 172.21.15.67:0/3797018717 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7f73240767a0 con 0x7f73241087d0 2024-09-10T20:50:41.226 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:41.226 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 msgr2=0x7f73100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 0x7f73100b78b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f732000abe0 tx=0x7f732000a5c0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 msgr2=0x7f73240759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7314006010 tx=0x7f73140042f0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 shutdown_connections 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f73100b53f0 0x7f73100b78b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7324109150 0x7f7324075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f73241087d0 0x7f73240759e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.224+0000 7f732c387640 1 --2- 172.21.15.67:0/3797018717 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7324102dc0 0x7f73240754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:41.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.225+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 >> 172.21.15.67:0/3797018717 conn(0x7f73240fe830 msgr2=0x7f7324100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:41.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.225+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 shutdown_connections 2024-09-10T20:50:41.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:41.225+0000 7f732c387640 1 -- 172.21.15.67:0/3797018717 wait complete. 2024-09-10T20:50:41.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:50:42.130 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:42 smithi067 ceph-mon[30891]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:42 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3797018717' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:42 smithi083 ceph-mon[35058]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:42 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3797018717' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.633+0000 7f442589f640 1 -- 172.21.15.67:0/357392496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420107780 msgr2=0x7f4420107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.633+0000 7f442589f640 1 --2- 172.21.15.67:0/357392496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420107780 0x7f4420107be0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4408009900 tx=0x7f440802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- 172.21.15.67:0/357392496 shutdown_connections 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- 172.21.15.67:0/357392496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420108120 0x7f442010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- 172.21.15.67:0/357392496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420107780 0x7f4420107be0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- 172.21.15.67:0/357392496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420102920 0x7f4420102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- 172.21.15.67:0/357392496 >> 172.21.15.67:0/357392496 conn(0x7f4420076f50 msgr2=0x7f4420077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- 172.21.15.67:0/357392496 shutdown_connections 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- 172.21.15.67:0/357392496 wait complete. 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 Processor -- start 2024-09-10T20:50:42.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- start start 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420107780 0x7f4420199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 0x7f442019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.634+0000 7f442589f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4420112dd0 con 0x7f4420102920 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442589f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4420112c50 con 0x7f4420107780 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442589f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4420112f50 con 0x7f4420108120 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53136/0 (socket says 172.21.15.67:53136) 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 -- 172.21.15.67:0/3390783234 learned_addr learned my addr 172.21.15.67:0/3390783234 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f4417fff640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420107780 0x7f4420199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441f7fe640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 0x7f442019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 -- 172.21.15.67:0/3390783234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 msgr2=0x7f442019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:42.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 0x7f442019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 -- 172.21.15.67:0/3390783234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420107780 msgr2=0x7f4420199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420107780 0x7f4420199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 -- 172.21.15.67:0/3390783234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442019f390 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441f7fe640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 0x7f442019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f441effd640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f441000c970 tx=0x7f441000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410007bb0 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4410007d50 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442019f680 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441000f450 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.635+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201a5d40 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.637+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4420102d00 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.638+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4410004f00 con 0x7f4420102920 2024-09-10T20:50:42.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.639+0000 7f442489d640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 0x7f440c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:42.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.639+0000 7f4417fff640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 0x7f440c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:42.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.639+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f44100e5e20 con 0x7f4420102920 2024-09-10T20:50:42.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.639+0000 7f4417fff640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 0x7f440c0b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4408031440 tx=0x7f4408005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:42.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.642+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4410014030 con 0x7f4420102920 2024-09-10T20:50:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:42 smithi172 ceph-mon[35265]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:42 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3797018717' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:50:42.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.864+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4420109ea0 con 0x7f4420102920 2024-09-10T20:50:42.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.865+0000 7f442489d640 1 -- 172.21.15.67:0/3390783234 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f44100acbb0 con 0x7f4420102920 2024-09-10T20:50:42.869 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:42.870 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:50:42.870 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.867+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 msgr2=0x7f440c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.867+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 0x7f440c0b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4408031440 tx=0x7f4408005e80 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.867+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 msgr2=0x7f44201992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.867+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f441000c970 tx=0x7f441000ce30 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 shutdown_connections 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f440c0b5370 0x7f440c0b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4420108120 0x7f442019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4420107780 0x7f4420199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 --2- 172.21.15.67:0/3390783234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4420102920 0x7f44201992e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 >> 172.21.15.67:0/3390783234 conn(0x7f4420076f50 msgr2=0x7f4420100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 shutdown_connections 2024-09-10T20:50:42.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:42.868+0000 7f442589f640 1 -- 172.21.15.67:0/3390783234 wait complete. 2024-09-10T20:50:43.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:43 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3390783234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:43.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T20:49:26.010912+0000', 'modified': '2024-09-10T20:49:37.096165+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24608, 'mds_1': 24583, 'mds_2': 24581}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24554': {'gid': 24554, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.83:6835/1348947486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1348947486}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 1348947486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/2165153315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2165153315}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2165153315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24565': {'gid': 24565, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/242991911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 242991911}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 242991911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24581': {'gid': 24581, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.83:6837/725743109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6836', 'nonce': 725743109}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 725743109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.172:6839/977540301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 977540301}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 977540301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.83:6839/4114167156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6838', 'nonce': 4114167156}, {'type': 'v1', 'addr': '172.21.15.83:6839', 'nonce': 4114167156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24608, 'qdb_cluster': [24581, 24583, 24608]} 2024-09-10T20:50:43.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T20:50:43.629 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T20:50:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:43 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3390783234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:43 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3390783234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:50:43.891 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:44.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:44 smithi067 ceph-mon[30891]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:44.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 -- 172.21.15.67:0/41819468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b41087d0 msgr2=0x7fc4b4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 --2- 172.21.15.67:0/41819468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b41087d0 0x7fc4b4108c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009900 tx=0x7fc4a402a410 comp rx=0 tx=0).stop 2024-09-10T20:50:44.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 -- 172.21.15.67:0/41819468 shutdown_connections 2024-09-10T20:50:44.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 --2- 172.21.15.67:0/41819468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b4109150 0x7fc4b410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 --2- 172.21.15.67:0/41819468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b41087d0 0x7fc4b4108c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 --2- 172.21.15.67:0/41819468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 0x7fc4b41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 -- 172.21.15.67:0/41819468 >> 172.21.15.67:0/41819468 conn(0x7fc4b40fe830 msgr2=0x7fc4b4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 -- 172.21.15.67:0/41819468 shutdown_connections 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.375+0000 7fc4bc689640 1 -- 172.21.15.67:0/41819468 wait complete. 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 Processor -- start 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 -- start start 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 0x7fc4b4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 0x7fc4b4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4112e60 con 0x7fc4b4109150 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4112ce0 con 0x7fc4b4102dc0 2024-09-10T20:50:44.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bc689640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4112fe0 con 0x7fc4b41087d0 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bac26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bac26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53166/0 (socket says 172.21.15.67:53166) 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4bac26640 1 -- 172.21.15.67:0/2662457086 learned_addr learned my addr 172.21.15.67:0/2662457086 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.376+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 0x7fc4b4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 0x7fc4b4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 -- 172.21.15.67:0/2662457086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 msgr2=0x7fc4b4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 0x7fc4b4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 -- 172.21.15.67:0/2662457086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 msgr2=0x7fc4b4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 0x7fc4b4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 -- 172.21.15.67:0/2662457086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b419f3c0 con 0x7fc4b4109150 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 0x7fc4b4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00b970 tx=0x7fc4ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4ab7fe640 1 -- 172.21.15.67:0/2662457086 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac019070 con 0x7fc4b4109150 2024-09-10T20:50:44.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b419f6b0 con 0x7fc4b4109150 2024-09-10T20:50:44.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4ab7fe640 1 -- 172.21.15.67:0/2662457086 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4ac014440 con 0x7fc4b4109150 2024-09-10T20:50:44.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4ab7fe640 1 -- 172.21.15.67:0/2662457086 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0075d0 con 0x7fc4b4109150 2024-09-10T20:50:44.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.377+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b41a5df0 con 0x7fc4b4109150 2024-09-10T20:50:44.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4ab7fe640 1 -- 172.21.15.67:0/2662457086 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc4ac00cb40 con 0x7fc4b4109150 2024-09-10T20:50:44.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 Processor -- start 2024-09-10T20:50:44.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 -- start start 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2cb5e0 0x55dafd2cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dafd236c10 con 0x55dafd2bed30 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dafd226040 con 0x55dafd2bf650 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.380+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dafd229e50 con 0x55dafd2cb5e0 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53182/0 (socket says 172.21.15.67:53182) 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 -- 172.21.15.67:0/2736522512 learned_addr learned my addr 172.21.15.67:0/2736522512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2cb5e0 0x55dafd2cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 -- 172.21.15.67:0/2736522512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2cb5e0 msgr2=0x55dafd2cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2cb5e0 0x55dafd2cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 -- 172.21.15.67:0/2736522512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 msgr2=0x55dafd2cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 -- 172.21.15.67:0/2736522512 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dafcf84540 con 0x55dafd2bed30 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005c40 tx=0x7fc4a4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22ddd0ef963574b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4ab7fe640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 0x7fc4a00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 0x7fc4a00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4a8ff9640 1 -- 172.21.15.67:0/2736522512 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4045070 con 0x55dafd2bed30 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4ab7fe640 1 -- 172.21.15.67:0/2662457086 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc4ac0e5510 con 0x7fc4b4109150 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4a8ff9640 1 -- 172.21.15.67:0/2736522512 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4a40053e0 con 0x55dafd2bed30 2024-09-10T20:50:44.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.381+0000 7fc4a8ff9640 1 -- 172.21.15.67:0/2736522512 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4035070 con 0x55dafd2bed30 2024-09-10T20:50:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2736522512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 msgr2=0x55dafd2bf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 0x7fc4a00b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55dafd2c1eb0 tx=0x7fc4b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4005c40 tx=0x7fc4a4009560 comp rx=0 tx=0).stop 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2736522512 shutdown_connections 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2cb5e0 0x55dafd2cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2736522512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2bf110 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2736522512 >> 172.21.15.67:0/2736522512 conn(0x55dafd2bcb60 msgr2=0x55dafd2bdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2736522512 shutdown_connections 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.382+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2736522512 wait complete. 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 -- start start 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 Processor -- start 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dafd0875f0 con 0x55dafd2bed30 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dafd1c1010 con 0x55dafd2cb5e0 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2d2640 con 0x55dafd2bf650 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bea5e740 10 client.0 _ll_register_callbacks cb 0x55dafd220340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4ba425640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4ba425640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53192/0 (socket says 172.21.15.67:53192) 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4ba425640 1 -- 172.21.15.67:0/2377061930 learned_addr learned my addr 172.21.15.67:0/2377061930 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4ba425640 1 -- 172.21.15.67:0/2377061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 msgr2=0x55dafd2c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.383+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4ba425640 1 -- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 msgr2=0x55dafd2c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4ba425640 1 -- 172.21.15.67:0/2377061930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dafd1eea00 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0003e30 tx=0x7fc4b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe2defacfb1551a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b001b660 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc4b001b800 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a40053e0 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4b001ba00 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4bea5e740 10 client.15108 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dafd2de2e0 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4a40053e0 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc4b0024070 con 0x55dafd2bed30 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.384+0000 7fc4bea5e740 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:44.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4bea5e740 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4bea5e740 20 client.15108 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd2e09c0 0x55dafd2e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4bea5e740 4 client.15108 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dafd238b60 con 0x55dafd2e09c0 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd2e09c0 0x55dafd2e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd2e09c0 0x55dafd2e1e30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7fe36b16578b436e server_cookie=935a8d3aee7466bf in_seq=0 out_seq=0 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.385+0000 7fc49dffb640 10 client.15108 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc49dffb640 1 -- 172.21.15.67:0/2377061930 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dafd238b60 con 0x55dafd2e09c0 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc49dffb640 10 client.15108 handle_command_reply: tid=0 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 client.15108 shutdown 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 msgr2=0x55dafd2c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0003e30 tx=0x7fc4b00046c0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 shutdown_connections 2024-09-10T20:50:44.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd2e09c0 0x55dafd2e1e30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2377061930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2c8600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 >> 172.21.15.67:0/2377061930 conn(0x55dafd2bcb60 msgr2=0x55dafd2c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc49dffb640 0 client.15108 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 shutdown_connections 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2377061930 wait complete. 2024-09-10T20:50:44.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.386+0000 7fc4bea5e740 20 client.15108 trim_cache size 0 max 16384 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 Processor -- start 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 -- start start 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bed30 0x55dafd2c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e0170 con 0x55dafd2cb5e0 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e0840 con 0x55dafd2bf650 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e0f10 con 0x55dafd2bed30 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53204/0 (socket says 172.21.15.67:53204) 2024-09-10T20:50:44.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 -- 172.21.15.67:0/2016797028 learned_addr learned my addr 172.21.15.67:0/2016797028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4ba425640 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bed30 0x55dafd2c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 -- 172.21.15.67:0/2016797028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bed30 msgr2=0x55dafd2c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bed30 0x55dafd2c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 -- 172.21.15.67:0/2016797028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 msgr2=0x55dafd2c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.405+0000 7fc4bac26640 1 -- 172.21.15.67:0/2016797028 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dafd2bd5e0 con 0x55dafd2cb5e0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bac26640 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0e2ec0 tx=0x7fc4ac004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66cfe5021a7cf26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc49ffff640 1 -- 172.21.15.67:0/2016797028 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0ab700 con 0x55dafd2cb5e0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc49ffff640 1 -- 172.21.15.67:0/2016797028 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4ac0abbf0 con 0x55dafd2cb5e0 2024-09-10T20:50:44.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc49ffff640 1 -- 172.21.15.67:0/2016797028 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0e50b0 con 0x55dafd2cb5e0 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2016797028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 msgr2=0x55dafd2c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0e2ec0 tx=0x7fc4ac004b50 comp rx=0 tx=0).stop 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2016797028 shutdown_connections 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2cb5e0 0x55dafd2c3880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2bf650 0x55dafd2c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/2016797028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bed30 0x55dafd2c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2016797028 >> 172.21.15.67:0/2016797028 conn(0x55dafd2bcb60 msgr2=0x55dafd2df7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2016797028 shutdown_connections 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.406+0000 7fc4bea5e740 1 -- 172.21.15.67:0/2016797028 wait complete. 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 -- start start 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 Processor -- start 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2e4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e1cb0 con 0x55dafd2bed30 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e15e0 con 0x55dafd2cb5e0 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dafd2e2380 con 0x55dafd2bf650 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bea5e740 10 client.0 _ll_register_callbacks cb 0x7fc4b0004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53216/0 (socket says 172.21.15.67:53216) 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 -- 172.21.15.67:0/642661624 learned_addr learned my addr 172.21.15.67:0/642661624 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 -- 172.21.15.67:0/642661624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 msgr2=0x55dafd2e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 -- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 msgr2=0x55dafd2e4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bac26640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2e4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4ba425640 1 -- 172.21.15.67:0/642661624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dafd2e9a40 con 0x55dafd2bed30 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.407+0000 7fc4bac26640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4ba425640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0031b60 tx=0x7fc4b0031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42233932a474aa89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00039f0 con 0x55dafd2bed30 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc4b0005040 con 0x55dafd2bed30 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ac0abbf0 con 0x55dafd2bed30 2024-09-10T20:50:44.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4b0040070 con 0x55dafd2bed30 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dafd34d7d0 con 0x55dafd2bed30 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4ac0abbf0 con 0x55dafd2bed30 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc4b0024050 con 0x55dafd2bed30 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.408+0000 7fc4bea5e740 20 client.15114 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd3523e0 0x55dafd3510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 4 client.15114 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "status"}) -- 0x55dafd234610 con 0x55dafd3523e0 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd3523e0 0x55dafd3510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc49dffb640 10 client.15114 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:50:44.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4b9c24640 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd3523e0 0x55dafd3510f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=433ba8577664bb5b server_cookie=15ac945b13cdcb30 in_seq=0 out_seq=0 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc49dffb640 1 -- 172.21.15.67:0/642661624 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55dafd234610 con 0x55dafd3523e0 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc49dffb640 10 client.15114 handle_command_reply: tid=0 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 client.15114 shutdown 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 msgr2=0x55dafd2e4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0031b60 tx=0x7fc4b0031de0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 shutdown_connections 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55dafd3523e0 0x55dafd3510f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.409+0000 7fc49dffb640 0 client.15114 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dafd2cb5e0 0x55dafd2e4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dafd2bf650 0x55dafd2e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 --2- 172.21.15.67:0/642661624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dafd2bed30 0x55dafd2e4150 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 >> 172.21.15.67:0/642661624 conn(0x55dafd2bcb60 msgr2=0x55dafd2c3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 shutdown_connections 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 1 -- 172.21.15.67:0/642661624 wait complete. 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bea5e740 20 client.15114 trim_cache size 0 max 16384 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 2, 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24581, 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:50:44.420 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 69.954420475000006, 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 99.858422873999999 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 msgr2=0x7fc4a00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 0x7fc4a00b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55dafd2c1eb0 tx=0x7fc4b000b390 comp rx=0 tx=0).stop 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 msgr2=0x7fc4b419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:44.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00b970 tx=0x7fc4ac00be30 comp rx=0 tx=0).stop 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 shutdown_connections 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc4b4109150 0x7fc4b419ebf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc4a00b5370 0x7fc4a00b7830 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b41087d0 0x7fc4b4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 --2- 172.21.15.67:0/2662457086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4b4102dc0 0x7fc4b4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 >> 172.21.15.67:0/2662457086 conn(0x7fc4b40fe830 msgr2=0x7fc4b4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 shutdown_connections 2024-09-10T20:50:44.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:44.410+0000 7fc4bc689640 1 -- 172.21.15.67:0/2662457086 wait complete. 2024-09-10T20:50:44.644 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:44 smithi083 ceph-mon[35058]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:44 smithi172 ceph-mon[35265]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:45.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T20:50:45.368 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:45.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 -- 172.21.15.67:0/3867175862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 msgr2=0x7fdcc810cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 --2- 172.21.15.67:0/3867175862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc810cad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009900 tx=0x7fdcb802a410 comp rx=0 tx=0).stop 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 -- 172.21.15.67:0/3867175862 shutdown_connections 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 --2- 172.21.15.67:0/3867175862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc810d120 0x7fdcc810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 --2- 172.21.15.67:0/3867175862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc810cad0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 --2- 172.21.15.67:0/3867175862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc8103cc0 0x7fdcc81040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 -- 172.21.15.67:0/3867175862 >> 172.21.15.67:0/3867175862 conn(0x7fdcc80fd700 msgr2=0x7fdcc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.816+0000 7fdccfab1640 1 -- 172.21.15.67:0/3867175862 shutdown_connections 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 -- 172.21.15.67:0/3867175862 wait complete. 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 Processor -- start 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 -- start start 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc8103cc0 0x7fdcc8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 0x7fdcc819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112e20 con 0x7fdcc81045e0 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112ca0 con 0x7fdcc810d120 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccfab1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112fa0 con 0x7fdcc8103cc0 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccd04c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccd04c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53224/0 (socket says 172.21.15.67:53224) 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.817+0000 7fdccd04c640 1 -- 172.21.15.67:0/1889155996 learned_addr learned my addr 172.21.15.67:0/1889155996 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd84d640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc8103cc0 0x7fdcc8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdcce04e640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 0x7fdcc819ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 -- 172.21.15.67:0/1889155996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc8103cc0 msgr2=0x7fdcc8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc8103cc0 0x7fdcc8199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 -- 172.21.15.67:0/1889155996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 msgr2=0x7fdcc819ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 0x7fdcc819ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 -- 172.21.15.67:0/1889155996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc819f3c0 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdcce04e640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 0x7fdcc819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccd04c640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8031440 tx=0x7fdcb8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdcbeffd640 1 -- 172.21.15.67:0/1889155996 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb803f070 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdcbeffd640 1 -- 172.21.15.67:0/1889155996 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcb8031d60 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc819f650 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdcbeffd640 1 -- 172.21.15.67:0/1889155996 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8035030 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.818+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc81a5d70 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 Processor -- start 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 -- start start 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcbeffd640 1 -- 172.21.15.67:0/1889155996 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fdcb803b580 con 0x7fdcc81045e0 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec17110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55eb3eb8ec10 con 0x55eb3ec17650 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55eb3eb7e040 con 0x55eb3ec16d30 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb3eb81e50 con 0x55eb3ec279f0 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.821+0000 7fdccd84d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53234/0 (socket says 172.21.15.67:53234) 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 -- 172.21.15.67:0/849073219 learned_addr learned my addr 172.21.15.67:0/849073219 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd04c640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcce04e640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec17110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 -- 172.21.15.67:0/849073219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 msgr2=0x55eb3ec29de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 -- 172.21.15.67:0/849073219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 msgr2=0x55eb3ec17110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec17110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 -- 172.21.15.67:0/849073219 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb3e8dc540 con 0x55eb3ec17650 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcce04e640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec17110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd04c640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdccd84d640 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400cbf0 tx=0x7fdcc400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a14c6316b702fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcbeffd640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 0x7fdcb40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcb3fff640 1 -- 172.21.15.67:0/849073219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4010630 con 0x55eb3ec17650 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcb3fff640 1 -- 172.21.15.67:0/849073219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc4010c80 con 0x55eb3ec17650 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcb3fff640 1 -- 172.21.15.67:0/849073219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400fba0 con 0x55eb3ec17650 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcce04e640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 0x7fdcb40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.822+0000 7fdcbeffd640 1 -- 172.21.15.67:0/1889155996 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdcb8106550 con 0x7fdcc81045e0 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcce04e640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 0x7fdcb40b78b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0007ee0 tx=0x7fdcc0007430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 -- 172.21.15.67:0/849073219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 msgr2=0x55eb3ec274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400cbf0 tx=0x7fdcc400e720 comp rx=0 tx=0).stop 2024-09-10T20:50:45.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 -- 172.21.15.67:0/849073219 shutdown_connections 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec274b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/849073219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec17110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 -- 172.21.15.67:0/849073219 >> 172.21.15.67:0/849073219 conn(0x55eb3ec14b60 msgr2=0x55eb3ec15d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 -- 172.21.15.67:0/849073219 shutdown_connections 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.823+0000 7fdcd1e86740 1 -- 172.21.15.67:0/849073219 wait complete. 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 -- start start 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 Processor -- start 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec24890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55eb3e9df5f0 con 0x55eb3ec279f0 2024-09-10T20:50:45.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55eb3eb19010 con 0x55eb3ec16d30 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec2a6a0 con 0x55eb3ec17650 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcd1e86740 10 client.0 _ll_register_callbacks cb 0x55eb3eb78340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcce04e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcce04e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53240/0 (socket says 172.21.15.67:53240) 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdcce04e640 1 -- 172.21.15.67:0/878795651 learned_addr learned my addr 172.21.15.67:0/878795651 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.824+0000 7fdccd84d640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdccd04c640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec24890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 -- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 msgr2=0x55eb3ec24890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec24890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 -- 172.21.15.67:0/878795651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 msgr2=0x55eb3ec27440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec27440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 -- 172.21.15.67:0/878795651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb3eb46a00 con 0x55eb3ec279f0 2024-09-10T20:50:45.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcce04e640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000fe10 tx=0x7fdcc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe41d3eb2ecd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0020070 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdcc000eb30 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc4010c80 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdcc002c050 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcd1e86740 10 client.15126 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb3ec36130 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.825+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc4010c80 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdcc00243b0 con 0x55eb3ec279f0 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 10 client.15126 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 20 client.15126 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:45.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ec38760 0x55eb3ec39bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 4 client.15126 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb3eb90b60 con 0x55eb3ec38760 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdccd84d640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ec38760 0x55eb3ec39bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdccd84d640 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ec38760 0x55eb3ec39bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a31a8625b876d45 server_cookie=94c6fd6355318d6a in_seq=0 out_seq=0 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.826+0000 7fdcb17fa640 10 client.15126 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcb17fa640 1 -- 172.21.15.67:0/878795651 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb3eb90b60 con 0x55eb3ec38760 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcb17fa640 10 client.15126 handle_command_reply: tid=0 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcd1e86740 1 client.15126 shutdown 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 msgr2=0x55eb3ec25020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000fe10 tx=0x7fdcc0004a40 comp rx=0 tx=0).stop 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 shutdown_connections 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.827+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ec38760 0x55eb3ec39bd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec25020 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcb17fa640 0 client.15126 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec24890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/878795651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 >> 172.21.15.67:0/878795651 conn(0x55eb3ec14b60 msgr2=0x55eb3ec13d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 shutdown_connections 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 1 -- 172.21.15.67:0/878795651 wait complete. 2024-09-10T20:50:45.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.828+0000 7fdcd1e86740 20 client.15126 trim_cache size 0 max 16384 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 Processor -- start 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 -- start start 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec34150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec375a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec37f10 con 0x55eb3ec279f0 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec385e0 con 0x55eb3ec16d30 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec38cb0 con 0x55eb3ec17650 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcce04e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcce04e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53244/0 (socket says 172.21.15.67:53244) 2024-09-10T20:50:45.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdcce04e640 1 -- 172.21.15.67:0/2565340565 learned_addr learned my addr 172.21.15.67:0/2565340565 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdccd04c640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.846+0000 7fdccd84d640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec34150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 -- 172.21.15.67:0/2565340565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 msgr2=0x55eb3ec375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 -- 172.21.15.67:0/2565340565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 msgr2=0x55eb3ec34150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec34150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 -- 172.21.15.67:0/2565340565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb3ec104f0 con 0x55eb3ec279f0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdccd04c640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdccd84d640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec34150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcce04e640 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0008010 tx=0x7fdcc000fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6d6efa616ea086 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcb37fe640 1 -- 172.21.15.67:0/2565340565 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0034030 con 0x55eb3ec279f0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcb37fe640 1 -- 172.21.15.67:0/2565340565 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc0007af0 con 0x55eb3ec279f0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcb37fe640 1 -- 172.21.15.67:0/2565340565 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0020050 con 0x55eb3ec279f0 2024-09-10T20:50:45.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcd1e86740 1 -- 172.21.15.67:0/2565340565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 msgr2=0x55eb3ec29930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.847+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0008010 tx=0x7fdcc000fad0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- 172.21.15.67:0/2565340565 shutdown_connections 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec279f0 0x55eb3ec29930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec17650 0x55eb3ec375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/2565340565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec34150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- 172.21.15.67:0/2565340565 >> 172.21.15.67:0/2565340565 conn(0x55eb3ec14b60 msgr2=0x55eb3ec0fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- 172.21.15.67:0/2565340565 shutdown_connections 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- 172.21.15.67:0/2565340565 wait complete. 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- start start 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 Processor -- start 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec42110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec134e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec39a50 con 0x55eb3ec17650 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec39380 con 0x55eb3ec16d30 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb3ec3a120 con 0x55eb3ec279f0 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.848+0000 7fdcd1e86740 10 client.0 _ll_register_callbacks cb 0x7fdcc0013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53252/0 (socket says 172.21.15.67:53252) 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 -- 172.21.15.67:0/3962440279 learned_addr learned my addr 172.21.15.67:0/3962440279 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd84d640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec42110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcce04e640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 -- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 msgr2=0x55eb3ec134e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec134e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 -- 172.21.15.67:0/3962440279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 msgr2=0x55eb3ec42110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec42110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 -- 172.21.15.67:0/3962440279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb3ec13ad0 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdccd04c640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdcb81044b0 tx=0x7fdcb8005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dbebf383523840 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8049040 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdcb80cce40 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc0007af0 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdcb80c8350 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcd1e86740 10 client.15132 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.849+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb3eca5890 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc0007af0 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdcb80d5ce0 con 0x55eb3ec17650 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T20:50:45.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 20 client.15132 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ecaa460 0x55eb3eca9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 4 client.15132 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "status"}) -- 0x55eb3eb8c610 con 0x55eb3ecaa460 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.850+0000 7fdccd84d640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ecaa460 0x55eb3eca9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdccd84d640 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ecaa460 0x55eb3eca9170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=38d8af0d50374003 server_cookie=382bcf6427cb1d78 in_seq=0 out_seq=0 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcb17fa640 10 client.15132 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcb17fa640 1 -- 172.21.15.67:0/3962440279 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55eb3eb8c610 con 0x55eb3ecaa460 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcb17fa640 10 client.15132 handle_command_reply: tid=0 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 client.15132 shutdown 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 msgr2=0x55eb3ec42650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdcb81044b0 tx=0x7fdcb8005e20 comp rx=0 tx=0).stop 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 shutdown_connections 2024-09-10T20:50:45.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55eb3ecaa460 0x55eb3eca9170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb3ec279f0 0x55eb3ec134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcb17fa640 0 client.15132 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55eb3ec17650 0x55eb3ec42650 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 --2- 172.21.15.67:0/3962440279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eb3ec16d30 0x55eb3ec42110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 >> 172.21.15.67:0/3962440279 conn(0x55eb3ec14b60 msgr2=0x55eb3ec33dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 shutdown_connections 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 1 -- 172.21.15.67:0/3962440279 wait complete. 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.851+0000 7fdcd1e86740 20 client.15132 trim_cache size 0 max 16384 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:50:45.867 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 1, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24583, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 72.402294792999996, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 98.768202735000003 2024-09-10T20:50:45.868 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 msgr2=0x7fdcb40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 0x7fdcb40b78b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0007ee0 tx=0x7fdcc0007430 comp rx=0 tx=0).stop 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 msgr2=0x7fdcc8199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8031440 tx=0x7fdcb8003c80 comp rx=0 tx=0).stop 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 shutdown_connections 2024-09-10T20:50:45.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc810d120 0x7fdcc819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcc81045e0 0x7fdcc8199850 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdcb40b53f0 0x7fdcb40b78b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 --2- 172.21.15.67:0/1889155996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcc8103cc0 0x7fdcc8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 >> 172.21.15.67:0/1889155996 conn(0x7fdcc80fd700 msgr2=0x7fdcc810f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 shutdown_connections 2024-09-10T20:50:45.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:45.852+0000 7fdccfab1640 1 -- 172.21.15.67:0/1889155996 wait complete. 2024-09-10T20:50:46.459 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:46 smithi067 ceph-mon[30891]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:46.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T20:50:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:46 smithi083 ceph-mon[35058]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:46 smithi172 ceph-mon[35265]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:46.744 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 -- 172.21.15.67:0/576601028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 msgr2=0x7f55fc1117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 --2- 172.21.15.67:0/576601028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1117d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009ca0 tx=0x7f55f402a950 comp rx=0 tx=0).stop 2024-09-10T20:50:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 -- 172.21.15.67:0/576601028 shutdown_connections 2024-09-10T20:50:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 --2- 172.21.15.67:0/576601028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1117d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 --2- 172.21.15.67:0/576601028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 0x7f55fc10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 --2- 172.21.15.67:0/576601028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 -- 172.21.15.67:0/576601028 >> 172.21.15.67:0/576601028 conn(0x7f55fc0fd700 msgr2=0x7f55fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 -- 172.21.15.67:0/576601028 shutdown_connections 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.215+0000 7f560423c640 1 -- 172.21.15.67:0/576601028 wait complete. 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 Processor -- start 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 -- start start 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 0x7f55fc19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc114f20 con 0x7f55fc10f3e0 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc114da0 con 0x7f55fc101830 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f560423c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1150a0 con 0x7f55fc102150 2024-09-10T20:50:47.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53258/0 (socket says 172.21.15.67:53258) 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.216+0000 7f56027d9640 1 -- 172.21.15.67:0/1539870740 learned_addr learned my addr 172.21.15.67:0/1539870740 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56017d7640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 0x7f55fc19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 -- 172.21.15.67:0/1539870740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 msgr2=0x7f55fc19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 0x7f55fc19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 -- 172.21.15.67:0/1539870740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 msgr2=0x7f55fc19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 -- 172.21.15.67:0/1539870740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc1a1460 con 0x7f55fc10f3e0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f56027d9640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f55f402ae70 tx=0x7f55f402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f55f2ffd640 1 -- 172.21.15.67:0/1539870740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4034040 con 0x7f55fc10f3e0 2024-09-10T20:50:47.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f55f2ffd640 1 -- 172.21.15.67:0/1539870740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f40308f0 con 0x7f55fc10f3e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc1a16f0 con 0x7f55fc10f3e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f55f2ffd640 1 -- 172.21.15.67:0/1539870740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4004720 con 0x7f55fc10f3e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.217+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc1a7e10 con 0x7f55fc10f3e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 Processor -- start 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f55f2ffd640 1 -- 172.21.15.67:0/1539870740 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f55f404d030 con 0x7f55fc10f3e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 -- start start 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b1650 0x55fc296bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296bd5e0 0x55fc296bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc29628c10 con 0x55fc296b0d30 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc29618040 con 0x55fc296b1650 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5606611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc2961be50 con 0x55fc296bd5e0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53274/0 (socket says 172.21.15.67:53274) 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 -- 172.21.15.67:0/1053731380 learned_addr learned my addr 172.21.15.67:0/1053731380 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b1650 0x55fc296bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 -- 172.21.15.67:0/1053731380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296bd5e0 msgr2=0x55fc296bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296bd5e0 0x55fc296bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 -- 172.21.15.67:0/1053731380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b1650 msgr2=0x55fc296bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b1650 0x55fc296bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.221+0000 7f56017d7640 1 -- 172.21.15.67:0/1053731380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc29376540 con 0x55fc296b0d30 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f55f2ffd640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 0x7f55e80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f56017d7640 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ad70 tx=0x7f55ec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c69be0d92f952a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 0x7f55e80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f55f2ffd640 1 -- 172.21.15.67:0/1539870740 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f55f4106be0 con 0x7f55fc10f3e0 2024-09-10T20:50:47.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f55e7fff640 1 -- 172.21.15.67:0/1053731380 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec012650 con 0x55fc296b0d30 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f55e7fff640 1 -- 172.21.15.67:0/1053731380 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55ec00ae60 con 0x55fc296b0d30 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.222+0000 7f55e7fff640 1 -- 172.21.15.67:0/1053731380 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00e9c0 con 0x55fc296b0d30 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- 172.21.15.67:0/1053731380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 msgr2=0x55fc296b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ad70 tx=0x7f55ec0117b0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 0x7f55e80b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55fc296b3eb0 tx=0x7f55f8005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- 172.21.15.67:0/1053731380 shutdown_connections 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296bd5e0 0x55fc296bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b1650 0x55fc296bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 --2- 172.21.15.67:0/1053731380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b0d30 0x55fc296b1110 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- 172.21.15.67:0/1053731380 >> 172.21.15.67:0/1053731380 conn(0x55fc296aeb60 msgr2=0x55fc296afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- 172.21.15.67:0/1053731380 shutdown_connections 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- 172.21.15.67:0/1053731380 wait complete. 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.223+0000 7f5606611740 1 -- start start 2024-09-10T20:50:47.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 Processor -- start 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc294795f0 con 0x55fc296bd5e0 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc295b3010 con 0x55fc296b0d30 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc296c0290 con 0x55fc296b1650 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5606611740 10 client.0 _ll_register_callbacks cb 0x55fc29612340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f5601fd8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f56017d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53276/0 (socket says 172.21.15.67:53276) 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.224+0000 7f56027d9640 1 -- 172.21.15.67:0/1800388826 learned_addr learned my addr 172.21.15.67:0/1800388826 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:47.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 -- 172.21.15.67:0/1800388826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 msgr2=0x55fc296bab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296bab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 -- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 msgr2=0x55fc296ba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296ba600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 -- 172.21.15.67:0/1800388826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc295e0a00 con 0x55fc296bd5e0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f56027d9640 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55f40cd1a0 tx=0x7f55f40cd0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922f349c6993ac3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f55e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4104d70 con 0x55fc296bd5e0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f55f40f40c0 con 0x55fc296bd5e0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55ec00ae60 con 0x55fc296bd5e0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f55f40098d0 con 0x55fc296bd5e0 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f5606611740 10 client.15144 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:47.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.225+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc296cbed0 con 0x55fc296bd5e0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55ec00ae60 con 0x55fc296bd5e0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f55f40cc470 con 0x55fc296bd5e0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 10 client.15144 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 10 client.15144 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 20 client.15144 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc296ce4d0 0x55fc296cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 4 client.15144 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc2962ab60 con 0x55fc296ce4d0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc296ce4d0 0x55fc296cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f55e57fa640 10 client.15144 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.226+0000 7f5601fd8640 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc296ce4d0 0x55fc296cf940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b6243265300ce3 server_cookie=92d8fa567ad502ad in_seq=0 out_seq=0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.227+0000 7f55e57fa640 1 -- 172.21.15.67:0/1800388826 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc2962ab60 con 0x55fc296ce4d0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.227+0000 7f55e57fa640 10 client.15144 handle_command_reply: tid=0 2024-09-10T20:50:47.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.227+0000 7f5606611740 1 client.15144 shutdown 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.227+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 msgr2=0x55fc296bb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.227+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55f40cd1a0 tx=0x7f55f40cd0a0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 shutdown_connections 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc296ce4d0 0x55fc296cf940 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296bb080 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296bab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f55e57fa640 0 client.15144 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 --2- 172.21.15.67:0/1800388826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296ba600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 >> 172.21.15.67:0/1800388826 conn(0x55fc296aeb60 msgr2=0x55fc296b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 shutdown_connections 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 1 -- 172.21.15.67:0/1800388826 wait complete. 2024-09-10T20:50:47.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.228+0000 7f5606611740 20 client.15144 trim_cache size 0 max 16384 2024-09-10T20:50:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 Processor -- start 2024-09-10T20:50:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 -- start start 2024-09-10T20:50:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc296cdc80 con 0x55fc296bd5e0 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc296ce350 con 0x55fc296b0d30 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.246+0000 7f5606611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc296cea20 con 0x55fc296b1650 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53282/0 (socket says 172.21.15.67:53282) 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 -- 172.21.15.67:0/933848246 learned_addr learned my addr 172.21.15.67:0/933848246 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56017d7640 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f5601fd8640 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 -- 172.21.15.67:0/933848246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 msgr2=0x55fc296b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 -- 172.21.15.67:0/933848246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 msgr2=0x55fc296b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 -- 172.21.15.67:0/933848246 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc296ae990 con 0x55fc296bd5e0 2024-09-10T20:50:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f56027d9640 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55f40ccf10 tx=0x7f55f402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837384921c3d5a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f55e77fe640 1 -- 172.21.15.67:0/933848246 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4003e10 con 0x55fc296bd5e0 2024-09-10T20:50:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f55e77fe640 1 -- 172.21.15.67:0/933848246 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f4004040 con 0x55fc296bd5e0 2024-09-10T20:50:47.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.247+0000 7f55e77fe640 1 -- 172.21.15.67:0/933848246 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4104dd0 con 0x55fc296bd5e0 2024-09-10T20:50:47.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- 172.21.15.67:0/933848246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 msgr2=0x55fc296b7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55f40ccf10 tx=0x7f55f402a950 comp rx=0 tx=0).stop 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- 172.21.15.67:0/933848246 shutdown_connections 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296bd5e0 0x55fc296b7d70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b1650 0x55fc296b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 --2- 172.21.15.67:0/933848246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296b0d30 0x55fc296b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- 172.21.15.67:0/933848246 >> 172.21.15.67:0/933848246 conn(0x55fc296aeb60 msgr2=0x55fc296cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- 172.21.15.67:0/933848246 shutdown_connections 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- 172.21.15.67:0/933848246 wait complete. 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 -- start start 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.248+0000 7f5606611740 1 Processor -- start 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 0x55fc296d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc296cf7c0 con 0x55fc296b1650 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc296cf0f0 con 0x55fc296bd5e0 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc296cfe90 con 0x55fc296b0d30 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5606611740 10 client.0 _ll_register_callbacks cb 0x7f55f4005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f56017d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:38566/0 (socket says 172.21.15.67:38566) 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 -- 172.21.15.67:0/2098580006 learned_addr learned my addr 172.21.15.67:0/2098580006 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f56017d7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53290/0 (socket says 172.21.15.67:53290) 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f56027d9640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 0x55fc296d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 -- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 msgr2=0x55fc296d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 0x55fc296d3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 -- 172.21.15.67:0/2098580006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 msgr2=0x55fc296d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f5601fd8640 1 -- 172.21.15.67:0/2098580006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc296af5e0 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f56027d9640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 0x55fc296d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.249+0000 7f56017d7640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f5601fd8640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55f8005ca0 tx=0x7f55f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f82e886f8fa0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005220 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f55f80053c0 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc29626610 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f55f8036070 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f5606611740 10 client.24841 fetch_fsmap learned FSMap version 24 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc2973ba90 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fc29626610 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f55f801f900 con 0x55fc296b0d30 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.250+0000 7f5606611740 10 client.24841 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:50:47.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 10 client.24841 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 20 client.24841 populate_metadata read hostname 'smithi067' 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc29740690 0x55fc2973f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 4 client.24841 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "status"}) -- 0x55fc29623a40 con 0x55fc29740690 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f56017d7640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc29740690 0x55fc2973f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f55e57fa640 10 client.24841 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f56017d7640 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc29740690 0x55fc2973f3a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3833fb84d8bc8065 server_cookie=a76c228bbaf217bf in_seq=0 out_seq=0 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f55e57fa640 1 -- 172.21.15.67:0/2098580006 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55fc29623a40 con 0x55fc29740690 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f55e57fa640 10 client.24841 handle_command_reply: tid=0 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.251+0000 7f5606611740 1 client.24841 shutdown 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 msgr2=0x55fc296d8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55f8005ca0 tx=0x7f55f80046c0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 shutdown_connections 2024-09-10T20:50:47.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fc29740690 0x55fc2973f3a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc296bd5e0 0x55fc296d3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc296b1650 0x55fc296d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 --2- 172.21.15.67:0/2098580006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc296b0d30 0x55fc296d8140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f55e57fa640 0 client.24841 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 >> 172.21.15.67:0/2098580006 conn(0x55fc296aeb60 msgr2=0x55fc296bbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 shutdown_connections 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 1 -- 172.21.15.67:0/2098580006 wait complete. 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.252+0000 7f5606611740 20 client.24841 trim_cache size 0 max 16384 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:50:47.261 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24608, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 80.839372784999995, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 91.713413738 2024-09-10T20:50:47.262 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 msgr2=0x7f55e80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 0x7f55e80b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55fc296b3eb0 tx=0x7f55f8005e90 comp rx=0 tx=0).stop 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 msgr2=0x7f55fc1a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f55f402ae70 tx=0x7f55f402f5d0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 shutdown_connections 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f55fc10f3e0 0x7f55fc1a0c90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55e80b53f0 0x7f55e80b78b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc102150 0x7f55fc19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 --2- 172.21.15.67:0/1539870740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55fc101830 0x7f55fc19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:47.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 >> 172.21.15.67:0/1539870740 conn(0x7f55fc0fd700 msgr2=0x7f55fc111530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:47.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 shutdown_connections 2024-09-10T20:50:47.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:47.253+0000 7f560423c640 1 -- 172.21.15.67:0/1539870740 wait complete. 2024-09-10T20:50:48.011 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T20:50:48.012 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T20:50:48.022 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T20:50:48.022 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T20:50:48.279 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:48.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:48 smithi067 ceph-mon[30891]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:48 smithi083 ceph-mon[35058]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:48 smithi172 ceph-mon[35265]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:48.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 -- 172.21.15.67:0/1136971869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8104560 msgr2=0x7f2cc810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:48.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/1136971869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8104560 0x7f2cc810aee0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009930 tx=0x7f2cc002a420 comp rx=0 tx=0).stop 2024-09-10T20:50:48.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 -- 172.21.15.67:0/1136971869 shutdown_connections 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/1136971869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8104560 0x7f2cc810aee0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/1136971869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8103ba0 0x7f2cc8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/1136971869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 -- 172.21.15.67:0/1136971869 >> 172.21.15.67:0/1136971869 conn(0x7f2cc80fe2f0 msgr2=0x7f2cc8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 -- 172.21.15.67:0/1136971869 shutdown_connections 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.749+0000 7f2ccdae0640 1 -- 172.21.15.67:0/1136971869 wait complete. 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 Processor -- start 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 -- start start 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8104560 0x7f2cc819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:48.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810e740 con 0x7f2cc8103ba0 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810e5c0 con 0x7f2cc8102a40 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.750+0000 7f2ccdae0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810e8c0 con 0x7f2cc8104560 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53322/0 (socket says 172.21.15.67:53322) 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 -- 172.21.15.67:0/2342422702 learned_addr learned my addr 172.21.15.67:0/2342422702 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc7fff640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8104560 0x7f2cc819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc77fe640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 -- 172.21.15.67:0/2342422702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8104560 msgr2=0x7f2cc819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8104560 0x7f2cc819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 -- 172.21.15.67:0/2342422702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 msgr2=0x7f2cc8198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:48.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 -- 172.21.15.67:0/2342422702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc819a990 con 0x7f2cc8103ba0 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc77fe640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc6ffd640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d770 tx=0x7f2cbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc017070 con 0x7f2cc8103ba0 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc0054d0 con 0x7f2cc8103ba0 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc819ac80 con 0x7f2cc8103ba0 2024-09-10T20:50:48.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.751+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc004c30 con 0x7f2cc8103ba0 2024-09-10T20:50:48.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.752+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc81a1360 con 0x7f2cc8103ba0 2024-09-10T20:50:48.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.753+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8109d60 con 0x7f2cc8103ba0 2024-09-10T20:50:48.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.754+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2cbc004dd0 con 0x7f2cc8103ba0 2024-09-10T20:50:48.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.755+0000 7f2cc4ff9640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:48.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.755+0000 7f2cc77fe640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:48.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.755+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2cbc0e5cd0 con 0x7f2cc8103ba0 2024-09-10T20:50:48.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.755+0000 7f2cc77fe640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 0x7f2cb00b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009fa0 tx=0x7f2cb8009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:48.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.758+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2cbc0aca60 con 0x7f2cc8103ba0 2024-09-10T20:50:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.961+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2cc8063590 con 0x7f2cb00b5370 2024-09-10T20:50:48.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.962+0000 7f2cc4ff9640 1 -- 172.21.15.67:0/2342422702 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2cc8063590 con 0x7f2cb00b5370 2024-09-10T20:50:48.966 INFO:teuthology.orchestra.run.smithi067.stdout:Backend: cephadm 2024-09-10T20:50:48.966 INFO:teuthology.orchestra.run.smithi067.stdout:Available: Yes 2024-09-10T20:50:48.966 INFO:teuthology.orchestra.run.smithi067.stdout:Paused: No 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 msgr2=0x7f2cb00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 0x7f2cb00b7830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009fa0 tx=0x7f2cb8009570 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 msgr2=0x7f2cc81994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d770 tx=0x7f2cbc00dc30 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 shutdown_connections 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2cc8104560 0x7f2cc819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2cc8103ba0 0x7f2cc81994b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 --2- 172.21.15.67:0/2342422702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2cc8102a40 0x7f2cc8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.964+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 >> 172.21.15.67:0/2342422702 conn(0x7f2cc80fe2f0 msgr2=0x7f2cc8106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.965+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 shutdown_connections 2024-09-10T20:50:48.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:48.965+0000 7f2ccdae0640 1 -- 172.21.15.67:0/2342422702 wait complete. 2024-09-10T20:50:49.599 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T20:50:49.858 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:50.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 -- 172.21.15.67:0/3504234368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4006b6e0 msgr2=0x7f3c401055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:50.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 --2- 172.21.15.67:0/3504234368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4006b6e0 0x7f3c401055f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009900 tx=0x7f3c3002a410 comp rx=0 tx=0).stop 2024-09-10T20:50:50.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 -- 172.21.15.67:0/3504234368 shutdown_connections 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 --2- 172.21.15.67:0/3504234368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c40108730 0x7f3c4010abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 --2- 172.21.15.67:0/3504234368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 0x7f3c40107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 --2- 172.21.15.67:0/3504234368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c4006b6e0 0x7f3c401055f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 -- 172.21.15.67:0/3504234368 >> 172.21.15.67:0/3504234368 conn(0x7f3c400fd1e0 msgr2=0x7f3c400ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 -- 172.21.15.67:0/3504234368 shutdown_connections 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.333+0000 7f3c45c46640 1 -- 172.21.15.67:0/3504234368 wait complete. 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 Processor -- start 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 -- start start 2024-09-10T20:50:50.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4006b6e0 0x7f3c40198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 0x7f3c40199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010e6b0 con 0x7f3c40108730 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010e530 con 0x7f3c40105b80 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c45c46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4010e830 con 0x7f3c4006b6e0 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53352/0 (socket says 172.21.15.67:53352) 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 -- 172.21.15.67:0/2889372254 learned_addr learned my addr 172.21.15.67:0/2889372254 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c37fff640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 0x7f3c40199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3f7fe640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4006b6e0 0x7f3c40198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 -- 172.21.15.67:0/2889372254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4006b6e0 msgr2=0x7f3c40198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4006b6e0 0x7f3c40198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 -- 172.21.15.67:0/2889372254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 msgr2=0x7f3c40199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 0x7f3c40199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 -- 172.21.15.67:0/2889372254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4019a8e0 con 0x7f3c40108730 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.334+0000 7f3c3ffff640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800eaa0 tx=0x7f3c3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.335+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800cdb0 con 0x7f3c40108730 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.335+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c38005020 con 0x7f3c40108730 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.335+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4019abd0 con 0x7f3c40108730 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.335+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c380116d0 con 0x7f3c40108730 2024-09-10T20:50:50.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.335+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c401a12b0 con 0x7f3c40108730 2024-09-10T20:50:50.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.336+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c400fecd0 con 0x7f3c40108730 2024-09-10T20:50:50.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.338+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3c38022060 con 0x7f3c40108730 2024-09-10T20:50:50.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.338+0000 7f3c3d7fa640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 0x7f3c2c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:50.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.339+0000 7f3c3f7fe640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 0x7f3c2c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:50.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.339+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c380e5a70 con 0x7f3c40108730 2024-09-10T20:50:50.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.339+0000 7f3c3f7fe640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 0x7f3c2c0b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c300314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:50.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.341+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c38016030 con 0x7f3c40108730 2024-09-10T20:50:50.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.537+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3c40063590 con 0x7f3c2c0b53f0 2024-09-10T20:50:50.541 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:50 smithi067 ceph-mon[30891]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:50.541 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:50 smithi067 ceph-mon[30891]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.549+0000 7f3c3d7fa640 1 -- 172.21.15.67:0/2889372254 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f3c40063590 con 0x7f3c2c0b53f0 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.a smithi067 running (97s) 18s ago 97s 16.1M - 19.3.0-4854-g8f219c47 589dd18248e4 54e977863d8e 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.b smithi083 running (95s) 28s ago 94s 28.9M - 19.3.0-4854-g8f219c47 589dd18248e4 6144f8cea0d1 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.c smithi172 running (109s) 28s ago 108s 20.4M - 19.3.0-4854-g8f219c47 589dd18248e4 1c6917cb8a33 2024-09-10T20:50:50.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.d smithi067 running (116s) 18s ago 116s 14.6M - 19.3.0-4854-g8f219c47 589dd18248e4 ad76e935829f 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.e smithi083 running (113s) 28s ago 113s 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 78ef0270f0cf 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.f smithi172 running (111s) 28s ago 111s 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 e3714ce99259 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.g smithi067 running (101s) 18s ago 100s 14.5M - 19.3.0-4854-g8f219c47 589dd18248e4 5dd0d32ecdaf 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.h smithi083 running (106s) 28s ago 105s 19.7M - 19.3.0-4854-g8f219c47 589dd18248e4 01b8b8eb55e4 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.i smithi172 running (103s) 28s ago 103s 18.2M - 19.3.0-4854-g8f219c47 589dd18248e4 c47520a66d01 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.j smithi067 running (2m) 18s ago 119s 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 5cefe523bf5d 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.k smithi083 running (2m) 28s ago 2m 18.3M - 19.3.0-4854-g8f219c47 589dd18248e4 ee21f51464bc 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mds.l smithi172 running (2m) 28s ago 2m 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 946c86bed926 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.x smithi067 *:9283,8765 running (9m) 18s ago 9m 523M - 19.3.0-4854-g8f219c47 589dd18248e4 c0ae6cce2660 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.y smithi083 *:8443,8765 running (7m) 28s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 86c77d7df231 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.z smithi172 *:8443,8765 running (7m) 28s ago 7m 455M - 19.3.0-4854-g8f219c47 589dd18248e4 0a709473e938 2024-09-10T20:50:50.554 INFO:teuthology.orchestra.run.smithi067.stdout:mon.a smithi067 running (9m) 18s ago 9m 53.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 c4084bafde25 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:mon.b smithi083 running (7m) 28s ago 7m 43.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 22f5fe731d4c 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:mon.c smithi172 running (8m) 28s ago 8m 41.7M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 80f3fbaa9a12 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (7m) 18s ago 7m 50.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 84fb409cfe76 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi083 running (6m) 28s ago 6m 56.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 ff170f65c5eb 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi172 running (6m) 28s ago 6m 57.6M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 e2901c716b17 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi067 running (5m) 18s ago 5m 49.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 474ce131b04a 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi083 running (5m) 28s ago 5m 52.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 5aa7fda1c2e1 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi172 running (4m) 28s ago 4m 46.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 7eef2def5dc2 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.6 smithi067 running (4m) 18s ago 4m 44.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0df7277018ba 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.7 smithi083 running (4m) 28s ago 4m 56.6M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 371772db483a 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.8 smithi172 running (3m) 28s ago 3m 57.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 c4b29db4c13b 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.9 smithi067 running (3m) 18s ago 3m 50.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 2f2d4fd62aaf 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.10 smithi083 running (2m) 28s ago 2m 48.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 62214fb5088f 2024-09-10T20:50:50.555 INFO:teuthology.orchestra.run.smithi067.stdout:osd.11 smithi172 running (2m) 28s ago 2m 44.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 82a4cc13b46f 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 msgr2=0x7f3c2c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 0x7f3c2c0b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c300314a0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 msgr2=0x7f3c4019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800eaa0 tx=0x7f3c3800ef60 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 shutdown_connections 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c40108730 0x7f3c4019a040 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c40105b80 0x7f3c40199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3c2c0b53f0 0x7f3c2c0b78b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 --2- 172.21.15.67:0/2889372254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c4006b6e0 0x7f3c40198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 >> 172.21.15.67:0/2889372254 conn(0x7f3c400fd1e0 msgr2=0x7f3c40103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 shutdown_connections 2024-09-10T20:50:50.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:50.552+0000 7f3c45c46640 1 -- 172.21.15.67:0/2889372254 wait complete. 2024-09-10T20:50:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:50 smithi083 ceph-mon[35058]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:50 smithi083 ceph-mon[35058]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:50 smithi172 ceph-mon[35265]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:50 smithi172 ceph-mon[35265]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:51.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T20:50:51.294 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:51 smithi067 ceph-mon[30891]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:51.457 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:51.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:51 smithi083 ceph-mon[35058]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:51.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:51 smithi172 ceph-mon[35265]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 -- 172.21.15.67:0/1796688968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4102a90 msgr2=0x7f64b4102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/1796688968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4102a90 0x7f64b4102f10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009930 tx=0x7f64a802a420 comp rx=0 tx=0).stop 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 -- 172.21.15.67:0/1796688968 shutdown_connections 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/1796688968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b4109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/1796688968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4102a90 0x7f64b4102f10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/1796688968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4101930 0x7f64b4101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 -- 172.21.15.67:0/1796688968 >> 172.21.15.67:0/1796688968 conn(0x7f64b40fd200 msgr2=0x7f64b40ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 -- 172.21.15.67:0/1796688968 shutdown_connections 2024-09-10T20:50:51.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.925+0000 7f64ba4c8640 1 -- 172.21.15.67:0/1796688968 wait complete. 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 Processor -- start 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 -- start start 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4102a90 0x7f64b4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64b410d590 con 0x7f64b4101930 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f64b410d410 con 0x7f64b4102a90 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.926+0000 7f64ba4c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64b410d710 con 0x7f64b4103450 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53382/0 (socket says 172.21.15.67:53382) 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 -- 172.21.15.67:0/2134273455 learned_addr learned my addr 172.21.15.67:0/2134273455 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b37fe640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4102a90 0x7f64b4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:51.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b8a65640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 -- 172.21.15.67:0/2134273455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 msgr2=0x7f64b419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 -- 172.21.15.67:0/2134273455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4102a90 msgr2=0x7f64b4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4102a90 0x7f64b4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 -- 172.21.15.67:0/2134273455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b419a940 con 0x7f64b4101930 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b8a65640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b3fff640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c890 tx=0x7f64a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4004220 con 0x7f64b4101930 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b419ac30 con 0x7f64b4101930 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a40043c0 con 0x7f64b4101930 2024-09-10T20:50:51.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4004a00 con 0x7f64b4101930 2024-09-10T20:50:51.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.927+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b41a1310 con 0x7f64b4101930 2024-09-10T20:50:51.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.928+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b41a14e0 con 0x7f64b4101930 2024-09-10T20:50:51.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.930+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f64a40079b0 con 0x7f64b4101930 2024-09-10T20:50:51.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.931+0000 7f64b17fa640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 0x7f649c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:51.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.931+0000 7f64b37fe640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 0x7f649c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:51.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.931+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64a40e5e60 con 0x7f64b4101930 2024-09-10T20:50:51.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.931+0000 7f64b37fe640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 0x7f649c0b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009900 tx=0x7f64a8031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:51.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:51.934+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64a4014030 con 0x7f64b4101930 2024-09-10T20:50:52.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.127+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f64b41a16b0 con 0x7f649c0b5370 2024-09-10T20:50:52.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.133+0000 7f64b17fa640 1 -- 172.21.15.67:0/2134273455 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f64b41a16b0 con 0x7f649c0b5370 2024-09-10T20:50:52.137 INFO:teuthology.orchestra.run.smithi067.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T20:50:52.137 INFO:teuthology.orchestra.run.smithi067.stdout:mds.all 12/12 30s ago 2m smithi067=a;smithi067=d;smithi067=g;smithi067=j;smithi083=b;smithi083=e;smithi083=h;smithi083=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-10T20:50:52.137 INFO:teuthology.orchestra.run.smithi067.stdout:mgr 3/3 30s ago 7m smithi067=x;smithi083=y;smithi172=z;count:3 2024-09-10T20:50:52.137 INFO:teuthology.orchestra.run.smithi067.stdout:mon 3/3 30s ago 8m smithi067:172.21.15.67=a;smithi083:172.21.15.83=b;smithi172:172.21.15.172=c;count:3 2024-09-10T20:50:52.137 INFO:teuthology.orchestra.run.smithi067.stdout:osd 12 30s ago - 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 msgr2=0x7f649c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 0x7f649c0b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f64a8009900 tx=0x7f64a8031430 comp rx=0 tx=0).stop 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 msgr2=0x7f64b4198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64a400c890 tx=0x7f64a400cd50 comp rx=0 tx=0).stop 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 shutdown_connections 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f649c0b5370 0x7f649c0b7830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b4103450 0x7f64b419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:52.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64b4102a90 0x7f64b4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 --2- 172.21.15.67:0/2134273455 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64b4101930 0x7f64b4198e10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 >> 172.21.15.67:0/2134273455 conn(0x7f64b40fd200 msgr2=0x7f64b40feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 shutdown_connections 2024-09-10T20:50:52.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:52.135+0000 7f64ba4c8640 1 -- 172.21.15.67:0/2134273455 wait complete. 2024-09-10T20:50:52.525 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:52 smithi067 ceph-mon[30891]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:52 smithi083 ceph-mon[35058]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:52 smithi172 ceph-mon[35265]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:50:52.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T20:50:53.085 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:53.487 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:53 smithi067 ceph-mon[30891]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:53.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.566+0000 7f5ffb015640 1 -- 172.21.15.67:0/1128844906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4105bf0 msgr2=0x7f5ff4107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.566+0000 7f5ffb015640 1 --2- 172.21.15.67:0/1128844906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4107fe0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009900 tx=0x7f5fdc02a410 comp rx=0 tx=0).stop 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- 172.21.15.67:0/1128844906 shutdown_connections 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- 172.21.15.67:0/1128844906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4108720 0x7f5ff410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- 172.21.15.67:0/1128844906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4107fe0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- 172.21.15.67:0/1128844906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 0x7f5ff41056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- 172.21.15.67:0/1128844906 >> 172.21.15.67:0/1128844906 conn(0x7f5ff40fd1e0 msgr2=0x7f5ff40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- 172.21.15.67:0/1128844906 shutdown_connections 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- 172.21.15.67:0/1128844906 wait complete. 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 Processor -- start 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- start start 2024-09-10T20:50:53.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 0x7f5ff4102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410e650 con 0x7f5ff4108720 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410e4d0 con 0x7f5ff406b620 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.567+0000 7f5ffb015640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410e7d0 con 0x7f5ff4105bf0 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33474/0 (socket says 172.21.15.67:33474) 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 -- 172.21.15.67:0/704111549 learned_addr learned my addr 172.21.15.67:0/704111549 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff8db1640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 0x7f5ff4102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:53.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff3fff640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 -- 172.21.15.67:0/704111549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4105bf0 msgr2=0x7f5ff4101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 -- 172.21.15.67:0/704111549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 msgr2=0x7f5ff4102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 0x7f5ff4102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 -- 172.21.15.67:0/704111549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff4102450 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff95b2640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c970 tx=0x7f5fec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec007bb0 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec007d50 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff41a2e60 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.568+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec004e60 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.569+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff41a32c0 con 0x7f5ff4108720 2024-09-10T20:50:53.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.570+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff40fecd0 con 0x7f5ff4108720 2024-09-10T20:50:53.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.571+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5fec005020 con 0x7f5ff4108720 2024-09-10T20:50:53.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.572+0000 7f5ff1ffb640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 0x7f5fe00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:53.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.572+0000 7f5ff8db1640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 0x7f5fe00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:53.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.572+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5fec0e5950 con 0x7f5ff4108720 2024-09-10T20:50:53.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.572+0000 7f5ff8db1640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 0x7f5fe00b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4007ec0 tx=0x7f5fe40075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:53.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.576+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5fec014030 con 0x7f5ff4108720 2024-09-10T20:50:53.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:53 smithi083 ceph-mon[35058]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:53.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:53 smithi172 ceph-mon[35265]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:53.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.768+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5ff4063590 con 0x7f5fe00b5370 2024-09-10T20:50:53.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.770+0000 7f5ff1ffb640 1 -- 172.21.15.67:0/704111549 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5ff4063590 con 0x7f5fe00b5370 2024-09-10T20:50:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:HOST ADDR LABELS STATUS 2024-09-10T20:50:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 172.21.15.67 2024-09-10T20:50:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:smithi083 172.21.15.83 2024-09-10T20:50:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:smithi172 172.21.15.172 2024-09-10T20:50:53.774 INFO:teuthology.orchestra.run.smithi067.stdout:3 hosts in cluster 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 msgr2=0x7f5fe00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 0x7f5fe00b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4007ec0 tx=0x7f5fe40075b0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 msgr2=0x7f5ff4101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c970 tx=0x7f5fec00ce30 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 shutdown_connections 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ff4108720 0x7f5ff4101b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5fe00b5370 0x7f5fe00b7830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff4105bf0 0x7f5ff4101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 --2- 172.21.15.67:0/704111549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ff406b620 0x7f5ff4102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:53.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 >> 172.21.15.67:0/704111549 conn(0x7f5ff40fd1e0 msgr2=0x7f5ff4103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:53.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 shutdown_connections 2024-09-10T20:50:53.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:53.772+0000 7f5ffb015640 1 -- 172.21.15.67:0/704111549 wait complete. 2024-09-10T20:50:54.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T20:50:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:54 smithi067 ceph-mon[30891]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:54.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:54 smithi172 ceph-mon[35265]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:54 smithi083 ceph-mon[35058]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:54.658 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:55.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 -- 172.21.15.67:0/4003368855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c103b90 msgr2=0x7f558c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 --2- 172.21.15.67:0/4003368855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c103b90 0x7f558c104010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5580009930 tx=0x7f558002a420 comp rx=0 tx=0).stop 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 -- 172.21.15.67:0/4003368855 shutdown_connections 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 --2- 172.21.15.67:0/4003368855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 --2- 172.21.15.67:0/4003368855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c103b90 0x7f558c104010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 --2- 172.21.15.67:0/4003368855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c102a30 0x7f558c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 -- 172.21.15.67:0/4003368855 >> 172.21.15.67:0/4003368855 conn(0x7f558c0fe320 msgr2=0x7f558c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 -- 172.21.15.67:0/4003368855 shutdown_connections 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.099+0000 7f5592549640 1 -- 172.21.15.67:0/4003368855 wait complete. 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 Processor -- start 2024-09-10T20:50:55.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 -- start start 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c103b90 0x7f558c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10e710 con 0x7f558c102a30 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10e590 con 0x7f558c103b90 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.100+0000 7f5592549640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10e890 con 0x7f558c104550 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33486/0 (socket says 172.21.15.67:33486) 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 -- 172.21.15.67:0/3131355650 learned_addr learned my addr 172.21.15.67:0/3131355650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f5590ae6640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 -- 172.21.15.67:0/3131355650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 msgr2=0x7f558c19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 -- 172.21.15.67:0/3131355650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c103b90 msgr2=0x7f558c1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558b7fe640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c103b90 0x7f558c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c103b90 0x7f558c1994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 -- 172.21.15.67:0/3131355650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c19a9c0 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f5590ae6640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f558bfff640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b4a0 tx=0x7f557c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c014070 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c19acb0 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c1a1390 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f557c010ac0 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.101+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c01e060 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.102+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c109d50 con 0x7f558c102a30 2024-09-10T20:50:55.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.104+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f557c017b60 con 0x7f558c102a30 2024-09-10T20:50:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.105+0000 7f55897fa640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 0x7f55740b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.105+0000 7f558b7fe640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 0x7f55740b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.105+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f557c0e5810 con 0x7f558c102a30 2024-09-10T20:50:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.105+0000 7f558b7fe640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 0x7f55740b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5580009230 tx=0x7f5580000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:55.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.108+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f557c0ac5a0 con 0x7f558c102a30 2024-09-10T20:50:55.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.300+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f558c063590 con 0x7f55740b5370 2024-09-10T20:50:55.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.302+0000 7f55897fa640 1 -- 172.21.15.67:0/3131355650 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f558c063590 con 0x7f55740b5370 2024-09-10T20:50:55.306 INFO:teuthology.orchestra.run.smithi067.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T20:50:55.306 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440042400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T20:50:55.306 INFO:teuthology.orchestra.run.smithi067.stdout:smithi083 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040148400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T20:50:55.307 INFO:teuthology.orchestra.run.smithi067.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T20:50:55.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 msgr2=0x7f55740b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 0x7f55740b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5580009230 tx=0x7f5580000bc0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 msgr2=0x7f558c198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f557c00b4a0 tx=0x7f557c00b960 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 shutdown_connections 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f55740b5370 0x7f55740b7830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558c104550 0x7f558c19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f558c103b90 0x7f558c1994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.304+0000 7f5592549640 1 --2- 172.21.15.67:0/3131355650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f558c102a30 0x7f558c198e90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.305+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 >> 172.21.15.67:0/3131355650 conn(0x7f558c0fe320 msgr2=0x7f558c106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.305+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 shutdown_connections 2024-09-10T20:50:55.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:55.305+0000 7f5592549640 1 -- 172.21.15.67:0/3131355650 wait complete. 2024-09-10T20:50:55.542 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:55 smithi083 ceph-mon[35058]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:55.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:55 smithi067 ceph-mon[30891]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:55.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:55 smithi172 ceph-mon[35265]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:56.003 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T20:50:56.035 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T20:50:56.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T20:50:56.295 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:56 smithi067 ceph-mon[30891]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:56 smithi067 ceph-mon[30891]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:56 smithi083 ceph-mon[35058]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:56 smithi083 ceph-mon[35058]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:56 smithi172 ceph-mon[35265]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:50:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:56 smithi172 ceph-mon[35265]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:50:56.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 -- 172.21.15.67:0/3439839601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4102a30 msgr2=0x7f3dd4102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/3439839601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4102a30 0x7f3dd4102e30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009930 tx=0x7f3dc402a420 comp rx=0 tx=0).stop 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 -- 172.21.15.67:0/3439839601 shutdown_connections 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/3439839601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/3439839601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4103b90 0x7f3dd4104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/3439839601 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4102a30 0x7f3dd4102e30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 -- 172.21.15.67:0/3439839601 >> 172.21.15.67:0/3439839601 conn(0x7f3dd40fe320 msgr2=0x7f3dd4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:56.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 -- 172.21.15.67:0/3439839601 shutdown_connections 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.764+0000 7f3dd9e60640 1 -- 172.21.15.67:0/3439839601 wait complete. 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 Processor -- start 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 -- start start 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4102a30 0x7f3dd4076c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd4075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd410e690 con 0x7f3dd4103b90 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd410e510 con 0x7f3dd4102a30 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd9e60640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd410e810 con 0x7f3dd4104550 2024-09-10T20:50:56.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33514/0 (socket says 172.21.15.67:33514) 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 -- 172.21.15.67:0/1982458949 learned_addr learned my addr 172.21.15.67:0/1982458949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd37fe640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4102a30 0x7f3dd4076c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd3fff640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd4075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 -- 172.21.15.67:0/1982458949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 msgr2=0x7f3dd4075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd4075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 -- 172.21.15.67:0/1982458949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4102a30 msgr2=0x7f3dd4076c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4102a30 0x7f3dd4076c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd2ffd640 1 -- 172.21.15.67:0/1982458949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd4076280 con 0x7f3dd4103b90 2024-09-10T20:50:56.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.765+0000 7f3dd3fff640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd2ffd640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d950 tx=0x7f3dc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8017030 con 0x7f3dd4103b90 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3dc8004020 con 0x7f3dd4103b90 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80047a0 con 0x7f3dd4103b90 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd41a2e70 con 0x7f3dd4103b90 2024-09-10T20:50:56.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.766+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd41a3370 con 0x7f3dd4103b90 2024-09-10T20:50:56.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.767+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd4109d50 con 0x7f3dd4103b90 2024-09-10T20:50:56.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.769+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3dc8009a30 con 0x7f3dd4103b90 2024-09-10T20:50:56.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.769+0000 7f3dd0ff9640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 0x7f3dbc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:56.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.769+0000 7f3dd37fe640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 0x7f3dbc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:56.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.769+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3dc80e5d90 con 0x7f3dd4103b90 2024-09-10T20:50:56.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.770+0000 7f3dd37fe640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 0x7f3dbc0b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009900 tx=0x7f3dc4031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:56.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.772+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3dc80acba0 con 0x7f3dd4103b90 2024-09-10T20:50:57.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.998+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3dd402e5c0 con 0x7f3dd4103b90 2024-09-10T20:50:57.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:56.998+0000 7f3dd0ff9640 1 -- 172.21.15.67:0/1982458949 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3082 (secure 0 0 0) 0x7f3dc80ac4a0 con 0x7f3dd4103b90 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:e24 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:btime 2024-09-10T20:49:37:460926+0000 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 24 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-09-10T20:49:26.010912+0000 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-09-10T20:49:37.096165+0000 2024-09-10T20:50:57.003 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 300 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 3 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1,2 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=24608,1=24583,2=24581} 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2024-09-10T20:50:57.004 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 0 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:qdb_cluster leader: 24608 members: 24581,24583,24608 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b{0:24608} state up:active seq 4 addr [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c{0:24565} state up:standby-replay seq 1 addr [v2:172.21.15.172:6836/242991911,v1:172.21.15.172:6837/242991911] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.i{1:24583} state up:active seq 8 addr [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.f{1:24559} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/2165153315,v1:172.21.15.172:6835/2165153315] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.h{2:24581} state up:active seq 9 addr [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.005 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.e{2:24554} state up:standby-replay seq 1 addr [v2:172.21.15.83:6834/1348947486,v1:172.21.15.83:6835/1348947486] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.j{-1:14676} state up:standby seq 1 addr [v2:172.21.15.67:6834/1678307285,v1:172.21.15.67:6835/1678307285] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d{-1:14688} state up:standby seq 1 addr [v2:172.21.15.67:6836/3722693224,v1:172.21.15.67:6837/3722693224] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.g{-1:14736} state up:standby seq 1 addr [v2:172.21.15.67:6838/4192230461,v1:172.21.15.67:6839/4192230461] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a{-1:14748} state up:standby seq 1 addr [v2:172.21.15.67:6840/2489750374,v1:172.21.15.67:6841/2489750374] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.l{-1:24520} state up:standby seq 1 addr [v2:172.21.15.172:6832/2002269630,v1:172.21.15.172:6833/2002269630] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.006 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.k{-1:24530} state up:standby seq 1 addr [v2:172.21.15.83:6832/1389029488,v1:172.21.15.83:6833/1389029488] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 msgr2=0x7f3dbc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 0x7f3dbc0b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009900 tx=0x7f3dc4031430 comp rx=0 tx=0).stop 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 msgr2=0x7f3dd4075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d950 tx=0x7f3dc800de10 comp rx=0 tx=0).stop 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 shutdown_connections 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3dbc0b53f0 0x7f3dbc0b78b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd4104550 0x7f3dd4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3dd4103b90 0x7f3dd4075540 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 --2- 172.21.15.67:0/1982458949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dd4102a30 0x7f3dd4076c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 >> 172.21.15.67:0/1982458949 conn(0x7f3dd40fe320 msgr2=0x7f3dd4106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 shutdown_connections 2024-09-10T20:50:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:57.001+0000 7f3dd9e60640 1 -- 172.21.15.67:0/1982458949 wait complete. 2024-09-10T20:50:57.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:57 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1982458949' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T20:50:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:57 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1982458949' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T20:50:57.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T20:50:57.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:57 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1982458949' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T20:50:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:58.351 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:58 smithi067 ceph-mon[30891]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 -- 172.21.15.67:0/3766856735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc102a40 msgr2=0x7f36dc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:58.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/3766856735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc102a40 0x7f36dc102e40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009cd0 tx=0x7f36c402a8e0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 -- 172.21.15.67:0/3766856735 shutdown_connections 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/3766856735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc104560 0x7f36dc10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/3766856735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc103ba0 0x7f36dc104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/3766856735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc102a40 0x7f36dc102e40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 -- 172.21.15.67:0/3766856735 >> 172.21.15.67:0/3766856735 conn(0x7f36dc0fe2f0 msgr2=0x7f36dc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 -- 172.21.15.67:0/3766856735 shutdown_connections 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.430+0000 7f36e0f7e640 1 -- 172.21.15.67:0/3766856735 wait complete. 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 Processor -- start 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 -- start start 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a40 0x7f36dc198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc103ba0 0x7f36dc199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:58.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc10e6c0 con 0x7f36dc104560 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc10e540 con 0x7f36dc103ba0 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36e0f7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc10e840 con 0x7f36dc102a40 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33530/0 (socket says 172.21.15.67:33530) 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 -- 172.21.15.67:0/1910797898 learned_addr learned my addr 172.21.15.67:0/1910797898 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36d9d9b640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc103ba0 0x7f36dc199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36da59c640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a40 0x7f36dc198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 -- 172.21.15.67:0/1910797898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a40 msgr2=0x7f36dc198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a40 0x7f36dc198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 -- 172.21.15.67:0/1910797898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc103ba0 msgr2=0x7f36dc199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc103ba0 0x7f36dc199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.431+0000 7f36dad9d640 1 -- 172.21.15.67:0/1910797898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc19a9e0 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36dad9d640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d750 tx=0x7f36d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4017070 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d40054d0 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc19acd0 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4004c60 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.432+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc1a13b0 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.433+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc102e40 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.434+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f36d4004e00 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.435+0000 7f36d37fe640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 0x7f36c80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.435+0000 7f36da59c640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 0x7f36c80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.435+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f36d40e5a90 con 0x7f36dc104560 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.436+0000 7f36da59c640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 0x7f36c80b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006010 tx=0x7f36c4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:50:58.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.438+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f36d40ac1d0 con 0x7f36dc104560 2024-09-10T20:50:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.625+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f36dc109dc0 con 0x7f36dc104560 2024-09-10T20:50:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.626+0000 7f36d37fe640 1 -- 172.21.15.67:0/1910797898 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5235 (secure 0 0 0) 0x7f36d40b0c00 con 0x7f36dc104560 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 75 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-09-10T20:41:20.189021+0000 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2024-09-10T20:50:08.551921+0000 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:crush_version 26 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:full_ratio 0.95 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:backfillfull_ratio 0.9 2024-09-10T20:50:58.630 INFO:teuthology.orchestra.run.smithi067.stdout:nearfull_ratio 0.85 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:require_min_compat_client luminous 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:min_compat_client luminous 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:require_osd_release squid 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:stretch_mode_enabled false 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:max_osd 12 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6802/363534915,v1:172.21.15.67:6803/363534915] [v2:172.21.15.67:6804/363534915,v1:172.21.15.67:6805/363534915] exists,up ccf7e4d5-d677-4722-8ca8-ce5156a1d333 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 up in weight 1 up_from 13 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6800/459488332,v1:172.21.15.83:6801/459488332] [v2:172.21.15.83:6802/459488332,v1:172.21.15.83:6803/459488332] exists,up c974252b-1bb0-4ca1-81e7-33a82fe76300 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 up in weight 1 up_from 17 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/1268193181,v1:172.21.15.172:6801/1268193181] [v2:172.21.15.172:6802/1268193181,v1:172.21.15.172:6803/1268193181] exists,up 84efdf2d-6565-4a34-89a6-8e825e3c1d12 2024-09-10T20:50:58.631 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 up in weight 1 up_from 24 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6810/3075228399,v1:172.21.15.67:6811/3075228399] [v2:172.21.15.67:6812/3075228399,v1:172.21.15.67:6813/3075228399] exists,up 428aeca1-57f7-4b42-888c-21fbfdbc9c6e 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 up in weight 1 up_from 30 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6808/451760367,v1:172.21.15.83:6809/451760367] [v2:172.21.15.83:6810/451760367,v1:172.21.15.83:6811/451760367] exists,up 72f98c5f-21d4-4013-8d85-70510054e05a 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 up in weight 1 up_from 34 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/10580951,v1:172.21.15.172:6809/10580951] [v2:172.21.15.172:6810/10580951,v1:172.21.15.172:6811/10580951] exists,up 68176cbf-20a3-44c1-82bb-2a78c8faf6fe 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.6 up in weight 1 up_from 40 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6818/1669148747,v1:172.21.15.67:6819/1669148747] [v2:172.21.15.67:6820/1669148747,v1:172.21.15.67:6821/1669148747] exists,up dc804584-08bf-4d2d-9d84-88f3d964c37d 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.7 up in weight 1 up_from 46 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6816/3493783526,v1:172.21.15.83:6817/3493783526] [v2:172.21.15.83:6818/3493783526,v1:172.21.15.83:6819/3493783526] exists,up 04b82fc4-1c68-44a1-8288-cf19eb6b81e4 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.8 up in weight 1 up_from 53 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/4093279752,v1:172.21.15.172:6817/4093279752] [v2:172.21.15.172:6818/4093279752,v1:172.21.15.172:6819/4093279752] exists,up 21f45657-f851-4a79-a825-3cab9b319417 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.9 up in weight 1 up_from 58 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.67:6826/2963981854,v1:172.21.15.67:6827/2963981854] [v2:172.21.15.67:6828/2963981854,v1:172.21.15.67:6829/2963981854] exists,up 1523fce3-7f24-44fc-a1e2-e5369e8a87c9 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.10 up in weight 1 up_from 62 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6824/2093574925,v1:172.21.15.83:6825/2093574925] [v2:172.21.15.83:6826/2093574925,v1:172.21.15.83:6827/2093574925] exists,up bd1ab16a-dfb6-446d-b9d4-67e2262b81ab 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/4044336910,v1:172.21.15.172:6825/4044336910] [v2:172.21.15.172:6826/4044336910,v1:172.21.15.172:6827/4044336910] exists,up b8bee1a1-ca3e-42df-b858-ffe08396314c 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 2.8 [2,11] 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 2.1c [8,11] 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 3.0 [4,8] 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 3.1b [5,9] 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 3.1d [4,6] 2024-09-10T20:50:58.632 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 3.34 [4,9] 2024-09-10T20:50:58.633 INFO:teuthology.orchestra.run.smithi067.stdout:pg_upmap_items 3.3b [3,9] 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:6801/3935023259 expires 2024-09-11T20:42:06.670586+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/1803732354 expires 2024-09-11T20:42:06.670586+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/3510169462 expires 2024-09-11T20:42:06.670586+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:6800/3935023259 expires 2024-09-11T20:42:06.670586+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/254721601 expires 2024-09-11T20:42:06.670586+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:6801/1741490673 expires 2024-09-11T20:41:41.469649+0000 2024-09-10T20:50:58.636 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:6800/1741490673 expires 2024-09-11T20:41:41.469649+0000 2024-09-10T20:50:58.637 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/3396835785 expires 2024-09-11T20:41:41.469649+0000 2024-09-10T20:50:58.637 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/3091391503 expires 2024-09-11T20:41:41.469649+0000 2024-09-10T20:50:58.637 INFO:teuthology.orchestra.run.smithi067.stdout:blocklist 172.21.15.67:0/3875557644 expires 2024-09-11T20:41:41.469649+0000 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 msgr2=0x7f36c80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 0x7f36c80b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006010 tx=0x7f36c4004a40 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 msgr2=0x7f36dc19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d750 tx=0x7f36d400dc10 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 shutdown_connections 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36dc104560 0x7f36dc19a140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36dc103ba0 0x7f36dc199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f36c80b5370 0x7f36c80b7830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 --2- 172.21.15.67:0/1910797898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a40 0x7f36dc198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 >> 172.21.15.67:0/1910797898 conn(0x7f36dc0fe2f0 msgr2=0x7f36dc106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 shutdown_connections 2024-09-10T20:50:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:50:58.628+0000 7f36e0f7e640 1 -- 172.21.15.67:0/1910797898 wait complete. 2024-09-10T20:50:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:58 smithi083 ceph-mon[35058]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:58 smithi172 ceph-mon[35265]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:50:59.223 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T20:50:59.234 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:50:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:50:59.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:50:59 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1910797898' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T20:50:59.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:50:59 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1910797898' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T20:50:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:50:59 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1910797898' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T20:51:00.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 -- 172.21.15.67:0/3207206122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 msgr2=0x7f4bcc10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:00.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/3207206122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc10f570 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009ca0 tx=0x7f4bc402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 -- 172.21.15.67:0/3207206122 shutdown_connections 2024-09-10T20:51:00.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/3207206122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc10f570 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/3207206122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 0x7f4bcc10cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/3207206122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 0x7f4bcc104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 -- 172.21.15.67:0/3207206122 >> 172.21.15.67:0/3207206122 conn(0x7f4bcc0fd6d0 msgr2=0x7f4bcc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 -- 172.21.15.67:0/3207206122 shutdown_connections 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.010+0000 7f4bd26f0640 1 -- 172.21.15.67:0/3207206122 wait complete. 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 Processor -- start 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 -- start start 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 0x7f4bcc19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 0x7f4bcc19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc112d80 con 0x7f4bcc10d110 2024-09-10T20:51:00.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc112c00 con 0x7f4bcc103cb0 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd26f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc112f00 con 0x7f4bcc1045d0 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd0c8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd0c8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33538/0 (socket says 172.21.15.67:33538) 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bd0c8d640 1 -- 172.21.15.67:0/2442272511 learned_addr learned my addr 172.21.15.67:0/2442272511 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.011+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 0x7f4bcc19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bcb7fe640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 0x7f4bcc19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 -- 172.21.15.67:0/2442272511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 msgr2=0x7f4bcc19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 0x7f4bcc19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 -- 172.21.15.67:0/2442272511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 msgr2=0x7f4bcc19b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 0x7f4bcc19b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 -- 172.21.15.67:0/2442272511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc1a14b0 con 0x7f4bcc10d110 2024-09-10T20:51:00.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd0c8d640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4005cc0 tx=0x7f4bc402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4003cf0 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bc40044f0 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc1a1740 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc402fd10 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.012+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc1a7e60 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.013+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc104090 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.015+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4bc4004040 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.015+0000 7f4bc97fa640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 0x7f4bb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.015+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4bc41074a0 con 0x7f4bcc10d110 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.015+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 0x7f4bb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:00.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.016+0000 7f4bcbfff640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 0x7f4bb40b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0058c0 tx=0x7f4bbc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:00.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.018+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4bc40ce230 con 0x7f4bcc10d110 2024-09-10T20:51:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.242+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bcc19c530 con 0x7f4bcc10d110 2024-09-10T20:51:00.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.243+0000 7f4bc97fa640 1 -- 172.21.15.67:0/2442272511 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7f4bc40cdb30 con 0x7f4bcc10d110 2024-09-10T20:51:00.247 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:00.247 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:51:00.248 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 msgr2=0x7f4bb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 0x7f4bb40b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0058c0 tx=0x7f4bbc00a2d0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 msgr2=0x7f4bcc1a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4005cc0 tx=0x7f4bc402f470 comp rx=0 tx=0).stop 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 shutdown_connections 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4bcc10d110 0x7f4bcc1a0ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4bb40b5370 0x7f4bb40b7830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bcc1045d0 0x7f4bcc19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 --2- 172.21.15.67:0/2442272511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc103cb0 0x7f4bcc19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 >> 172.21.15.67:0/2442272511 conn(0x7f4bcc0fd6d0 msgr2=0x7f4bcc10f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 shutdown_connections 2024-09-10T20:51:00.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:00.246+0000 7f4bd26f0640 1 -- 172.21.15.67:0/2442272511 wait complete. 2024-09-10T20:51:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:00 smithi067 ceph-mon[30891]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:00 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2442272511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:00 smithi083 ceph-mon[35058]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:00 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2442272511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:00 smithi172 ceph-mon[35265]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:00 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2442272511' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:01.111 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:51:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:01.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/70761166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075e60 msgr2=0x7fca9c1135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/70761166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075e60 0x7fca9c1135e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fca98009ca0 tx=0x7fca9802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/70761166 shutdown_connections 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/70761166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c113b20 0x7fca9c115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/70761166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075e60 0x7fca9c1135e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/70761166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c075540 0x7fca9c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/70761166 >> 172.21.15.67:0/70761166 conn(0x7fca9c0fe830 msgr2=0x7fca9c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/70761166 shutdown_connections 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.860+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/70761166 wait complete. 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 Processor -- start 2024-09-10T20:51:01.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 -- start start 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c075e60 0x7fca9c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 0x7fca9c1a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1193a0 con 0x7fca9c075540 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c119220 con 0x7fca9c075e60 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa3ea2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c119520 con 0x7fca9c113b20 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa1c3e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa1c3e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33560/0 (socket says 172.21.15.67:33560) 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa1c3e640 1 -- 172.21.15.67:0/119940656 learned_addr learned my addr 172.21.15.67:0/119940656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:01.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa143d640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c075e60 0x7fca9c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.861+0000 7fcaa243f640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 0x7fca9c1a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 -- 172.21.15.67:0/119940656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 msgr2=0x7fca9c1a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 0x7fca9c1a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 -- 172.21.15.67:0/119940656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c075e60 msgr2=0x7fca9c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c075e60 0x7fca9c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 -- 172.21.15.67:0/119940656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c1a5860 con 0x7fca9c075540 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa243f640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 0x7fca9c1a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa1c3e640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c920 tx=0x7fca9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90007c70 con 0x7fca9c075540 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c1a5b50 con 0x7fca9c075540 2024-09-10T20:51:01.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca90007e10 con 0x7fca9c075540 2024-09-10T20:51:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90018820 con 0x7fca9c075540 2024-09-10T20:51:01.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.862+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1ac3e0 con 0x7fca9c075540 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.863+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9c075920 con 0x7fca9c075540 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.865+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fca9000f450 con 0x7fca9c075540 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.865+0000 7fca8effd640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 0x7fca880b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.866+0000 7fcaa143d640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 0x7fca880b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.866+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fca900e6110 con 0x7fca9c075540 2024-09-10T20:51:01.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.866+0000 7fcaa143d640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 0x7fca880b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca9c116000 tx=0x7fca98009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:01.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:01.868+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca90014030 con 0x7fca9c075540 2024-09-10T20:51:02.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.093+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca9c1a08e0 con 0x7fca9c075540 2024-09-10T20:51:02.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.094+0000 7fca8effd640 1 -- 172.21.15.67:0/119940656 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11905 (secure 0 0 0) 0x7fca900acf30 con 0x7fca9c075540 2024-09-10T20:51:02.098 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:02.098 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":24,"btime":"2024-09-10T20:49:37:460926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:49:37.096165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:51:02.099 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 24 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.096+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 msgr2=0x7fca880b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.096+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 0x7fca880b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca9c116000 tx=0x7fca98009900 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.096+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 msgr2=0x7fca9c19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.096+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fca9000c920 tx=0x7fca9000cde0 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 shutdown_connections 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca880b5370 0x7fca880b7830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c113b20 0x7fca9c1a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca9c075e60 0x7fca9c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 --2- 172.21.15.67:0/119940656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca9c075540 0x7fca9c19f7b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 >> 172.21.15.67:0/119940656 conn(0x7fca9c0fe830 msgr2=0x7fca9c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 shutdown_connections 2024-09-10T20:51:02.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:02.097+0000 7fcaa3ea2640 1 -- 172.21.15.67:0/119940656 wait complete. 2024-09-10T20:51:02.524 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:02 smithi067 ceph-mon[30891]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:51:02.525 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:02 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/119940656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:02 smithi083 ceph-mon[35058]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:51:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:02 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/119940656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:02 smithi172 ceph-mon[35265]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T20:51:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:02 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/119940656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:02.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:51:03.145 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.610+0000 7fd8c626c640 1 -- 172.21.15.67:0/132083921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 msgr2=0x7fd8c010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.610+0000 7fd8c626c640 1 --2- 172.21.15.67:0/132083921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c010f950 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ca0 tx=0x7fd8b802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 -- 172.21.15.67:0/132083921 shutdown_connections 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 --2- 172.21.15.67:0/132083921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c010f950 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 --2- 172.21.15.67:0/132083921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 0x7fd8c0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 --2- 172.21.15.67:0/132083921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 0x7fd8c01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 -- 172.21.15.67:0/132083921 >> 172.21.15.67:0/132083921 conn(0x7fd8c00fe830 msgr2=0x7fd8c0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 -- 172.21.15.67:0/132083921 shutdown_connections 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 -- 172.21.15.67:0/132083921 wait complete. 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 Processor -- start 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.611+0000 7fd8c626c640 1 -- start start 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 0x7fd8c01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 0x7fd8c0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112e10 con 0x7fd8c0109150 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112c90 con 0x7fd8c01087d0 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c626c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112f90 con 0x7fd8c0102dc0 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43268/0 (socket says 172.21.15.67:43268) 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 -- 172.21.15.67:0/226589180 learned_addr learned my addr 172.21.15.67:0/226589180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8bffff640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 0x7fd8c01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8b7fff640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 0x7fd8c0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 -- 172.21.15.67:0/226589180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 msgr2=0x7fd8c01993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 0x7fd8c01993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 -- 172.21.15.67:0/226589180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 msgr2=0x7fd8c0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 0x7fd8c0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 -- 172.21.15.67:0/226589180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c019f470 con 0x7fd8c0109150 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8c4809640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8005cc0 tx=0x7fd8b802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.612+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8003bf0 con 0x7fd8c0109150 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.613+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8b8003d90 con 0x7fd8c0109150 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.613+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c019f700 con 0x7fd8c0109150 2024-09-10T20:51:03.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.613+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802fb20 con 0x7fd8c0109150 2024-09-10T20:51:03.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.613+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c01a5e20 con 0x7fd8c0109150 2024-09-10T20:51:03.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.614+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c01031a0 con 0x7fd8c0109150 2024-09-10T20:51:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.615+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd8b8004580 con 0x7fd8c0109150 2024-09-10T20:51:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.616+0000 7fd8bdffb640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 0x7fd8ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.616+0000 7fd8bffff640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 0x7fd8ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.616+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd8b81071a0 con 0x7fd8c0109150 2024-09-10T20:51:03.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.616+0000 7fd8bffff640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 0x7fd8ac0b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000bbe0 tx=0x7fd8b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:03.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.619+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8b80cdf30 con 0x7fd8c0109150 2024-09-10T20:51:03.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.809+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8c019a4f0 con 0x7fd8c0109150 2024-09-10T20:51:03.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.810+0000 7fd8bdffb640 1 -- 172.21.15.67:0/226589180 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7fd8b80cd830 con 0x7fd8c0109150 2024-09-10T20:51:03.814 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:03.814 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:51:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 msgr2=0x7fd8ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 0x7fd8ac0b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000bbe0 tx=0x7fd8b000b390 comp rx=0 tx=0).stop 2024-09-10T20:51:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 msgr2=0x7fd8c019eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8005cc0 tx=0x7fd8b802f380 comp rx=0 tx=0).stop 2024-09-10T20:51:03.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 shutdown_connections 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c0109150 0x7fd8c019eca0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c01087d0 0x7fd8c0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd8ac0b5370 0x7fd8ac0b7830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 --2- 172.21.15.67:0/226589180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8c0102dc0 0x7fd8c01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 >> 172.21.15.67:0/226589180 conn(0x7fd8c00fe830 msgr2=0x7fd8c0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 shutdown_connections 2024-09-10T20:51:03.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:03.812+0000 7fd8c626c640 1 -- 172.21.15.67:0/226589180 wait complete. 2024-09-10T20:51:04.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:04 smithi067 ceph-mon[30891]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:04.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:04 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/226589180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:04.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T20:49:26.010912+0000', 'modified': '2024-09-10T20:49:37.096165+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24608, 'mds_1': 24583, 'mds_2': 24581}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24554': {'gid': 24554, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.83:6835/1348947486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6834', 'nonce': 1348947486}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 1348947486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24559': {'gid': 24559, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/2165153315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2165153315}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2165153315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24565': {'gid': 24565, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6837/242991911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 242991911}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 242991911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24581': {'gid': 24581, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.83:6837/725743109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6836', 'nonce': 725743109}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 725743109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.172:6839/977540301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 977540301}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 977540301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24608': {'gid': 24608, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.83:6839/4114167156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6838', 'nonce': 4114167156}, {'type': 'v1', 'addr': '172.21.15.83:6839', 'nonce': 4114167156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24608, 'qdb_cluster': [24581, 24583, 24608]} 2024-09-10T20:51:04.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T20:51:04.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T20:51:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:04 smithi083 ceph-mon[35058]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:04 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/226589180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:04 smithi172 ceph-mon[35265]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:04 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/226589180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:04.863 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:05.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 -- 172.21.15.67:0/4124171883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca681076a0 msgr2=0x7fca68107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 --2- 172.21.15.67:0/4124171883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca681076a0 0x7fca68107ae0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009900 tx=0x7fca5c02a410 comp rx=0 tx=0).stop 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 -- 172.21.15.67:0/4124171883 shutdown_connections 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 --2- 172.21.15.67:0/4124171883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68108020 0x7fca6810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 --2- 172.21.15.67:0/4124171883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca681076a0 0x7fca68107ae0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 --2- 172.21.15.67:0/4124171883 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca68101c90 0x7fca68102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 -- 172.21.15.67:0/4124171883 >> 172.21.15.67:0/4124171883 conn(0x7fca680fd700 msgr2=0x7fca680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 -- 172.21.15.67:0/4124171883 shutdown_connections 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.285+0000 7fca6d68f640 1 -- 172.21.15.67:0/4124171883 wait complete. 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 Processor -- start 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 -- start start 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68101c90 0x7fca680fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 0x7fca680fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fca68111ca0 con 0x7fca68108020 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fca68111b20 con 0x7fca681076a0 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca6d68f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca68111e20 con 0x7fca68101c90 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43282/0 (socket says 172.21.15.67:43282) 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca677fe640 1 -- 172.21.15.67:0/2475349913 learned_addr learned my addr 172.21.15.67:0/2475349913 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.286+0000 7fca66ffd640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68101c90 0x7fca680fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca667fc640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 0x7fca680fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 -- 172.21.15.67:0/2475349913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68101c90 msgr2=0x7fca680fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68101c90 0x7fca680fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 -- 172.21.15.67:0/2475349913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 msgr2=0x7fca680fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 0x7fca680fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 -- 172.21.15.67:0/2475349913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca681a76e0 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca667fc640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 0x7fca680fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca677fe640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca6000eaa0 tx=0x7fca6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca4ffff640 1 -- 172.21.15.67:0/2475349913 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6000cdb0 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca4ffff640 1 -- 172.21.15.67:0/2475349913 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca60005020 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca681a79d0 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca4ffff640 1 -- 172.21.15.67:0/2475349913 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600116d0 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.287+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca681a7f10 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 Processor -- start 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca4ffff640 1 -- 172.21.15.67:0/2475349913 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fca6000f040 con 0x7fca68108020 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 -- start start 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80bc5e0 0x5644b80be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644b8027c10 con 0x5644b80b0650 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b8017040 con 0x5644b80afd30 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca6fa64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644b801ae50 con 0x5644b80bc5e0 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43288/0 (socket says 172.21.15.67:43288) 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca66ffd640 1 -- 172.21.15.67:0/252465930 learned_addr learned my addr 172.21.15.67:0/252465930 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca667fc640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.290+0000 7fca667fc640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80bc5e0 0x5644b80be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 -- 172.21.15.67:0/252465930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80bc5e0 msgr2=0x5644b80be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80bc5e0 0x5644b80be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 -- 172.21.15.67:0/252465930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 msgr2=0x5644b80b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 -- 172.21.15.67:0/252465930 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b7d75540 con 0x5644b80b0650 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca667fc640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca66ffd640 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca5800ac50 tx=0x7fca5800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7430a824801e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca4ffff640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 0x7fca500b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca667fc640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 0x7fca500b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca4d7fa640 1 -- 172.21.15.67:0/252465930 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5801d070 con 0x5644b80b0650 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca4ffff640 1 -- 172.21.15.67:0/2475349913 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fca600e5b70 con 0x7fca68108020 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca4d7fa640 1 -- 172.21.15.67:0/252465930 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca58018af0 con 0x5644b80b0650 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.291+0000 7fca4d7fa640 1 -- 172.21.15.67:0/252465930 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58010ad0 con 0x5644b80b0650 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- 172.21.15.67:0/252465930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 msgr2=0x5644b80bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca667fc640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 0x7fca500b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5644b80afce0 tx=0x7fca5c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca5800ac50 tx=0x7fca5800f790 comp rx=0 tx=0).stop 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- 172.21.15.67:0/252465930 shutdown_connections 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80bc5e0 0x5644b80be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80bc0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 --2- 172.21.15.67:0/252465930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- 172.21.15.67:0/252465930 >> 172.21.15.67:0/252465930 conn(0x5644b80adb60 msgr2=0x5644b80aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- 172.21.15.67:0/252465930 shutdown_connections 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- 172.21.15.67:0/252465930 wait complete. 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 -- start start 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.292+0000 7fca6fa64740 1 Processor -- start 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80ba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644b7e785f0 con 0x5644b80afd30 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b7fb2010 con 0x5644b80bc5e0 2024-09-10T20:51:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644b80bf290 con 0x5644b80b0650 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 10 client.0 _ll_register_callbacks cb 0x5644b8011340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43300/0 (socket says 172.21.15.67:43300) 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 -- 172.21.15.67:0/245033767 learned_addr learned my addr 172.21.15.67:0/245033767 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca667fc640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca677fe640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 -- 172.21.15.67:0/245033767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 msgr2=0x5644b80b9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80b9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 -- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 msgr2=0x5644b80ba040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80ba040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 -- 172.21.15.67:0/245033767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b7fdfa00 con 0x5644b80afd30 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca66ffd640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca5800a7d0 tx=0x7fca580186d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe0e9ee46bc2ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5801d040 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fca580108b0 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.293+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca58018af0 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca58005ce0 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 10 client.15222 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644b80caea0 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca58018af0 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca58020030 con 0x5644b80afd30 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 10 client.15222 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 10 client.15222 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 20 client.15222 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b80cd180 0x5644b80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 4 client.15222 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644b8029b60 con 0x5644b80cd180 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.294+0000 7fca667fc640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b80cd180 0x5644b80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.295+0000 7fca4aff5640 10 client.15222 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.295+0000 7fca667fc640 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b80cd180 0x5644b80ce5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50c22b4a3448bad3 server_cookie=c044d49acce559 in_seq=0 out_seq=0 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.295+0000 7fca4aff5640 1 -- 172.21.15.67:0/245033767 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644b8029b60 con 0x5644b80cd180 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.295+0000 7fca4aff5640 10 client.15222 handle_command_reply: tid=0 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.295+0000 7fca6fa64740 1 client.15222 shutdown 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 msgr2=0x5644b80b95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca5800a7d0 tx=0x7fca580186d0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 shutdown_connections 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b80cd180 0x5644b80ce5f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80ba040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80b9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 --2- 172.21.15.67:0/245033767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80afd30 0x5644b80b95c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca4aff5640 0 client.15222 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 >> 172.21.15.67:0/245033767 conn(0x5644b80adb60 msgr2=0x5644b80b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 shutdown_connections 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 1 -- 172.21.15.67:0/245033767 wait complete. 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.296+0000 7fca6fa64740 20 client.15222 trim_cache size 0 max 16384 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 Processor -- start 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 -- start start 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80ba380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644b80cc930 con 0x5644b80bc5e0 2024-09-10T20:51:05.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b80cd000 con 0x5644b80afd30 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.314+0000 7fca6fa64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644b80cd6d0 con 0x5644b80b0650 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43302/0 (socket says 172.21.15.67:43302) 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 -- 172.21.15.67:0/2043302904 learned_addr learned my addr 172.21.15.67:0/2043302904 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca667fc640 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 -- 172.21.15.67:0/2043302904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 msgr2=0x5644b80ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80ba380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 -- 172.21.15.67:0/2043302904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 msgr2=0x5644b80a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 -- 172.21.15.67:0/2043302904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644b80ae5e0 con 0x5644b80bc5e0 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca677fe640 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca6000efd0 tx=0x7fca600ac0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2d0661034b51e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca4cff9640 1 -- 172.21.15.67:0/2043302904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6001f070 con 0x5644b80bc5e0 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca4cff9640 1 -- 172.21.15.67:0/2043302904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca600ac900 con 0x5644b80bc5e0 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.315+0000 7fca4cff9640 1 -- 172.21.15.67:0/2043302904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600cf0d0 con 0x5644b80bc5e0 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- 172.21.15.67:0/2043302904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 msgr2=0x5644b80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca6000efd0 tx=0x7fca600ac0e0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- 172.21.15.67:0/2043302904 shutdown_connections 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80bc5e0 0x5644b80b3da0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80b0650 0x5644b80ba380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- 172.21.15.67:0/2043302904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80afd30 0x5644b80a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- 172.21.15.67:0/2043302904 >> 172.21.15.67:0/2043302904 conn(0x5644b80adb60 msgr2=0x5644b80b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- 172.21.15.67:0/2043302904 shutdown_connections 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- 172.21.15.67:0/2043302904 wait complete. 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- start start 2024-09-10T20:51:05.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 Processor -- start 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80afd30 0x5644b80d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644b80ce470 con 0x5644b80b0650 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644b80cdda0 con 0x5644b80bc5e0 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644b80ceb40 con 0x5644b80afd30 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca6fa64740 10 client.0 _ll_register_callbacks cb 0x7fca5801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca667fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca667fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43318/0 (socket says 172.21.15.67:43318) 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.316+0000 7fca667fc640 1 -- 172.21.15.67:0/1733681811 learned_addr learned my addr 172.21.15.67:0/1733681811 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca66ffd640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80afd30 0x5644b80d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 -- 172.21.15.67:0/1733681811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80afd30 msgr2=0x5644b80d6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80afd30 0x5644b80d6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 -- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 msgr2=0x5644b80d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 -- 172.21.15.67:0/1733681811 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644b80cc760 con 0x5644b80b0650 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca667fc640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009900 tx=0x7fca5c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af40359603fe0050 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c058020 con 0x5644b80b0650 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fca5c004450 con 0x5644b80b0650 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca600ac900 con 0x5644b80b0650 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca5c035040 con 0x5644b80b0650 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca6fa64740 10 client.15228 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:05.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644b80d6800 con 0x5644b80b0650 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.317+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca600ac900 con 0x5644b80b0650 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca5c03a040 con 0x5644b80b0650 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 10 client.15228 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 10 client.15228 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 20 client.15228 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b813e4a0 0x5644b813d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 4 client.15228 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "status"}) -- 0x5644b8025610 con 0x5644b813e4a0 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca66ffd640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b813e4a0 0x5644b813d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca4aff5640 10 client.15228 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca66ffd640 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b813e4a0 0x5644b813d1b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=204af61f319da662 server_cookie=a60dbc0d8735fbec in_seq=0 out_seq=0 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca4aff5640 1 -- 172.21.15.67:0/1733681811 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5644b8025610 con 0x5644b813e4a0 2024-09-10T20:51:05.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca4aff5640 10 client.15228 handle_command_reply: tid=0 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.318+0000 7fca6fa64740 1 client.15228 shutdown 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 msgr2=0x5644b80d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009900 tx=0x7fca5c02a410 comp rx=0 tx=0).stop 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 shutdown_connections 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5644b813e4a0 0x5644b813d1b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644b80bc5e0 0x5644b80d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644b80b0650 0x5644b80d0330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca4aff5640 0 client.15228 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 --2- 172.21.15.67:0/1733681811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644b80afd30 0x5644b80d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 >> 172.21.15.67:0/1733681811 conn(0x5644b80adb60 msgr2=0x5644b80b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 2, 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24581, 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 90.863524118000001, 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:51:05.344 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 120.767527777 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 shutdown_connections 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 1 -- 172.21.15.67:0/1733681811 wait complete. 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6fa64740 20 client.15228 trim_cache size 0 max 16384 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 msgr2=0x7fca500b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 0x7fca500b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x5644b80afce0 tx=0x7fca5c031400 comp rx=0 tx=0).stop 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 msgr2=0x7fca680fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca6000eaa0 tx=0x7fca6000ef60 comp rx=0 tx=0).stop 2024-09-10T20:51:05.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 shutdown_connections 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fca68108020 0x7fca680fe680 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca681076a0 0x7fca680fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fca500b5370 0x7fca500b7830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 --2- 172.21.15.67:0/2475349913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca68101c90 0x7fca680fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.319+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 >> 172.21.15.67:0/2475349913 conn(0x7fca680fd700 msgr2=0x7fca681047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.320+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 shutdown_connections 2024-09-10T20:51:05.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:05.320+0000 7fca6d68f640 1 -- 172.21.15.67:0/2475349913 wait complete. 2024-09-10T20:51:06.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T20:51:06.292 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:06.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:06 smithi067 ceph-mon[30891]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:06 smithi083 ceph-mon[35058]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:06 smithi172 ceph-mon[35265]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T20:51:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 -- 172.21.15.67:0/36287394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 msgr2=0x7fbed81040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/36287394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed81040c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009ca0 tx=0x7fbecc02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 -- 172.21.15.67:0/36287394 shutdown_connections 2024-09-10T20:51:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/36287394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed810d140 0x7fbed810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/36287394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed8104600 0x7fbed810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/36287394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed81040c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 -- 172.21.15.67:0/36287394 >> 172.21.15.67:0/36287394 conn(0x7fbed80fd720 msgr2=0x7fbed80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 -- 172.21.15.67:0/36287394 shutdown_connections 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.769+0000 7fbedf3dc640 1 -- 172.21.15.67:0/36287394 wait complete. 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 Processor -- start 2024-09-10T20:51:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 -- start start 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed8104600 0x7fbed8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed810d140 0x7fbed819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8112e10 con 0x7fbed8103ce0 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8112c90 con 0x7fbed810d140 2024-09-10T20:51:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.770+0000 7fbedf3dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8112f90 con 0x7fbed8104600 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43334/0 (socket says 172.21.15.67:43334) 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 -- 172.21.15.67:0/3272287204 learned_addr learned my addr 172.21.15.67:0/3272287204 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedc977640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed8104600 0x7fbed8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd979640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed810d140 0x7fbed819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 -- 172.21.15.67:0/3272287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed8104600 msgr2=0x7fbed8199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed8104600 0x7fbed8199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 -- 172.21.15.67:0/3272287204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed810d140 msgr2=0x7fbed819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed810d140 0x7fbed819ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 -- 172.21.15.67:0/3272287204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed819f3d0 con 0x7fbed8103ce0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedd178640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006010 tx=0x7fbecc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbeca7fc640 1 -- 172.21.15.67:0/3272287204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc003bf0 con 0x7fbed8103ce0 2024-09-10T20:51:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbeca7fc640 1 -- 172.21.15.67:0/3272287204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbecc003d90 con 0x7fbed8103ce0 2024-09-10T20:51:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed819f660 con 0x7fbed8103ce0 2024-09-10T20:51:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbeca7fc640 1 -- 172.21.15.67:0/3272287204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02fc20 con 0x7fbed8103ce0 2024-09-10T20:51:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.771+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed81a5e00 con 0x7fbed8103ce0 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.774+0000 7fbeca7fc640 1 -- 172.21.15.67:0/3272287204 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbecc0046a0 con 0x7fbed8103ce0 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.774+0000 7fbee17b1740 1 Processor -- start 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.774+0000 7fbee17b1740 1 -- start start 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf7191110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf719d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf719f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fcf7108c10 con 0x55fcf7191650 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fcf70f8040 con 0x55fcf7190d30 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbee17b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fcf70fbe50 con 0x55fcf719d5e0 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd178640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf719d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd178640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf719d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43346/0 (socket says 172.21.15.67:43346) 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd178640 1 -- 172.21.15.67:0/159942966 learned_addr learned my addr 172.21.15.67:0/159942966 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf7191110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedc977640 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf719f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 -- 172.21.15.67:0/159942966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 msgr2=0x55fcf719f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf719f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 -- 172.21.15.67:0/159942966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 msgr2=0x55fcf719d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf719d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 -- 172.21.15.67:0/159942966 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf6e56540 con 0x55fcf7190d30 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbeca7fc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 0x7fbec40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd178640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 0x7fbec40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.775+0000 7fbedd979640 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf7191110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbed0004640 tx=0x7fbed000ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=622db1e2433dbe47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbeca7fc640 1 -- 172.21.15.67:0/3272287204 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbecc106fe0 con 0x7fbed8103ce0 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbec37fe640 1 -- 172.21.15.67:0/159942966 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0003bb0 con 0x55fcf7190d30 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbec37fe640 1 -- 172.21.15.67:0/159942966 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbed0015070 con 0x55fcf7190d30 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbec37fe640 1 -- 172.21.15.67:0/159942966 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00106a0 con 0x55fcf7190d30 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbedd178640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 0x7fbec40b7830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbecc1049f0 tx=0x7fbecc10ab30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbee17b1740 1 -- 172.21.15.67:0/159942966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 msgr2=0x55fcf7191110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.776+0000 7fbee17b1740 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf7191110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbed0004640 tx=0x7fbed000ba90 comp rx=0 tx=0).stop 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 -- 172.21.15.67:0/159942966 shutdown_connections 2024-09-10T20:51:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf719f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf719d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 --2- 172.21.15.67:0/159942966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf7191110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 -- 172.21.15.67:0/159942966 >> 172.21.15.67:0/159942966 conn(0x55fcf718eb60 msgr2=0x55fcf718fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 -- 172.21.15.67:0/159942966 shutdown_connections 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 -- 172.21.15.67:0/159942966 wait complete. 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 -- start start 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.777+0000 7fbee17b1740 1 Processor -- start 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7190d30 0x55fcf719a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7191650 0x55fcf719aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fcf6f595f0 con 0x55fcf719d5e0 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fcf7093010 con 0x55fcf7191650 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71a0290 con 0x55fcf7190d30 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbee17b1740 10 client.0 _ll_register_callbacks cb 0x55fcf70f2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43360/0 (socket says 172.21.15.67:43360) 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 -- 172.21.15.67:0/3450064075 learned_addr learned my addr 172.21.15.67:0/3450064075 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedc977640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7191650 0x55fcf719aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7190d30 0x55fcf719a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 -- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7190d30 msgr2=0x55fcf719a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7190d30 0x55fcf719a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 -- 172.21.15.67:0/3450064075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7191650 msgr2=0x55fcf719aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7191650 0x55fcf719aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 -- 172.21.15.67:0/3450064075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf70c0a00 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbedd979640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbed0011f60 tx=0x7fbed0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba46a263fd8d10c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbec0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.778+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed001e070 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbed0003bc0 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed0015070 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbed0030050 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fcf71abe80 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbed0015070 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbed0010c20 con 0x55fcf719d5e0 2024-09-10T20:51:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:06.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 10 client.15240 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T20:51:06.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 20 client.15240 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:06.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf71ae2a0 0x55fcf71af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 4 client.15240 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:06.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.779+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcf710ab60 con 0x55fcf71ae2a0 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.780+0000 7fbedc977640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf71ae2a0 0x55fcf71af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.780+0000 7fbedc977640 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf71ae2a0 0x55fcf71af710 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9fa505ed97ea46b server_cookie=87af511def3578e in_seq=0 out_seq=0 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.780+0000 7fbec0ff9640 10 client.15240 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbec0ff9640 1 -- 172.21.15.67:0/3450064075 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcf710ab60 con 0x55fcf71ae2a0 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbec0ff9640 10 client.15240 handle_command_reply: tid=0 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 client.15240 shutdown 2024-09-10T20:51:06.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 msgr2=0x55fcf719b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbed0011f60 tx=0x7fbed0011c80 comp rx=0 tx=0).stop 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 shutdown_connections 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf71ae2a0 0x55fcf71af710 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf719d5e0 0x55fcf719b000 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7191650 0x55fcf719aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3450064075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7190d30 0x55fcf719a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbec0ff9640 0 client.15240 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 >> 172.21.15.67:0/3450064075 conn(0x55fcf718eb60 msgr2=0x55fcf7194700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 shutdown_connections 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 1 -- 172.21.15.67:0/3450064075 wait complete. 2024-09-10T20:51:06.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.781+0000 7fbee17b1740 20 client.15240 trim_cache size 0 max 16384 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 Processor -- start 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 -- start start 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf71902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf7197790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71ada50 con 0x55fcf7191650 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71ae120 con 0x55fcf7190d30 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbee17b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71ae7f0 con 0x55fcf719d5e0 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43366/0 (socket says 172.21.15.67:43366) 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 -- 172.21.15.67:0/3542928088 learned_addr learned my addr 172.21.15.67:0/3542928088 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedd979640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf71902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedd979640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf7197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 -- 172.21.15.67:0/3542928088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 msgr2=0x55fcf7197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf7197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 -- 172.21.15.67:0/3542928088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 msgr2=0x55fcf71902c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf71902c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedc977640 1 -- 172.21.15.67:0/3542928088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcf718a4f0 con 0x55fcf7191650 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.800+0000 7fbedd979640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf71902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbedc977640 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000c00 tx=0x7fbed4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30dd28414bbcf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbec2ffd640 1 -- 172.21.15.67:0/3542928088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4025380 con 0x55fcf7191650 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbec2ffd640 1 -- 172.21.15.67:0/3542928088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbed40259d0 con 0x55fcf7191650 2024-09-10T20:51:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbec2ffd640 1 -- 172.21.15.67:0/3542928088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4015720 con 0x55fcf7191650 2024-09-10T20:51:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbee17b1740 1 -- 172.21.15.67:0/3542928088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 msgr2=0x55fcf71ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.801+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000c00 tx=0x7fbed4008040 comp rx=0 tx=0).stop 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- 172.21.15.67:0/3542928088 shutdown_connections 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf719d5e0 0x55fcf7197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7191650 0x55fcf71ad290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- 172.21.15.67:0/3542928088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf7190d30 0x55fcf71902c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- 172.21.15.67:0/3542928088 >> 172.21.15.67:0/3542928088 conn(0x55fcf718eb60 msgr2=0x55fcf718fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- 172.21.15.67:0/3542928088 shutdown_connections 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- 172.21.15.67:0/3542928088 wait complete. 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- start start 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 Processor -- start 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7191650 0x55fcf71b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf719d5e0 0x55fcf71b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71af590 con 0x55fcf7190d30 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71aeec0 con 0x55fcf719d5e0 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.802+0000 7fbee17b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fcf71afc60 con 0x55fcf7191650 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbee17b1740 10 client.0 _ll_register_callbacks cb 0x7fbecc10aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43370/0 (socket says 172.21.15.67:43370) 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 -- 172.21.15.67:0/2914968289 learned_addr learned my addr 172.21.15.67:0/2914968289 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedc977640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7191650 0x55fcf71b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf719d5e0 0x55fcf71b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 -- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7191650 msgr2=0x55fcf71b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7191650 0x55fcf71b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 -- 172.21.15.67:0/2914968289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf719d5e0 msgr2=0x55fcf71b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:06.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf719d5e0 0x55fcf71b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 -- 172.21.15.67:0/2914968289 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcf71b2220 con 0x55fcf7190d30 2024-09-10T20:51:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbedd979640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbed0011cf0 tx=0x7fbed002b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cfaf020897ecd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbec0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed001e070 con 0x55fcf7190d30 2024-09-10T20:51:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbed0011d20 con 0x55fcf7190d30 2024-09-10T20:51:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.803+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed40259d0 con 0x55fcf7190d30 2024-09-10T20:51:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbed001ad80 con 0x55fcf7190d30 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fcf721abe0 con 0x55fcf7190d30 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbed40259d0 con 0x55fcf7190d30 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbed0010c80 con 0x55fcf7190d30 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:06.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 20 client.15246 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf721f700 0x55fcf721e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 4 client.15246 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "status"}) -- 0x55fcf7106610 con 0x55fcf721f700 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.804+0000 7fbedc977640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf721f700 0x55fcf721e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:06.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbedc977640 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf721f700 0x55fcf721e410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8df1a5932f9672a2 server_cookie=b3840db4f7325aa6 in_seq=0 out_seq=0 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbec0ff9640 10 client.15246 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbec0ff9640 1 -- 172.21.15.67:0/2914968289 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fcf7106610 con 0x55fcf721f700 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbec0ff9640 10 client.15246 handle_command_reply: tid=0 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 client.15246 shutdown 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 msgr2=0x55fcf71b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbed0011cf0 tx=0x7fbed002b040 comp rx=0 tx=0).stop 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 shutdown_connections 2024-09-10T20:51:06.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55fcf721f700 0x55fcf721e410 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbec0ff9640 0 client.15246 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fcf719d5e0 0x55fcf71b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fcf7191650 0x55fcf71b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 --2- 172.21.15.67:0/2914968289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fcf7190d30 0x55fcf71b80a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 >> 172.21.15.67:0/2914968289 conn(0x55fcf718eb60 msgr2=0x55fcf719bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.805+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 shutdown_connections 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbee17b1740 1 -- 172.21.15.67:0/2914968289 wait complete. 2024-09-10T20:51:06.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbee17b1740 20 client.15246 trim_cache size 0 max 16384 2024-09-10T20:51:06.826 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:06.826 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:51:06.826 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 1, 2024-09-10T20:51:06.826 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24583, 2024-09-10T20:51:06.826 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 93.356566334999997, 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:51:06.827 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 119.722474631 2024-09-10T20:51:06.828 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 msgr2=0x7fbec40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 0x7fbec40b7830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbecc1049f0 tx=0x7fbecc10ab30 comp rx=0 tx=0).stop 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 msgr2=0x7fbed8199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006010 tx=0x7fbecc0319f0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 shutdown_connections 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed810d140 0x7fbed819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbec40b5370 0x7fbec40b7830 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed8104600 0x7fbed8199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 --2- 172.21.15.67:0/3272287204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed8103ce0 0x7fbed8199320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 >> 172.21.15.67:0/3272287204 conn(0x7fbed80fd720 msgr2=0x7fbed80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 shutdown_connections 2024-09-10T20:51:06.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:06.806+0000 7fbedf3dc640 1 -- 172.21.15.67:0/3272287204 wait complete. 2024-09-10T20:51:07.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T20:51:07.723 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 -- 172.21.15.67:0/4109573955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c102dc0 msgr2=0x7ff96c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 --2- 172.21.15.67:0/4109573955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c102dc0 0x7ff96c1031a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009900 tx=0x7ff95c02a410 comp rx=0 tx=0).stop 2024-09-10T20:51:08.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 -- 172.21.15.67:0/4109573955 shutdown_connections 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 --2- 172.21.15.67:0/4109573955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 0x7ff96c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 --2- 172.21.15.67:0/4109573955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c1087d0 0x7ff96c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 --2- 172.21.15.67:0/4109573955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c102dc0 0x7ff96c1031a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 -- 172.21.15.67:0/4109573955 >> 172.21.15.67:0/4109573955 conn(0x7ff96c0fe830 msgr2=0x7ff96c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 -- 172.21.15.67:0/4109573955 shutdown_connections 2024-09-10T20:51:08.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.210+0000 7ff970f9f640 1 -- 172.21.15.67:0/4109573955 wait complete. 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 Processor -- start 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 -- start start 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c102dc0 0x7ff96c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 0x7ff96c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c112e50 con 0x7ff96c1087d0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c112cd0 con 0x7ff96c109150 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff970f9f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c112fd0 con 0x7ff96c102dc0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff963fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff963fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43382/0 (socket says 172.21.15.67:43382) 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff963fff640 1 -- 172.21.15.67:0/747432803 learned_addr learned my addr 172.21.15.67:0/747432803 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff96a59c640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c102dc0 0x7ff96c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.211+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 0x7ff96c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 -- 172.21.15.67:0/747432803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c102dc0 msgr2=0x7ff96c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c102dc0 0x7ff96c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 -- 172.21.15.67:0/747432803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 msgr2=0x7ff96c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 0x7ff96c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 -- 172.21.15.67:0/747432803 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c19f4f0 con 0x7ff96c1087d0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff963fff640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b4a0 tx=0x7ff95400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff9637fe640 1 -- 172.21.15.67:0/747432803 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954014070 con 0x7ff96c1087d0 2024-09-10T20:51:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff9637fe640 1 -- 172.21.15.67:0/747432803 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff954010ac0 con 0x7ff96c1087d0 2024-09-10T20:51:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c19f7e0 con 0x7ff96c1087d0 2024-09-10T20:51:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff9637fe640 1 -- 172.21.15.67:0/747432803 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954017c30 con 0x7ff96c1087d0 2024-09-10T20:51:08.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.212+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c1a5ea0 con 0x7ff96c1087d0 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.215+0000 7ff973374740 1 Processor -- start 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.215+0000 7ff973374740 1 -- start start 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff9637fe640 1 -- 172.21.15.67:0/747432803 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff954010610 con 0x7ff96c1087d0 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b339f0 0x55c8c5b35de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5a9ac10 con 0x55c8c5b23650 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5a8a040 con 0x55c8c5b339f0 2024-09-10T20:51:08.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff973374740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5a8de50 con 0x55c8c5b22d30 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43392/0 (socket says 172.21.15.67:43392) 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 -- 172.21.15.67:0/3027479933 learned_addr learned my addr 172.21.15.67:0/3027479933 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff963fff640 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b339f0 0x55c8c5b35de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 -- 172.21.15.67:0/3027479933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 msgr2=0x55c8c5b23110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 -- 172.21.15.67:0/3027479933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b339f0 msgr2=0x55c8c5b35de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b339f0 0x55c8c5b35de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 -- 172.21.15.67:0/3027479933 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c57e8540 con 0x55c8c5b23650 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.216+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009900 tx=0x7ff95c031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d02ed3422626cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff960ff9640 1 -- 172.21.15.67:0/3027479933 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c040070 con 0x55c8c5b23650 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff960ff9640 1 -- 172.21.15.67:0/3027479933 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff95c0316a0 con 0x55c8c5b23650 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff960ff9640 1 -- 172.21.15.67:0/3027479933 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c035040 con 0x55c8c5b23650 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff9637fe640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 0x7ff9580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 0x7ff9580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff9637fe640 1 -- 172.21.15.67:0/747432803 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff9540e52d0 con 0x7ff96c1087d0 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 0x7ff9580b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fd0 tx=0x7ff96400e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 -- 172.21.15.67:0/3027479933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 msgr2=0x55c8c5b334b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009900 tx=0x7ff95c031de0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 -- 172.21.15.67:0/3027479933 shutdown_connections 2024-09-10T20:51:08.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b339f0 0x55c8c5b35de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b334b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 --2- 172.21.15.67:0/3027479933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.217+0000 7ff973374740 1 -- 172.21.15.67:0/3027479933 >> 172.21.15.67:0/3027479933 conn(0x55c8c5b20b60 msgr2=0x55c8c5b21d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- 172.21.15.67:0/3027479933 shutdown_connections 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- 172.21.15.67:0/3027479933 wait complete. 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- start start 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 Processor -- start 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b339f0 0x55c8c5b31400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c58eb5f0 con 0x55c8c5b23650 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5a25010 con 0x55c8c5b22d30 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b36640 con 0x55c8c5b339f0 2024-09-10T20:51:08.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff973374740 10 client.0 _ll_register_callbacks cb 0x55c8c5a84340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff963fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff963fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43396/0 (socket says 172.21.15.67:43396) 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.218+0000 7ff963fff640 1 -- 172.21.15.67:0/3607408918 learned_addr learned my addr 172.21.15.67:0/3607408918 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b339f0 0x55c8c5b31400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 -- 172.21.15.67:0/3607408918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b339f0 msgr2=0x55c8c5b31400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b339f0 0x55c8c5b31400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 -- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 msgr2=0x55c8c5b30980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b30980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 -- 172.21.15.67:0/3607408918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c5a52a00 con 0x55c8c5b23650 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff963fff640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b470 tx=0x7ff9540e3130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebd145ee415441d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95401e070 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff9540aabc0 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff95c0316a0 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9540ab730 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff973374740 10 client.15258 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c8c5b42210 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.219+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff95c0316a0 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff9540b00c0 con 0x55c8c5b23650 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 10 client.15258 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 10 client.15258 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 20 client.15258 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:08.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5b448b0 0x55c8c5b45d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 4 client.15258 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8c5a9cb60 con 0x55c8c5b448b0 2024-09-10T20:51:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5b448b0 0x55c8c5b45d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5b448b0 0x55c8c5b45d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=831a7ca873745295 server_cookie=73bc75d164c60205 in_seq=0 out_seq=0 2024-09-10T20:51:08.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.220+0000 7ff951ffb640 10 client.15258 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff951ffb640 1 -- 172.21.15.67:0/3607408918 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8c5a9cb60 con 0x55c8c5b448b0 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff951ffb640 10 client.15258 handle_command_reply: tid=0 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 client.15258 shutdown 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 msgr2=0x55c8c5b30ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b470 tx=0x7ff9540e3130 comp rx=0 tx=0).stop 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 shutdown_connections 2024-09-10T20:51:08.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5b448b0 0x55c8c5b45d20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b339f0 0x55c8c5b31400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b23650 0x55c8c5b30ec0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 --2- 172.21.15.67:0/3607408918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 >> 172.21.15.67:0/3607408918 conn(0x55c8c5b20b60 msgr2=0x55c8c5b1fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff951ffb640 0 client.15258 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.221+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 shutdown_connections 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.222+0000 7ff973374740 1 -- 172.21.15.67:0/3607408918 wait complete. 2024-09-10T20:51:08.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.222+0000 7ff973374740 20 client.15258 trim_cache size 0 max 16384 2024-09-10T20:51:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 Processor -- start 2024-09-10T20:51:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 -- start start 2024-09-10T20:51:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b23650 0x55c8c5b436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b44060 con 0x55c8c5b339f0 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b44730 con 0x55c8c5b22d30 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff973374740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b44e00 con 0x55c8c5b23650 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43408/0 (socket says 172.21.15.67:43408) 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 -- 172.21.15.67:0/3093549774 learned_addr learned my addr 172.21.15.67:0/3093549774 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff963fff640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b23650 0x55c8c5b436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 -- 172.21.15.67:0/3093549774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b23650 msgr2=0x55c8c5b436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b23650 0x55c8c5b436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 -- 172.21.15.67:0/3093549774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 msgr2=0x55c8c5b204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.240+0000 7ff96ad9d640 1 -- 172.21.15.67:0/3093549774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c5b2e8c0 con 0x55c8c5b339f0 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff96a59c640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff9640070b0 tx=0x7ff96400c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77748c9a2ba576f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff953fff640 1 -- 172.21.15.67:0/3093549774 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964027070 con 0x55c8c5b339f0 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff953fff640 1 -- 172.21.15.67:0/3093549774 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff964016ca0 con 0x55c8c5b339f0 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff953fff640 1 -- 172.21.15.67:0/3093549774 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640075d0 con 0x55c8c5b339f0 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 -- 172.21.15.67:0/3093549774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 msgr2=0x55c8c5b21c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff9640070b0 tx=0x7ff96400c050 comp rx=0 tx=0).stop 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 -- 172.21.15.67:0/3093549774 shutdown_connections 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b21c70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b23650 0x55c8c5b436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 --2- 172.21.15.67:0/3093549774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b22d30 0x55c8c5b204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.241+0000 7ff973374740 1 -- 172.21.15.67:0/3093549774 >> 172.21.15.67:0/3093549774 conn(0x55c8c5b20b60 msgr2=0x55c8c5b35a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- 172.21.15.67:0/3093549774 shutdown_connections 2024-09-10T20:51:08.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- 172.21.15.67:0/3093549774 wait complete. 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- start start 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 Processor -- start 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 0x55c8c5b24230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b45ba0 con 0x55c8c5b339f0 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b454d0 con 0x55c8c5b23650 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c5b46270 con 0x55c8c5b22d30 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff973374740 10 client.0 _ll_register_callbacks cb 0x7ff9540e8b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff96ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff96ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43412/0 (socket says 172.21.15.67:43412) 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.242+0000 7ff96ad9d640 1 -- 172.21.15.67:0/329829884 learned_addr learned my addr 172.21.15.67:0/329829884 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96a59c640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff963fff640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 0x55c8c5b24230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 -- 172.21.15.67:0/329829884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 msgr2=0x55c8c5b23cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 -- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 msgr2=0x55c8c5b24230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 0x55c8c5b24230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 -- 172.21.15.67:0/329829884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c5b250e0 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff963fff640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 0x55c8c5b24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff96ad9d640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff964004a80 tx=0x7ff964009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a1710b3384fda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964027070 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff964007580 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff964016ca0 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9640175b0 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff973374740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c8c5bb1980 con 0x55c8c5b339f0 2024-09-10T20:51:08.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.243+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff964016ca0 con 0x55c8c5b339f0 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff964033030 con 0x55c8c5b339f0 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 10 client.15264 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 20 client.15264 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5bb6430 0x55c8c5bb5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 4 client.15264 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "status"}) -- 0x55c8c5a98610 con 0x55c8c5bb6430 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff96a59c640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5bb6430 0x55c8c5bb5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff96a59c640 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5bb6430 0x55c8c5bb5140 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fedf65c17da94601 server_cookie=992b744e831632d9 in_seq=0 out_seq=0 2024-09-10T20:51:08.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.244+0000 7ff951ffb640 10 client.15264 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:08.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff951ffb640 1 -- 172.21.15.67:0/329829884 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c8c5a98610 con 0x55c8c5bb6430 2024-09-10T20:51:08.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff951ffb640 10 client.15264 handle_command_reply: tid=0 2024-09-10T20:51:08.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 client.15264 shutdown 2024-09-10T20:51:08.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 msgr2=0x55c8c5b248b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff964004a80 tx=0x7ff964009640 comp rx=0 tx=0).stop 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 shutdown_connections 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c8c5bb6430 0x55c8c5bb5140 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c8c5b339f0 0x55c8c5b248b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c8c5b23650 0x55c8c5b24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 --2- 172.21.15.67:0/329829884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c5b22d30 0x55c8c5b23cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 >> 172.21.15.67:0/329829884 conn(0x55c8c5b20b60 msgr2=0x55c8c5b436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff951ffb640 0 client.15264 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 shutdown_connections 2024-09-10T20:51:08.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 1 -- 172.21.15.67:0/329829884 wait complete. 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff973374740 20 client.15264 trim_cache size 0 max 16384 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "d92bf05e-6fb4-11ef-bcea-c7b262605968", 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 24608, 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 101.83246594800001, 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 24, 2024-09-10T20:51:08.256 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 75, 2024-09-10T20:51:08.257 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T20:51:08.257 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 112.70650649300001 2024-09-10T20:51:08.257 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 msgr2=0x7ff9580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.245+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 0x7ff9580b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff964009fd0 tx=0x7ff96400e040 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 msgr2=0x7ff96c199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b4a0 tx=0x7ff95400b960 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 shutdown_connections 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff96c109150 0x7ff96c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff96c1087d0 0x7ff96c199980 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff9580b5370 0x7ff9580b7830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 --2- 172.21.15.67:0/747432803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c102dc0 0x7ff96c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 >> 172.21.15.67:0/747432803 conn(0x7ff96c0fe830 msgr2=0x7ff96c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 shutdown_connections 2024-09-10T20:51:08.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:08.246+0000 7ff970f9f640 1 -- 172.21.15.67:0/747432803 wait complete. 2024-09-10T20:51:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:08 smithi067 ceph-mon[30891]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:08 smithi083 ceph-mon[35058]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:08 smithi172 ceph-mon[35265]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T20:51:08.973 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T20:51:09.068 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T20:51:09.068 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T20:51:09.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:09.069 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-10T20:51:09.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:09.086 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-09-10T20:51:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2024-09-10T20:51:09.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:51:09.157 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-10T20:51:09.157 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:51:09.157 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-10T20:51:09.157 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-10T20:51:09.157 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T20:51:09.459 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 -- 172.21.15.67:0/966164484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c1076e0 msgr2=0x7fc25c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 --2- 172.21.15.67:0/966164484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c1076e0 0x7fc25c107b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc250009900 tx=0x7fc25002a410 comp rx=0 tx=0).stop 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 -- 172.21.15.67:0/966164484 shutdown_connections 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 --2- 172.21.15.67:0/966164484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 --2- 172.21.15.67:0/966164484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c1076e0 0x7fc25c107b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 --2- 172.21.15.67:0/966164484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c101cd0 0x7fc25c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 -- 172.21.15.67:0/966164484 >> 172.21.15.67:0/966164484 conn(0x7fc25c0fd700 msgr2=0x7fc25c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 -- 172.21.15.67:0/966164484 shutdown_connections 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.933+0000 7fc263bd7640 1 -- 172.21.15.67:0/966164484 wait complete. 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 Processor -- start 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 -- start start 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 0x7fc25c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111d20 con 0x7fc25c101cd0 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111ba0 con 0x7fc25c1076e0 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc263bd7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c111ea0 con 0x7fc25c108060 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc261973640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc261973640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43434/0 (socket says 172.21.15.67:43434) 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc261973640 1 -- 172.21.15.67:0/1484388790 learned_addr learned my addr 172.21.15.67:0/1484388790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.934+0000 7fc261172640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 0x7fc25c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc262174640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 -- 172.21.15.67:0/1484388790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 msgr2=0x7fc25c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 -- 172.21.15.67:0/1484388790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 msgr2=0x7fc25c0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 0x7fc25c0fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 -- 172.21.15.67:0/1484388790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c1a76a0 con 0x7fc25c101cd0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc262174640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261172640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 0x7fc25c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc261973640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc25800d950 tx=0x7fc25800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258017070 con 0x7fc25c101cd0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc258009c30 con 0x7fc25c101cd0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c1a7990 con 0x7fc25c101cd0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25800f620 con 0x7fc25c101cd0 2024-09-10T20:51:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.935+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1a7ef0 con 0x7fc25c101cd0 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.936+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c1020b0 con 0x7fc25c101cd0 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.937+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc258010460 con 0x7fc25c101cd0 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.938+0000 7fc24effd640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 0x7fc2480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.938+0000 7fc261172640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 0x7fc2480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.938+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc2580e5810 con 0x7fc25c101cd0 2024-09-10T20:51:09.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.939+0000 7fc261172640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 0x7fc2480b7820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc250031440 tx=0x7fc250005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:09.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:09.941+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc2580ac780 con 0x7fc25c101cd0 2024-09-10T20:51:10.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.169+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc25c0fef00 con 0x7fc25c101cd0 2024-09-10T20:51:10.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.170+0000 7fc24effd640 1 -- 172.21.15.67:0/1484388790 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fc25c0fef00 con 0x7fc25c101cd0 2024-09-10T20:51:10.174 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:51:10.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 msgr2=0x7fc2480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:10.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 0x7fc2480b7820 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc250031440 tx=0x7fc250005a20 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 msgr2=0x7fc25c0fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc25800d950 tx=0x7fc25800de10 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 shutdown_connections 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc2480b5360 0x7fc2480b7820 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25c108060 0x7fc25c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc25c1076e0 0x7fc25c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 --2- 172.21.15.67:0/1484388790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc25c101cd0 0x7fc25c0fdc00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 >> 172.21.15.67:0/1484388790 conn(0x7fc25c0fd700 msgr2=0x7fc25c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 shutdown_connections 2024-09-10T20:51:10.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10.172+0000 7fc263bd7640 1 -- 172.21.15.67:0/1484388790 wait complete. 2024-09-10T20:51:10.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:10 smithi067 ceph-mon[30891]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:10.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:10 smithi067 ceph-mon[30891]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T20:51:10.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:10 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1484388790' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T20:51:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:10 smithi083 ceph-mon[35058]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:10 smithi083 ceph-mon[35058]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T20:51:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:10 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1484388790' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T20:51:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:10 smithi172 ceph-mon[35265]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:10 smithi172 ceph-mon[35265]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T20:51:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:10 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1484388790' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T20:51:10.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:51:10.870 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:51:10.870 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:51:10.871 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-10T20:51:10.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:10.871 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:51:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42155sec preferred_lft 42155sec 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link noprefixroute 2024-09-10T20:51:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:51:10.892 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:51:10.892 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-10T20:51:10.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:11.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:11.115 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:51:11.140 INFO:teuthology.orchestra.run.smithi067.stdout:1 2024-09-10T20:51:11.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:11.141 DEBUG:teuthology.orchestra.run.smithi067:> route 2024-09-10T20:51:11.211 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2024-09-10T20:51:11.211 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:51:11.211 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:51:11.212 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:51:11.212 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:51:11.212 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:51:11.212 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-10T20:51:11.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:51:11.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:51:11.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:51:11.213 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-10T20:51:11.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:11.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:11.513 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-10T20:51:11.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:11.530 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2024-09-10T20:51:11.586 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:51:11.586 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-10T20:51:11.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-10T20:51:11.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-10T20:51:11.586 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-10T20:51:11.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:11.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:11.706 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-10T20:51:11.706 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-10T20:51:11.707 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-10T20:51:11.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:11.841 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:51:11.842 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2024-09-10T20:51:11.842 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2024-09-10T20:51:11.842 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:51:11.842 DEBUG:teuthology.orchestra.run.smithi067:> ') 2024-09-10T20:51:11.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:11.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:11.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:51:11.926 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /tmp/cephfs 2024-09-10T20:51:11.945 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-10T20:51:11.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:51:11.946 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /tmp/cephfs 2024-09-10T20:51:12.001 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T20:51:12.002 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T20:51:12.002 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/a9073dc0-5834-4153-871f-d46f72a504b3 2024-09-10T20:51:12.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:12.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/a9073dc0-5834-4153-871f-d46f72a504b3 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-09-10T20:51:12.101 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-10T20:51:12.101 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-10T20:51:12.232 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-09-10T20:51:12.233 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-10T20:51:12.233 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.83:3300,172.21.15.172:3300" 2024-09-10T20:51:12.233 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@d92bf05e-6fb4-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/a9073dc0-5834-4153-871f-d46f72a504b3 2024-09-10T20:51:12.233 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.67:3300/172.21.15.83:3300/172.21.15.172:3300" will pass to kernel 2024-09-10T20:51:12.235 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T20:51:12.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:51:12.236 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /tmp/cephfs 2024-09-10T20:51:12.269 DEBUG:teuthology.orchestra.run.smithi067:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T20:51:12.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T20:51:12.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:12.368 INFO:teuthology.orchestra.run.smithi067.stdout:client15273 2024-09-10T20:51:12.368 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T20:51:12.368 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:51:12.385 DEBUG:teuthology.orchestra.run.smithi067:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T20:51:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T20:51:12.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:12.484 INFO:teuthology.orchestra.run.smithi067.stdout:client15273 2024-09-10T20:51:12.485 DEBUG:teuthology.orchestra.run.smithi067:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T20:51:12.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T20:51:12.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:12.542 INFO:teuthology.orchestra.run.smithi067.stdout:client15273 2024-09-10T20:51:12.543 DEBUG:teuthology.orchestra.run.smithi067:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968.client15273/status') 2024-09-10T20:51:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:12 smithi067 ceph-mon[30891]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:12.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:51:12.604 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.15273 (3)192.168.0.1:0/1379373926 2024-09-10T20:51:12.604 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2024-09-10T20:51:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2024-09-10T20:51:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2024-09-10T20:51:12.604 INFO:teuthology.orchestra.run.smithi067.stderr:70 bytes copied, 2.4283e-05 s, 2.9 MB/s 2024-09-10T20:51:12.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:51:12.611 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T20:51:12.625 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T20:51:12.625 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T20:51:12.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-10T20:51:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:12 smithi083 ceph-mon[35058]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:12 smithi172 ceph-mon[35265]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 -- 172.21.15.67:0/510851080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 msgr2=0x7ffbbc101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 --2- 172.21.15.67:0/510851080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc101c60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009930 tx=0x7ffbb402a420 comp rx=0 tx=0).stop 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 -- 172.21.15.67:0/510851080 shutdown_connections 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 --2- 172.21.15.67:0/510851080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc103370 0x7ffbbc109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 --2- 172.21.15.67:0/510851080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:12.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 --2- 172.21.15.67:0/510851080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc101c60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 -- 172.21.15.67:0/510851080 >> 172.21.15.67:0/510851080 conn(0x7ffbbc0fd140 msgr2=0x7ffbbc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 -- 172.21.15.67:0/510851080 shutdown_connections 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.726+0000 7ffbc311f640 1 -- 172.21.15.67:0/510851080 wait complete. 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 Processor -- start 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 -- start start 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 0x7ffbbc1043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc10d4b0 con 0x7ffbbc101860 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc10d330 con 0x7ffbbc103370 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc311f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc10d630 con 0x7ffbbc1029b0 2024-09-10T20:51:12.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36210/0 (socket says 172.21.15.67:36210) 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 -- 172.21.15.67:0/3639230956 learned_addr learned my addr 172.21.15.67:0/3639230956 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc16bc640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 0x7ffbbc1043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbbbfff640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 -- 172.21.15.67:0/3639230956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 msgr2=0x7ffbbc103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 -- 172.21.15.67:0/3639230956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 msgr2=0x7ffbbc1043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 0x7ffbbc1043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc0ebb640 1 -- 172.21.15.67:0/3639230956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc104c30 con 0x7ffbbc101860 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbc16bc640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 0x7ffbbc1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.727+0000 7ffbbbfff640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbc0ebb640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009a50 tx=0x7ffbb4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:12.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb403f030 con 0x7ffbbc101860 2024-09-10T20:51:12.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbbc1a2e30 con 0x7ffbbc101860 2024-09-10T20:51:12.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb40044b0 con 0x7ffbbc101860 2024-09-10T20:51:12.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4035070 con 0x7ffbbc101860 2024-09-10T20:51:12.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.728+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbbc1a3230 con 0x7ffbbc101860 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.729+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbbc1a3460 con 0x7ffbbc101860 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.731+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ffbb403bb90 con 0x7ffbbc101860 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.731+0000 7ffbb9ffb640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 0x7ffba80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.731+0000 7ffbbbfff640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 0x7ffba80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.731+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffbb4106a40 con 0x7ffbbc101860 2024-09-10T20:51:12.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.732+0000 7ffbbbfff640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 0x7ffba80b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbac005c40 tx=0x7ffbac0082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:12.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.734+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffbb40cd930 con 0x7ffbbc101860 2024-09-10T20:51:12.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:12.958+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7ffbbc1a3630 con 0x7ffbbc101860 2024-09-10T20:51:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.289+0000 7ffbb9ffb640 1 -- 172.21.15.67:0/3639230956 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7ffbb40cd230 con 0x7ffbbc101860 2024-09-10T20:51:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 msgr2=0x7ffba80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 0x7ffba80b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbac005c40 tx=0x7ffbac0082f0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 msgr2=0x7ffbbc105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009a50 tx=0x7ffbb4031a50 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 shutdown_connections 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbbc103370 0x7ffbbc1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba80b52e0 0x7ffba80b77a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbbc1029b0 0x7ffbbc103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 --2- 172.21.15.67:0/3639230956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbbc101860 0x7ffbbc105620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 >> 172.21.15.67:0/3639230956 conn(0x7ffbbc0fd140 msgr2=0x7ffbbc0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 shutdown_connections 2024-09-10T20:51:13.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.293+0000 7ffbc311f640 1 -- 172.21.15.67:0/3639230956 wait complete. 2024-09-10T20:51:13.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-10T20:51:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 -- 172.21.15.67:0/550498357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 msgr2=0x7f3834101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 --2- 172.21.15.67:0/550498357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834101cb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3830009930 tx=0x7f383002a420 comp rx=0 tx=0).stop 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 -- 172.21.15.67:0/550498357 shutdown_connections 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 --2- 172.21.15.67:0/550498357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38341033c0 0x7f3834109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 --2- 172.21.15.67:0/550498357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3834102a00 0x7f3834102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 --2- 172.21.15.67:0/550498357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834101cb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 -- 172.21.15.67:0/550498357 >> 172.21.15.67:0/550498357 conn(0x7f38340fd150 msgr2=0x7f38340ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 -- 172.21.15.67:0/550498357 shutdown_connections 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.411+0000 7f383b47f640 1 -- 172.21.15.67:0/550498357 wait complete. 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 Processor -- start 2024-09-10T20:51:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 -- start start 2024-09-10T20:51:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3834102a00 0x7f3834199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38341033c0 0x7f383419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f383410d520 con 0x7f38341018b0 2024-09-10T20:51:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f383410d3a0 con 0x7f38341033c0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383b47f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f383410d6a0 con 0x7f3834102a00 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36226/0 (socket says 172.21.15.67:36226) 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 -- 172.21.15.67:0/2706959789 learned_addr learned my addr 172.21.15.67:0/2706959789 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 -- 172.21.15.67:0/2706959789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3834102a00 msgr2=0x7f3834199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3834102a00 0x7f3834199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 -- 172.21.15.67:0/2706959789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38341033c0 msgr2=0x7f383419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38341033c0 0x7f383419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 -- 172.21.15.67:0/2706959789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383419a980 con 0x7f38341018b0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.412+0000 7f383921b640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3830009a50 tx=0x7f3830031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.413+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383003f030 con 0x7f38341018b0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.413+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38300044b0 con 0x7f38341018b0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.413+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830035070 con 0x7f38341018b0 2024-09-10T20:51:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.413+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383419ac10 con 0x7f38341018b0 2024-09-10T20:51:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.413+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38341a1340 con 0x7f38341018b0 2024-09-10T20:51:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.414+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38341a1510 con 0x7f38341018b0 2024-09-10T20:51:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.415+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f383003bbc0 con 0x7f38341018b0 2024-09-10T20:51:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.416+0000 7f382a7fc640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 0x7f38200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.416+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3830106900 con 0x7f38341018b0 2024-09-10T20:51:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.416+0000 7f3838a1a640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 0x7f38200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.416+0000 7f3838a1a640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 0x7f38200b7820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3824005fd0 tx=0x7f3824005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.419+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f38300cd7f0 con 0x7f38341018b0 2024-09-10T20:51:13.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T20:51:13.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.635+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f38340ff350 con 0x7f38200b5360 2024-09-10T20:51:13.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:13 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T20:51:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.657+0000 7f382a7fc640 1 -- 172.21.15.67:0/2706959789 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f38340ff350 con 0x7f38200b5360 2024-09-10T20:51:13.661 INFO:teuthology.orchestra.run.smithi067.stdout:{} 2024-09-10T20:51:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 msgr2=0x7f38200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 0x7f38200b7820 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3824005fd0 tx=0x7f3824005850 comp rx=0 tx=0).stop 2024-09-10T20:51:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 msgr2=0x7f3834198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3830009a50 tx=0x7f3830031a50 comp rx=0 tx=0).stop 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 shutdown_connections 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38341033c0 0x7f383419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38200b5360 0x7f38200b7820 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3834102a00 0x7f3834199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 --2- 172.21.15.67:0/2706959789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38341018b0 0x7f3834198e40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 >> 172.21.15.67:0/2706959789 conn(0x7f38340fd150 msgr2=0x7f38340fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 shutdown_connections 2024-09-10T20:51:13.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.659+0000 7f383b47f640 1 -- 172.21.15.67:0/2706959789 wait complete. 2024-09-10T20:51:13.674 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T20:51:13.685 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T20:51:13.694 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:51:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:13 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-10T20:51:13.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 -- 172.21.15.67:0/2114591061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf48105b20 msgr2=0x7fdf48107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 --2- 172.21.15.67:0/2114591061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf48105b20 0x7fdf48107f90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009900 tx=0x7fdf3802a410 comp rx=0 tx=0).stop 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 -- 172.21.15.67:0/2114591061 shutdown_connections 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 --2- 172.21.15.67:0/2114591061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf4810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 --2- 172.21.15.67:0/2114591061 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf48105b20 0x7fdf48107f90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 --2- 172.21.15.67:0/2114591061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf4806bea0 0x7fdf48105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 -- 172.21.15.67:0/2114591061 >> 172.21.15.67:0/2114591061 conn(0x7fdf480fd160 msgr2=0x7fdf480ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 -- 172.21.15.67:0/2114591061 shutdown_connections 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.793+0000 7fdf504ef640 1 -- 172.21.15.67:0/2114591061 wait complete. 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 Processor -- start 2024-09-10T20:51:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 -- start start 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 0x7fdf48101530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf48101a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810e600 con 0x7fdf4806bea0 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810e480 con 0x7fdf48105b20 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf504ef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810e780 con 0x7fdf481086d0 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36260/0 (socket says 172.21.15.67:36260) 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 -- 172.21.15.67:0/910555044 learned_addr learned my addr 172.21.15.67:0/910555044 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4ea8c640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf48101a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4da8a640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 0x7fdf48101530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 -- 172.21.15.67:0/910555044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 msgr2=0x7fdf48101a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf48101a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 -- 172.21.15.67:0/910555044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 msgr2=0x7fdf48101530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 0x7fdf48101530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 -- 172.21.15.67:0/910555044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf481022e0 con 0x7fdf4806bea0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4da8a640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 0x7fdf48101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4ea8c640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf48101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.794+0000 7fdf4e28b640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c890 tx=0x7fdf4400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.795+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44004220 con 0x7fdf4806bea0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.795+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf440043c0 con 0x7fdf4806bea0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.795+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf481a2ec0 con 0x7fdf4806bea0 2024-09-10T20:51:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.795+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44004a00 con 0x7fdf4806bea0 2024-09-10T20:51:13.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.795+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481a3320 con 0x7fdf4806bea0 2024-09-10T20:51:13.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.796+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf480fec50 con 0x7fdf4806bea0 2024-09-10T20:51:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.797+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdf440079b0 con 0x7fdf4806bea0 2024-09-10T20:51:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.798+0000 7fdf3f7fe640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 0x7fdf340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.798+0000 7fdf4da8a640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 0x7fdf340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.798+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdf440e59d0 con 0x7fdf4806bea0 2024-09-10T20:51:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.798+0000 7fdf4da8a640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 0x7fdf340b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf38000c00 tx=0x7fdf380314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:13.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.802+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf44014030 con 0x7fdf4806bea0 2024-09-10T20:51:13.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.989+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf48063e20 con 0x7fdf4806bea0 2024-09-10T20:51:13.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.990+0000 7fdf3f7fe640 1 -- 172.21.15.67:0/910555044 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7fdf440ac8c0 con 0x7fdf4806bea0 2024-09-10T20:51:13.995 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:13.995 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:51:13.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 msgr2=0x7fdf340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 0x7fdf340b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf38000c00 tx=0x7fdf380314a0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 msgr2=0x7fdf48102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:13.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400c890 tx=0x7fdf4400cd50 comp rx=0 tx=0).stop 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 shutdown_connections 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdf340b52e0 0x7fdf340b77a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf481086d0 0x7fdf48101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf48105b20 0x7fdf48101530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 --2- 172.21.15.67:0/910555044 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf4806bea0 0x7fdf48102cd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 >> 172.21.15.67:0/910555044 conn(0x7fdf480fd160 msgr2=0x7fdf48103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 shutdown_connections 2024-09-10T20:51:13.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:13.993+0000 7fdf504ef640 1 -- 172.21.15.67:0/910555044 wait complete. 2024-09-10T20:51:14.006 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:51:13.640+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:51:14.007 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:51:13.640+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:51:14.007 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:51:13.640+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:51:14.007 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:51:13.640+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:51:14.007 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 20:51:13 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x[31118]: 2024-09-10T20:51:13.640+0000 7fb670c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T20:51:14.008 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T20:44:51.135967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T20:49:21.721858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T20:49:23.984209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T20:51:14.009 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T20:51:14.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 -- 172.21.15.67:0/2583574398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 msgr2=0x7fd37c10ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2583574398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c10ab60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd37402a410 comp rx=0 tx=0).stop 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 -- 172.21.15.67:0/2583574398 shutdown_connections 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2583574398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c10ab60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2583574398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2583574398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.110+0000 7fd3833a3640 1 -- 172.21.15.67:0/2583574398 >> 172.21.15.67:0/2583574398 conn(0x7fd37c0fd150 msgr2=0x7fd37c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- 172.21.15.67:0/2583574398 shutdown_connections 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- 172.21.15.67:0/2583574398 wait complete. 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 Processor -- start 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- start start 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c10e5d0 con 0x7fd37c1086a0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c10e450 con 0x7fd37c105af0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd3833a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd37c10e750 con 0x7fd37c06bea0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd381940640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd381940640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36280/0 (socket says 172.21.15.67:36280) 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.111+0000 7fd381940640 1 -- 172.21.15.67:0/2022709503 learned_addr learned my addr 172.21.15.67:0/2022709503 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd38113f640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd38093e640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 -- 172.21.15.67:0/2022709503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 msgr2=0x7fd37c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 -- 172.21.15.67:0/2022709503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 msgr2=0x7fd37c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 -- 172.21.15.67:0/2022709503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37c19a7a0 con 0x7fd37c1086a0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd38093e640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd38113f640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd381940640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd374005940 tx=0x7fd374004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37403f030 con 0x7fd37c1086a0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd374003cb0 con 0x7fd37c1086a0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37c19aa30 con 0x7fd37c1086a0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374035070 con 0x7fd37c1086a0 2024-09-10T20:51:14.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.112+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37c19ad40 con 0x7fd37c1086a0 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.113+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37c0fec40 con 0x7fd37c1086a0 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.115+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd37403b4f0 con 0x7fd37c1086a0 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.115+0000 7fd3727fc640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 0x7fd3680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.115+0000 7fd38113f640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 0x7fd3680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.115+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd374106b60 con 0x7fd37c1086a0 2024-09-10T20:51:14.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.116+0000 7fd38113f640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 0x7fd3680b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd378007e70 tx=0x7fd378007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.118+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3740cda50 con 0x7fd37c1086a0 2024-09-10T20:51:14.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:14 smithi067 ceph-mon[30891]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T20:51:14.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:14 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T20:51:14.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:14 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:14.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.305+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd37c02e5c0 con 0x7fd37c1086a0 2024-09-10T20:51:14.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.305+0000 7fd3727fc640 1 -- 172.21.15.67:0/2022709503 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fd3740d6070 con 0x7fd37c1086a0 2024-09-10T20:51:14.309 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 msgr2=0x7fd3680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 0x7fd3680b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd378007e70 tx=0x7fd378007850 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 msgr2=0x7fd37c199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd374005940 tx=0x7fd374004430 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 shutdown_connections 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd37c1086a0 0x7fd37c199ee0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd37c105af0 0x7fd37c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3680b52e0 0x7fd3680b77a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 --2- 172.21.15.67:0/2022709503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd37c06bea0 0x7fd37c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.307+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 >> 172.21.15.67:0/2022709503 conn(0x7fd37c0fd150 msgr2=0x7fd37c103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.308+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 shutdown_connections 2024-09-10T20:51:14.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.308+0000 7fd3833a3640 1 -- 172.21.15.67:0/2022709503 wait complete. 2024-09-10T20:51:14.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.424+0000 7fa466591640 1 -- 172.21.15.67:0/560425062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4601086a0 msgr2=0x7fa46010ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.424+0000 7fa466591640 1 --2- 172.21.15.67:0/560425062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4601086a0 0x7fa46010ab60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa458009ca0 tx=0x7fa45802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- 172.21.15.67:0/560425062 shutdown_connections 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- 172.21.15.67:0/560425062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa4601086a0 0x7fa46010ab60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- 172.21.15.67:0/560425062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460105af0 0x7fa460107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- 172.21.15.67:0/560425062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 0x7fa460105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- 172.21.15.67:0/560425062 >> 172.21.15.67:0/560425062 conn(0x7fa4600fd150 msgr2=0x7fa4600ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- 172.21.15.67:0/560425062 shutdown_connections 2024-09-10T20:51:14.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- 172.21.15.67:0/560425062 wait complete. 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 Processor -- start 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- start start 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 0x7fa460198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086a0 0x7fa460199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010e5f0 con 0x7fa460105af0 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010e470 con 0x7fa46006bea0 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.425+0000 7fa466591640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010e770 con 0x7fa4601086a0 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36304/0 (socket says 172.21.15.67:36304) 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 -- 172.21.15.67:0/3780977539 learned_addr learned my addr 172.21.15.67:0/3780977539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa45ffff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 0x7fa460198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa464b2e640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086a0 0x7fa460199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 -- 172.21.15.67:0/3780977539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086a0 msgr2=0x7fa460199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086a0 0x7fa460199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 -- 172.21.15.67:0/3780977539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 msgr2=0x7fa460198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 0x7fa460198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 -- 172.21.15.67:0/3780977539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019a890 con 0x7fa460105af0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa457fff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa44800d770 tx=0x7fa44800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448017070 con 0x7fa460105af0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4480054d0 con 0x7fa460105af0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448004c30 con 0x7fa460105af0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46019ab80 con 0x7fa460105af0 2024-09-10T20:51:14.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.426+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a1250 con 0x7fa460105af0 2024-09-10T20:51:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.427+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4600fec40 con 0x7fa460105af0 2024-09-10T20:51:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.429+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa448004dd0 con 0x7fa460105af0 2024-09-10T20:51:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.430+0000 7fa45dffb640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 0x7fa44c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.430+0000 7fa45ffff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 0x7fa44c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.430+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa4480e5a00 con 0x7fa460105af0 2024-09-10T20:51:14.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.430+0000 7fa45ffff640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 0x7fa44c0b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa45000bbe0 tx=0x7fa45000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.433+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa4480ac970 con 0x7fa460105af0 2024-09-10T20:51:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:14 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/910555044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.618+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa46002e5c0 con 0x7fa460105af0 2024-09-10T20:51:14.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.618+0000 7fa45dffb640 1 -- 172.21.15.67:0/3780977539 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fa4480ac270 con 0x7fa460105af0 2024-09-10T20:51:14.622 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-09-10T20:51:14.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 msgr2=0x7fa44c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 0x7fa44c0b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa45000bbe0 tx=0x7fa45000b390 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 msgr2=0x7fa4601993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa44800d770 tx=0x7fa44800dc30 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 shutdown_connections 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa44c0b5360 0x7fa44c0b7820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086a0 0x7fa460199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa460105af0 0x7fa4601993a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 --2- 172.21.15.67:0/3780977539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa46006bea0 0x7fa460198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 >> 172.21.15.67:0/3780977539 conn(0x7fa4600fd150 msgr2=0x7fa460103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.620+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 shutdown_connections 2024-09-10T20:51:14.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.621+0000 7fa466591640 1 -- 172.21.15.67:0/3780977539 wait complete. 2024-09-10T20:51:14.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T20:51:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:14 smithi083 ceph-mon[35058]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T20:51:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:14 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T20:51:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:14 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:14 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/910555044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:14 smithi172 ceph-mon[35265]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T20:51:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:14 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3639230956' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-10T20:51:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:14 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:14 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/910555044' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:14.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 -- 172.21.15.67:0/2717919451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc105af0 msgr2=0x7f1cfc107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 --2- 172.21.15.67:0/2717919451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc105af0 0x7f1cfc107f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009900 tx=0x7f1ce802a410 comp rx=0 tx=0).stop 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 -- 172.21.15.67:0/2717919451 shutdown_connections 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 --2- 172.21.15.67:0/2717919451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc10ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 --2- 172.21.15.67:0/2717919451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc105af0 0x7f1cfc107f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 --2- 172.21.15.67:0/2717919451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 -- 172.21.15.67:0/2717919451 >> 172.21.15.67:0/2717919451 conn(0x7f1cfc0fd150 msgr2=0x7f1cfc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 -- 172.21.15.67:0/2717919451 shutdown_connections 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.738+0000 7f1d02add640 1 -- 172.21.15.67:0/2717919451 wait complete. 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 Processor -- start 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 -- start start 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc105af0 0x7f1cfc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc10e5f0 con 0x7f1cfc1086a0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc10e470 con 0x7f1cfc105af0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d02add640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc10e770 con 0x7f1cfc06bea0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36328/0 (socket says 172.21.15.67:36328) 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 -- 172.21.15.67:0/871317791 learned_addr learned my addr 172.21.15.67:0/871317791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1cfbfff640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc105af0 0x7f1cfc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d00879640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 -- 172.21.15.67:0/871317791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 msgr2=0x7f1cfc198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 -- 172.21.15.67:0/871317791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc105af0 msgr2=0x7f1cfc199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc105af0 0x7f1cfc199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d0107a640 1 -- 172.21.15.67:0/871317791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc19a880 con 0x7f1cfc1086a0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.739+0000 7f1d00879640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1d0107a640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400cad0 tx=0x7f1cf400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400ae20 con 0x7f1cfc1086a0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf4005020 con 0x7f1cfc1086a0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc19ab70 con 0x7f1cfc1086a0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400f6b0 con 0x7f1cfc1086a0 2024-09-10T20:51:14.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.740+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1a1240 con 0x7f1cfc1086a0 2024-09-10T20:51:14.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.741+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc0fec40 con 0x7f1cfc1086a0 2024-09-10T20:51:14.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.742+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1cf40054f0 con 0x7f1cfc1086a0 2024-09-10T20:51:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.743+0000 7f1cf9ffb640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 0x7f1cec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.743+0000 7f1d00879640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 0x7f1cec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.743+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1cf40e5c50 con 0x7f1cfc1086a0 2024-09-10T20:51:14.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.743+0000 7f1d00879640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 0x7f1cec0b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000baa0 tx=0x7f1cf0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:14.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.747+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1cf40eb020 con 0x7f1cfc1086a0 2024-09-10T20:51:14.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.932+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1cfc063d50 con 0x7f1cfc1086a0 2024-09-10T20:51:14.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.932+0000 7f1cf9ffb640 1 -- 172.21.15.67:0/871317791 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f1cf40cde20 con 0x7f1cfc1086a0 2024-09-10T20:51:14.937 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 msgr2=0x7f1cec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 0x7f1cec0b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000baa0 tx=0x7f1cf0005d90 comp rx=0 tx=0).stop 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 msgr2=0x7f1cfc199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400cad0 tx=0x7f1cf400cf90 comp rx=0 tx=0).stop 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 shutdown_connections 2024-09-10T20:51:14.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1cfc1086a0 0x7f1cfc199fc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.934+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1cfc105af0 0x7f1cfc199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.935+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1cec0b52e0 0x7f1cec0b77a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.935+0000 7f1d02add640 1 --2- 172.21.15.67:0/871317791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1cfc06bea0 0x7f1cfc198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.935+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 >> 172.21.15.67:0/871317791 conn(0x7f1cfc0fd150 msgr2=0x7f1cfc103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.935+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 shutdown_connections 2024-09-10T20:51:14.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:14.935+0000 7f1d02add640 1 -- 172.21.15.67:0/871317791 wait complete. 2024-09-10T20:51:14.949 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T20:51:14.950 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:51:15.207 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:15.616 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:15 smithi067 ceph-mon[30891]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:51:15.616 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2022709503' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.616 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3780977539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.617 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:15 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/871317791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:15 smithi083 ceph-mon[35058]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:51:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2022709503' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3780977539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:15 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/871317791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:15 smithi172 ceph-mon[35265]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T20:51:15.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2022709503' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3780977539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:15 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/871317791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T20:51:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 -- 172.21.15.67:0/2777720234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa040104600 msgr2=0x7fa04010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2777720234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa040104600 0x7fa04010caf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009900 tx=0x7fa03c02a410 comp rx=0 tx=0).stop 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 -- 172.21.15.67:0/2777720234 shutdown_connections 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2777720234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04010d140 0x7fa04010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2777720234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa040104600 0x7fa04010caf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2777720234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040103ce0 0x7fa0401040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 -- 172.21.15.67:0/2777720234 >> 172.21.15.67:0/2777720234 conn(0x7fa0400fd700 msgr2=0x7fa0400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 -- 172.21.15.67:0/2777720234 shutdown_connections 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.696+0000 7fa047a2d640 1 -- 172.21.15.67:0/2777720234 wait complete. 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 Processor -- start 2024-09-10T20:51:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 -- start start 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa040103ce0 0x7fa040199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104600 0x7fa040199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa040112db0 con 0x7fa04010d140 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa040112c30 con 0x7fa040103ce0 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa047a2d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa040112f30 con 0x7fa040104600 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa045fca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa045fca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36340/0 (socket says 172.21.15.67:36340) 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa045fca640 1 -- 172.21.15.67:0/2244449538 learned_addr learned my addr 172.21.15.67:0/2244449538 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa0457c9640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa040103ce0 0x7fa040199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.697+0000 7fa044fc8640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104600 0x7fa040199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:15.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 -- 172.21.15.67:0/2244449538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104600 msgr2=0x7fa040199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104600 0x7fa040199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 -- 172.21.15.67:0/2244449538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa040103ce0 msgr2=0x7fa040199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa040103ce0 0x7fa040199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 -- 172.21.15.67:0/2244449538 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04019f3d0 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa045fca640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa03800cad0 tx=0x7fa03800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03800ae20 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa038005020 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04019f6c0 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03800f6b0 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.698+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0401a5d80 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.699+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0401040c0 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.700+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fa0380054f0 con 0x7fa04010d140 2024-09-10T20:51:15.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.701+0000 7fa0327fc640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 0x7fa02c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.701+0000 7fa0457c9640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 0x7fa02c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.701+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa0380e6160 con 0x7fa04010d140 2024-09-10T20:51:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.702+0000 7fa0457c9640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 0x7fa02c0b7830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa034005fd0 tx=0x7fa03400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:15.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.704+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa038014030 con 0x7fa04010d140 2024-09-10T20:51:15.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.928+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa04019a450 con 0x7fa04010d140 2024-09-10T20:51:15.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.929+0000 7fa0327fc640 1 -- 172.21.15.67:0/2244449538 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7fa0380acef0 con 0x7fa04010d140 2024-09-10T20:51:15.933 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:15.933 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"btime":"2024-09-10T20:51:13:282702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:51:12.959331+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:51:15.934 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 25 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 msgr2=0x7fa02c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 0x7fa02c0b7830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa034005fd0 tx=0x7fa03400b390 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 msgr2=0x7fa04019ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa03800cad0 tx=0x7fa03800cf90 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 shutdown_connections 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04010d140 0x7fa04019ec00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa02c0b5370 0x7fa02c0b7830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa040104600 0x7fa040199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 --2- 172.21.15.67:0/2244449538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa040103ce0 0x7fa040199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:15.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.932+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 >> 172.21.15.67:0/2244449538 conn(0x7fa0400fd700 msgr2=0x7fa0400fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:15.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.933+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 shutdown_connections 2024-09-10T20:51:15.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:15.933+0000 7fa047a2d640 1 -- 172.21.15.67:0/2244449538 wait complete. 2024-09-10T20:51:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:16 smithi083 ceph-mon[35058]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T20:51:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:16 smithi083 ceph-mon[35058]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T20:51:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:16 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2244449538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:16.670 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:16 smithi067 ceph-mon[30891]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T20:51:16.671 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:16 smithi067 ceph-mon[30891]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T20:51:16.671 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:16 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2244449538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:16.699 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T20:51:16.699 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T20:51:16.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:51:16.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:16 smithi172 ceph-mon[35265]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-10T20:51:16.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:16 smithi172 ceph-mon[35265]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-10T20:51:16.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:16 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2244449538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 -- 172.21.15.67:0/1801119419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1033b0 msgr2=0x7fd3cc109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 --2- 172.21.15.67:0/1801119419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc109d30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009cd0 tx=0x7fd3c402a8e0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 -- 172.21.15.67:0/1801119419 shutdown_connections 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 --2- 172.21.15.67:0/1801119419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc109d30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 --2- 172.21.15.67:0/1801119419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 --2- 172.21.15.67:0/1801119419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 -- 172.21.15.67:0/1801119419 >> 172.21.15.67:0/1801119419 conn(0x7fd3cc0fd180 msgr2=0x7fd3cc0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:16.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 -- 172.21.15.67:0/1801119419 shutdown_connections 2024-09-10T20:51:16.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 -- 172.21.15.67:0/1801119419 wait complete. 2024-09-10T20:51:16.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.801+0000 7fd3d113d640 1 Processor -- start 2024-09-10T20:51:16.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 -- start start 2024-09-10T20:51:16.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc06acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:16.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:16.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:16.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc10d4f0 con 0x7fd3cc1029f0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc10d370 con 0x7fd3cc1018a0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3d113d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc10d670 con 0x7fd3cc1033b0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36354/0 (socket says 172.21.15.67:36354) 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 -- 172.21.15.67:0/3470309528 learned_addr learned my addr 172.21.15.67:0/3470309528 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3cad9d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc06acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3cb59e640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 -- 172.21.15.67:0/3470309528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1033b0 msgr2=0x7fd3cc19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc19ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 -- 172.21.15.67:0/3470309528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 msgr2=0x7fd3cc06acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc06acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 -- 172.21.15.67:0/3470309528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc1a0810 con 0x7fd3cc1029f0 2024-09-10T20:51:16.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3cad9d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc06acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.802+0000 7fd3c259c640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c890 tx=0x7fd3b400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.803+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4004220 con 0x7fd3cc1029f0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.803+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3b40043c0 con 0x7fd3cc1029f0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.803+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc1a0b00 con 0x7fd3cc1029f0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.803+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4004a00 con 0x7fd3cc1029f0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.803+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc1a1050 con 0x7fd3cc1029f0 2024-09-10T20:51:16.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.804+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3cc108b40 con 0x7fd3cc1029f0 2024-09-10T20:51:16.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.805+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fd3b40079b0 con 0x7fd3cc1029f0 2024-09-10T20:51:16.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.806+0000 7fd3c8d99640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 0x7fd3b80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:16.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.806+0000 7fd3cad9d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 0x7fd3b80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:16.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.806+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd3b40e5f20 con 0x7fd3cc1029f0 2024-09-10T20:51:16.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.806+0000 7fd3cad9d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 0x7fd3b80b7830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00baa0 tx=0x7fd3bc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:16.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.808+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3b4014030 con 0x7fd3cc1029f0 2024-09-10T20:51:16.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.992+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3cc063590 con 0x7fd3b80b5370 2024-09-10T20:51:17.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:16.997+0000 7fd3c8d99640 1 -- 172.21.15.67:0/3470309528 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258821 (secure 0 0 0) 0x7fd3cc063590 con 0x7fd3b80b5370 2024-09-10T20:51:17.005 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:17.007 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 msgr2=0x7fd3b80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 0x7fd3b80b7830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00baa0 tx=0x7fd3bc005d90 comp rx=0 tx=0).stop 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 msgr2=0x7fd3cc19d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c890 tx=0x7fd3b400cd50 comp rx=0 tx=0).stop 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 shutdown_connections 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd3b80b5370 0x7fd3b80b7830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc1033b0 0x7fd3cc19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3cc1029f0 0x7fd3cc19d960 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 --2- 172.21.15.67:0/3470309528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd3cc1018a0 0x7fd3cc06acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.000+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 >> 172.21.15.67:0/3470309528 conn(0x7fd3cc0fd180 msgr2=0x7fd3cc105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:17.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.001+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 shutdown_connections 2024-09-10T20:51:17.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.001+0000 7fd3d113d640 1 -- 172.21.15.67:0/3470309528 wait complete. 2024-09-10T20:51:17.016 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T20:51:16.783435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665366,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":717,"num_read_kb":464,"num_write":305,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6714860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9013,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":59,"num_write":18,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002705"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154148+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:51:07.154148+0000","last_peered":"2024-09-10T20:51:07.154148+0000","last_clean":"2024-09-10T20:51:07.154148+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:51:07.154148+0000","last_undegraded":"2024-09-10T20:51:07.154148+0000","last_fullsized":"2024-09-10T20:51:07.154148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163916+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:51:07.163916+0000","last_peered":"2024-09-10T20:51:07.163916+0000","last_clean":"2024-09-10T20:51:07.163916+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:51:07.163916+0000","last_undegraded":"2024-09-10T20:51:07.163916+0000","last_fullsized":"2024-09-10T20:51:07.163916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.138716+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:51:07.138716+0000","last_peered":"2024-09-10T20:51:07.138716+0000","last_clean":"2024-09-10T20:51:07.138716+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:51:07.138716+0000","last_undegraded":"2024-09-10T20:51:07.138716+0000","last_fullsized":"2024-09-10T20:51:07.138716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150162+0000","last_change":"2024-09-10T20:50:08.570682+0000","last_active":"2024-09-10T20:51:07.150162+0000","last_peered":"2024-09-10T20:51:07.150162+0000","last_clean":"2024-09-10T20:51:07.150162+0000","last_became_active":"2024-09-10T20:50:08.570099+0000","last_became_peered":"2024-09-10T20:50:08.570099+0000","last_unstale":"2024-09-10T20:51:07.150162+0000","last_undegraded":"2024-09-10T20:51:07.150162+0000","last_fullsized":"2024-09-10T20:51:07.150162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:09.651291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150997+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:51:07.150997+0000","last_peered":"2024-09-10T20:51:07.150997+0000","last_clean":"2024-09-10T20:51:07.150997+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:51:07.150997+0000","last_undegraded":"2024-09-10T20:51:07.150997+0000","last_fullsized":"2024-09-10T20:51:07.150997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165630+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:51:07.165630+0000","last_peered":"2024-09-10T20:51:07.165630+0000","last_clean":"2024-09-10T20:51:07.165630+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:51:07.165630+0000","last_undegraded":"2024-09-10T20:51:07.165630+0000","last_fullsized":"2024-09-10T20:51:07.165630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162457+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:51:07.162457+0000","last_peered":"2024-09-10T20:51:07.162457+0000","last_clean":"2024-09-10T20:51:07.162457+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:51:07.162457+0000","last_undegraded":"2024-09-10T20:51:07.162457+0000","last_fullsized":"2024-09-10T20:51:07.162457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.167069+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:51:07.167069+0000","last_peered":"2024-09-10T20:51:07.167069+0000","last_clean":"2024-09-10T20:51:07.167069+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:51:07.167069+0000","last_undegraded":"2024-09-10T20:51:07.167069+0000","last_fullsized":"2024-09-10T20:51:07.167069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149872+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:51:07.149872+0000","last_peered":"2024-09-10T20:51:07.149872+0000","last_clean":"2024-09-10T20:51:07.149872+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:51:07.149872+0000","last_undegraded":"2024-09-10T20:51:07.149872+0000","last_fullsized":"2024-09-10T20:51:07.149872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164853+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:51:07.164853+0000","last_peered":"2024-09-10T20:51:07.164853+0000","last_clean":"2024-09-10T20:51:07.164853+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:51:07.164853+0000","last_undegraded":"2024-09-10T20:51:07.164853+0000","last_fullsized":"2024-09-10T20:51:07.164853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155162+0000","last_change":"2024-09-10T20:50:08.567682+0000","last_active":"2024-09-10T20:51:07.155162+0000","last_peered":"2024-09-10T20:51:07.155162+0000","last_clean":"2024-09-10T20:51:07.155162+0000","last_became_active":"2024-09-10T20:50:08.567302+0000","last_became_peered":"2024-09-10T20:50:08.567302+0000","last_unstale":"2024-09-10T20:51:07.155162+0000","last_undegraded":"2024-09-10T20:51:07.155162+0000","last_fullsized":"2024-09-10T20:51:07.155162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:59.818786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155285+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:51:07.155285+0000","last_peered":"2024-09-10T20:51:07.155285+0000","last_clean":"2024-09-10T20:51:07.155285+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:51:07.155285+0000","last_undegraded":"2024-09-10T20:51:07.155285+0000","last_fullsized":"2024-09-10T20:51:07.155285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153616+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:51:07.153616+0000","last_peered":"2024-09-10T20:51:07.153616+0000","last_clean":"2024-09-10T20:51:07.153616+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:51:07.153616+0000","last_undegraded":"2024-09-10T20:51:07.153616+0000","last_fullsized":"2024-09-10T20:51:07.153616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152130+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:51:07.152130+0000","last_peered":"2024-09-10T20:51:07.152130+0000","last_clean":"2024-09-10T20:51:07.152130+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:51:07.152130+0000","last_undegraded":"2024-09-10T20:51:07.152130+0000","last_fullsized":"2024-09-10T20:51:07.152130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166654+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:51:07.166654+0000","last_peered":"2024-09-10T20:51:07.166654+0000","last_clean":"2024-09-10T20:51:07.166654+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:51:07.166654+0000","last_undegraded":"2024-09-10T20:51:07.166654+0000","last_fullsized":"2024-09-10T20:51:07.166654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154544+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:51:07.154544+0000","last_peered":"2024-09-10T20:51:07.154544+0000","last_clean":"2024-09-10T20:51:07.154544+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:51:07.154544+0000","last_undegraded":"2024-09-10T20:51:07.154544+0000","last_fullsized":"2024-09-10T20:51:07.154544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149739+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:51:07.149739+0000","last_peered":"2024-09-10T20:51:07.149739+0000","last_clean":"2024-09-10T20:51:07.149739+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:51:07.149739+0000","last_undegraded":"2024-09-10T20:51:07.149739+0000","last_fullsized":"2024-09-10T20:51:07.149739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151719+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:51:07.151719+0000","last_peered":"2024-09-10T20:51:07.151719+0000","last_clean":"2024-09-10T20:51:07.151719+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:51:07.151719+0000","last_undegraded":"2024-09-10T20:51:07.151719+0000","last_fullsized":"2024-09-10T20:51:07.151719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164817+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:51:07.164817+0000","last_peered":"2024-09-10T20:51:07.164817+0000","last_clean":"2024-09-10T20:51:07.164817+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:51:07.164817+0000","last_undegraded":"2024-09-10T20:51:07.164817+0000","last_fullsized":"2024-09-10T20:51:07.164817+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166699+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:51:07.166699+0000","last_peered":"2024-09-10T20:51:07.166699+0000","last_clean":"2024-09-10T20:51:07.166699+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:51:07.166699+0000","last_undegraded":"2024-09-10T20:51:07.166699+0000","last_fullsized":"2024-09-10T20:51:07.166699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.159931+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:51:07.159931+0000","last_peered":"2024-09-10T20:51:07.159931+0000","last_clean":"2024-09-10T20:51:07.159931+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:51:07.159931+0000","last_undegraded":"2024-09-10T20:51:07.159931+0000","last_fullsized":"2024-09-10T20:51:07.159931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158143+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:51:07.158143+0000","last_peered":"2024-09-10T20:51:07.158143+0000","last_clean":"2024-09-10T20:51:07.158143+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:51:07.158143+0000","last_undegraded":"2024-09-10T20:51:07.158143+0000","last_fullsized":"2024-09-10T20:51:07.158143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153964+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:51:07.153964+0000","last_peered":"2024-09-10T20:51:07.153964+0000","last_clean":"2024-09-10T20:51:07.153964+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:51:07.153964+0000","last_undegraded":"2024-09-10T20:51:07.153964+0000","last_fullsized":"2024-09-10T20:51:07.153964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152357+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:51:07.152357+0000","last_peered":"2024-09-10T20:51:07.152357+0000","last_clean":"2024-09-10T20:51:07.152357+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:51:07.152357+0000","last_undegraded":"2024-09-10T20:51:07.152357+0000","last_fullsized":"2024-09-10T20:51:07.152357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151244+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:51:07.151244+0000","last_peered":"2024-09-10T20:51:07.151244+0000","last_clean":"2024-09-10T20:51:07.151244+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:51:07.151244+0000","last_undegraded":"2024-09-10T20:51:07.151244+0000","last_fullsized":"2024-09-10T20:51:07.151244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150629+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:51:07.150629+0000","last_peered":"2024-09-10T20:51:07.150629+0000","last_clean":"2024-09-10T20:51:07.150629+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:51:07.150629+0000","last_undegraded":"2024-09-10T20:51:07.150629+0000","last_fullsized":"2024-09-10T20:51:07.150629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149268+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:51:07.149268+0000","last_peered":"2024-09-10T20:51:07.149268+0000","last_clean":"2024-09-10T20:51:07.149268+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:51:07.149268+0000","last_undegraded":"2024-09-10T20:51:07.149268+0000","last_fullsized":"2024-09-10T20:51:07.149268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150258+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:51:07.150258+0000","last_peered":"2024-09-10T20:51:07.150258+0000","last_clean":"2024-09-10T20:51:07.150258+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:51:07.150258+0000","last_undegraded":"2024-09-10T20:51:07.150258+0000","last_fullsized":"2024-09-10T20:51:07.150258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.145506+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:51:07.145506+0000","last_peered":"2024-09-10T20:51:07.145506+0000","last_clean":"2024-09-10T20:51:07.145506+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:51:07.145506+0000","last_undegraded":"2024-09-10T20:51:07.145506+0000","last_fullsized":"2024-09-10T20:51:07.145506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150943+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:51:07.150943+0000","last_peered":"2024-09-10T20:51:07.150943+0000","last_clean":"2024-09-10T20:51:07.150943+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:51:07.150943+0000","last_undegraded":"2024-09-10T20:51:07.150943+0000","last_fullsized":"2024-09-10T20:51:07.150943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150204+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:51:07.150204+0000","last_peered":"2024-09-10T20:51:07.150204+0000","last_clean":"2024-09-10T20:51:07.150204+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:51:07.150204+0000","last_undegraded":"2024-09-10T20:51:07.150204+0000","last_fullsized":"2024-09-10T20:51:07.150204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":134,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.633057+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:51:14.633057+0000","last_peered":"2024-09-10T20:51:14.633057+0000","last_clean":"2024-09-10T20:51:14.633057+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:51:14.633057+0000","last_undegraded":"2024-09-10T20:51:14.633057+0000","last_fullsized":"2024-09-10T20:51:14.633057+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1321,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157230+0000","last_change":"2024-09-10T20:50:08.570456+0000","last_active":"2024-09-10T20:51:07.157230+0000","last_peered":"2024-09-10T20:51:07.157230+0000","last_clean":"2024-09-10T20:51:07.157230+0000","last_became_active":"2024-09-10T20:50:08.570104+0000","last_became_peered":"2024-09-10T20:50:08.570104+0000","last_unstale":"2024-09-10T20:51:07.157230+0000","last_undegraded":"2024-09-10T20:51:07.157230+0000","last_fullsized":"2024-09-10T20:51:07.157230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.998765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561580+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:50:08.561580+0000","last_peered":"2024-09-10T20:50:08.561580+0000","last_clean":"2024-09-10T20:50:08.561580+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:50:08.561580+0000","last_undegraded":"2024-09-10T20:50:08.561580+0000","last_fullsized":"2024-09-10T20:50:08.561580+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568874+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:50:08.568874+0000","last_peered":"2024-09-10T20:50:08.568874+0000","last_clean":"2024-09-10T20:50:08.568874+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:50:08.568874+0000","last_undegraded":"2024-09-10T20:50:08.568874+0000","last_fullsized":"2024-09-10T20:50:08.568874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156000+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:51:07.156000+0000","last_peered":"2024-09-10T20:51:07.156000+0000","last_clean":"2024-09-10T20:51:07.156000+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:51:07.156000+0000","last_undegraded":"2024-09-10T20:51:07.156000+0000","last_fullsized":"2024-09-10T20:51:07.156000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565380+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:50:08.565380+0000","last_peered":"2024-09-10T20:50:08.565380+0000","last_clean":"2024-09-10T20:50:08.565380+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:50:08.565380+0000","last_undegraded":"2024-09-10T20:50:08.565380+0000","last_fullsized":"2024-09-10T20:50:08.565380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156921+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:51:07.156921+0000","last_peered":"2024-09-10T20:51:07.156921+0000","last_clean":"2024-09-10T20:51:07.156921+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:51:07.156921+0000","last_undegraded":"2024-09-10T20:51:07.156921+0000","last_fullsized":"2024-09-10T20:51:07.156921+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.632276+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:51:14.632276+0000","last_peered":"2024-09-10T20:51:14.632276+0000","last_clean":"2024-09-10T20:51:14.632276+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:51:14.632276+0000","last_undegraded":"2024-09-10T20:51:14.632276+0000","last_fullsized":"2024-09-10T20:51:14.632276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164790+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:51:07.164790+0000","last_peered":"2024-09-10T20:51:07.164790+0000","last_clean":"2024-09-10T20:51:07.164790+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:51:07.164790+0000","last_undegraded":"2024-09-10T20:51:07.164790+0000","last_fullsized":"2024-09-10T20:51:07.164790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570157+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:50:08.570157+0000","last_peered":"2024-09-10T20:50:08.570157+0000","last_clean":"2024-09-10T20:50:08.570157+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:50:08.570157+0000","last_undegraded":"2024-09-10T20:50:08.570157+0000","last_fullsized":"2024-09-10T20:50:08.570157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148551+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:51:07.148551+0000","last_peered":"2024-09-10T20:51:07.148551+0000","last_clean":"2024-09-10T20:51:07.148551+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:51:07.148551+0000","last_undegraded":"2024-09-10T20:51:07.148551+0000","last_fullsized":"2024-09-10T20:51:07.148551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564804+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:50:08.564804+0000","last_peered":"2024-09-10T20:50:08.564804+0000","last_clean":"2024-09-10T20:50:08.564804+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:50:08.564804+0000","last_undegraded":"2024-09-10T20:50:08.564804+0000","last_fullsized":"2024-09-10T20:50:08.564804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165142+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:51:07.165142+0000","last_peered":"2024-09-10T20:51:07.165142+0000","last_clean":"2024-09-10T20:51:07.165142+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:51:07.165142+0000","last_undegraded":"2024-09-10T20:51:07.165142+0000","last_fullsized":"2024-09-10T20:51:07.165142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:15.635101+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:51:15.635101+0000","last_peered":"2024-09-10T20:51:15.635101+0000","last_clean":"2024-09-10T20:51:15.635101+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:51:15.635101+0000","last_undegraded":"2024-09-10T20:51:15.635101+0000","last_fullsized":"2024-09-10T20:51:15.635101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69532,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163328+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:51:07.163328+0000","last_peered":"2024-09-10T20:51:07.163328+0000","last_clean":"2024-09-10T20:51:07.163328+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:51:07.163328+0000","last_undegraded":"2024-09-10T20:51:07.163328+0000","last_fullsized":"2024-09-10T20:51:07.163328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567504+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:50:08.567504+0000","last_peered":"2024-09-10T20:50:08.567504+0000","last_clean":"2024-09-10T20:50:08.567504+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:50:08.567504+0000","last_undegraded":"2024-09-10T20:50:08.567504+0000","last_fullsized":"2024-09-10T20:50:08.567504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164646+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:51:07.164646+0000","last_peered":"2024-09-10T20:51:07.164646+0000","last_clean":"2024-09-10T20:51:07.164646+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:51:07.164646+0000","last_undegraded":"2024-09-10T20:51:07.164646+0000","last_fullsized":"2024-09-10T20:51:07.164646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564496+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:50:08.564496+0000","last_peered":"2024-09-10T20:50:08.564496+0000","last_clean":"2024-09-10T20:50:08.564496+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:50:08.564496+0000","last_undegraded":"2024-09-10T20:50:08.564496+0000","last_fullsized":"2024-09-10T20:50:08.564496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164304+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:51:07.164304+0000","last_peered":"2024-09-10T20:51:07.164304+0000","last_clean":"2024-09-10T20:51:07.164304+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:51:07.164304+0000","last_undegraded":"2024-09-10T20:51:07.164304+0000","last_fullsized":"2024-09-10T20:51:07.164304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.636075+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:51:14.636075+0000","last_peered":"2024-09-10T20:51:14.636075+0000","last_clean":"2024-09-10T20:51:14.636075+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:51:14.636075+0000","last_undegraded":"2024-09-10T20:51:14.636075+0000","last_fullsized":"2024-09-10T20:51:14.636075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165906+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:51:07.165906+0000","last_peered":"2024-09-10T20:51:07.165906+0000","last_clean":"2024-09-10T20:51:07.165906+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:51:07.165906+0000","last_undegraded":"2024-09-10T20:51:07.165906+0000","last_fullsized":"2024-09-10T20:51:07.165906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563927+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:50:08.563927+0000","last_peered":"2024-09-10T20:50:08.563927+0000","last_clean":"2024-09-10T20:50:08.563927+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:50:08.563927+0000","last_undegraded":"2024-09-10T20:50:08.563927+0000","last_fullsized":"2024-09-10T20:50:08.563927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154725+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:51:07.154725+0000","last_peered":"2024-09-10T20:51:07.154725+0000","last_clean":"2024-09-10T20:51:07.154725+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:51:07.154725+0000","last_undegraded":"2024-09-10T20:51:07.154725+0000","last_fullsized":"2024-09-10T20:51:07.154725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566303+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:50:08.566303+0000","last_peered":"2024-09-10T20:50:08.566303+0000","last_clean":"2024-09-10T20:50:08.566303+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:50:08.566303+0000","last_undegraded":"2024-09-10T20:50:08.566303+0000","last_fullsized":"2024-09-10T20:50:08.566303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148870+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:51:07.148870+0000","last_peered":"2024-09-10T20:51:07.148870+0000","last_clean":"2024-09-10T20:51:07.148870+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:51:07.148870+0000","last_undegraded":"2024-09-10T20:51:07.148870+0000","last_fullsized":"2024-09-10T20:51:07.148870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569541+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:50:08.569541+0000","last_peered":"2024-09-10T20:50:08.569541+0000","last_clean":"2024-09-10T20:50:08.569541+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:50:08.569541+0000","last_undegraded":"2024-09-10T20:50:08.569541+0000","last_fullsized":"2024-09-10T20:50:08.569541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162002+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:51:07.162002+0000","last_peered":"2024-09-10T20:51:07.162002+0000","last_clean":"2024-09-10T20:51:07.162002+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:51:07.162002+0000","last_undegraded":"2024-09-10T20:51:07.162002+0000","last_fullsized":"2024-09-10T20:51:07.162002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564958+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:50:08.564958+0000","last_peered":"2024-09-10T20:50:08.564958+0000","last_clean":"2024-09-10T20:50:08.564958+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:50:08.564958+0000","last_undegraded":"2024-09-10T20:50:08.564958+0000","last_fullsized":"2024-09-10T20:50:08.564958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165653+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:51:07.165653+0000","last_peered":"2024-09-10T20:51:07.165653+0000","last_clean":"2024-09-10T20:51:07.165653+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:51:07.165653+0000","last_undegraded":"2024-09-10T20:51:07.165653+0000","last_fullsized":"2024-09-10T20:51:07.165653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568133+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:50:08.568133+0000","last_peered":"2024-09-10T20:50:08.568133+0000","last_clean":"2024-09-10T20:50:08.568133+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:50:08.568133+0000","last_undegraded":"2024-09-10T20:50:08.568133+0000","last_fullsized":"2024-09-10T20:50:08.568133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165007+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:51:07.165007+0000","last_peered":"2024-09-10T20:51:07.165007+0000","last_clean":"2024-09-10T20:51:07.165007+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:51:07.165007+0000","last_undegraded":"2024-09-10T20:51:07.165007+0000","last_fullsized":"2024-09-10T20:51:07.165007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569651+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:50:08.569651+0000","last_peered":"2024-09-10T20:50:08.569651+0000","last_clean":"2024-09-10T20:50:08.569651+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:50:08.569651+0000","last_undegraded":"2024-09-10T20:50:08.569651+0000","last_fullsized":"2024-09-10T20:50:08.569651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568872+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:50:08.568872+0000","last_peered":"2024-09-10T20:50:08.568872+0000","last_clean":"2024-09-10T20:50:08.568872+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:50:08.568872+0000","last_undegraded":"2024-09-10T20:50:08.568872+0000","last_fullsized":"2024-09-10T20:50:08.568872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156364+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:51:07.156364+0000","last_peered":"2024-09-10T20:51:07.156364+0000","last_clean":"2024-09-10T20:51:07.156364+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:51:07.156364+0000","last_undegraded":"2024-09-10T20:51:07.156364+0000","last_fullsized":"2024-09-10T20:51:07.156364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569502+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:50:08.569502+0000","last_peered":"2024-09-10T20:50:08.569502+0000","last_clean":"2024-09-10T20:50:08.569502+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:50:08.569502+0000","last_undegraded":"2024-09-10T20:50:08.569502+0000","last_fullsized":"2024-09-10T20:50:08.569502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.147300+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:51:07.147300+0000","last_peered":"2024-09-10T20:51:07.147300+0000","last_clean":"2024-09-10T20:51:07.147300+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:51:07.147300+0000","last_undegraded":"2024-09-10T20:51:07.147300+0000","last_fullsized":"2024-09-10T20:51:07.147300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.635048+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:51:14.635048+0000","last_peered":"2024-09-10T20:51:14.635048+0000","last_clean":"2024-09-10T20:51:14.635048+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:51:14.635048+0000","last_undegraded":"2024-09-10T20:51:14.635048+0000","last_fullsized":"2024-09-10T20:51:14.635048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149046+0000","last_change":"2024-09-10T20:50:08.569711+0000","last_active":"2024-09-10T20:51:07.149046+0000","last_peered":"2024-09-10T20:51:07.149046+0000","last_clean":"2024-09-10T20:51:07.149046+0000","last_became_active":"2024-09-10T20:50:08.569348+0000","last_became_peered":"2024-09-10T20:50:08.569348+0000","last_unstale":"2024-09-10T20:51:07.149046+0000","last_undegraded":"2024-09-10T20:51:07.149046+0000","last_fullsized":"2024-09-10T20:51:07.149046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570006+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:50:08.570006+0000","last_peered":"2024-09-10T20:50:08.570006+0000","last_clean":"2024-09-10T20:50:08.570006+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:50:08.570006+0000","last_undegraded":"2024-09-10T20:50:08.570006+0000","last_fullsized":"2024-09-10T20:50:08.570006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152951+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:51:07.152951+0000","last_peered":"2024-09-10T20:51:07.152951+0000","last_clean":"2024-09-10T20:51:07.152951+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:51:07.152951+0000","last_undegraded":"2024-09-10T20:51:07.152951+0000","last_fullsized":"2024-09-10T20:51:07.152951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563780+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:50:08.563780+0000","last_peered":"2024-09-10T20:50:08.563780+0000","last_clean":"2024-09-10T20:50:08.563780+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:50:08.563780+0000","last_undegraded":"2024-09-10T20:50:08.563780+0000","last_fullsized":"2024-09-10T20:50:08.563780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157700+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:51:07.157700+0000","last_peered":"2024-09-10T20:51:07.157700+0000","last_clean":"2024-09-10T20:51:07.157700+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:51:07.157700+0000","last_undegraded":"2024-09-10T20:51:07.157700+0000","last_fullsized":"2024-09-10T20:51:07.157700+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566052+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:50:08.566052+0000","last_peered":"2024-09-10T20:50:08.566052+0000","last_clean":"2024-09-10T20:50:08.566052+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:50:08.566052+0000","last_undegraded":"2024-09-10T20:50:08.566052+0000","last_fullsized":"2024-09-10T20:50:08.566052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148689+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:51:07.148689+0000","last_peered":"2024-09-10T20:51:07.148689+0000","last_clean":"2024-09-10T20:51:07.148689+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:51:07.148689+0000","last_undegraded":"2024-09-10T20:51:07.148689+0000","last_fullsized":"2024-09-10T20:51:07.148689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.432509+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:51:07.432509+0000","last_peered":"2024-09-10T20:51:07.432509+0000","last_clean":"2024-09-10T20:51:07.432509+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:51:07.432509+0000","last_undegraded":"2024-09-10T20:51:07.432509+0000","last_fullsized":"2024-09-10T20:51:07.432509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158981+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:51:07.158981+0000","last_peered":"2024-09-10T20:51:07.158981+0000","last_clean":"2024-09-10T20:51:07.158981+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:51:07.158981+0000","last_undegraded":"2024-09-10T20:51:07.158981+0000","last_fullsized":"2024-09-10T20:51:07.158981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569278+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:50:08.569278+0000","last_peered":"2024-09-10T20:50:08.569278+0000","last_clean":"2024-09-10T20:50:08.569278+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:50:08.569278+0000","last_undegraded":"2024-09-10T20:50:08.569278+0000","last_fullsized":"2024-09-10T20:50:08.569278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150190+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:51:07.150190+0000","last_peered":"2024-09-10T20:51:07.150190+0000","last_clean":"2024-09-10T20:51:07.150190+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:51:07.150190+0000","last_undegraded":"2024-09-10T20:51:07.150190+0000","last_fullsized":"2024-09-10T20:51:07.150190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.571450+0000","last_change":"2024-09-10T20:50:08.571340+0000","last_active":"2024-09-10T20:50:08.571450+0000","last_peered":"2024-09-10T20:50:08.571450+0000","last_clean":"2024-09-10T20:50:08.571450+0000","last_became_active":"2024-09-10T20:50:08.567038+0000","last_became_peered":"2024-09-10T20:50:08.567038+0000","last_unstale":"2024-09-10T20:50:08.571450+0000","last_undegraded":"2024-09-10T20:50:08.571450+0000","last_fullsized":"2024-09-10T20:50:08.571450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:56.536271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.140458+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:51:07.140458+0000","last_peered":"2024-09-10T20:51:07.140458+0000","last_clean":"2024-09-10T20:51:07.140458+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:51:07.140458+0000","last_undegraded":"2024-09-10T20:51:07.140458+0000","last_fullsized":"2024-09-10T20:51:07.140458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568779+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:50:08.568779+0000","last_peered":"2024-09-10T20:50:08.568779+0000","last_clean":"2024-09-10T20:50:08.568779+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:50:08.568779+0000","last_undegraded":"2024-09-10T20:50:08.568779+0000","last_fullsized":"2024-09-10T20:50:08.568779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150494+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:51:07.150494+0000","last_peered":"2024-09-10T20:51:07.150494+0000","last_clean":"2024-09-10T20:51:07.150494+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:51:07.150494+0000","last_undegraded":"2024-09-10T20:51:07.150494+0000","last_fullsized":"2024-09-10T20:51:07.150494+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567602+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:50:08.567602+0000","last_peered":"2024-09-10T20:50:08.567602+0000","last_clean":"2024-09-10T20:50:08.567602+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:50:08.567602+0000","last_undegraded":"2024-09-10T20:50:08.567602+0000","last_fullsized":"2024-09-10T20:50:08.567602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156218+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:51:07.156218+0000","last_peered":"2024-09-10T20:51:07.156218+0000","last_clean":"2024-09-10T20:51:07.156218+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:51:07.156218+0000","last_undegraded":"2024-09-10T20:51:07.156218+0000","last_fullsized":"2024-09-10T20:51:07.156218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566615+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:50:08.566615+0000","last_peered":"2024-09-10T20:50:08.566615+0000","last_clean":"2024-09-10T20:50:08.566615+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:50:08.566615+0000","last_undegraded":"2024-09-10T20:50:08.566615+0000","last_fullsized":"2024-09-10T20:50:08.566615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164761+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:51:07.164761+0000","last_peered":"2024-09-10T20:51:07.164761+0000","last_clean":"2024-09-10T20:51:07.164761+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:51:07.164761+0000","last_undegraded":"2024-09-10T20:51:07.164761+0000","last_fullsized":"2024-09-10T20:51:07.164761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.160537+0000","last_change":"2024-09-10T20:50:08.570537+0000","last_active":"2024-09-10T20:51:07.160537+0000","last_peered":"2024-09-10T20:51:07.160537+0000","last_clean":"2024-09-10T20:51:07.160537+0000","last_became_active":"2024-09-10T20:50:08.570083+0000","last_became_peered":"2024-09-10T20:50:08.570083+0000","last_unstale":"2024-09-10T20:51:07.160537+0000","last_undegraded":"2024-09-10T20:51:07.160537+0000","last_fullsized":"2024-09-10T20:51:07.160537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:15.834461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.573406+0000","last_change":"2024-09-10T20:50:08.572886+0000","last_active":"2024-09-10T20:50:08.573406+0000","last_peered":"2024-09-10T20:50:08.573406+0000","last_clean":"2024-09-10T20:50:08.573406+0000","last_became_active":"2024-09-10T20:50:08.568973+0000","last_became_peered":"2024-09-10T20:50:08.568973+0000","last_unstale":"2024-09-10T20:50:08.573406+0000","last_undegraded":"2024-09-10T20:50:08.573406+0000","last_fullsized":"2024-09-10T20:50:08.573406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:09.903383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164671+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:51:07.164671+0000","last_peered":"2024-09-10T20:51:07.164671+0000","last_clean":"2024-09-10T20:51:07.164671+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:51:07.164671+0000","last_undegraded":"2024-09-10T20:51:07.164671+0000","last_fullsized":"2024-09-10T20:51:07.164671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565963+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:50:08.565963+0000","last_peered":"2024-09-10T20:50:08.565963+0000","last_clean":"2024-09-10T20:50:08.565963+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:50:08.565963+0000","last_undegraded":"2024-09-10T20:50:08.565963+0000","last_fullsized":"2024-09-10T20:50:08.565963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164885+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:51:07.164885+0000","last_peered":"2024-09-10T20:51:07.164885+0000","last_clean":"2024-09-10T20:51:07.164885+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:51:07.164885+0000","last_undegraded":"2024-09-10T20:51:07.164885+0000","last_fullsized":"2024-09-10T20:51:07.164885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569349+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:50:08.569349+0000","last_peered":"2024-09-10T20:50:08.569349+0000","last_clean":"2024-09-10T20:50:08.569349+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:50:08.569349+0000","last_undegraded":"2024-09-10T20:50:08.569349+0000","last_fullsized":"2024-09-10T20:50:08.569349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155806+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:51:07.155806+0000","last_peered":"2024-09-10T20:51:07.155806+0000","last_clean":"2024-09-10T20:51:07.155806+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:51:07.155806+0000","last_undegraded":"2024-09-10T20:51:07.155806+0000","last_fullsized":"2024-09-10T20:51:07.155806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563549+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:50:08.563549+0000","last_peered":"2024-09-10T20:50:08.563549+0000","last_clean":"2024-09-10T20:50:08.563549+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:50:08.563549+0000","last_undegraded":"2024-09-10T20:50:08.563549+0000","last_fullsized":"2024-09-10T20:50:08.563549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74764,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":400,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":223510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":394113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1056049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":394269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":986340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":393738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":986191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":395098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":394049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":462592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":463063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":395009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:51:17.022 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 -- 172.21.15.67:0/3333753820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c06bdb0 msgr2=0x7f3f9c107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/3333753820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c107980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009900 tx=0x7f3f9802a410 comp rx=0 tx=0).stop 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 -- 172.21.15.67:0/3333753820 shutdown_connections 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/3333753820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c10a900 0x7f3f9c10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/3333753820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c10a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/3333753820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c107980 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.155+0000 7f3fa3a16640 1 -- 172.21.15.67:0/3333753820 >> 172.21.15.67:0/3333753820 conn(0x7f3f9c0fd190 msgr2=0x7f3f9c0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- 172.21.15.67:0/3333753820 shutdown_connections 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- 172.21.15.67:0/3333753820 wait complete. 2024-09-10T20:51:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 Processor -- start 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- start start 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c19af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c110860 con 0x7f3f9c10a900 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c1106e0 con 0x7f3f9c06bdb0 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.156+0000 7f3fa3a16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c1109e0 con 0x7f3f9c107ec0 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36368/0 (socket says 172.21.15.67:36368) 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 -- 172.21.15.67:0/4178880720 learned_addr learned my addr 172.21.15.67:0/4178880720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa0fb1640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa17b2640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c19af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 -- 172.21.15.67:0/4178880720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 msgr2=0x7f3f9c19b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c19b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 -- 172.21.15.67:0/4178880720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c06bdb0 msgr2=0x7f3f9c19af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c19af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 -- 172.21.15.67:0/4178880720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c19caa0 con 0x7f3f9c10a900 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa0fb1640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c19b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa1fb3640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400cce0 tx=0x7f3f9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400f450 con 0x7f3f9c10a900 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f9400faa0 con 0x7f3f9c10a900 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9c19cd90 con 0x7f3f9c10a900 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94018b70 con 0x7f3f9c10a900 2024-09-10T20:51:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.157+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9c1a3460 con 0x7f3f9c10a900 2024-09-10T20:51:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.158+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9c107980 con 0x7f3f9c10a900 2024-09-10T20:51:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.160+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f3f9400f5f0 con 0x7f3f9c10a900 2024-09-10T20:51:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.160+0000 7f3f927fc640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 0x7f3f880b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.160+0000 7f3fa17b2640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 0x7f3f880b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.160+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3f940e6580 con 0x7f3f9c10a900 2024-09-10T20:51:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.161+0000 7f3fa17b2640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 0x7f3f880b78b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f980314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:17.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.163+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3f94014030 con 0x7f3f9c10a900 2024-09-10T20:51:17.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.345+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f9c063590 con 0x7f3f880b53f0 2024-09-10T20:51:17.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.349+0000 7f3f927fc640 1 -- 172.21.15.67:0/4178880720 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258821 (secure 0 0 0) 0x7f3f9c063590 con 0x7f3f880b53f0 2024-09-10T20:51:17.356 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:17.357 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 msgr2=0x7f3f880b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 0x7f3f880b78b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f980314a0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 msgr2=0x7f3f9c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400cce0 tx=0x7f3f9400a620 comp rx=0 tx=0).stop 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 shutdown_connections 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f9c10a900 0x7f3f9c19c1e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f880b53f0 0x7f3f880b78b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c107ec0 0x7f3f9c19b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 --2- 172.21.15.67:0/4178880720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f9c06bdb0 0x7f3f9c19af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 >> 172.21.15.67:0/4178880720 conn(0x7f3f9c0fd190 msgr2=0x7f3f9c108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:17.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 shutdown_connections 2024-09-10T20:51:17.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.352+0000 7f3fa3a16640 1 -- 172.21.15.67:0/4178880720 wait complete. 2024-09-10T20:51:17.368 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T20:51:16.783435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665366,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":717,"num_read_kb":464,"num_write":305,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6714860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9013,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":59,"num_write":18,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002705"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154148+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:51:07.154148+0000","last_peered":"2024-09-10T20:51:07.154148+0000","last_clean":"2024-09-10T20:51:07.154148+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:51:07.154148+0000","last_undegraded":"2024-09-10T20:51:07.154148+0000","last_fullsized":"2024-09-10T20:51:07.154148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163916+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:51:07.163916+0000","last_peered":"2024-09-10T20:51:07.163916+0000","last_clean":"2024-09-10T20:51:07.163916+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:51:07.163916+0000","last_undegraded":"2024-09-10T20:51:07.163916+0000","last_fullsized":"2024-09-10T20:51:07.163916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.138716+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:51:07.138716+0000","last_peered":"2024-09-10T20:51:07.138716+0000","last_clean":"2024-09-10T20:51:07.138716+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:51:07.138716+0000","last_undegraded":"2024-09-10T20:51:07.138716+0000","last_fullsized":"2024-09-10T20:51:07.138716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150162+0000","last_change":"2024-09-10T20:50:08.570682+0000","last_active":"2024-09-10T20:51:07.150162+0000","last_peered":"2024-09-10T20:51:07.150162+0000","last_clean":"2024-09-10T20:51:07.150162+0000","last_became_active":"2024-09-10T20:50:08.570099+0000","last_became_peered":"2024-09-10T20:50:08.570099+0000","last_unstale":"2024-09-10T20:51:07.150162+0000","last_undegraded":"2024-09-10T20:51:07.150162+0000","last_fullsized":"2024-09-10T20:51:07.150162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:09.651291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150997+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:51:07.150997+0000","last_peered":"2024-09-10T20:51:07.150997+0000","last_clean":"2024-09-10T20:51:07.150997+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:51:07.150997+0000","last_undegraded":"2024-09-10T20:51:07.150997+0000","last_fullsized":"2024-09-10T20:51:07.150997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165630+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:51:07.165630+0000","last_peered":"2024-09-10T20:51:07.165630+0000","last_clean":"2024-09-10T20:51:07.165630+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:51:07.165630+0000","last_undegraded":"2024-09-10T20:51:07.165630+0000","last_fullsized":"2024-09-10T20:51:07.165630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162457+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:51:07.162457+0000","last_peered":"2024-09-10T20:51:07.162457+0000","last_clean":"2024-09-10T20:51:07.162457+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:51:07.162457+0000","last_undegraded":"2024-09-10T20:51:07.162457+0000","last_fullsized":"2024-09-10T20:51:07.162457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.167069+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:51:07.167069+0000","last_peered":"2024-09-10T20:51:07.167069+0000","last_clean":"2024-09-10T20:51:07.167069+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:51:07.167069+0000","last_undegraded":"2024-09-10T20:51:07.167069+0000","last_fullsized":"2024-09-10T20:51:07.167069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149872+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:51:07.149872+0000","last_peered":"2024-09-10T20:51:07.149872+0000","last_clean":"2024-09-10T20:51:07.149872+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:51:07.149872+0000","last_undegraded":"2024-09-10T20:51:07.149872+0000","last_fullsized":"2024-09-10T20:51:07.149872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164853+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:51:07.164853+0000","last_peered":"2024-09-10T20:51:07.164853+0000","last_clean":"2024-09-10T20:51:07.164853+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:51:07.164853+0000","last_undegraded":"2024-09-10T20:51:07.164853+0000","last_fullsized":"2024-09-10T20:51:07.164853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155162+0000","last_change":"2024-09-10T20:50:08.567682+0000","last_active":"2024-09-10T20:51:07.155162+0000","last_peered":"2024-09-10T20:51:07.155162+0000","last_clean":"2024-09-10T20:51:07.155162+0000","last_became_active":"2024-09-10T20:50:08.567302+0000","last_became_peered":"2024-09-10T20:50:08.567302+0000","last_unstale":"2024-09-10T20:51:07.155162+0000","last_undegraded":"2024-09-10T20:51:07.155162+0000","last_fullsized":"2024-09-10T20:51:07.155162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:59.818786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155285+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:51:07.155285+0000","last_peered":"2024-09-10T20:51:07.155285+0000","last_clean":"2024-09-10T20:51:07.155285+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:51:07.155285+0000","last_undegraded":"2024-09-10T20:51:07.155285+0000","last_fullsized":"2024-09-10T20:51:07.155285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153616+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:51:07.153616+0000","last_peered":"2024-09-10T20:51:07.153616+0000","last_clean":"2024-09-10T20:51:07.153616+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:51:07.153616+0000","last_undegraded":"2024-09-10T20:51:07.153616+0000","last_fullsized":"2024-09-10T20:51:07.153616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152130+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:51:07.152130+0000","last_peered":"2024-09-10T20:51:07.152130+0000","last_clean":"2024-09-10T20:51:07.152130+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:51:07.152130+0000","last_undegraded":"2024-09-10T20:51:07.152130+0000","last_fullsized":"2024-09-10T20:51:07.152130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166654+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:51:07.166654+0000","last_peered":"2024-09-10T20:51:07.166654+0000","last_clean":"2024-09-10T20:51:07.166654+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:51:07.166654+0000","last_undegraded":"2024-09-10T20:51:07.166654+0000","last_fullsized":"2024-09-10T20:51:07.166654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154544+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:51:07.154544+0000","last_peered":"2024-09-10T20:51:07.154544+0000","last_clean":"2024-09-10T20:51:07.154544+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:51:07.154544+0000","last_undegraded":"2024-09-10T20:51:07.154544+0000","last_fullsized":"2024-09-10T20:51:07.154544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149739+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:51:07.149739+0000","last_peered":"2024-09-10T20:51:07.149739+0000","last_clean":"2024-09-10T20:51:07.149739+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:51:07.149739+0000","last_undegraded":"2024-09-10T20:51:07.149739+0000","last_fullsized":"2024-09-10T20:51:07.149739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151719+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:51:07.151719+0000","last_peered":"2024-09-10T20:51:07.151719+0000","last_clean":"2024-09-10T20:51:07.151719+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:51:07.151719+0000","last_undegraded":"2024-09-10T20:51:07.151719+0000","last_fullsized":"2024-09-10T20:51:07.151719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164817+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:51:07.164817+0000","last_peered":"2024-09-10T20:51:07.164817+0000","last_clean":"2024-09-10T20:51:07.164817+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:51:07.164817+0000","last_undegraded":"2024-09-10T20:51:07.164817+0000","last_fullsized":"2024-09-10T20:51:07.164817+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166699+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:51:07.166699+0000","last_peered":"2024-09-10T20:51:07.166699+0000","last_clean":"2024-09-10T20:51:07.166699+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:51:07.166699+0000","last_undegraded":"2024-09-10T20:51:07.166699+0000","last_fullsized":"2024-09-10T20:51:07.166699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.159931+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:51:07.159931+0000","last_peered":"2024-09-10T20:51:07.159931+0000","last_clean":"2024-09-10T20:51:07.159931+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:51:07.159931+0000","last_undegraded":"2024-09-10T20:51:07.159931+0000","last_fullsized":"2024-09-10T20:51:07.159931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158143+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:51:07.158143+0000","last_peered":"2024-09-10T20:51:07.158143+0000","last_clean":"2024-09-10T20:51:07.158143+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:51:07.158143+0000","last_undegraded":"2024-09-10T20:51:07.158143+0000","last_fullsized":"2024-09-10T20:51:07.158143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153964+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:51:07.153964+0000","last_peered":"2024-09-10T20:51:07.153964+0000","last_clean":"2024-09-10T20:51:07.153964+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:51:07.153964+0000","last_undegraded":"2024-09-10T20:51:07.153964+0000","last_fullsized":"2024-09-10T20:51:07.153964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152357+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:51:07.152357+0000","last_peered":"2024-09-10T20:51:07.152357+0000","last_clean":"2024-09-10T20:51:07.152357+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:51:07.152357+0000","last_undegraded":"2024-09-10T20:51:07.152357+0000","last_fullsized":"2024-09-10T20:51:07.152357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151244+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:51:07.151244+0000","last_peered":"2024-09-10T20:51:07.151244+0000","last_clean":"2024-09-10T20:51:07.151244+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:51:07.151244+0000","last_undegraded":"2024-09-10T20:51:07.151244+0000","last_fullsized":"2024-09-10T20:51:07.151244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150629+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:51:07.150629+0000","last_peered":"2024-09-10T20:51:07.150629+0000","last_clean":"2024-09-10T20:51:07.150629+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:51:07.150629+0000","last_undegraded":"2024-09-10T20:51:07.150629+0000","last_fullsized":"2024-09-10T20:51:07.150629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149268+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:51:07.149268+0000","last_peered":"2024-09-10T20:51:07.149268+0000","last_clean":"2024-09-10T20:51:07.149268+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:51:07.149268+0000","last_undegraded":"2024-09-10T20:51:07.149268+0000","last_fullsized":"2024-09-10T20:51:07.149268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150258+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:51:07.150258+0000","last_peered":"2024-09-10T20:51:07.150258+0000","last_clean":"2024-09-10T20:51:07.150258+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:51:07.150258+0000","last_undegraded":"2024-09-10T20:51:07.150258+0000","last_fullsized":"2024-09-10T20:51:07.150258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.145506+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:51:07.145506+0000","last_peered":"2024-09-10T20:51:07.145506+0000","last_clean":"2024-09-10T20:51:07.145506+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:51:07.145506+0000","last_undegraded":"2024-09-10T20:51:07.145506+0000","last_fullsized":"2024-09-10T20:51:07.145506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150943+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:51:07.150943+0000","last_peered":"2024-09-10T20:51:07.150943+0000","last_clean":"2024-09-10T20:51:07.150943+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:51:07.150943+0000","last_undegraded":"2024-09-10T20:51:07.150943+0000","last_fullsized":"2024-09-10T20:51:07.150943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150204+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:51:07.150204+0000","last_peered":"2024-09-10T20:51:07.150204+0000","last_clean":"2024-09-10T20:51:07.150204+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:51:07.150204+0000","last_undegraded":"2024-09-10T20:51:07.150204+0000","last_fullsized":"2024-09-10T20:51:07.150204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":134,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.633057+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:51:14.633057+0000","last_peered":"2024-09-10T20:51:14.633057+0000","last_clean":"2024-09-10T20:51:14.633057+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:51:14.633057+0000","last_undegraded":"2024-09-10T20:51:14.633057+0000","last_fullsized":"2024-09-10T20:51:14.633057+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1321,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157230+0000","last_change":"2024-09-10T20:50:08.570456+0000","last_active":"2024-09-10T20:51:07.157230+0000","last_peered":"2024-09-10T20:51:07.157230+0000","last_clean":"2024-09-10T20:51:07.157230+0000","last_became_active":"2024-09-10T20:50:08.570104+0000","last_became_peered":"2024-09-10T20:50:08.570104+0000","last_unstale":"2024-09-10T20:51:07.157230+0000","last_undegraded":"2024-09-10T20:51:07.157230+0000","last_fullsized":"2024-09-10T20:51:07.157230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.998765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561580+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:50:08.561580+0000","last_peered":"2024-09-10T20:50:08.561580+0000","last_clean":"2024-09-10T20:50:08.561580+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:50:08.561580+0000","last_undegraded":"2024-09-10T20:50:08.561580+0000","last_fullsized":"2024-09-10T20:50:08.561580+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568874+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:50:08.568874+0000","last_peered":"2024-09-10T20:50:08.568874+0000","last_clean":"2024-09-10T20:50:08.568874+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:50:08.568874+0000","last_undegraded":"2024-09-10T20:50:08.568874+0000","last_fullsized":"2024-09-10T20:50:08.568874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156000+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:51:07.156000+0000","last_peered":"2024-09-10T20:51:07.156000+0000","last_clean":"2024-09-10T20:51:07.156000+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:51:07.156000+0000","last_undegraded":"2024-09-10T20:51:07.156000+0000","last_fullsized":"2024-09-10T20:51:07.156000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565380+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:50:08.565380+0000","last_peered":"2024-09-10T20:50:08.565380+0000","last_clean":"2024-09-10T20:50:08.565380+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:50:08.565380+0000","last_undegraded":"2024-09-10T20:50:08.565380+0000","last_fullsized":"2024-09-10T20:50:08.565380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156921+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:51:07.156921+0000","last_peered":"2024-09-10T20:51:07.156921+0000","last_clean":"2024-09-10T20:51:07.156921+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:51:07.156921+0000","last_undegraded":"2024-09-10T20:51:07.156921+0000","last_fullsized":"2024-09-10T20:51:07.156921+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.632276+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:51:14.632276+0000","last_peered":"2024-09-10T20:51:14.632276+0000","last_clean":"2024-09-10T20:51:14.632276+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:51:14.632276+0000","last_undegraded":"2024-09-10T20:51:14.632276+0000","last_fullsized":"2024-09-10T20:51:14.632276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164790+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:51:07.164790+0000","last_peered":"2024-09-10T20:51:07.164790+0000","last_clean":"2024-09-10T20:51:07.164790+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:51:07.164790+0000","last_undegraded":"2024-09-10T20:51:07.164790+0000","last_fullsized":"2024-09-10T20:51:07.164790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570157+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:50:08.570157+0000","last_peered":"2024-09-10T20:50:08.570157+0000","last_clean":"2024-09-10T20:50:08.570157+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:50:08.570157+0000","last_undegraded":"2024-09-10T20:50:08.570157+0000","last_fullsized":"2024-09-10T20:50:08.570157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148551+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:51:07.148551+0000","last_peered":"2024-09-10T20:51:07.148551+0000","last_clean":"2024-09-10T20:51:07.148551+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:51:07.148551+0000","last_undegraded":"2024-09-10T20:51:07.148551+0000","last_fullsized":"2024-09-10T20:51:07.148551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564804+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:50:08.564804+0000","last_peered":"2024-09-10T20:50:08.564804+0000","last_clean":"2024-09-10T20:50:08.564804+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:50:08.564804+0000","last_undegraded":"2024-09-10T20:50:08.564804+0000","last_fullsized":"2024-09-10T20:50:08.564804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165142+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:51:07.165142+0000","last_peered":"2024-09-10T20:51:07.165142+0000","last_clean":"2024-09-10T20:51:07.165142+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:51:07.165142+0000","last_undegraded":"2024-09-10T20:51:07.165142+0000","last_fullsized":"2024-09-10T20:51:07.165142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:15.635101+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:51:15.635101+0000","last_peered":"2024-09-10T20:51:15.635101+0000","last_clean":"2024-09-10T20:51:15.635101+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:51:15.635101+0000","last_undegraded":"2024-09-10T20:51:15.635101+0000","last_fullsized":"2024-09-10T20:51:15.635101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69532,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163328+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:51:07.163328+0000","last_peered":"2024-09-10T20:51:07.163328+0000","last_clean":"2024-09-10T20:51:07.163328+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:51:07.163328+0000","last_undegraded":"2024-09-10T20:51:07.163328+0000","last_fullsized":"2024-09-10T20:51:07.163328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567504+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:50:08.567504+0000","last_peered":"2024-09-10T20:50:08.567504+0000","last_clean":"2024-09-10T20:50:08.567504+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:50:08.567504+0000","last_undegraded":"2024-09-10T20:50:08.567504+0000","last_fullsized":"2024-09-10T20:50:08.567504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164646+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:51:07.164646+0000","last_peered":"2024-09-10T20:51:07.164646+0000","last_clean":"2024-09-10T20:51:07.164646+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:51:07.164646+0000","last_undegraded":"2024-09-10T20:51:07.164646+0000","last_fullsized":"2024-09-10T20:51:07.164646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564496+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:50:08.564496+0000","last_peered":"2024-09-10T20:50:08.564496+0000","last_clean":"2024-09-10T20:50:08.564496+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:50:08.564496+0000","last_undegraded":"2024-09-10T20:50:08.564496+0000","last_fullsized":"2024-09-10T20:50:08.564496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164304+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:51:07.164304+0000","last_peered":"2024-09-10T20:51:07.164304+0000","last_clean":"2024-09-10T20:51:07.164304+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:51:07.164304+0000","last_undegraded":"2024-09-10T20:51:07.164304+0000","last_fullsized":"2024-09-10T20:51:07.164304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.636075+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:51:14.636075+0000","last_peered":"2024-09-10T20:51:14.636075+0000","last_clean":"2024-09-10T20:51:14.636075+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:51:14.636075+0000","last_undegraded":"2024-09-10T20:51:14.636075+0000","last_fullsized":"2024-09-10T20:51:14.636075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165906+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:51:07.165906+0000","last_peered":"2024-09-10T20:51:07.165906+0000","last_clean":"2024-09-10T20:51:07.165906+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:51:07.165906+0000","last_undegraded":"2024-09-10T20:51:07.165906+0000","last_fullsized":"2024-09-10T20:51:07.165906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563927+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:50:08.563927+0000","last_peered":"2024-09-10T20:50:08.563927+0000","last_clean":"2024-09-10T20:50:08.563927+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:50:08.563927+0000","last_undegraded":"2024-09-10T20:50:08.563927+0000","last_fullsized":"2024-09-10T20:50:08.563927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154725+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:51:07.154725+0000","last_peered":"2024-09-10T20:51:07.154725+0000","last_clean":"2024-09-10T20:51:07.154725+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:51:07.154725+0000","last_undegraded":"2024-09-10T20:51:07.154725+0000","last_fullsized":"2024-09-10T20:51:07.154725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566303+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:50:08.566303+0000","last_peered":"2024-09-10T20:50:08.566303+0000","last_clean":"2024-09-10T20:50:08.566303+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:50:08.566303+0000","last_undegraded":"2024-09-10T20:50:08.566303+0000","last_fullsized":"2024-09-10T20:50:08.566303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148870+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:51:07.148870+0000","last_peered":"2024-09-10T20:51:07.148870+0000","last_clean":"2024-09-10T20:51:07.148870+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:51:07.148870+0000","last_undegraded":"2024-09-10T20:51:07.148870+0000","last_fullsized":"2024-09-10T20:51:07.148870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569541+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:50:08.569541+0000","last_peered":"2024-09-10T20:50:08.569541+0000","last_clean":"2024-09-10T20:50:08.569541+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:50:08.569541+0000","last_undegraded":"2024-09-10T20:50:08.569541+0000","last_fullsized":"2024-09-10T20:50:08.569541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162002+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:51:07.162002+0000","last_peered":"2024-09-10T20:51:07.162002+0000","last_clean":"2024-09-10T20:51:07.162002+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:51:07.162002+0000","last_undegraded":"2024-09-10T20:51:07.162002+0000","last_fullsized":"2024-09-10T20:51:07.162002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564958+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:50:08.564958+0000","last_peered":"2024-09-10T20:50:08.564958+0000","last_clean":"2024-09-10T20:50:08.564958+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:50:08.564958+0000","last_undegraded":"2024-09-10T20:50:08.564958+0000","last_fullsized":"2024-09-10T20:50:08.564958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165653+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:51:07.165653+0000","last_peered":"2024-09-10T20:51:07.165653+0000","last_clean":"2024-09-10T20:51:07.165653+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:51:07.165653+0000","last_undegraded":"2024-09-10T20:51:07.165653+0000","last_fullsized":"2024-09-10T20:51:07.165653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568133+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:50:08.568133+0000","last_peered":"2024-09-10T20:50:08.568133+0000","last_clean":"2024-09-10T20:50:08.568133+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:50:08.568133+0000","last_undegraded":"2024-09-10T20:50:08.568133+0000","last_fullsized":"2024-09-10T20:50:08.568133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165007+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:51:07.165007+0000","last_peered":"2024-09-10T20:51:07.165007+0000","last_clean":"2024-09-10T20:51:07.165007+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:51:07.165007+0000","last_undegraded":"2024-09-10T20:51:07.165007+0000","last_fullsized":"2024-09-10T20:51:07.165007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569651+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:50:08.569651+0000","last_peered":"2024-09-10T20:50:08.569651+0000","last_clean":"2024-09-10T20:50:08.569651+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:50:08.569651+0000","last_undegraded":"2024-09-10T20:50:08.569651+0000","last_fullsized":"2024-09-10T20:50:08.569651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568872+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:50:08.568872+0000","last_peered":"2024-09-10T20:50:08.568872+0000","last_clean":"2024-09-10T20:50:08.568872+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:50:08.568872+0000","last_undegraded":"2024-09-10T20:50:08.568872+0000","last_fullsized":"2024-09-10T20:50:08.568872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156364+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:51:07.156364+0000","last_peered":"2024-09-10T20:51:07.156364+0000","last_clean":"2024-09-10T20:51:07.156364+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:51:07.156364+0000","last_undegraded":"2024-09-10T20:51:07.156364+0000","last_fullsized":"2024-09-10T20:51:07.156364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569502+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:50:08.569502+0000","last_peered":"2024-09-10T20:50:08.569502+0000","last_clean":"2024-09-10T20:50:08.569502+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:50:08.569502+0000","last_undegraded":"2024-09-10T20:50:08.569502+0000","last_fullsized":"2024-09-10T20:50:08.569502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.147300+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:51:07.147300+0000","last_peered":"2024-09-10T20:51:07.147300+0000","last_clean":"2024-09-10T20:51:07.147300+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:51:07.147300+0000","last_undegraded":"2024-09-10T20:51:07.147300+0000","last_fullsized":"2024-09-10T20:51:07.147300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.635048+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:51:14.635048+0000","last_peered":"2024-09-10T20:51:14.635048+0000","last_clean":"2024-09-10T20:51:14.635048+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:51:14.635048+0000","last_undegraded":"2024-09-10T20:51:14.635048+0000","last_fullsized":"2024-09-10T20:51:14.635048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149046+0000","last_change":"2024-09-10T20:50:08.569711+0000","last_active":"2024-09-10T20:51:07.149046+0000","last_peered":"2024-09-10T20:51:07.149046+0000","last_clean":"2024-09-10T20:51:07.149046+0000","last_became_active":"2024-09-10T20:50:08.569348+0000","last_became_peered":"2024-09-10T20:50:08.569348+0000","last_unstale":"2024-09-10T20:51:07.149046+0000","last_undegraded":"2024-09-10T20:51:07.149046+0000","last_fullsized":"2024-09-10T20:51:07.149046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570006+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:50:08.570006+0000","last_peered":"2024-09-10T20:50:08.570006+0000","last_clean":"2024-09-10T20:50:08.570006+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:50:08.570006+0000","last_undegraded":"2024-09-10T20:50:08.570006+0000","last_fullsized":"2024-09-10T20:50:08.570006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152951+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:51:07.152951+0000","last_peered":"2024-09-10T20:51:07.152951+0000","last_clean":"2024-09-10T20:51:07.152951+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:51:07.152951+0000","last_undegraded":"2024-09-10T20:51:07.152951+0000","last_fullsized":"2024-09-10T20:51:07.152951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563780+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:50:08.563780+0000","last_peered":"2024-09-10T20:50:08.563780+0000","last_clean":"2024-09-10T20:50:08.563780+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:50:08.563780+0000","last_undegraded":"2024-09-10T20:50:08.563780+0000","last_fullsized":"2024-09-10T20:50:08.563780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157700+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:51:07.157700+0000","last_peered":"2024-09-10T20:51:07.157700+0000","last_clean":"2024-09-10T20:51:07.157700+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:51:07.157700+0000","last_undegraded":"2024-09-10T20:51:07.157700+0000","last_fullsized":"2024-09-10T20:51:07.157700+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566052+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:50:08.566052+0000","last_peered":"2024-09-10T20:50:08.566052+0000","last_clean":"2024-09-10T20:50:08.566052+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:50:08.566052+0000","last_undegraded":"2024-09-10T20:50:08.566052+0000","last_fullsized":"2024-09-10T20:50:08.566052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148689+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:51:07.148689+0000","last_peered":"2024-09-10T20:51:07.148689+0000","last_clean":"2024-09-10T20:51:07.148689+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:51:07.148689+0000","last_undegraded":"2024-09-10T20:51:07.148689+0000","last_fullsized":"2024-09-10T20:51:07.148689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.432509+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:51:07.432509+0000","last_peered":"2024-09-10T20:51:07.432509+0000","last_clean":"2024-09-10T20:51:07.432509+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:51:07.432509+0000","last_undegraded":"2024-09-10T20:51:07.432509+0000","last_fullsized":"2024-09-10T20:51:07.432509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158981+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:51:07.158981+0000","last_peered":"2024-09-10T20:51:07.158981+0000","last_clean":"2024-09-10T20:51:07.158981+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:51:07.158981+0000","last_undegraded":"2024-09-10T20:51:07.158981+0000","last_fullsized":"2024-09-10T20:51:07.158981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569278+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:50:08.569278+0000","last_peered":"2024-09-10T20:50:08.569278+0000","last_clean":"2024-09-10T20:50:08.569278+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:50:08.569278+0000","last_undegraded":"2024-09-10T20:50:08.569278+0000","last_fullsized":"2024-09-10T20:50:08.569278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150190+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:51:07.150190+0000","last_peered":"2024-09-10T20:51:07.150190+0000","last_clean":"2024-09-10T20:51:07.150190+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:51:07.150190+0000","last_undegraded":"2024-09-10T20:51:07.150190+0000","last_fullsized":"2024-09-10T20:51:07.150190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.571450+0000","last_change":"2024-09-10T20:50:08.571340+0000","last_active":"2024-09-10T20:50:08.571450+0000","last_peered":"2024-09-10T20:50:08.571450+0000","last_clean":"2024-09-10T20:50:08.571450+0000","last_became_active":"2024-09-10T20:50:08.567038+0000","last_became_peered":"2024-09-10T20:50:08.567038+0000","last_unstale":"2024-09-10T20:50:08.571450+0000","last_undegraded":"2024-09-10T20:50:08.571450+0000","last_fullsized":"2024-09-10T20:50:08.571450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:56.536271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.140458+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:51:07.140458+0000","last_peered":"2024-09-10T20:51:07.140458+0000","last_clean":"2024-09-10T20:51:07.140458+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:51:07.140458+0000","last_undegraded":"2024-09-10T20:51:07.140458+0000","last_fullsized":"2024-09-10T20:51:07.140458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568779+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:50:08.568779+0000","last_peered":"2024-09-10T20:50:08.568779+0000","last_clean":"2024-09-10T20:50:08.568779+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:50:08.568779+0000","last_undegraded":"2024-09-10T20:50:08.568779+0000","last_fullsized":"2024-09-10T20:50:08.568779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150494+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:51:07.150494+0000","last_peered":"2024-09-10T20:51:07.150494+0000","last_clean":"2024-09-10T20:51:07.150494+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:51:07.150494+0000","last_undegraded":"2024-09-10T20:51:07.150494+0000","last_fullsized":"2024-09-10T20:51:07.150494+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567602+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:50:08.567602+0000","last_peered":"2024-09-10T20:50:08.567602+0000","last_clean":"2024-09-10T20:50:08.567602+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:50:08.567602+0000","last_undegraded":"2024-09-10T20:50:08.567602+0000","last_fullsized":"2024-09-10T20:50:08.567602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156218+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:51:07.156218+0000","last_peered":"2024-09-10T20:51:07.156218+0000","last_clean":"2024-09-10T20:51:07.156218+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:51:07.156218+0000","last_undegraded":"2024-09-10T20:51:07.156218+0000","last_fullsized":"2024-09-10T20:51:07.156218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566615+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:50:08.566615+0000","last_peered":"2024-09-10T20:50:08.566615+0000","last_clean":"2024-09-10T20:50:08.566615+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:50:08.566615+0000","last_undegraded":"2024-09-10T20:50:08.566615+0000","last_fullsized":"2024-09-10T20:50:08.566615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164761+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:51:07.164761+0000","last_peered":"2024-09-10T20:51:07.164761+0000","last_clean":"2024-09-10T20:51:07.164761+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:51:07.164761+0000","last_undegraded":"2024-09-10T20:51:07.164761+0000","last_fullsized":"2024-09-10T20:51:07.164761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.160537+0000","last_change":"2024-09-10T20:50:08.570537+0000","last_active":"2024-09-10T20:51:07.160537+0000","last_peered":"2024-09-10T20:51:07.160537+0000","last_clean":"2024-09-10T20:51:07.160537+0000","last_became_active":"2024-09-10T20:50:08.570083+0000","last_became_peered":"2024-09-10T20:50:08.570083+0000","last_unstale":"2024-09-10T20:51:07.160537+0000","last_undegraded":"2024-09-10T20:51:07.160537+0000","last_fullsized":"2024-09-10T20:51:07.160537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:15.834461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.573406+0000","last_change":"2024-09-10T20:50:08.572886+0000","last_active":"2024-09-10T20:50:08.573406+0000","last_peered":"2024-09-10T20:50:08.573406+0000","last_clean":"2024-09-10T20:50:08.573406+0000","last_became_active":"2024-09-10T20:50:08.568973+0000","last_became_peered":"2024-09-10T20:50:08.568973+0000","last_unstale":"2024-09-10T20:50:08.573406+0000","last_undegraded":"2024-09-10T20:50:08.573406+0000","last_fullsized":"2024-09-10T20:50:08.573406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:09.903383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164671+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:51:07.164671+0000","last_peered":"2024-09-10T20:51:07.164671+0000","last_clean":"2024-09-10T20:51:07.164671+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:51:07.164671+0000","last_undegraded":"2024-09-10T20:51:07.164671+0000","last_fullsized":"2024-09-10T20:51:07.164671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565963+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:50:08.565963+0000","last_peered":"2024-09-10T20:50:08.565963+0000","last_clean":"2024-09-10T20:50:08.565963+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:50:08.565963+0000","last_undegraded":"2024-09-10T20:50:08.565963+0000","last_fullsized":"2024-09-10T20:50:08.565963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164885+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:51:07.164885+0000","last_peered":"2024-09-10T20:51:07.164885+0000","last_clean":"2024-09-10T20:51:07.164885+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:51:07.164885+0000","last_undegraded":"2024-09-10T20:51:07.164885+0000","last_fullsized":"2024-09-10T20:51:07.164885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569349+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:50:08.569349+0000","last_peered":"2024-09-10T20:50:08.569349+0000","last_clean":"2024-09-10T20:50:08.569349+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:50:08.569349+0000","last_undegraded":"2024-09-10T20:50:08.569349+0000","last_fullsized":"2024-09-10T20:50:08.569349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155806+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:51:07.155806+0000","last_peered":"2024-09-10T20:51:07.155806+0000","last_clean":"2024-09-10T20:51:07.155806+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:51:07.155806+0000","last_undegraded":"2024-09-10T20:51:07.155806+0000","last_fullsized":"2024-09-10T20:51:07.155806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563549+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:50:08.563549+0000","last_peered":"2024-09-10T20:50:08.563549+0000","last_clean":"2024-09-10T20:50:08.563549+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:50:08.563549+0000","last_undegraded":"2024-09-10T20:50:08.563549+0000","last_fullsized":"2024-09-10T20:50:08.563549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74764,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":400,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":223510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":394113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1056049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":394269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":986340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":393738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":986191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":395098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":394049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":462592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":463063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":395009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:51:17.372 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T20:51:17.373 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- 172.21.15.67:0/2412004072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741029f0 msgr2=0x7f0774102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 --2- 172.21.15.67:0/2412004072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741029f0 0x7f0774102e70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0764009cd0 tx=0x7f076402a8e0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- 172.21.15.67:0/2412004072 shutdown_connections 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 --2- 172.21.15.67:0/2412004072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741033b0 0x7f0774109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 --2- 172.21.15.67:0/2412004072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741029f0 0x7f0774102e70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 --2- 172.21.15.67:0/2412004072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741018a0 0x7f0774101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- 172.21.15.67:0/2412004072 >> 172.21.15.67:0/2412004072 conn(0x7f07740fd180 msgr2=0x7f07740ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- 172.21.15.67:0/2412004072 shutdown_connections 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- 172.21.15.67:0/2412004072 wait complete. 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 Processor -- start 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 -- start start 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.510+0000 7f077ad16640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 0x7f0774198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 0x7f07741993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f077410d4f0 con 0x7f07741033b0 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f077410d370 con 0x7f07741018a0 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f077410d670 con 0x7f07741029f0 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36392/0 (socket says 172.21.15.67:36392) 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 -- 172.21.15.67:0/1487081227 learned_addr learned my addr 172.21.15.67:0/1487081227 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0773fff640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 0x7f07741993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0778ab2640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 0x7f0774198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 -- 172.21.15.67:0/1487081227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 msgr2=0x7f07741993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 0x7f07741993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 -- 172.21.15.67:0/1487081227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 msgr2=0x7f0774198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 0x7f0774198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 -- 172.21.15.67:0/1487081227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077419a8a0 con 0x7f07741033b0 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0773fff640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 0x7f07741993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0778ab2640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 0x7f0774198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:17.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f07792b3640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f076c00d750 tx=0x7f076c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c017070 con 0x7f07741033b0 2024-09-10T20:51:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f076c0054d0 con 0x7f07741033b0 2024-09-10T20:51:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077419ab90 con 0x7f07741033b0 2024-09-10T20:51:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.511+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c004c60 con 0x7f07741033b0 2024-09-10T20:51:17.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.512+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07741a1260 con 0x7f07741033b0 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.512+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07741a1430 con 0x7f07741033b0 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.514+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f076c004e00 con 0x7f07741033b0 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.515+0000 7f0771ffb640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 0x7f07600b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.515+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f076c0e5be0 con 0x7f07741033b0 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.515+0000 7f0778ab2640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 0x7f07600b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:17.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.515+0000 7f0778ab2640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 0x7f07600b7830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f075c009b40 tx=0x7f075c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:17.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.517+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f076c0ac970 con 0x7f07741033b0 2024-09-10T20:51:17.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.700+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 --> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f077406aa90 con 0x7f07600b5370 2024-09-10T20:51:17.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.705+0000 7f0771ffb640 1 -- 172.21.15.67:0/1487081227 <== mgr.14150 v2:172.21.15.67:6800/1712569035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258821 (secure 0 0 0) 0x7f077406aa90 con 0x7f07600b5370 2024-09-10T20:51:17.713 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:17.714 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 msgr2=0x7f07600b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 0x7f07600b7830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f075c009b40 tx=0x7f075c005e50 comp rx=0 tx=0).stop 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 msgr2=0x7f0774199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f076c00d750 tx=0x7f076c00dc10 comp rx=0 tx=0).stop 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 shutdown_connections 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07741033b0 0x7f0774199fe0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07600b5370 0x7f07600b7830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07741029f0 0x7f07741993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 --2- 172.21.15.67:0/1487081227 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07741018a0 0x7f0774198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 >> 172.21.15.67:0/1487081227 conn(0x7f07740fd180 msgr2=0x7f077406a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 shutdown_connections 2024-09-10T20:51:17.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:17.708+0000 7f077ad16640 1 -- 172.21.15.67:0/1487081227 wait complete. 2024-09-10T20:51:17.724 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T20:51:16.783435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665366,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":717,"num_read_kb":464,"num_write":305,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":381700,"kb_used_data":11652,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124560124,"statfs":{"total":1151940427776,"available":1151549566976,"internally_reserved":0,"allocated":11931648,"data_stored":6714860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9013,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":59,"num_write":18,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002705"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.440515+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.440203+0000","last_became_peered":"2024-09-10T20:49:25.440203+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:49.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154148+0000","last_change":"2024-09-10T20:49:25.435533+0000","last_active":"2024-09-10T20:51:07.154148+0000","last_peered":"2024-09-10T20:51:07.154148+0000","last_clean":"2024-09-10T20:51:07.154148+0000","last_became_active":"2024-09-10T20:49:25.435119+0000","last_became_peered":"2024-09-10T20:49:25.435119+0000","last_unstale":"2024-09-10T20:51:07.154148+0000","last_undegraded":"2024-09-10T20:51:07.154148+0000","last_fullsized":"2024-09-10T20:51:07.154148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:16.360881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163916+0000","last_change":"2024-09-10T20:49:25.440775+0000","last_active":"2024-09-10T20:51:07.163916+0000","last_peered":"2024-09-10T20:51:07.163916+0000","last_clean":"2024-09-10T20:51:07.163916+0000","last_became_active":"2024-09-10T20:49:25.440418+0000","last_became_peered":"2024-09-10T20:49:25.440418+0000","last_unstale":"2024-09-10T20:51:07.163916+0000","last_undegraded":"2024-09-10T20:51:07.163916+0000","last_fullsized":"2024-09-10T20:51:07.163916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:53:06.897533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.138716+0000","last_change":"2024-09-10T20:49:25.426877+0000","last_active":"2024-09-10T20:51:07.138716+0000","last_peered":"2024-09-10T20:51:07.138716+0000","last_clean":"2024-09-10T20:51:07.138716+0000","last_became_active":"2024-09-10T20:49:25.426525+0000","last_became_peered":"2024-09-10T20:49:25.426525+0000","last_unstale":"2024-09-10T20:51:07.138716+0000","last_undegraded":"2024-09-10T20:51:07.138716+0000","last_fullsized":"2024-09-10T20:51:07.138716+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:31.283224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150162+0000","last_change":"2024-09-10T20:50:08.570682+0000","last_active":"2024-09-10T20:51:07.150162+0000","last_peered":"2024-09-10T20:51:07.150162+0000","last_clean":"2024-09-10T20:51:07.150162+0000","last_became_active":"2024-09-10T20:50:08.570099+0000","last_became_peered":"2024-09-10T20:50:08.570099+0000","last_unstale":"2024-09-10T20:51:07.150162+0000","last_undegraded":"2024-09-10T20:51:07.150162+0000","last_fullsized":"2024-09-10T20:51:07.150162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:10:09.651291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150997+0000","last_change":"2024-09-10T20:49:25.441562+0000","last_active":"2024-09-10T20:51:07.150997+0000","last_peered":"2024-09-10T20:51:07.150997+0000","last_clean":"2024-09-10T20:51:07.150997+0000","last_became_active":"2024-09-10T20:49:25.441209+0000","last_became_peered":"2024-09-10T20:49:25.441209+0000","last_unstale":"2024-09-10T20:51:07.150997+0000","last_undegraded":"2024-09-10T20:51:07.150997+0000","last_fullsized":"2024-09-10T20:51:07.150997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:40.537364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165630+0000","last_change":"2024-09-10T20:49:25.435231+0000","last_active":"2024-09-10T20:51:07.165630+0000","last_peered":"2024-09-10T20:51:07.165630+0000","last_clean":"2024-09-10T20:51:07.165630+0000","last_became_active":"2024-09-10T20:49:25.434514+0000","last_became_peered":"2024-09-10T20:49:25.434514+0000","last_unstale":"2024-09-10T20:51:07.165630+0000","last_undegraded":"2024-09-10T20:51:07.165630+0000","last_fullsized":"2024-09-10T20:51:07.165630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:38.410905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162457+0000","last_change":"2024-09-10T20:49:25.431329+0000","last_active":"2024-09-10T20:51:07.162457+0000","last_peered":"2024-09-10T20:51:07.162457+0000","last_clean":"2024-09-10T20:51:07.162457+0000","last_became_active":"2024-09-10T20:49:25.430998+0000","last_became_peered":"2024-09-10T20:49:25.430998+0000","last_unstale":"2024-09-10T20:51:07.162457+0000","last_undegraded":"2024-09-10T20:51:07.162457+0000","last_fullsized":"2024-09-10T20:51:07.162457+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:02:11.390159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.167069+0000","last_change":"2024-09-10T20:49:25.440678+0000","last_active":"2024-09-10T20:51:07.167069+0000","last_peered":"2024-09-10T20:51:07.167069+0000","last_clean":"2024-09-10T20:51:07.167069+0000","last_became_active":"2024-09-10T20:49:25.438521+0000","last_became_peered":"2024-09-10T20:49:25.438521+0000","last_unstale":"2024-09-10T20:51:07.167069+0000","last_undegraded":"2024-09-10T20:51:07.167069+0000","last_fullsized":"2024-09-10T20:51:07.167069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:19.653551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149872+0000","last_change":"2024-09-10T20:49:25.434052+0000","last_active":"2024-09-10T20:51:07.149872+0000","last_peered":"2024-09-10T20:51:07.149872+0000","last_clean":"2024-09-10T20:51:07.149872+0000","last_became_active":"2024-09-10T20:49:25.433649+0000","last_became_peered":"2024-09-10T20:49:25.433649+0000","last_unstale":"2024-09-10T20:51:07.149872+0000","last_undegraded":"2024-09-10T20:51:07.149872+0000","last_fullsized":"2024-09-10T20:51:07.149872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:34:04.346102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164853+0000","last_change":"2024-09-10T20:49:25.444687+0000","last_active":"2024-09-10T20:51:07.164853+0000","last_peered":"2024-09-10T20:51:07.164853+0000","last_clean":"2024-09-10T20:51:07.164853+0000","last_became_active":"2024-09-10T20:49:25.444368+0000","last_became_peered":"2024-09-10T20:49:25.444368+0000","last_unstale":"2024-09-10T20:51:07.164853+0000","last_undegraded":"2024-09-10T20:51:07.164853+0000","last_fullsized":"2024-09-10T20:51:07.164853+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:58.313400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155162+0000","last_change":"2024-09-10T20:50:08.567682+0000","last_active":"2024-09-10T20:51:07.155162+0000","last_peered":"2024-09-10T20:51:07.155162+0000","last_clean":"2024-09-10T20:51:07.155162+0000","last_became_active":"2024-09-10T20:50:08.567302+0000","last_became_peered":"2024-09-10T20:50:08.567302+0000","last_unstale":"2024-09-10T20:51:07.155162+0000","last_undegraded":"2024-09-10T20:51:07.155162+0000","last_fullsized":"2024-09-10T20:51:07.155162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:59.818786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155285+0000","last_change":"2024-09-10T20:49:25.430484+0000","last_active":"2024-09-10T20:51:07.155285+0000","last_peered":"2024-09-10T20:51:07.155285+0000","last_clean":"2024-09-10T20:51:07.155285+0000","last_became_active":"2024-09-10T20:49:25.430170+0000","last_became_peered":"2024-09-10T20:49:25.430170+0000","last_unstale":"2024-09-10T20:51:07.155285+0000","last_undegraded":"2024-09-10T20:51:07.155285+0000","last_fullsized":"2024-09-10T20:51:07.155285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:45:19.858334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153616+0000","last_change":"2024-09-10T20:49:25.436053+0000","last_active":"2024-09-10T20:51:07.153616+0000","last_peered":"2024-09-10T20:51:07.153616+0000","last_clean":"2024-09-10T20:51:07.153616+0000","last_became_active":"2024-09-10T20:49:25.435673+0000","last_became_peered":"2024-09-10T20:49:25.435673+0000","last_unstale":"2024-09-10T20:51:07.153616+0000","last_undegraded":"2024-09-10T20:51:07.153616+0000","last_fullsized":"2024-09-10T20:51:07.153616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:17:44.921559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152130+0000","last_change":"2024-09-10T20:49:25.431789+0000","last_active":"2024-09-10T20:51:07.152130+0000","last_peered":"2024-09-10T20:51:07.152130+0000","last_clean":"2024-09-10T20:51:07.152130+0000","last_became_active":"2024-09-10T20:49:25.431482+0000","last_became_peered":"2024-09-10T20:49:25.431482+0000","last_unstale":"2024-09-10T20:51:07.152130+0000","last_undegraded":"2024-09-10T20:51:07.152130+0000","last_fullsized":"2024-09-10T20:51:07.152130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:52:03.328752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166654+0000","last_change":"2024-09-10T20:49:25.439083+0000","last_active":"2024-09-10T20:51:07.166654+0000","last_peered":"2024-09-10T20:51:07.166654+0000","last_clean":"2024-09-10T20:51:07.166654+0000","last_became_active":"2024-09-10T20:49:25.438665+0000","last_became_peered":"2024-09-10T20:49:25.438665+0000","last_unstale":"2024-09-10T20:51:07.166654+0000","last_undegraded":"2024-09-10T20:51:07.166654+0000","last_fullsized":"2024-09-10T20:51:07.166654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:48:44.097609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.168416+0000","last_change":"2024-09-10T20:49:25.437751+0000","last_active":"2024-09-10T20:51:07.168416+0000","last_peered":"2024-09-10T20:51:07.168416+0000","last_clean":"2024-09-10T20:51:07.168416+0000","last_became_active":"2024-09-10T20:49:25.437382+0000","last_became_peered":"2024-09-10T20:49:25.437382+0000","last_unstale":"2024-09-10T20:51:07.168416+0000","last_undegraded":"2024-09-10T20:51:07.168416+0000","last_fullsized":"2024-09-10T20:51:07.168416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:06.427203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154544+0000","last_change":"2024-09-10T20:49:25.437915+0000","last_active":"2024-09-10T20:51:07.154544+0000","last_peered":"2024-09-10T20:51:07.154544+0000","last_clean":"2024-09-10T20:51:07.154544+0000","last_became_active":"2024-09-10T20:49:25.437506+0000","last_became_peered":"2024-09-10T20:49:25.437506+0000","last_unstale":"2024-09-10T20:51:07.154544+0000","last_undegraded":"2024-09-10T20:51:07.154544+0000","last_fullsized":"2024-09-10T20:51:07.154544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:19.224493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149739+0000","last_change":"2024-09-10T20:49:25.420868+0000","last_active":"2024-09-10T20:51:07.149739+0000","last_peered":"2024-09-10T20:51:07.149739+0000","last_clean":"2024-09-10T20:51:07.149739+0000","last_became_active":"2024-09-10T20:49:25.420561+0000","last_became_peered":"2024-09-10T20:49:25.420561+0000","last_unstale":"2024-09-10T20:51:07.149739+0000","last_undegraded":"2024-09-10T20:51:07.149739+0000","last_fullsized":"2024-09-10T20:51:07.149739+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:44:16.399706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151719+0000","last_change":"2024-09-10T20:49:25.428997+0000","last_active":"2024-09-10T20:51:07.151719+0000","last_peered":"2024-09-10T20:51:07.151719+0000","last_clean":"2024-09-10T20:51:07.151719+0000","last_became_active":"2024-09-10T20:49:25.428672+0000","last_became_peered":"2024-09-10T20:49:25.428672+0000","last_unstale":"2024-09-10T20:51:07.151719+0000","last_undegraded":"2024-09-10T20:51:07.151719+0000","last_fullsized":"2024-09-10T20:51:07.151719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:06.233511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164817+0000","last_change":"2024-09-10T20:49:25.431804+0000","last_active":"2024-09-10T20:51:07.164817+0000","last_peered":"2024-09-10T20:51:07.164817+0000","last_clean":"2024-09-10T20:51:07.164817+0000","last_became_active":"2024-09-10T20:49:25.430589+0000","last_became_peered":"2024-09-10T20:49:25.430589+0000","last_unstale":"2024-09-10T20:51:07.164817+0000","last_undegraded":"2024-09-10T20:51:07.164817+0000","last_fullsized":"2024-09-10T20:51:07.164817+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:48.881941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.166699+0000","last_change":"2024-09-10T20:49:25.440527+0000","last_active":"2024-09-10T20:51:07.166699+0000","last_peered":"2024-09-10T20:51:07.166699+0000","last_clean":"2024-09-10T20:51:07.166699+0000","last_became_active":"2024-09-10T20:49:25.438971+0000","last_became_peered":"2024-09-10T20:49:25.438971+0000","last_unstale":"2024-09-10T20:51:07.166699+0000","last_undegraded":"2024-09-10T20:51:07.166699+0000","last_fullsized":"2024-09-10T20:51:07.166699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:54.181974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.159931+0000","last_change":"2024-09-10T20:49:25.427354+0000","last_active":"2024-09-10T20:51:07.159931+0000","last_peered":"2024-09-10T20:51:07.159931+0000","last_clean":"2024-09-10T20:51:07.159931+0000","last_became_active":"2024-09-10T20:49:25.427049+0000","last_became_peered":"2024-09-10T20:49:25.427049+0000","last_unstale":"2024-09-10T20:51:07.159931+0000","last_undegraded":"2024-09-10T20:51:07.159931+0000","last_fullsized":"2024-09-10T20:51:07.159931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:58.097670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158143+0000","last_change":"2024-09-10T20:49:25.428039+0000","last_active":"2024-09-10T20:51:07.158143+0000","last_peered":"2024-09-10T20:51:07.158143+0000","last_clean":"2024-09-10T20:51:07.158143+0000","last_became_active":"2024-09-10T20:49:25.427726+0000","last_became_peered":"2024-09-10T20:49:25.427726+0000","last_unstale":"2024-09-10T20:51:07.158143+0000","last_undegraded":"2024-09-10T20:51:07.158143+0000","last_fullsized":"2024-09-10T20:51:07.158143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:56.764487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.153964+0000","last_change":"2024-09-10T20:49:25.425879+0000","last_active":"2024-09-10T20:51:07.153964+0000","last_peered":"2024-09-10T20:51:07.153964+0000","last_clean":"2024-09-10T20:51:07.153964+0000","last_became_active":"2024-09-10T20:49:25.425574+0000","last_became_peered":"2024-09-10T20:49:25.425574+0000","last_unstale":"2024-09-10T20:51:07.153964+0000","last_undegraded":"2024-09-10T20:51:07.153964+0000","last_fullsized":"2024-09-10T20:51:07.153964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:33.844654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152357+0000","last_change":"2024-09-10T20:49:25.437826+0000","last_active":"2024-09-10T20:51:07.152357+0000","last_peered":"2024-09-10T20:51:07.152357+0000","last_clean":"2024-09-10T20:51:07.152357+0000","last_became_active":"2024-09-10T20:49:25.437485+0000","last_became_peered":"2024-09-10T20:49:25.437485+0000","last_unstale":"2024-09-10T20:51:07.152357+0000","last_undegraded":"2024-09-10T20:51:07.152357+0000","last_fullsized":"2024-09-10T20:51:07.152357+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:48.394811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.151244+0000","last_change":"2024-09-10T20:49:25.425640+0000","last_active":"2024-09-10T20:51:07.151244+0000","last_peered":"2024-09-10T20:51:07.151244+0000","last_clean":"2024-09-10T20:51:07.151244+0000","last_became_active":"2024-09-10T20:49:25.424676+0000","last_became_peered":"2024-09-10T20:49:25.424676+0000","last_unstale":"2024-09-10T20:51:07.151244+0000","last_undegraded":"2024-09-10T20:51:07.151244+0000","last_fullsized":"2024-09-10T20:51:07.151244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:34.328766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150629+0000","last_change":"2024-09-10T20:49:25.421305+0000","last_active":"2024-09-10T20:51:07.150629+0000","last_peered":"2024-09-10T20:51:07.150629+0000","last_clean":"2024-09-10T20:51:07.150629+0000","last_became_active":"2024-09-10T20:49:25.420998+0000","last_became_peered":"2024-09-10T20:49:25.420998+0000","last_unstale":"2024-09-10T20:51:07.150629+0000","last_undegraded":"2024-09-10T20:51:07.150629+0000","last_fullsized":"2024-09-10T20:51:07.150629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:36.845996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149268+0000","last_change":"2024-09-10T20:49:25.424740+0000","last_active":"2024-09-10T20:51:07.149268+0000","last_peered":"2024-09-10T20:51:07.149268+0000","last_clean":"2024-09-10T20:51:07.149268+0000","last_became_active":"2024-09-10T20:49:25.424376+0000","last_became_peered":"2024-09-10T20:49:25.424376+0000","last_unstale":"2024-09-10T20:51:07.149268+0000","last_undegraded":"2024-09-10T20:51:07.149268+0000","last_fullsized":"2024-09-10T20:51:07.149268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:49.764811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150258+0000","last_change":"2024-09-10T20:49:25.424185+0000","last_active":"2024-09-10T20:51:07.150258+0000","last_peered":"2024-09-10T20:51:07.150258+0000","last_clean":"2024-09-10T20:51:07.150258+0000","last_became_active":"2024-09-10T20:49:25.423689+0000","last_became_peered":"2024-09-10T20:49:25.423689+0000","last_unstale":"2024-09-10T20:51:07.150258+0000","last_undegraded":"2024-09-10T20:51:07.150258+0000","last_fullsized":"2024-09-10T20:51:07.150258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:46.863566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.145506+0000","last_change":"2024-09-10T20:49:25.422381+0000","last_active":"2024-09-10T20:51:07.145506+0000","last_peered":"2024-09-10T20:51:07.145506+0000","last_clean":"2024-09-10T20:51:07.145506+0000","last_became_active":"2024-09-10T20:49:25.422079+0000","last_became_peered":"2024-09-10T20:49:25.422079+0000","last_unstale":"2024-09-10T20:51:07.145506+0000","last_undegraded":"2024-09-10T20:51:07.145506+0000","last_fullsized":"2024-09-10T20:51:07.145506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:59.477239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150943+0000","last_change":"2024-09-10T20:49:25.432918+0000","last_active":"2024-09-10T20:51:07.150943+0000","last_peered":"2024-09-10T20:51:07.150943+0000","last_clean":"2024-09-10T20:51:07.150943+0000","last_became_active":"2024-09-10T20:49:25.432315+0000","last_became_peered":"2024-09-10T20:49:25.432315+0000","last_unstale":"2024-09-10T20:51:07.150943+0000","last_undegraded":"2024-09-10T20:51:07.150943+0000","last_fullsized":"2024-09-10T20:51:07.150943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:52.761438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150204+0000","last_change":"2024-09-10T20:49:25.426980+0000","last_active":"2024-09-10T20:51:07.150204+0000","last_peered":"2024-09-10T20:51:07.150204+0000","last_clean":"2024-09-10T20:51:07.150204+0000","last_became_active":"2024-09-10T20:49:25.426674+0000","last_became_peered":"2024-09-10T20:49:25.426674+0000","last_unstale":"2024-09-10T20:51:07.150204+0000","last_undegraded":"2024-09-10T20:51:07.150204+0000","last_fullsized":"2024-09-10T20:51:07.150204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:17.660790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":134,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.633057+0000","last_change":"2024-09-10T20:49:23.414002+0000","last_active":"2024-09-10T20:51:14.633057+0000","last_peered":"2024-09-10T20:51:14.633057+0000","last_clean":"2024-09-10T20:51:14.633057+0000","last_became_active":"2024-09-10T20:49:23.413528+0000","last_became_peered":"2024-09-10T20:49:23.413528+0000","last_unstale":"2024-09-10T20:51:14.633057+0000","last_undegraded":"2024-09-10T20:51:14.633057+0000","last_fullsized":"2024-09-10T20:51:14.633057+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.465859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1321,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157230+0000","last_change":"2024-09-10T20:50:08.570456+0000","last_active":"2024-09-10T20:51:07.157230+0000","last_peered":"2024-09-10T20:51:07.157230+0000","last_clean":"2024-09-10T20:51:07.157230+0000","last_became_active":"2024-09-10T20:50:08.570104+0000","last_became_peered":"2024-09-10T20:50:08.570104+0000","last_unstale":"2024-09-10T20:51:07.157230+0000","last_undegraded":"2024-09-10T20:51:07.157230+0000","last_fullsized":"2024-09-10T20:51:07.157230+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:34:38.998765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.561580+0000","last_change":"2024-09-10T20:49:23.417933+0000","last_active":"2024-09-10T20:50:08.561580+0000","last_peered":"2024-09-10T20:50:08.561580+0000","last_clean":"2024-09-10T20:50:08.561580+0000","last_became_active":"2024-09-10T20:49:23.417610+0000","last_became_peered":"2024-09-10T20:49:23.417610+0000","last_unstale":"2024-09-10T20:50:08.561580+0000","last_undegraded":"2024-09-10T20:50:08.561580+0000","last_fullsized":"2024-09-10T20:50:08.561580+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:36.706557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568874+0000","last_change":"2024-09-10T20:49:23.406748+0000","last_active":"2024-09-10T20:50:08.568874+0000","last_peered":"2024-09-10T20:50:08.568874+0000","last_clean":"2024-09-10T20:50:08.568874+0000","last_became_active":"2024-09-10T20:49:23.406397+0000","last_became_peered":"2024-09-10T20:49:23.406397+0000","last_unstale":"2024-09-10T20:50:08.568874+0000","last_undegraded":"2024-09-10T20:50:08.568874+0000","last_fullsized":"2024-09-10T20:50:08.568874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:39.025151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156000+0000","last_change":"2024-09-10T20:49:25.425424+0000","last_active":"2024-09-10T20:51:07.156000+0000","last_peered":"2024-09-10T20:51:07.156000+0000","last_clean":"2024-09-10T20:51:07.156000+0000","last_became_active":"2024-09-10T20:49:25.425111+0000","last_became_peered":"2024-09-10T20:49:25.425111+0000","last_unstale":"2024-09-10T20:51:07.156000+0000","last_undegraded":"2024-09-10T20:51:07.156000+0000","last_fullsized":"2024-09-10T20:51:07.156000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:46:22.286643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565380+0000","last_change":"2024-09-10T20:49:23.415584+0000","last_active":"2024-09-10T20:50:08.565380+0000","last_peered":"2024-09-10T20:50:08.565380+0000","last_clean":"2024-09-10T20:50:08.565380+0000","last_became_active":"2024-09-10T20:49:23.415248+0000","last_became_peered":"2024-09-10T20:49:23.415248+0000","last_unstale":"2024-09-10T20:50:08.565380+0000","last_undegraded":"2024-09-10T20:50:08.565380+0000","last_fullsized":"2024-09-10T20:50:08.565380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:07.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156921+0000","last_change":"2024-09-10T20:49:25.435442+0000","last_active":"2024-09-10T20:51:07.156921+0000","last_peered":"2024-09-10T20:51:07.156921+0000","last_clean":"2024-09-10T20:51:07.156921+0000","last_became_active":"2024-09-10T20:49:25.435082+0000","last_became_peered":"2024-09-10T20:49:25.435082+0000","last_unstale":"2024-09-10T20:51:07.156921+0000","last_undegraded":"2024-09-10T20:51:07.156921+0000","last_fullsized":"2024-09-10T20:51:07.156921+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:19:11.755219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":128,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.632276+0000","last_change":"2024-09-10T20:49:23.414780+0000","last_active":"2024-09-10T20:51:14.632276+0000","last_peered":"2024-09-10T20:51:14.632276+0000","last_clean":"2024-09-10T20:51:14.632276+0000","last_became_active":"2024-09-10T20:49:23.414403+0000","last_became_peered":"2024-09-10T20:49:23.414403+0000","last_unstale":"2024-09-10T20:51:14.632276+0000","last_undegraded":"2024-09-10T20:51:14.632276+0000","last_fullsized":"2024-09-10T20:51:14.632276+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:54.734108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164790+0000","last_change":"2024-09-10T20:49:25.440701+0000","last_active":"2024-09-10T20:51:07.164790+0000","last_peered":"2024-09-10T20:51:07.164790+0000","last_clean":"2024-09-10T20:51:07.164790+0000","last_became_active":"2024-09-10T20:49:25.440313+0000","last_became_peered":"2024-09-10T20:49:25.440313+0000","last_unstale":"2024-09-10T20:51:07.164790+0000","last_undegraded":"2024-09-10T20:51:07.164790+0000","last_fullsized":"2024-09-10T20:51:07.164790+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:39.636110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570157+0000","last_change":"2024-09-10T20:49:23.415180+0000","last_active":"2024-09-10T20:50:08.570157+0000","last_peered":"2024-09-10T20:50:08.570157+0000","last_clean":"2024-09-10T20:50:08.570157+0000","last_became_active":"2024-09-10T20:49:23.414803+0000","last_became_peered":"2024-09-10T20:49:23.414803+0000","last_unstale":"2024-09-10T20:50:08.570157+0000","last_undegraded":"2024-09-10T20:50:08.570157+0000","last_fullsized":"2024-09-10T20:50:08.570157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:56.366525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148551+0000","last_change":"2024-09-10T20:49:25.429237+0000","last_active":"2024-09-10T20:51:07.148551+0000","last_peered":"2024-09-10T20:51:07.148551+0000","last_clean":"2024-09-10T20:51:07.148551+0000","last_became_active":"2024-09-10T20:49:25.428889+0000","last_became_peered":"2024-09-10T20:49:25.428889+0000","last_unstale":"2024-09-10T20:51:07.148551+0000","last_undegraded":"2024-09-10T20:51:07.148551+0000","last_fullsized":"2024-09-10T20:51:07.148551+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:33.415563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564804+0000","last_change":"2024-09-10T20:49:23.452254+0000","last_active":"2024-09-10T20:50:08.564804+0000","last_peered":"2024-09-10T20:50:08.564804+0000","last_clean":"2024-09-10T20:50:08.564804+0000","last_became_active":"2024-09-10T20:49:23.451913+0000","last_became_peered":"2024-09-10T20:49:23.451913+0000","last_unstale":"2024-09-10T20:50:08.564804+0000","last_undegraded":"2024-09-10T20:50:08.564804+0000","last_fullsized":"2024-09-10T20:50:08.564804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:45.595835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165142+0000","last_change":"2024-09-10T20:49:25.439936+0000","last_active":"2024-09-10T20:51:07.165142+0000","last_peered":"2024-09-10T20:51:07.165142+0000","last_clean":"2024-09-10T20:51:07.165142+0000","last_became_active":"2024-09-10T20:49:25.438757+0000","last_became_peered":"2024-09-10T20:49:25.438757+0000","last_unstale":"2024-09-10T20:51:07.165142+0000","last_undegraded":"2024-09-10T20:51:07.165142+0000","last_fullsized":"2024-09-10T20:51:07.165142+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.314174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'35","reported_seq":273,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:15.635101+0000","last_change":"2024-09-10T20:49:23.416487+0000","last_active":"2024-09-10T20:51:15.635101+0000","last_peered":"2024-09-10T20:51:15.635101+0000","last_clean":"2024-09-10T20:51:15.635101+0000","last_became_active":"2024-09-10T20:49:23.415396+0000","last_became_peered":"2024-09-10T20:49:23.415396+0000","last_unstale":"2024-09-10T20:51:15.635101+0000","last_undegraded":"2024-09-10T20:51:15.635101+0000","last_fullsized":"2024-09-10T20:51:15.635101+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:20:42.598793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69532,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":175,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.163328+0000","last_change":"2024-09-10T20:49:25.431151+0000","last_active":"2024-09-10T20:51:07.163328+0000","last_peered":"2024-09-10T20:51:07.163328+0000","last_clean":"2024-09-10T20:51:07.163328+0000","last_became_active":"2024-09-10T20:49:25.430851+0000","last_became_peered":"2024-09-10T20:49:25.430851+0000","last_unstale":"2024-09-10T20:51:07.163328+0000","last_undegraded":"2024-09-10T20:51:07.163328+0000","last_fullsized":"2024-09-10T20:51:07.163328+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:06.452646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567504+0000","last_change":"2024-09-10T20:49:23.414870+0000","last_active":"2024-09-10T20:50:08.567504+0000","last_peered":"2024-09-10T20:50:08.567504+0000","last_clean":"2024-09-10T20:50:08.567504+0000","last_became_active":"2024-09-10T20:49:23.414429+0000","last_became_peered":"2024-09-10T20:49:23.414429+0000","last_unstale":"2024-09-10T20:50:08.567504+0000","last_undegraded":"2024-09-10T20:50:08.567504+0000","last_fullsized":"2024-09-10T20:50:08.567504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:36.144071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164646+0000","last_change":"2024-09-10T20:49:25.430557+0000","last_active":"2024-09-10T20:51:07.164646+0000","last_peered":"2024-09-10T20:51:07.164646+0000","last_clean":"2024-09-10T20:51:07.164646+0000","last_became_active":"2024-09-10T20:49:25.430250+0000","last_became_peered":"2024-09-10T20:49:25.430250+0000","last_unstale":"2024-09-10T20:51:07.164646+0000","last_undegraded":"2024-09-10T20:51:07.164646+0000","last_fullsized":"2024-09-10T20:51:07.164646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:25.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564496+0000","last_change":"2024-09-10T20:49:23.413791+0000","last_active":"2024-09-10T20:50:08.564496+0000","last_peered":"2024-09-10T20:50:08.564496+0000","last_clean":"2024-09-10T20:50:08.564496+0000","last_became_active":"2024-09-10T20:49:23.413448+0000","last_became_peered":"2024-09-10T20:49:23.413448+0000","last_unstale":"2024-09-10T20:50:08.564496+0000","last_undegraded":"2024-09-10T20:50:08.564496+0000","last_fullsized":"2024-09-10T20:50:08.564496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:10:19.796497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164304+0000","last_change":"2024-09-10T20:49:25.428465+0000","last_active":"2024-09-10T20:51:07.164304+0000","last_peered":"2024-09-10T20:51:07.164304+0000","last_clean":"2024-09-10T20:51:07.164304+0000","last_became_active":"2024-09-10T20:49:25.428138+0000","last_became_peered":"2024-09-10T20:49:25.428138+0000","last_unstale":"2024-09-10T20:51:07.164304+0000","last_undegraded":"2024-09-10T20:51:07.164304+0000","last_fullsized":"2024-09-10T20:51:07.164304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:40:04.856094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.636075+0000","last_change":"2024-09-10T20:49:23.415659+0000","last_active":"2024-09-10T20:51:14.636075+0000","last_peered":"2024-09-10T20:51:14.636075+0000","last_clean":"2024-09-10T20:51:14.636075+0000","last_became_active":"2024-09-10T20:49:23.414522+0000","last_became_peered":"2024-09-10T20:49:23.414522+0000","last_unstale":"2024-09-10T20:51:14.636075+0000","last_undegraded":"2024-09-10T20:51:14.636075+0000","last_fullsized":"2024-09-10T20:51:14.636075+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:31.326584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165906+0000","last_change":"2024-09-10T20:49:25.433399+0000","last_active":"2024-09-10T20:51:07.165906+0000","last_peered":"2024-09-10T20:51:07.165906+0000","last_clean":"2024-09-10T20:51:07.165906+0000","last_became_active":"2024-09-10T20:49:25.430779+0000","last_became_peered":"2024-09-10T20:49:25.430779+0000","last_unstale":"2024-09-10T20:51:07.165906+0000","last_undegraded":"2024-09-10T20:51:07.165906+0000","last_fullsized":"2024-09-10T20:51:07.165906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:49:18.771364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563927+0000","last_change":"2024-09-10T20:49:23.452649+0000","last_active":"2024-09-10T20:50:08.563927+0000","last_peered":"2024-09-10T20:50:08.563927+0000","last_clean":"2024-09-10T20:50:08.563927+0000","last_became_active":"2024-09-10T20:49:23.452221+0000","last_became_peered":"2024-09-10T20:49:23.452221+0000","last_unstale":"2024-09-10T20:50:08.563927+0000","last_undegraded":"2024-09-10T20:50:08.563927+0000","last_fullsized":"2024-09-10T20:50:08.563927+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:14:20.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.154725+0000","last_change":"2024-09-10T20:49:25.438498+0000","last_active":"2024-09-10T20:51:07.154725+0000","last_peered":"2024-09-10T20:51:07.154725+0000","last_clean":"2024-09-10T20:51:07.154725+0000","last_became_active":"2024-09-10T20:49:25.438206+0000","last_became_peered":"2024-09-10T20:49:25.438206+0000","last_unstale":"2024-09-10T20:51:07.154725+0000","last_undegraded":"2024-09-10T20:51:07.154725+0000","last_fullsized":"2024-09-10T20:51:07.154725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:38.450425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566303+0000","last_change":"2024-09-10T20:49:23.409398+0000","last_active":"2024-09-10T20:50:08.566303+0000","last_peered":"2024-09-10T20:50:08.566303+0000","last_clean":"2024-09-10T20:50:08.566303+0000","last_became_active":"2024-09-10T20:49:23.408885+0000","last_became_peered":"2024-09-10T20:49:23.408885+0000","last_unstale":"2024-09-10T20:50:08.566303+0000","last_undegraded":"2024-09-10T20:50:08.566303+0000","last_fullsized":"2024-09-10T20:50:08.566303+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:10.948299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148870+0000","last_change":"2024-09-10T20:49:25.420829+0000","last_active":"2024-09-10T20:51:07.148870+0000","last_peered":"2024-09-10T20:51:07.148870+0000","last_clean":"2024-09-10T20:51:07.148870+0000","last_became_active":"2024-09-10T20:49:25.420007+0000","last_became_peered":"2024-09-10T20:49:25.420007+0000","last_unstale":"2024-09-10T20:51:07.148870+0000","last_undegraded":"2024-09-10T20:51:07.148870+0000","last_fullsized":"2024-09-10T20:51:07.148870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:26:20.833118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569541+0000","last_change":"2024-09-10T20:49:23.403527+0000","last_active":"2024-09-10T20:50:08.569541+0000","last_peered":"2024-09-10T20:50:08.569541+0000","last_clean":"2024-09-10T20:50:08.569541+0000","last_became_active":"2024-09-10T20:49:23.403054+0000","last_became_peered":"2024-09-10T20:49:23.403054+0000","last_unstale":"2024-09-10T20:50:08.569541+0000","last_undegraded":"2024-09-10T20:50:08.569541+0000","last_fullsized":"2024-09-10T20:50:08.569541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:19.814106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.162002+0000","last_change":"2024-09-10T20:49:25.434408+0000","last_active":"2024-09-10T20:51:07.162002+0000","last_peered":"2024-09-10T20:51:07.162002+0000","last_clean":"2024-09-10T20:51:07.162002+0000","last_became_active":"2024-09-10T20:49:25.430359+0000","last_became_peered":"2024-09-10T20:49:25.430359+0000","last_unstale":"2024-09-10T20:51:07.162002+0000","last_undegraded":"2024-09-10T20:51:07.162002+0000","last_fullsized":"2024-09-10T20:51:07.162002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:57.100913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.564958+0000","last_change":"2024-09-10T20:49:23.413046+0000","last_active":"2024-09-10T20:50:08.564958+0000","last_peered":"2024-09-10T20:50:08.564958+0000","last_clean":"2024-09-10T20:50:08.564958+0000","last_became_active":"2024-09-10T20:49:23.412525+0000","last_became_peered":"2024-09-10T20:49:23.412525+0000","last_unstale":"2024-09-10T20:50:08.564958+0000","last_undegraded":"2024-09-10T20:50:08.564958+0000","last_fullsized":"2024-09-10T20:50:08.564958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:47.939771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165653+0000","last_change":"2024-09-10T20:49:25.435186+0000","last_active":"2024-09-10T20:51:07.165653+0000","last_peered":"2024-09-10T20:51:07.165653+0000","last_clean":"2024-09-10T20:51:07.165653+0000","last_became_active":"2024-09-10T20:49:25.434839+0000","last_became_peered":"2024-09-10T20:49:25.434839+0000","last_unstale":"2024-09-10T20:51:07.165653+0000","last_undegraded":"2024-09-10T20:51:07.165653+0000","last_fullsized":"2024-09-10T20:51:07.165653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:58.355781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568133+0000","last_change":"2024-09-10T20:49:23.674298+0000","last_active":"2024-09-10T20:50:08.568133+0000","last_peered":"2024-09-10T20:50:08.568133+0000","last_clean":"2024-09-10T20:50:08.568133+0000","last_became_active":"2024-09-10T20:49:23.673759+0000","last_became_peered":"2024-09-10T20:49:23.673759+0000","last_unstale":"2024-09-10T20:50:08.568133+0000","last_undegraded":"2024-09-10T20:50:08.568133+0000","last_fullsized":"2024-09-10T20:50:08.568133+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:19.484008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.165007+0000","last_change":"2024-09-10T20:49:25.443979+0000","last_active":"2024-09-10T20:51:07.165007+0000","last_peered":"2024-09-10T20:51:07.165007+0000","last_clean":"2024-09-10T20:51:07.165007+0000","last_became_active":"2024-09-10T20:49:25.443560+0000","last_became_peered":"2024-09-10T20:49:25.443560+0000","last_unstale":"2024-09-10T20:51:07.165007+0000","last_undegraded":"2024-09-10T20:51:07.165007+0000","last_fullsized":"2024-09-10T20:51:07.165007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.511747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569651+0000","last_change":"2024-09-10T20:48:12.759879+0000","last_active":"2024-09-10T20:50:08.569651+0000","last_peered":"2024-09-10T20:50:08.569651+0000","last_clean":"2024-09-10T20:50:08.569651+0000","last_became_active":"2024-09-10T20:48:12.754392+0000","last_became_peered":"2024-09-10T20:48:12.754392+0000","last_unstale":"2024-09-10T20:50:08.569651+0000","last_undegraded":"2024-09-10T20:50:08.569651+0000","last_fullsized":"2024-09-10T20:50:08.569651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:44:51.468131+0000","last_clean_scrub_stamp":"2024-09-10T20:44:51.468131+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:34:16.333862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568872+0000","last_change":"2024-09-10T20:49:23.414500+0000","last_active":"2024-09-10T20:50:08.568872+0000","last_peered":"2024-09-10T20:50:08.568872+0000","last_clean":"2024-09-10T20:50:08.568872+0000","last_became_active":"2024-09-10T20:49:23.414137+0000","last_became_peered":"2024-09-10T20:49:23.414137+0000","last_unstale":"2024-09-10T20:50:08.568872+0000","last_undegraded":"2024-09-10T20:50:08.568872+0000","last_fullsized":"2024-09-10T20:50:08.568872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:56.899674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156364+0000","last_change":"2024-09-10T20:49:25.437452+0000","last_active":"2024-09-10T20:51:07.156364+0000","last_peered":"2024-09-10T20:51:07.156364+0000","last_clean":"2024-09-10T20:51:07.156364+0000","last_became_active":"2024-09-10T20:49:25.437121+0000","last_became_peered":"2024-09-10T20:49:25.437121+0000","last_unstale":"2024-09-10T20:51:07.156364+0000","last_undegraded":"2024-09-10T20:51:07.156364+0000","last_fullsized":"2024-09-10T20:51:07.156364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:25:02.682068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569502+0000","last_change":"2024-09-10T20:49:23.414142+0000","last_active":"2024-09-10T20:50:08.569502+0000","last_peered":"2024-09-10T20:50:08.569502+0000","last_clean":"2024-09-10T20:50:08.569502+0000","last_became_active":"2024-09-10T20:49:23.413686+0000","last_became_peered":"2024-09-10T20:49:23.413686+0000","last_unstale":"2024-09-10T20:50:08.569502+0000","last_undegraded":"2024-09-10T20:50:08.569502+0000","last_fullsized":"2024-09-10T20:50:08.569502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:12.223337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.147300+0000","last_change":"2024-09-10T20:49:25.423448+0000","last_active":"2024-09-10T20:51:07.147300+0000","last_peered":"2024-09-10T20:51:07.147300+0000","last_clean":"2024-09-10T20:51:07.147300+0000","last_became_active":"2024-09-10T20:49:25.423095+0000","last_became_peered":"2024-09-10T20:49:25.423095+0000","last_unstale":"2024-09-10T20:51:07.147300+0000","last_undegraded":"2024-09-10T20:51:07.147300+0000","last_fullsized":"2024-09-10T20:51:07.147300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:10.483115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:14.635048+0000","last_change":"2024-09-10T20:49:23.451896+0000","last_active":"2024-09-10T20:51:14.635048+0000","last_peered":"2024-09-10T20:51:14.635048+0000","last_clean":"2024-09-10T20:51:14.635048+0000","last_became_active":"2024-09-10T20:49:23.451514+0000","last_became_peered":"2024-09-10T20:49:23.451514+0000","last_unstale":"2024-09-10T20:51:14.635048+0000","last_undegraded":"2024-09-10T20:51:14.635048+0000","last_fullsized":"2024-09-10T20:51:14.635048+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.327487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.149046+0000","last_change":"2024-09-10T20:50:08.569711+0000","last_active":"2024-09-10T20:51:07.149046+0000","last_peered":"2024-09-10T20:51:07.149046+0000","last_clean":"2024-09-10T20:51:07.149046+0000","last_became_active":"2024-09-10T20:50:08.569348+0000","last_became_peered":"2024-09-10T20:50:08.569348+0000","last_unstale":"2024-09-10T20:51:07.149046+0000","last_undegraded":"2024-09-10T20:51:07.149046+0000","last_fullsized":"2024-09-10T20:51:07.149046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:35.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.570006+0000","last_change":"2024-09-10T20:49:23.415646+0000","last_active":"2024-09-10T20:50:08.570006+0000","last_peered":"2024-09-10T20:50:08.570006+0000","last_clean":"2024-09-10T20:50:08.570006+0000","last_became_active":"2024-09-10T20:49:23.415297+0000","last_became_peered":"2024-09-10T20:49:23.415297+0000","last_unstale":"2024-09-10T20:50:08.570006+0000","last_undegraded":"2024-09-10T20:50:08.570006+0000","last_fullsized":"2024-09-10T20:50:08.570006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:52.213999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.152951+0000","last_change":"2024-09-10T20:49:25.432723+0000","last_active":"2024-09-10T20:51:07.152951+0000","last_peered":"2024-09-10T20:51:07.152951+0000","last_clean":"2024-09-10T20:51:07.152951+0000","last_became_active":"2024-09-10T20:49:25.432300+0000","last_became_peered":"2024-09-10T20:49:25.432300+0000","last_unstale":"2024-09-10T20:51:07.152951+0000","last_undegraded":"2024-09-10T20:51:07.152951+0000","last_fullsized":"2024-09-10T20:51:07.152951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:09.304874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563780+0000","last_change":"2024-09-10T20:49:23.452433+0000","last_active":"2024-09-10T20:50:08.563780+0000","last_peered":"2024-09-10T20:50:08.563780+0000","last_clean":"2024-09-10T20:50:08.563780+0000","last_became_active":"2024-09-10T20:49:23.452012+0000","last_became_peered":"2024-09-10T20:49:23.452012+0000","last_unstale":"2024-09-10T20:50:08.563780+0000","last_undegraded":"2024-09-10T20:50:08.563780+0000","last_fullsized":"2024-09-10T20:50:08.563780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:56.923464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.157700+0000","last_change":"2024-09-10T20:49:25.437617+0000","last_active":"2024-09-10T20:51:07.157700+0000","last_peered":"2024-09-10T20:51:07.157700+0000","last_clean":"2024-09-10T20:51:07.157700+0000","last_became_active":"2024-09-10T20:49:25.437293+0000","last_became_peered":"2024-09-10T20:49:25.437293+0000","last_unstale":"2024-09-10T20:51:07.157700+0000","last_undegraded":"2024-09-10T20:51:07.157700+0000","last_fullsized":"2024-09-10T20:51:07.157700+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:36:11.842232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566052+0000","last_change":"2024-09-10T20:49:23.453360+0000","last_active":"2024-09-10T20:50:08.566052+0000","last_peered":"2024-09-10T20:50:08.566052+0000","last_clean":"2024-09-10T20:50:08.566052+0000","last_became_active":"2024-09-10T20:49:23.453013+0000","last_became_peered":"2024-09-10T20:49:23.453013+0000","last_unstale":"2024-09-10T20:50:08.566052+0000","last_undegraded":"2024-09-10T20:50:08.566052+0000","last_fullsized":"2024-09-10T20:50:08.566052+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:24:09.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.148689+0000","last_change":"2024-09-10T20:49:25.423465+0000","last_active":"2024-09-10T20:51:07.148689+0000","last_peered":"2024-09-10T20:51:07.148689+0000","last_clean":"2024-09-10T20:51:07.148689+0000","last_became_active":"2024-09-10T20:49:25.423191+0000","last_became_peered":"2024-09-10T20:49:25.423191+0000","last_unstale":"2024-09-10T20:51:07.148689+0000","last_undegraded":"2024-09-10T20:51:07.148689+0000","last_fullsized":"2024-09-10T20:51:07.148689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:12.380126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.432509+0000","last_change":"2024-09-10T20:49:23.409850+0000","last_active":"2024-09-10T20:51:07.432509+0000","last_peered":"2024-09-10T20:51:07.432509+0000","last_clean":"2024-09-10T20:51:07.432509+0000","last_became_active":"2024-09-10T20:49:23.409553+0000","last_became_peered":"2024-09-10T20:49:23.409553+0000","last_unstale":"2024-09-10T20:51:07.432509+0000","last_undegraded":"2024-09-10T20:51:07.432509+0000","last_fullsized":"2024-09-10T20:51:07.432509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:31:58.079948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.158981+0000","last_change":"2024-09-10T20:49:25.432144+0000","last_active":"2024-09-10T20:51:07.158981+0000","last_peered":"2024-09-10T20:51:07.158981+0000","last_clean":"2024-09-10T20:51:07.158981+0000","last_became_active":"2024-09-10T20:49:25.431845+0000","last_became_peered":"2024-09-10T20:49:25.431845+0000","last_unstale":"2024-09-10T20:51:07.158981+0000","last_undegraded":"2024-09-10T20:51:07.158981+0000","last_fullsized":"2024-09-10T20:51:07.158981+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:07.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569278+0000","last_change":"2024-09-10T20:49:23.674086+0000","last_active":"2024-09-10T20:50:08.569278+0000","last_peered":"2024-09-10T20:50:08.569278+0000","last_clean":"2024-09-10T20:50:08.569278+0000","last_became_active":"2024-09-10T20:49:23.673771+0000","last_became_peered":"2024-09-10T20:49:23.673771+0000","last_unstale":"2024-09-10T20:50:08.569278+0000","last_undegraded":"2024-09-10T20:50:08.569278+0000","last_fullsized":"2024-09-10T20:50:08.569278+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:07.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150190+0000","last_change":"2024-09-10T20:49:25.424924+0000","last_active":"2024-09-10T20:51:07.150190+0000","last_peered":"2024-09-10T20:51:07.150190+0000","last_clean":"2024-09-10T20:51:07.150190+0000","last_became_active":"2024-09-10T20:49:25.424571+0000","last_became_peered":"2024-09-10T20:49:25.424571+0000","last_unstale":"2024-09-10T20:51:07.150190+0000","last_undegraded":"2024-09-10T20:51:07.150190+0000","last_fullsized":"2024-09-10T20:51:07.150190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:14.990799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.571450+0000","last_change":"2024-09-10T20:50:08.571340+0000","last_active":"2024-09-10T20:50:08.571450+0000","last_peered":"2024-09-10T20:50:08.571450+0000","last_clean":"2024-09-10T20:50:08.571450+0000","last_became_active":"2024-09-10T20:50:08.567038+0000","last_became_peered":"2024-09-10T20:50:08.567038+0000","last_unstale":"2024-09-10T20:50:08.571450+0000","last_undegraded":"2024-09-10T20:50:08.571450+0000","last_fullsized":"2024-09-10T20:50:08.571450+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:20:56.536271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.140458+0000","last_change":"2024-09-10T20:49:25.435320+0000","last_active":"2024-09-10T20:51:07.140458+0000","last_peered":"2024-09-10T20:51:07.140458+0000","last_clean":"2024-09-10T20:51:07.140458+0000","last_became_active":"2024-09-10T20:49:25.434995+0000","last_became_peered":"2024-09-10T20:49:25.434995+0000","last_unstale":"2024-09-10T20:51:07.140458+0000","last_undegraded":"2024-09-10T20:51:07.140458+0000","last_fullsized":"2024-09-10T20:51:07.140458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:21:54.199480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.568779+0000","last_change":"2024-09-10T20:49:23.414328+0000","last_active":"2024-09-10T20:50:08.568779+0000","last_peered":"2024-09-10T20:50:08.568779+0000","last_clean":"2024-09-10T20:50:08.568779+0000","last_became_active":"2024-09-10T20:49:23.414033+0000","last_became_peered":"2024-09-10T20:49:23.414033+0000","last_unstale":"2024-09-10T20:50:08.568779+0000","last_undegraded":"2024-09-10T20:50:08.568779+0000","last_fullsized":"2024-09-10T20:50:08.568779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:35.080321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.150494+0000","last_change":"2024-09-10T20:49:25.432615+0000","last_active":"2024-09-10T20:51:07.150494+0000","last_peered":"2024-09-10T20:51:07.150494+0000","last_clean":"2024-09-10T20:51:07.150494+0000","last_became_active":"2024-09-10T20:49:25.431927+0000","last_became_peered":"2024-09-10T20:49:25.431927+0000","last_unstale":"2024-09-10T20:51:07.150494+0000","last_undegraded":"2024-09-10T20:51:07.150494+0000","last_fullsized":"2024-09-10T20:51:07.150494+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:16.232843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.567602+0000","last_change":"2024-09-10T20:49:23.409989+0000","last_active":"2024-09-10T20:50:08.567602+0000","last_peered":"2024-09-10T20:50:08.567602+0000","last_clean":"2024-09-10T20:50:08.567602+0000","last_became_active":"2024-09-10T20:49:23.409487+0000","last_became_peered":"2024-09-10T20:49:23.409487+0000","last_unstale":"2024-09-10T20:50:08.567602+0000","last_undegraded":"2024-09-10T20:50:08.567602+0000","last_fullsized":"2024-09-10T20:50:08.567602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:52.252409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.156218+0000","last_change":"2024-09-10T20:49:25.431574+0000","last_active":"2024-09-10T20:51:07.156218+0000","last_peered":"2024-09-10T20:51:07.156218+0000","last_clean":"2024-09-10T20:51:07.156218+0000","last_became_active":"2024-09-10T20:49:25.431123+0000","last_became_peered":"2024-09-10T20:49:25.431123+0000","last_unstale":"2024-09-10T20:51:07.156218+0000","last_undegraded":"2024-09-10T20:51:07.156218+0000","last_fullsized":"2024-09-10T20:51:07.156218+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:08.372009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.566615+0000","last_change":"2024-09-10T20:49:23.414777+0000","last_active":"2024-09-10T20:50:08.566615+0000","last_peered":"2024-09-10T20:50:08.566615+0000","last_clean":"2024-09-10T20:50:08.566615+0000","last_became_active":"2024-09-10T20:49:23.414350+0000","last_became_peered":"2024-09-10T20:49:23.414350+0000","last_unstale":"2024-09-10T20:50:08.566615+0000","last_undegraded":"2024-09-10T20:50:08.566615+0000","last_fullsized":"2024-09-10T20:50:08.566615+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:08.872133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164761+0000","last_change":"2024-09-10T20:49:25.444071+0000","last_active":"2024-09-10T20:51:07.164761+0000","last_peered":"2024-09-10T20:51:07.164761+0000","last_clean":"2024-09-10T20:51:07.164761+0000","last_became_active":"2024-09-10T20:49:25.443598+0000","last_became_peered":"2024-09-10T20:49:25.443598+0000","last_unstale":"2024-09-10T20:51:07.164761+0000","last_undegraded":"2024-09-10T20:51:07.164761+0000","last_fullsized":"2024-09-10T20:51:07.164761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:40.900197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.160537+0000","last_change":"2024-09-10T20:50:08.570537+0000","last_active":"2024-09-10T20:51:07.160537+0000","last_peered":"2024-09-10T20:51:07.160537+0000","last_clean":"2024-09-10T20:51:07.160537+0000","last_became_active":"2024-09-10T20:50:08.570083+0000","last_became_peered":"2024-09-10T20:50:08.570083+0000","last_unstale":"2024-09-10T20:51:07.160537+0000","last_undegraded":"2024-09-10T20:51:07.160537+0000","last_fullsized":"2024-09-10T20:51:07.160537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:15.834461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.573406+0000","last_change":"2024-09-10T20:50:08.572886+0000","last_active":"2024-09-10T20:50:08.573406+0000","last_peered":"2024-09-10T20:50:08.573406+0000","last_clean":"2024-09-10T20:50:08.573406+0000","last_became_active":"2024-09-10T20:50:08.568973+0000","last_became_peered":"2024-09-10T20:50:08.568973+0000","last_unstale":"2024-09-10T20:50:08.573406+0000","last_undegraded":"2024-09-10T20:50:08.573406+0000","last_fullsized":"2024-09-10T20:50:08.573406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:09.903383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164671+0000","last_change":"2024-09-10T20:49:25.441853+0000","last_active":"2024-09-10T20:51:07.164671+0000","last_peered":"2024-09-10T20:51:07.164671+0000","last_clean":"2024-09-10T20:51:07.164671+0000","last_became_active":"2024-09-10T20:49:25.441110+0000","last_became_peered":"2024-09-10T20:49:25.441110+0000","last_unstale":"2024-09-10T20:51:07.164671+0000","last_undegraded":"2024-09-10T20:51:07.164671+0000","last_fullsized":"2024-09-10T20:51:07.164671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:01:47.963960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.565963+0000","last_change":"2024-09-10T20:49:23.415095+0000","last_active":"2024-09-10T20:50:08.565963+0000","last_peered":"2024-09-10T20:50:08.565963+0000","last_clean":"2024-09-10T20:50:08.565963+0000","last_became_active":"2024-09-10T20:49:23.414650+0000","last_became_peered":"2024-09-10T20:49:23.414650+0000","last_unstale":"2024-09-10T20:50:08.565963+0000","last_undegraded":"2024-09-10T20:50:08.565963+0000","last_fullsized":"2024-09-10T20:50:08.565963+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:26.415568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.164885+0000","last_change":"2024-09-10T20:49:25.437653+0000","last_active":"2024-09-10T20:51:07.164885+0000","last_peered":"2024-09-10T20:51:07.164885+0000","last_clean":"2024-09-10T20:51:07.164885+0000","last_became_active":"2024-09-10T20:49:25.437390+0000","last_became_peered":"2024-09-10T20:49:25.437390+0000","last_unstale":"2024-09-10T20:51:07.164885+0000","last_undegraded":"2024-09-10T20:51:07.164885+0000","last_fullsized":"2024-09-10T20:51:07.164885+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:53.260753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.569349+0000","last_change":"2024-09-10T20:49:23.451985+0000","last_active":"2024-09-10T20:50:08.569349+0000","last_peered":"2024-09-10T20:50:08.569349+0000","last_clean":"2024-09-10T20:50:08.569349+0000","last_became_active":"2024-09-10T20:49:23.451502+0000","last_became_peered":"2024-09-10T20:49:23.451502+0000","last_unstale":"2024-09-10T20:50:08.569349+0000","last_undegraded":"2024-09-10T20:50:08.569349+0000","last_fullsized":"2024-09-10T20:50:08.569349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:37:37.339852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:51:07.155806+0000","last_change":"2024-09-10T20:49:25.432680+0000","last_active":"2024-09-10T20:51:07.155806+0000","last_peered":"2024-09-10T20:51:07.155806+0000","last_clean":"2024-09-10T20:51:07.155806+0000","last_became_active":"2024-09-10T20:49:25.432369+0000","last_became_peered":"2024-09-10T20:49:25.432369+0000","last_unstale":"2024-09-10T20:51:07.155806+0000","last_undegraded":"2024-09-10T20:51:07.155806+0000","last_fullsized":"2024-09-10T20:51:07.155806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:24.396900+0000","last_clean_scrub_stamp":"2024-09-10T20:49:24.396900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:12.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T20:50:08.563549+0000","last_change":"2024-09-10T20:49:23.412571+0000","last_active":"2024-09-10T20:50:08.563549+0000","last_peered":"2024-09-10T20:50:08.563549+0000","last_clean":"2024-09-10T20:50:08.563549+0000","last_became_active":"2024-09-10T20:49:23.411987+0000","last_became_peered":"2024-09-10T20:49:23.411987+0000","last_unstale":"2024-09-10T20:50:08.563549+0000","last_undegraded":"2024-09-10T20:50:08.563549+0000","last_fullsized":"2024-09-10T20:50:08.563549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:49:22.384863+0000","last_clean_scrub_stamp":"2024-09-10T20:49:22.384863+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:25.891924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74764,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":400,"num_write":180,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":223510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":394113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1056049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":827392,"data_stored":394349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":827392,"data_stored":394269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36732,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708420,"statfs":{"total":95995035648,"available":95957422080,"internally_reserved":0,"allocated":1421312,"data_stored":986340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":393738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888130,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":986191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":395098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215179,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":394049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444114,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":462592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":884736,"data_stored":463063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":395009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:51:17.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:51:18.021 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:18.448 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:18 smithi067 ceph-mon[30891]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T20:51:18.448 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:18 smithi067 ceph-mon[30891]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:18.448 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:18 smithi067 ceph-mon[30891]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 -- 172.21.15.67:0/3505035706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf4101cd0 msgr2=0x7febf41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 --2- 172.21.15.67:0/3505035706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf4101cd0 0x7febf41020b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7febe8009900 tx=0x7febe802a410 comp rx=0 tx=0).stop 2024-09-10T20:51:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 -- 172.21.15.67:0/3505035706 shutdown_connections 2024-09-10T20:51:18.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 --2- 172.21.15.67:0/3505035706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 0x7febf410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 --2- 172.21.15.67:0/3505035706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf41076e0 0x7febf4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 --2- 172.21.15.67:0/3505035706 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf4101cd0 0x7febf41020b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 -- 172.21.15.67:0/3505035706 >> 172.21.15.67:0/3505035706 conn(0x7febf40fd700 msgr2=0x7febf40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 -- 172.21.15.67:0/3505035706 shutdown_connections 2024-09-10T20:51:18.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.459+0000 7febfb2a3640 1 -- 172.21.15.67:0/3505035706 wait complete. 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 Processor -- start 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 -- start start 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf4101cd0 0x7febf40fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 0x7febf40fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7febf4111ce0 con 0x7febf41076e0 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7febf4111b60 con 0x7febf4101cd0 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febfb2a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febf4111e60 con 0x7febf4108060 2024-09-10T20:51:18.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36398/0 (socket says 172.21.15.67:36398) 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 -- 172.21.15.67:0/1295246023 learned_addr learned my addr 172.21.15.67:0/1295246023 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf903f640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf4101cd0 0x7febf40fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf9840640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 0x7febf40fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 -- 172.21.15.67:0/1295246023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 msgr2=0x7febf40fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 0x7febf40fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 -- 172.21.15.67:0/1295246023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf4101cd0 msgr2=0x7febf40fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf4101cd0 0x7febf40fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.460+0000 7febf883e640 1 -- 172.21.15.67:0/1295246023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf41a76b0 con 0x7febf41076e0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febf883e640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7febf000d950 tx=0x7febf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0017030 con 0x7febf41076e0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf0004020 con 0x7febf41076e0 2024-09-10T20:51:18.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf41a79a0 con 0x7febf41076e0 2024-09-10T20:51:18.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00047a0 con 0x7febf41076e0 2024-09-10T20:51:18.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.461+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf41a7ee0 con 0x7febf41076e0 2024-09-10T20:51:18.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.462+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf41020b0 con 0x7febf41076e0 2024-09-10T20:51:18.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.463+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7febf0009a30 con 0x7febf41076e0 2024-09-10T20:51:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.464+0000 7febe67fc640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 0x7febe00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.464+0000 7febf903f640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 0x7febe00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.464+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7febf00e5f40 con 0x7febf41076e0 2024-09-10T20:51:18.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.465+0000 7febf903f640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 0x7febe00b7830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febe8031440 tx=0x7febe80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.467+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7febf00accd0 con 0x7febf41076e0 2024-09-10T20:51:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:18 smithi083 ceph-mon[35058]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T20:51:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:18 smithi083 ceph-mon[35058]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:18 smithi083 ceph-mon[35058]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:18.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.689+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febf402e5c0 con 0x7febf41076e0 2024-09-10T20:51:18.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.690+0000 7febe67fc640 1 -- 172.21.15.67:0/1295246023 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11905 (secure 0 0 0) 0x7febf00ac5d0 con 0x7febf41076e0 2024-09-10T20:51:18.696 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:18.696 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":25,"btime":"2024-09-10T20:51:13:282702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:51:12.959331+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:51:18.696 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 25 2024-09-10T20:51:18.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 msgr2=0x7febe00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:18.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 0x7febe00b7830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7febe8031440 tx=0x7febe80095f0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 msgr2=0x7febf40fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7febf000d950 tx=0x7febf000de10 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 shutdown_connections 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7febe00b5370 0x7febe00b7830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf4108060 0x7febf40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7febf41076e0 0x7febf40fe140 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 --2- 172.21.15.67:0/1295246023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febf4101cd0 0x7febf40fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 >> 172.21.15.67:0/1295246023 conn(0x7febf40fd700 msgr2=0x7febf406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 shutdown_connections 2024-09-10T20:51:18.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:18.692+0000 7febfb2a3640 1 -- 172.21.15.67:0/1295246023 wait complete. 2024-09-10T20:51:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:18 smithi172 ceph-mon[35265]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T20:51:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:18 smithi172 ceph-mon[35265]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:18 smithi172 ceph-mon[35265]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:19.428 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:19 smithi067 ceph-mon[30891]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:19.428 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:19 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1295246023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:19.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T20:51:19.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:19 smithi083 ceph-mon[35058]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:19.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:19 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1295246023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:19.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:19 smithi172 ceph-mon[35265]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T20:51:19.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:19 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1295246023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:19.717 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:20.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 -- 172.21.15.67:0/198349282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 msgr2=0x7fdebc1117f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:20.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 --2- 172.21.15.67:0/198349282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1117f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ca0 tx=0x7fdeb402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 -- 172.21.15.67:0/198349282 shutdown_connections 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 --2- 172.21.15.67:0/198349282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1117f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 --2- 172.21.15.67:0/198349282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075f40 0x7fdebc10ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 --2- 172.21.15.67:0/198349282 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075540 0x7fdebc075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 -- 172.21.15.67:0/198349282 >> 172.21.15.67:0/198349282 conn(0x7fdebc0fe830 msgr2=0x7fdebc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 -- 172.21.15.67:0/198349282 shutdown_connections 2024-09-10T20:51:20.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.216+0000 7fdec1228640 1 -- 172.21.15.67:0/198349282 wait complete. 2024-09-10T20:51:20.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 Processor -- start 2024-09-10T20:51:20.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 -- start start 2024-09-10T20:51:20.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075540 0x7fdebc19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:20.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075f40 0x7fdebc19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc114fd0 con 0x7fdebc10f400 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc114e50 con 0x7fdebc075f40 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.217+0000 7fdec1228640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdebc115150 con 0x7fdebc075540 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36404/0 (socket says 172.21.15.67:36404) 2024-09-10T20:51:20.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 -- 172.21.15.67:0/470131778 learned_addr learned my addr 172.21.15.67:0/470131778 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebad9d640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075540 0x7fdebc19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdeba59c640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075f40 0x7fdebc19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 -- 172.21.15.67:0/470131778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075540 msgr2=0x7fdebc19b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075540 0x7fdebc19b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 -- 172.21.15.67:0/470131778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075f40 msgr2=0x7fdebc19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:20.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075f40 0x7fdebc19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 -- 172.21.15.67:0/470131778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc1a1550 con 0x7fdebc10f400 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.218+0000 7fdebb59e640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005e30 tx=0x7fdeb40317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.219+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4003b70 con 0x7fdebc10f400 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.219+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdebc1a17e0 con 0x7fdebc10f400 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.219+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeb4003d10 con 0x7fdebc10f400 2024-09-10T20:51:20.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.219+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb402fa00 con 0x7fdebc10f400 2024-09-10T20:51:20.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.219+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdebc1a7f00 con 0x7fdebc10f400 2024-09-10T20:51:20.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.220+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdebc075920 con 0x7fdebc10f400 2024-09-10T20:51:20.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.221+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fdeb4004580 con 0x7fdebc10f400 2024-09-10T20:51:20.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.222+0000 7fdea3fff640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 0x7fdea40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:20.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.222+0000 7fdebad9d640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 0x7fdea40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:20.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.222+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdeb4106dc0 con 0x7fdebc10f400 2024-09-10T20:51:20.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.223+0000 7fdebad9d640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 0x7fdea40b78b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00bbe0 tx=0x7fdeac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:20.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.227+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdeb40cdb50 con 0x7fdebc10f400 2024-09-10T20:51:20.435 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:20 smithi067 ceph-mon[30891]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:20.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.431+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdebc1a8160 con 0x7fdebc10f400 2024-09-10T20:51:20.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.433+0000 7fdea3fff640 1 -- 172.21.15.67:0/470131778 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7fdeb40cd450 con 0x7fdebc10f400 2024-09-10T20:51:20.437 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:20.437 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:51:20.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 msgr2=0x7fdea40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:20.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 0x7fdea40b78b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00bbe0 tx=0x7fdeac00b390 comp rx=0 tx=0).stop 2024-09-10T20:51:20.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 msgr2=0x7fdebc1a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:20.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005e30 tx=0x7fdeb40317c0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 shutdown_connections 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdebc10f400 0x7fdebc1a0d80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdebc075f40 0x7fdebc19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdea40b53f0 0x7fdea40b78b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 --2- 172.21.15.67:0/470131778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdebc075540 0x7fdebc19b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 >> 172.21.15.67:0/470131778 conn(0x7fdebc0fe830 msgr2=0x7fdebc111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 shutdown_connections 2024-09-10T20:51:20.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:20.435+0000 7fdec1228640 1 -- 172.21.15.67:0/470131778 wait complete. 2024-09-10T20:51:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:20 smithi083 ceph-mon[35058]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:20 smithi172 ceph-mon[35265]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:21.103 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T20:51:21.103 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T20:51:21.112 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T20:51:21.112 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T20:51:21.112 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-10T20:51:21.113 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T20:51:21.113 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:51:21.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:51:21.152 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:21.164 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-10T20:51:21.165 INFO:teuthology.orchestra.run.smithi067.stdout:0@d92bf05e-6fb4-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/a9073dc0-5834-4153-871f-d46f72a504b3 340G 0 340G 0% /tmp/cephfs 2024-09-10T20:51:21.167 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-10T20:51:21.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-10T20:51:21.305 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-10T20:51:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:21.509 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:21 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/470131778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:21.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:21 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/470131778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:21.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:21 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/470131778' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 -- 172.21.15.67:0/317648769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720109170 msgr2=0x7f372010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 --2- 172.21.15.67:0/317648769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720109170 0x7f372010f970 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3718009900 tx=0x7f371802a410 comp rx=0 tx=0).stop 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 -- 172.21.15.67:0/317648769 shutdown_connections 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 --2- 172.21.15.67:0/317648769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720109170 0x7f372010f970 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 --2- 172.21.15.67:0/317648769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 --2- 172.21.15.67:0/317648769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720102de0 0x7f37201031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 -- 172.21.15.67:0/317648769 >> 172.21.15.67:0/317648769 conn(0x7f37200fe830 msgr2=0x7f3720100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 -- 172.21.15.67:0/317648769 shutdown_connections 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.911+0000 7f37279ca640 1 -- 172.21.15.67:0/317648769 wait complete. 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 Processor -- start 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 -- start start 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720109170 0x7f372019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3720112e80 con 0x7f3720102de0 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3720112d00 con 0x7f3720109170 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f37279ca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3720113000 con 0x7f37201087f0 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36430/0 (socket says 172.21.15.67:36430) 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 -- 172.21.15.67:0/1480680026 learned_addr learned my addr 172.21.15.67:0/1480680026 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725f67640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720109170 0x7f372019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3724f65640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 -- 172.21.15.67:0/1480680026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 msgr2=0x7f3720199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 -- 172.21.15.67:0/1480680026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720109170 msgr2=0x7f372019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720109170 0x7f372019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 -- 172.21.15.67:0/1480680026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372019f300 con 0x7f3720102de0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3724f65640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.912+0000 7f3725766640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f371c00e9f0 tx=0x7f371c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.913+0000 7f37127fc640 1 -- 172.21.15.67:0/1480680026 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00cd80 con 0x7f3720102de0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.913+0000 7f37127fc640 1 -- 172.21.15.67:0/1480680026 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c0108e0 con 0x7f3720102de0 2024-09-10T20:51:21.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.913+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372019f5f0 con 0x7f3720102de0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.913+0000 7f37127fc640 1 -- 172.21.15.67:0/1480680026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c018980 con 0x7f3720102de0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.913+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37201a5cb0 con 0x7f3720102de0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.915+0000 7f37127fc640 1 -- 172.21.15.67:0/1480680026 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f371c010430 con 0x7f3720102de0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 Processor -- start 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 -- start start 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf938b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938b800 0x559bf939b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559bf9301e60 con 0x559bf939bba0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559bf92f1290 con 0x559bf938b800 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3729d9f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf92f50a0 con 0x559bf938aee0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36442/0 (socket says 172.21.15.67:36442) 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 -- 172.21.15.67:0/1572821696 learned_addr learned my addr 172.21.15.67:0/1572821696 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3725766640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938b800 0x559bf939b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3725f67640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf938b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 -- 172.21.15.67:0/1572821696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 msgr2=0x559bf938b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf938b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 -- 172.21.15.67:0/1572821696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938b800 msgr2=0x559bf939b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.916+0000 7f3724f65640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938b800 0x559bf939b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f37127fc640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f3724f65640 1 -- 172.21.15.67:0/1572821696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf904f930 con 0x559bf939bba0 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f3725f67640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf938b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f3725f67640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f37127fc640 1 -- 172.21.15.67:0/1480680026 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f371c0e6180 con 0x7f3720102de0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f3724f65640 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3714008e70 tx=0x7f371400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dee946add0233b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f370b7fe640 1 -- 172.21.15.67:0/1572821696 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400f830 con 0x559bf939bba0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f370b7fe640 1 -- 172.21.15.67:0/1572821696 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371400e3b0 con 0x559bf939bba0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.917+0000 7f370b7fe640 1 -- 172.21.15.67:0/1572821696 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400b600 con 0x559bf939bba0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3725f67640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 0x7f370c0b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3718031440 tx=0x7f3718005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 -- 172.21.15.67:0/1572821696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 msgr2=0x559bf939df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3714008e70 tx=0x7f371400d710 comp rx=0 tx=0).stop 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 -- 172.21.15.67:0/1572821696 shutdown_connections 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf939df90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938b800 0x559bf939b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 --2- 172.21.15.67:0/1572821696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf938b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 -- 172.21.15.67:0/1572821696 >> 172.21.15.67:0/1572821696 conn(0x559bf9388d10 msgr2=0x559bf9389eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 -- 172.21.15.67:0/1572821696 shutdown_connections 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.918+0000 7f3729d9f740 1 -- 172.21.15.67:0/1572821696 wait complete. 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 -- start start 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 Processor -- start 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938b800 0x559bf93990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559bf9152890 con 0x559bf938aee0 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559bf928bd40 con 0x559bf939bba0 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.919+0000 7f3729d9f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559bf939e850 con 0x559bf938b800 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36452/0 (socket says 172.21.15.67:36452) 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 -- 172.21.15.67:0/106858918 learned_addr learned my addr 172.21.15.67:0/106858918 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:21.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3729d9f740 10 client.0 _ll_register_callbacks cb 0x559bf92efc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3724f65640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938b800 0x559bf93990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725f67640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 -- 172.21.15.67:0/106858918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938b800 msgr2=0x559bf93990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938b800 0x559bf93990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 -- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 msgr2=0x559bf93995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 -- 172.21.15.67:0/106858918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf93a7c30 con 0x559bf938aee0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725f67640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3725766640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c6a0 tx=0x7f371c0e3fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4946860a45253d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0e5070 con 0x559bf938aee0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f371c018b20 con 0x559bf938aee0 2024-09-10T20:51:21.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371400e3b0 con 0x559bf938aee0 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f371c0a8e60 con 0x559bf938aee0 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3729d9f740 10 client.15363 fetch_fsmap learned FSMap version 25 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.920+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bf93aa5e0 con 0x559bf938aee0 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371400e3b0 con 0x559bf938aee0 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f371c0cfb60 con 0x559bf938aee0 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 10 client.15363 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 10 client.15363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 20 client.15363 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf93aba90 0x559bf93adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 4 client.15363 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bf9303db0 con 0x559bf93aba90 2024-09-10T20:51:21.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.921+0000 7f3724f65640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf93aba90 0x559bf93adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.922+0000 7f3724f65640 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf93aba90 0x559bf93adec0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f789d4f715d5c472 server_cookie=83e8fba85a220969 in_seq=0 out_seq=0 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.922+0000 7f3708ff9640 10 client.15363 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.922+0000 7f3708ff9640 1 -- 172.21.15.67:0/106858918 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bf9303db0 con 0x559bf93aba90 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.922+0000 7f3708ff9640 10 client.15363 handle_command_reply: tid=0 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.922+0000 7f3729d9f740 1 client.15363 shutdown 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 msgr2=0x559bf9398b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c6a0 tx=0x7f371c0e3fe0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 shutdown_connections 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf93aba90 0x559bf93adec0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938b800 0x559bf93990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 --2- 172.21.15.67:0/106858918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938aee0 0x559bf9398b60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 >> 172.21.15.67:0/106858918 conn(0x559bf9388d10 msgr2=0x559bf9387f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3708ff9640 0 client.15363 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:21.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 shutdown_connections 2024-09-10T20:51:21.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 1 -- 172.21.15.67:0/106858918 wait complete. 2024-09-10T20:51:21.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.923+0000 7f3729d9f740 20 client.15363 trim_cache size 0 max 16384 2024-09-10T20:51:21.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 Processor -- start 2024-09-10T20:51:21.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 -- start start 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf9388760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93983f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f37201ae9e0 con 0x559bf938b800 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f37201ac2b0 con 0x559bf939bba0 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3729d9f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37201aa100 con 0x559bf938aee0 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36462/0 (socket says 172.21.15.67:36462) 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3724f65640 1 -- 172.21.15.67:0/4019825979 learned_addr learned my addr 172.21.15.67:0/4019825979 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.941+0000 7f3725766640 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf9388760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 -- 172.21.15.67:0/4019825979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 msgr2=0x559bf9388760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf9388760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 -- 172.21.15.67:0/4019825979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 msgr2=0x559bf93983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 -- 172.21.15.67:0/4019825979 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf9389790 con 0x559bf938b800 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f3724f65640 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f371400ed40 tx=0x7f3714008750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4283e04ab620761 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f370affd640 1 -- 172.21.15.67:0/4019825979 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714031070 con 0x559bf938b800 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f370affd640 1 -- 172.21.15.67:0/4019825979 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37140084f0 con 0x559bf938b800 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.942+0000 7f370affd640 1 -- 172.21.15.67:0/4019825979 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400fa20 con 0x559bf938b800 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- 172.21.15.67:0/4019825979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 msgr2=0x559bf9396630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f371400ed40 tx=0x7f3714008750 comp rx=0 tx=0).stop 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- 172.21.15.67:0/4019825979 shutdown_connections 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf939bba0 0x559bf93983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf938b800 0x559bf9396630 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 --2- 172.21.15.67:0/4019825979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf938aee0 0x559bf9388760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- 172.21.15.67:0/4019825979 >> 172.21.15.67:0/4019825979 conn(0x559bf9388d10 msgr2=0x559bf9398ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- 172.21.15.67:0/4019825979 shutdown_connections 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- 172.21.15.67:0/4019825979 wait complete. 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 -- start start 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.943+0000 7f3729d9f740 1 Processor -- start 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 0x559bf93a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf93b2780 0x559bf93b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f37201aa770 con 0x559bf939bba0 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f37201abbe0 con 0x559bf938aee0 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37201aae40 con 0x559bf93b2780 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3729d9f740 10 client.0 _ll_register_callbacks cb 0x7f371c0e99c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:36468/0 (socket says 172.21.15.67:36468) 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 -- 172.21.15.67:0/3690668257 learned_addr learned my addr 172.21.15.67:0/3690668257 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3725766640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 0x559bf93a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3725f67640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf93b2780 0x559bf93b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 -- 172.21.15.67:0/3690668257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf93b2780 msgr2=0x559bf93b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf93b2780 0x559bf93b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 -- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 msgr2=0x559bf93a3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 0x559bf93a3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3724f65640 1 -- 172.21.15.67:0/3690668257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf93b3270 con 0x559bf939bba0 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.944+0000 7f3725766640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 0x559bf93a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3724f65640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f371400dc10 tx=0x7f371400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6dc970c3d506b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3708ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371403a060 con 0x559bf939bba0 2024-09-10T20:51:21.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f371400f9a0 con 0x559bf939bba0 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37140084f0 con 0x559bf939bba0 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3714031070 con 0x559bf939bba0 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3729d9f740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bf94199a0 con 0x559bf939bba0 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.945+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37140084f0 con 0x559bf939bba0 2024-09-10T20:51:21.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3714018480 con 0x559bf939bba0 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 10 client.15369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 20 client.15369 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf9419d80 0x559bf941c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 4 client.15369 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:51:21.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559bf92ff860 con 0x559bf9419d80 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3725766640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf9419d80 0x559bf941c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3725766640 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf9419d80 0x559bf941c1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1712105c6998698e server_cookie=b4d91453dc29a2fa in_seq=0 out_seq=0 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.946+0000 7f3708ff9640 10 client.15369 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.948+0000 7f3708ff9640 1 -- 172.21.15.67:0/3690668257 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559bf92ff860 con 0x559bf9419d80 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.948+0000 7f3708ff9640 10 client.15369 handle_command_reply: tid=0 2024-09-10T20:51:21.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.948+0000 7f3729d9f740 1 client.15369 shutdown 2024-09-10T20:51:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.948+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 msgr2=0x559bf93a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.948+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f371400dc10 tx=0x7f371400f6c0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 shutdown_connections 2024-09-10T20:51:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559bf9419d80 0x559bf941c1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559bf93b2780 0x559bf93b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559bf939bba0 0x559bf93a4200 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 --2- 172.21.15.67:0/3690668257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559bf938aee0 0x559bf93a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 >> 172.21.15.67:0/3690668257 conn(0x559bf9388d10 msgr2=0x559bf93a7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3708ff9640 0 client.15369 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 shutdown_connections 2024-09-10T20:51:21.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 1 -- 172.21.15.67:0/3690668257 wait complete. 2024-09-10T20:51:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.949+0000 7f3729d9f740 20 client.15369 trim_cache size 0 max 16384 2024-09-10T20:51:21.967 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:21.967 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:51:21.967 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "5ecb4bf8-59ef-4cd6-824c-75c4862c200d", 2024-09-10T20:51:21.968 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:51:21.968 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 msgr2=0x7f370c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 0x7f370c0b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3718031440 tx=0x7f3718005a20 comp rx=0 tx=0).stop 2024-09-10T20:51:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 msgr2=0x7f3720199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:21.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f371c00e9f0 tx=0x7f371c00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 shutdown_connections 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3720109170 0x7f372019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37201087f0 0x7f3720199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 --2- 172.21.15.67:0/1480680026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3720102de0 0x7f3720199250 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:21.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 >> 172.21.15.67:0/1480680026 conn(0x7f37200fe830 msgr2=0x7f3720101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:21.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 shutdown_connections 2024-09-10T20:51:21.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:21.950+0000 7f37279ca640 1 -- 172.21.15.67:0/1480680026 wait complete. 2024-09-10T20:51:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:22 smithi083 ceph-mon[35058]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:22.645 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:22 smithi067 ceph-mon[30891]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:22 smithi172 ceph-mon[35265]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T20:51:23.596 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:23 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:51:23.596 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:23 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.596 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:23 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:51:23.596 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:23 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:51:23.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:23 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:51:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:23 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:23 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:51:23.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:23 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-10T20:51:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:23 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:51:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:23 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:23 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:51:23.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:23 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:51:23.720 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-10T20:51:23.723 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-10T20:51:23.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T20:51:23.885 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/: 2024-09-10T20:51:23.885 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:23.885 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:23.885 INFO:teuthology.orchestra.run.smithi067.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T20:51:23.885 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 data 2024-09-10T20:51:23.886 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:23.886 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data: 2024-09-10T20:51:23.886 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:23.886 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:23.886 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T20:51:23.888 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-10T20:51:23.946 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:23.976 INFO:teuthology.orchestra.run.smithi067.stdout:[Service] 2024-09-10T20:51:23.976 INFO:teuthology.orchestra.run.smithi067.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-10T20:51:23.976 INFO:teuthology.orchestra.run.smithi067.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-10T20:51:23.979 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-10T20:51:24.136 INFO:teuthology.orchestra.run.smithi067.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-10T20:51:24.457 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:24 smithi067 ceph-mon[30891]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T20:51:24.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 -- 172.21.15.67:0/1232254204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c101890 msgr2=0x7f950c101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 --2- 172.21.15.67:0/1232254204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c101890 0x7f950c101c70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9508009900 tx=0x7f950802a480 comp rx=0 tx=0).stop 2024-09-10T20:51:24.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 -- 172.21.15.67:0/1232254204 shutdown_connections 2024-09-10T20:51:24.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 --2- 172.21.15.67:0/1232254204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c10f440 0x7f950c111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 --2- 172.21.15.67:0/1232254204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c1021b0 0x7f950c10ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 --2- 172.21.15.67:0/1232254204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c101890 0x7f950c101c70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 -- 172.21.15.67:0/1232254204 >> 172.21.15.67:0/1232254204 conn(0x7f950c0fd700 msgr2=0x7f950c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 -- 172.21.15.67:0/1232254204 shutdown_connections 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 -- 172.21.15.67:0/1232254204 wait complete. 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.439+0000 7f95143d0640 1 Processor -- start 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 -- start start 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101890 0x7f950c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c10f440 0x7f950c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f950c114f50 con 0x7f950c1021b0 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f950c114dd0 con 0x7f950c101890 2024-09-10T20:51:24.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f95143d0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1150d0 con 0x7f950c10f440 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53476/0 (socket says 172.21.15.67:53476) 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 -- 172.21.15.67:0/1667638708 learned_addr learned my addr 172.21.15.67:0/1667638708 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951216c640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101890 0x7f950c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951296d640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c10f440 0x7f950c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 -- 172.21.15.67:0/1667638708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c10f440 msgr2=0x7f950c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c10f440 0x7f950c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 -- 172.21.15.67:0/1667638708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101890 msgr2=0x7f950c19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101890 0x7f950c19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 -- 172.21.15.67:0/1667638708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c1a1510 con 0x7f950c1021b0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.440+0000 7f951196b640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c920 tx=0x7f94fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.441+0000 7f95037fe640 1 -- 172.21.15.67:0/1667638708 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc007c70 con 0x7f950c1021b0 2024-09-10T20:51:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.441+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c1a1800 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.441+0000 7f95037fe640 1 -- 172.21.15.67:0/1667638708 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94fc007e10 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.441+0000 7f95037fe640 1 -- 172.21.15.67:0/1667638708 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc018820 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.441+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c1a7ec0 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.444+0000 7f95037fe640 1 -- 172.21.15.67:0/1667638708 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f94fc00f450 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.444+0000 7f95037fe640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 0x7f94f80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951216c640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 0x7f94f80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95037fe640 1 -- 172.21.15.67:0/1667638708 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f94fc0e5eb0 con 0x7f950c1021b0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 Processor -- start 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 -- start start 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99fe7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951216c640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 0x7f94f80b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9508031440 tx=0x7f9508005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562a99f54e50 con 0x562a99fe75b0 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562a99f44280 con 0x562a99ff3540 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f95167a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562a99f48090 con 0x562a99fe6c90 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951196b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951196b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53478/0 (socket says 172.21.15.67:53478) 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951196b640 1 -- 172.21.15.67:0/3511285875 learned_addr learned my addr 172.21.15.67:0/3511285875 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.445+0000 7f951296d640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951216c640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99fe7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 -- 172.21.15.67:0/3511285875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 msgr2=0x562a99fe7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99fe7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 -- 172.21.15.67:0/3511285875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 msgr2=0x562a99ff3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 -- 172.21.15.67:0/3511285875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a99ca2650 con 0x562a99ff3540 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951196b640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951216c640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99fe7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f951296d640 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff5930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9504005fd0 tx=0x7f950400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7817a262cfaf70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f9500de6640 1 -- 172.21.15.67:0/3511285875 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504015070 con 0x562a99ff3540 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f9500de6640 1 -- 172.21.15.67:0/3511285875 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9504005020 con 0x562a99ff3540 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.446+0000 7f9500de6640 1 -- 172.21.15.67:0/3511285875 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040116a0 con 0x562a99ff3540 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 -- 172.21.15.67:0/3511285875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 msgr2=0x562a99ff5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff5930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9504005fd0 tx=0x7f950400f730 comp rx=0 tx=0).stop 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 -- 172.21.15.67:0/3511285875 shutdown_connections 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff5930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe75b0 0x562a99ff3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 --2- 172.21.15.67:0/3511285875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99fe7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 -- 172.21.15.67:0/3511285875 >> 172.21.15.67:0/3511285875 conn(0x562a99fe4ac0 msgr2=0x562a99fe5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 -- 172.21.15.67:0/3511285875 shutdown_connections 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.447+0000 7f95167a5740 1 -- 172.21.15.67:0/3511285875 wait complete. 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 -- start start 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 Processor -- start 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99ff2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562a99da5700 con 0x562a99ff3540 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562a99edf110 con 0x562a99fe75b0 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562a99ff61c0 con 0x562a99fe6c90 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.448+0000 7f95167a5740 10 client.0 _ll_register_callbacks cb 0x562a99ef8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53484/0 (socket says 172.21.15.67:53484) 2024-09-10T20:51:24.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 -- 172.21.15.67:0/3562139954 learned_addr learned my addr 172.21.15.67:0/3562139954 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:24.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951216c640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99ff2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951196b640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 -- 172.21.15.67:0/3562139954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 msgr2=0x562a99ff2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99ff2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 -- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 msgr2=0x562a99ff0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 -- 172.21.15.67:0/3562139954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a99f0cc40 con 0x562a99ff3540 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951216c640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99ff2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f951296d640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f95040058d0 tx=0x7f9504004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c98a11cdeb3255 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504028060 con 0x562a99ff3540 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f950400fe40 con 0x562a99ff3540 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9504005020 con 0x562a99ff3540 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9504015070 con 0x562a99ff3540 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f95167a5740 10 client.15381 fetch_fsmap learned FSMap version 25 2024-09-10T20:51:24.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.449+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a9a001b10 con 0x562a99ff3540 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9504005020 con 0x562a99ff3540 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9504011b40 con 0x562a99ff3540 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 10 client.15381 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 20 client.15381 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a002f10 0x562a9a005300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 4 client.15381 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a99f56da0 con 0x562a9a002f10 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f951216c640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a002f10 0x562a9a005300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f951216c640 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a002f10 0x562a9a005300 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2738c13de14affce server_cookie=393bb06b16887def in_seq=0 out_seq=0 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.450+0000 7f94f5ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f94f5ffb640 1 -- 172.21.15.67:0/3562139954 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a99f56da0 con 0x562a9a002f10 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f94f5ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-10T20:51:24.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 client.15381 shutdown 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 msgr2=0x562a99ff0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f95040058d0 tx=0x7f9504004c70 comp rx=0 tx=0).stop 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 shutdown_connections 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a002f10 0x562a9a005300 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99ff3540 0x562a99ff0800 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f94f5ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 --2- 172.21.15.67:0/3562139954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe6c90 0x562a99ff2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 >> 172.21.15.67:0/3562139954 conn(0x562a99fe4ac0 msgr2=0x562a99fdb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 shutdown_connections 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 1 -- 172.21.15.67:0/3562139954 wait complete. 2024-09-10T20:51:24.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.451+0000 7f95167a5740 20 client.15381 trim_cache size 0 max 16384 2024-09-10T20:51:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 Processor -- start 2024-09-10T20:51:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 -- start start 2024-09-10T20:51:24.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe75b0 0x562a99ff4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.471+0000 7f95167a5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1ae9c0 con 0x562a99fe6c90 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f95167a5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1ac290 con 0x562a99ff3540 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f95167a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1aa120 con 0x562a99fe75b0 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53486/0 (socket says 172.21.15.67:53486) 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 -- 172.21.15.67:0/3486546124 learned_addr learned my addr 172.21.15.67:0/3486546124 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951296d640 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951196b640 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe75b0 0x562a99ff4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 -- 172.21.15.67:0/3486546124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe75b0 msgr2=0x562a99ff4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe75b0 0x562a99ff4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 -- 172.21.15.67:0/3486546124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 msgr2=0x562a99ff4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 -- 172.21.15.67:0/3486546124 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a99ff60a0 con 0x562a99fe6c90 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f951216c640 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f950802a9a0 tx=0x7f9508040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec824d7d0b79cda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f94f7fff640 1 -- 172.21.15.67:0/3486546124 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508056070 con 0x562a99fe6c90 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f94f7fff640 1 -- 172.21.15.67:0/3486546124 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9508005500 con 0x562a99fe6c90 2024-09-10T20:51:24.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.472+0000 7f94f7fff640 1 -- 172.21.15.67:0/3486546124 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508035040 con 0x562a99fe6c90 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 -- 172.21.15.67:0/3486546124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 msgr2=0x562a99fff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f950802a9a0 tx=0x7f9508040000 comp rx=0 tx=0).stop 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 -- 172.21.15.67:0/3486546124 shutdown_connections 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99ff3540 0x562a99ff4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99fe75b0 0x562a99ff4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 --2- 172.21.15.67:0/3486546124 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99fff450 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 -- 172.21.15.67:0/3486546124 >> 172.21.15.67:0/3486546124 conn(0x562a99fe4ac0 msgr2=0x562a99ff2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 -- 172.21.15.67:0/3486546124 shutdown_connections 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.473+0000 7f95167a5740 1 -- 172.21.15.67:0/3486546124 wait complete. 2024-09-10T20:51:24.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 -- start start 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 Processor -- start 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99ff3540 0x562a99ff6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1aa770 con 0x562a99fe6c90 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1abbc0 con 0x562a99fe75b0 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f950c1aae20 con 0x562a99ff3540 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f95167a5740 10 client.0 _ll_register_callbacks cb 0x7f9504009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951196b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53488/0 (socket says 172.21.15.67:53488) 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 -- 172.21.15.67:0/2230772607 learned_addr learned my addr 172.21.15.67:0/2230772607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951296d640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99ff3540 0x562a99ff6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 -- 172.21.15.67:0/2230772607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99ff3540 msgr2=0x562a99ff6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99ff3540 0x562a99ff6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 -- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 msgr2=0x562a99ff6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951216c640 1 -- 172.21.15.67:0/2230772607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9a06faa0 con 0x562a99fe6c90 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.474+0000 7f951196b640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f951216c640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9508005c40 tx=0x7f9508005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda8ff4d4d8144a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508035070 con 0x562a99fe6c90 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9508005250 con 0x562a99fe6c90 2024-09-10T20:51:24.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9508005500 con 0x562a99fe6c90 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9508056070 con 0x562a99fe6c90 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f95167a5740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a9a070d00 con 0x562a99fe6c90 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.475+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9508005500 con 0x562a99fe6c90 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9508003b00 con 0x562a99fe6c90 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 20 client.15387 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a071450 0x562a9a073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 4 client.15387 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:51:24.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a99f52850 con 0x562a9a071450 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f951196b640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a071450 0x562a9a073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f951196b640 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a071450 0x562a9a073870 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4954076db2187ff7 server_cookie=e6940075e308011d in_seq=0 out_seq=0 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f94f5ffb640 10 client.15387 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f94f5ffb640 1 -- 172.21.15.67:0/2230772607 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x562a99f52850 con 0x562a9a071450 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f94f5ffb640 10 client.15387 handle_command_reply: tid=0 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.476+0000 7f95167a5740 1 client.15387 shutdown 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 msgr2=0x562a99ffbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9508005c40 tx=0x7f9508005740 comp rx=0 tx=0).stop 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 shutdown_connections 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562a9a071450 0x562a9a073870 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a99ff3540 0x562a99ff6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562a99fe75b0 0x562a99ff6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f94f5ffb640 0 client.15387 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 --2- 172.21.15.67:0/2230772607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562a99fe6c90 0x562a99ffbe70 secure :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9508005c40 tx=0x7f9508005740 comp rx=0 tx=0).stop 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 >> 172.21.15.67:0/2230772607 conn(0x562a99fe4ac0 msgr2=0x562a99fdabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 shutdown_connections 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 1 -- 172.21.15.67:0/2230772607 wait complete. 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.477+0000 7f95167a5740 20 client.15387 trim_cache size 0 max 16384 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:51:24.487 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "5ecb4bf8-59ef-4cd6-824c-75c4862c200d", 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:51:24.488 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:51:24.489 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:24.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 msgr2=0x7f94f80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 0x7f94f80b7830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9508031440 tx=0x7f9508005b50 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 msgr2=0x7f950c19b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f94fc00c920 tx=0x7f94fc00cde0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 shutdown_connections 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f94f80b5370 0x7f94f80b7830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f950c10f440 0x7f950c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f950c1021b0 0x7f950c19b9a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 --2- 172.21.15.67:0/1667638708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f950c101890 0x7f950c19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 >> 172.21.15.67:0/1667638708 conn(0x7f950c0fd700 msgr2=0x7f950c111730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 shutdown_connections 2024-09-10T20:51:24.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:24.478+0000 7f95143d0640 1 -- 172.21.15.67:0/1667638708 wait complete. 2024-09-10T20:51:24.600 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:24 smithi172 ceph-mon[35265]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T20:51:24.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:24 smithi083 ceph-mon[35058]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-10T20:51:25.142 INFO:tasks.cephfs.filesystem:scrub status for tag:5ecb4bf8-59ef-4cd6-824c-75c4862c200d - {'path': '/', 'tag': '5ecb4bf8-59ef-4cd6-824c-75c4862c200d', 'options': 'recursive,force'} 2024-09-10T20:51:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:26 smithi083 ceph-mon[35058]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T20:51:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:26 smithi172 ceph-mon[35265]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T20:51:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:26 smithi067 ceph-mon[30891]: pgmap v344: 97 pgs: 97 active+clean; 650 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-10T20:51:27.148 INFO:teuthology.orchestra.run.smithi067.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-10T20:51:27.151 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T20:51:27.194 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/: 2024-09-10T20:51:27.194 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.194 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 data 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data: 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:total 35 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 . 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 base 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 10 20:51 global 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 log 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_commit_ts 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_dynshmem 2024-09-10T20:51:27.195 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 20:51 pg_hba.conf 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 20:51 pg_ident.conf 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 pg_logical 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 pg_multixact 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_notify 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_replslot 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_serial 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_snapshots 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_stat 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_stat_tmp 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 pg_subtrans 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_tblspc 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_twophase 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T20:51:27.196 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 pg_wal 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 pg_xact 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 20:51 postgresql.auto.conf 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 20:51 postgresql.conf 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base: 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 . 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 1 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 13493 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 13494 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.197 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:total 7777 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 . 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 .. 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T20:51:27.198 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 20:51 1259 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T20:51:27.199 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T20:51:27.200 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T20:51:27.201 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T20:51:27.202 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T20:51:27.203 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T20:51:27.204 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 20:51 2619 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2619_fsm 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T20:51:27.205 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T20:51:27.206 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T20:51:27.207 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2696 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T20:51:27.208 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T20:51:27.209 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T20:51:27.210 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T20:51:27.211 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T20:51:27.212 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T20:51:27.213 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T20:51:27.214 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T20:51:27.215 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T20:51:27.216 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T20:51:27.217 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T20:51:27.217 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T20:51:27.217 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T20:51:27.217 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T20:51:27.217 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T20:51:27.220 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T20:51:27.221 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:total 7777 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 . 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 .. 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T20:51:27.222 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 20:51 1259 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T20:51:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T20:51:27.224 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T20:51:27.225 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T20:51:27.226 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T20:51:27.227 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T20:51:27.228 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 20:51 2619 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2619_fsm 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T20:51:27.229 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T20:51:27.230 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T20:51:27.231 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2696 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T20:51:27.232 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T20:51:27.233 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T20:51:27.234 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T20:51:27.235 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T20:51:27.236 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T20:51:27.237 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T20:51:27.238 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T20:51:27.239 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T20:51:27.240 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T20:51:27.241 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T20:51:27.242 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:total 7777 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 . 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 .. 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T20:51:27.243 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 20:51 1259 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T20:51:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T20:51:27.245 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T20:51:27.246 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T20:51:27.247 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T20:51:27.248 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T20:51:27.249 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 20:51 2619 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2619_fsm 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T20:51:27.250 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T20:51:27.251 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T20:51:27.252 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2696 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T20:51:27.253 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T20:51:27.254 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T20:51:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T20:51:27.256 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T20:51:27.257 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T20:51:27.258 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T20:51:27.259 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T20:51:27.260 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T20:51:27.261 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T20:51:27.262 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T20:51:27.263 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/global: 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:total 537 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 10 20:51 . 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.264 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1213 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1213_fsm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1213_vm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1214 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1214_fsm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1214_vm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 1232 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 1233 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1260 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1260_fsm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1260_vm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1261 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1261_fsm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1261_vm 2024-09-10T20:51:27.265 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1262 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1262_fsm 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1262_vm 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2396 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2396_fsm 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2396_vm 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2397 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2671 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2672 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2676 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2677 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2694 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2695 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2697 2024-09-10T20:51:27.266 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2698 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2846 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2847 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2964 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2965 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2966 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2967 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3592 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3593 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4060 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4061 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4175 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4176 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4177 2024-09-10T20:51:27.267 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4178 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4181 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4182 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4183 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4184 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4185 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4186 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6000 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6001 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6002 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6100 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6114 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6115 2024-09-10T20:51:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 pg_control 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/log: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:total 1 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 . 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 mappings 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 20:51 replorigin_checkpoint 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 snapshots 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.270 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 .. 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 .. 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 . 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 members 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 offsets 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.271 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 .. 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 0000 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 .. 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 0000 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.272 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-10T20:51:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.274 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 0000 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.275 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:total 16384 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 . 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:51 000000010000000000000001 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 archive_status 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 .. 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:27.276 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-10T20:51:27.277 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T20:51:27.277 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T20:51:27.277 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 20:51 .. 2024-09-10T20:51:27.277 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 0000 2024-09-10T20:51:27.277 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-10T20:51:27.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-10T20:51:27.419 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:27 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:27.444 INFO:teuthology.orchestra.run.smithi067.stderr:dropping old tables... 2024-09-10T20:51:27.445 INFO:teuthology.orchestra.run.smithi067.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-10T20:51:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-10T20:51:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-10T20:51:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-10T20:51:27.446 INFO:teuthology.orchestra.run.smithi067.stderr:creating tables... 2024-09-10T20:51:27.479 INFO:teuthology.orchestra.run.smithi067.stderr:generating data (client-side)... 2024-09-10T20:51:27.576 INFO:teuthology.orchestra.run.smithi067.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.79 s) 2024-09-10T20:51:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:27 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:27 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:27.739 INFO:teuthology.orchestra.run.smithi067.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.22 s, remaining 3.33 s) 2024-09-10T20:51:27.855 INFO:teuthology.orchestra.run.smithi067.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.34 s, remaining 3.26 s) 2024-09-10T20:51:28.006 INFO:teuthology.orchestra.run.smithi067.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.49 s, remaining 3.42 s) 2024-09-10T20:51:28.146 INFO:teuthology.orchestra.run.smithi067.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.63 s, remaining 3.39 s) 2024-09-10T20:51:28.241 INFO:teuthology.orchestra.run.smithi067.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.72 s, remaining 3.13 s) 2024-09-10T20:51:28.412 INFO:teuthology.orchestra.run.smithi067.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.89 s, remaining 3.20 s) 2024-09-10T20:51:28.590 INFO:teuthology.orchestra.run.smithi067.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.07 s, remaining 3.22 s) 2024-09-10T20:51:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:28 smithi083 ceph-mon[35058]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 130 KiB/s wr, 11 op/s 2024-09-10T20:51:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:28 smithi172 ceph-mon[35265]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 130 KiB/s wr, 11 op/s 2024-09-10T20:51:28.771 INFO:teuthology.orchestra.run.smithi067.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.25 s, remaining 3.20 s) 2024-09-10T20:51:28.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:28 smithi067 ceph-mon[30891]: pgmap v345: 97 pgs: 97 active+clean; 2.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 130 KiB/s wr, 11 op/s 2024-09-10T20:51:28.836 INFO:teuthology.orchestra.run.smithi067.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.32 s, remaining 2.90 s) 2024-09-10T20:51:29.031 INFO:teuthology.orchestra.run.smithi067.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.51 s, remaining 2.89 s) 2024-09-10T20:51:29.089 INFO:teuthology.orchestra.run.smithi067.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.57 s, remaining 2.62 s) 2024-09-10T20:51:29.268 INFO:teuthology.orchestra.run.smithi067.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.75 s, remaining 2.56 s) 2024-09-10T20:51:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.92 s, remaining 2.47 s) 2024-09-10T20:51:29.531 INFO:teuthology.orchestra.run.smithi067.stderr:1500000 of 3200000 tuples (46%) done (elapsed 2.01 s, remaining 2.28 s) 2024-09-10T20:51:29.701 INFO:teuthology.orchestra.run.smithi067.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.18 s, remaining 2.18 s) 2024-09-10T20:51:29.804 INFO:teuthology.orchestra.run.smithi067.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.29 s, remaining 2.02 s) 2024-09-10T20:51:29.969 INFO:teuthology.orchestra.run.smithi067.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.45 s, remaining 1.91 s) 2024-09-10T20:51:30.144 INFO:teuthology.orchestra.run.smithi067.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.63 s, remaining 1.80 s) 2024-09-10T20:51:30.312 INFO:teuthology.orchestra.run.smithi067.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.79 s, remaining 1.68 s) 2024-09-10T20:51:30.390 INFO:teuthology.orchestra.run.smithi067.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.87 s, remaining 1.50 s) 2024-09-10T20:51:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2200000 of 3200000 tuples (68%) done (elapsed 3.05 s, remaining 1.39 s) 2024-09-10T20:51:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.11 s, remaining 1.22 s) 2024-09-10T20:51:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:30 smithi083 ceph-mon[35058]: pgmap v346: 97 pgs: 97 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 754 KiB/s wr, 28 op/s 2024-09-10T20:51:30.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:30 smithi172 ceph-mon[35265]: pgmap v346: 97 pgs: 97 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 754 KiB/s wr, 28 op/s 2024-09-10T20:51:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:30 smithi067 ceph-mon[30891]: pgmap v346: 97 pgs: 97 active+clean; 9.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 754 KiB/s wr, 28 op/s 2024-09-10T20:51:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.31 s, remaining 1.10 s) 2024-09-10T20:51:31.009 INFO:teuthology.orchestra.run.smithi067.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.49 s, remaining 0.98 s) 2024-09-10T20:51:31.068 INFO:teuthology.orchestra.run.smithi067.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.55 s, remaining 0.82 s) 2024-09-10T20:51:31.247 INFO:teuthology.orchestra.run.smithi067.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.73 s, remaining 0.69 s) 2024-09-10T20:51:31.410 INFO:teuthology.orchestra.run.smithi067.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.89 s, remaining 0.56 s) 2024-09-10T20:51:31.487 INFO:teuthology.orchestra.run.smithi067.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.97 s, remaining 0.41 s) 2024-09-10T20:51:31.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:31 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:31.667 INFO:teuthology.orchestra.run.smithi067.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.15 s, remaining 0.28 s) 2024-09-10T20:51:31.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:31 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:31.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:31 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:51:31.838 INFO:teuthology.orchestra.run.smithi067.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.32 s, remaining 0.14 s) 2024-09-10T20:51:31.912 INFO:teuthology.orchestra.run.smithi067.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.39 s, remaining 0.00 s) 2024-09-10T20:51:31.960 INFO:teuthology.orchestra.run.smithi067.stderr:vacuuming... 2024-09-10T20:51:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:creating primary keys... 2024-09-10T20:51:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:32 smithi083 ceph-mon[35058]: pgmap v347: 97 pgs: 97 active+clean; 57 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.6 MiB/s wr, 53 op/s 2024-09-10T20:51:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:32 smithi172 ceph-mon[35265]: pgmap v347: 97 pgs: 97 active+clean; 57 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.6 MiB/s wr, 53 op/s 2024-09-10T20:51:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:32 smithi067 ceph-mon[30891]: pgmap v347: 97 pgs: 97 active+clean; 57 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 7.6 MiB/s wr, 53 op/s 2024-09-10T20:51:33.628 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:33 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:51:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:33 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:51:33.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:33 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:51:33.911 INFO:teuthology.orchestra.run.smithi067.stderr:done in 6.47 s (drop tables 0.00 s, create tables 0.03 s, client-side generate 4.48 s, vacuum 0.64 s, primary keys 1.31 s). 2024-09-10T20:51:33.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-10T20:51:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:starting vacuum...end. 2024-09-10T20:51:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: pgmap v348: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 42 MiB/s wr, 118 op/s 2024-09-10T20:51:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:34 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: pgmap v348: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 42 MiB/s wr, 118 op/s 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:34 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: pgmap v348: 97 pgs: 97 active+clean; 269 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 42 MiB/s wr, 118 op/s 2024-09-10T20:51:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:34.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:34 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:51:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:51:35.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:35.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:51:35.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:51:35.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:51:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:51:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:51:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:36 smithi172 ceph-mon[35265]: pgmap v349: 97 pgs: 97 active+clean; 365 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 56 MiB/s wr, 122 op/s 2024-09-10T20:51:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:36 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:51:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:36 smithi067 ceph-mon[30891]: pgmap v349: 97 pgs: 97 active+clean; 365 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 56 MiB/s wr, 122 op/s 2024-09-10T20:51:36.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:36 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:51:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:36 smithi083 ceph-mon[35058]: pgmap v349: 97 pgs: 97 active+clean; 365 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 56 MiB/s wr, 122 op/s 2024-09-10T20:51:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:36 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:51:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:38 smithi172 ceph-mon[35265]: pgmap v350: 97 pgs: 97 active+clean; 554 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 71 MiB/s wr, 221 op/s 2024-09-10T20:51:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:38 smithi067 ceph-mon[30891]: pgmap v350: 97 pgs: 97 active+clean; 554 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 71 MiB/s wr, 221 op/s 2024-09-10T20:51:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:38 smithi083 ceph-mon[35058]: pgmap v350: 97 pgs: 97 active+clean; 554 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 71 MiB/s wr, 221 op/s 2024-09-10T20:51:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 5.0 s, 5628.1 tps, lat 17.482 ms stddev 17.037 2024-09-10T20:51:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:40 smithi172 ceph-mon[35265]: pgmap v351: 97 pgs: 97 active+clean; 701 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 77 MiB/s wr, 277 op/s 2024-09-10T20:51:40.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:40 smithi067 ceph-mon[30891]: pgmap v351: 97 pgs: 97 active+clean; 701 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 77 MiB/s wr, 277 op/s 2024-09-10T20:51:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:40 smithi083 ceph-mon[35058]: pgmap v351: 97 pgs: 97 active+clean; 701 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 77 MiB/s wr, 277 op/s 2024-09-10T20:51:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:42 smithi172 ceph-mon[35265]: pgmap v352: 97 pgs: 97 active+clean; 781 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 78 MiB/s wr, 328 op/s 2024-09-10T20:51:42.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:42 smithi067 ceph-mon[30891]: pgmap v352: 97 pgs: 97 active+clean; 781 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 78 MiB/s wr, 328 op/s 2024-09-10T20:51:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:42 smithi083 ceph-mon[35058]: pgmap v352: 97 pgs: 97 active+clean; 781 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 78 MiB/s wr, 328 op/s 2024-09-10T20:51:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 10.0 s, 5464.6 tps, lat 18.295 ms stddev 17.842 2024-09-10T20:51:44.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:44 smithi172 ceph-mon[35265]: pgmap v353: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 74 MiB/s wr, 517 op/s 2024-09-10T20:51:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:44 smithi067 ceph-mon[30891]: pgmap v353: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 74 MiB/s wr, 517 op/s 2024-09-10T20:51:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:44 smithi083 ceph-mon[35058]: pgmap v353: 97 pgs: 97 active+clean; 900 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 74 MiB/s wr, 517 op/s 2024-09-10T20:51:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:46 smithi172 ceph-mon[35265]: pgmap v354: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 42 MiB/s wr, 597 op/s 2024-09-10T20:51:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:46 smithi067 ceph-mon[30891]: pgmap v354: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 42 MiB/s wr, 597 op/s 2024-09-10T20:51:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:46 smithi083 ceph-mon[35058]: pgmap v354: 97 pgs: 97 active+clean; 921 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 42 MiB/s wr, 597 op/s 2024-09-10T20:51:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:48 smithi172 ceph-mon[35265]: pgmap v355: 97 pgs: 97 active+clean; 934 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 751 op/s 2024-09-10T20:51:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:48 smithi067 ceph-mon[30891]: pgmap v355: 97 pgs: 97 active+clean; 934 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 751 op/s 2024-09-10T20:51:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:48 smithi083 ceph-mon[35058]: pgmap v355: 97 pgs: 97 active+clean; 934 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 29 MiB/s wr, 751 op/s 2024-09-10T20:51:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 15.0 s, 5771.7 tps, lat 17.346 ms stddev 17.841 2024-09-10T20:51:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:50 smithi172 ceph-mon[35265]: pgmap v356: 97 pgs: 97 active+clean; 945 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 707 op/s 2024-09-10T20:51:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:50 smithi067 ceph-mon[30891]: pgmap v356: 97 pgs: 97 active+clean; 945 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 707 op/s 2024-09-10T20:51:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:50 smithi083 ceph-mon[35058]: pgmap v356: 97 pgs: 97 active+clean; 945 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 15 MiB/s wr, 707 op/s 2024-09-10T20:51:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:52 smithi172 ceph-mon[35265]: pgmap v357: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 783 op/s 2024-09-10T20:51:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:52 smithi067 ceph-mon[30891]: pgmap v357: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 783 op/s 2024-09-10T20:51:52.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:52 smithi083 ceph-mon[35058]: pgmap v357: 97 pgs: 97 active+clean; 952 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 783 op/s 2024-09-10T20:51:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 20.0 s, 6067.0 tps, lat 16.460 ms stddev 16.593 2024-09-10T20:51:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:54 smithi172 ceph-mon[35265]: pgmap v358: 97 pgs: 97 active+clean; 968 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 977 op/s 2024-09-10T20:51:54.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:54 smithi067 ceph-mon[30891]: pgmap v358: 97 pgs: 97 active+clean; 968 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 977 op/s 2024-09-10T20:51:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:54 smithi083 ceph-mon[35058]: pgmap v358: 97 pgs: 97 active+clean; 968 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 977 op/s 2024-09-10T20:51:55.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:51:55.579 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.229+0000 7f5c6b264640 1 -- 172.21.15.67:0/683238573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c64109130 msgr2=0x7f5c6410f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.229+0000 7f5c6b264640 1 --2- 172.21.15.67:0/683238573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c64109130 0x7f5c6410f930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009be0 tx=0x7f5c5c02a6c0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.230+0000 7f5c6b264640 1 -- 172.21.15.67:0/683238573 shutdown_connections 2024-09-10T20:51:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.230+0000 7f5c6b264640 1 --2- 172.21.15.67:0/683238573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c64109130 0x7f5c6410f930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.230+0000 7f5c6b264640 1 --2- 172.21.15.67:0/683238573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c641087b0 0x7f5c64108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.230+0000 7f5c6b264640 1 --2- 172.21.15.67:0/683238573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.230+0000 7f5c6b264640 1 -- 172.21.15.67:0/683238573 >> 172.21.15.67:0/683238573 conn(0x7f5c640fe810 msgr2=0x7f5c64100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.232+0000 7f5c6b264640 1 -- 172.21.15.67:0/683238573 shutdown_connections 2024-09-10T20:51:56.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.232+0000 7f5c6b264640 1 -- 172.21.15.67:0/683238573 wait complete. 2024-09-10T20:51:56.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.233+0000 7f5c6b264640 1 Processor -- start 2024-09-10T20:51:56.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.233+0000 7f5c6b264640 1 -- start start 2024-09-10T20:51:56.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 0x7f5c64199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 0x7f5c6419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64112df0 con 0x7f5c64109130 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64112c70 con 0x7f5c641087b0 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c6b264640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64112f70 con 0x7f5c64102da0 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.234+0000 7f5c69000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 0x7f5c64199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c69000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51338/0 (socket says 172.21.15.67:51338) 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c69000640 1 -- 172.21.15.67:0/3289271743 learned_addr learned my addr 172.21.15.67:0/3289271743 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:56.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c69801640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 0x7f5c6419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 -- 172.21.15.67:0/3289271743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 msgr2=0x7f5c64199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 -- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 msgr2=0x7f5c6419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 0x7f5c6419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c63fff640 1 -- 172.21.15.67:0/3289271743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6419f2d0 con 0x7f5c641087b0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.235+0000 7f5c69801640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 0x7f5c6419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c63fff640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 0x7f5c64199760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000e790 tx=0x7f5c5000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c61ffb640 1 -- 172.21.15.67:0/3289271743 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000eea0 con 0x7f5c641087b0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c61ffb640 1 -- 172.21.15.67:0/3289271743 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c5000ccc0 con 0x7f5c641087b0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6419f5c0 con 0x7f5c641087b0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c61ffb640 1 -- 172.21.15.67:0/3289271743 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c50018680 con 0x7f5c641087b0 2024-09-10T20:51:56.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.236+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c641a5c80 con 0x7f5c641087b0 2024-09-10T20:51:56.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.240+0000 7f5c61ffb640 1 -- 172.21.15.67:0/3289271743 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f5c50018820 con 0x7f5c641087b0 2024-09-10T20:51:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.240+0000 7f5c6d639740 1 Processor -- start 2024-09-10T20:51:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.241+0000 7f5c61ffb640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 0x7f5c540b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.241+0000 7f5c61ffb640 1 -- 172.21.15.67:0/3289271743 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5c500e5d20 con 0x7f5c641087b0 2024-09-10T20:51:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.242+0000 7f5c6d639740 1 -- start start 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 0x55f1e59a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f1e590de50 con 0x55f1e5997da0 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f1e58fd280 con 0x55f1e5997480 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c6d639740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f1e5901090 con 0x55f1e59a3d30 2024-09-10T20:51:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69801640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 0x7f5c540b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69801640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 0x55f1e59a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69801640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51346/0 (socket says 172.21.15.67:51346) 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69801640 1 -- 172.21.15.67:0/3158642771 learned_addr learned my addr 172.21.15.67:0/3158642771 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.243+0000 7f5c69000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46896/0 (socket says 172.21.15.67:46896) 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 -- 172.21.15.67:0/3158642771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 msgr2=0x55f1e59a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 -- 172.21.15.67:0/3158642771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 msgr2=0x55f1e59a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 0x55f1e59a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 -- 172.21.15.67:0/3158642771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e565b650 con 0x55f1e5997480 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c63fff640 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 0x55f1e59a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c69000640 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c58004610 tx=0x7f5c5800bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91aadd308a96227b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c4effd640 1 -- 172.21.15.67:0/3158642771 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58003dd0 con 0x55f1e5997480 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c4effd640 1 -- 172.21.15.67:0/3158642771 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c58015070 con 0x55f1e5997480 2024-09-10T20:51:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.244+0000 7f5c4effd640 1 -- 172.21.15.67:0/3158642771 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58011440 con 0x55f1e5997480 2024-09-10T20:51:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.245+0000 7f5c6d639740 1 -- 172.21.15.67:0/3158642771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 msgr2=0x55f1e5997860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.245+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c58004610 tx=0x7f5c5800bc70 comp rx=0 tx=0).stop 2024-09-10T20:51:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.245+0000 7f5c69801640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 0x7f5c540b7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099a0 tx=0x7f5c5c0307e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 -- 172.21.15.67:0/3158642771 shutdown_connections 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997da0 0x55f1e59a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3158642771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997480 0x55f1e5997860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 -- 172.21.15.67:0/3158642771 >> 172.21.15.67:0/3158642771 conn(0x55f1e59952b0 msgr2=0x55f1e5996450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 -- 172.21.15.67:0/3158642771 shutdown_connections 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.246+0000 7f5c6d639740 1 -- 172.21.15.67:0/3158642771 wait complete. 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.247+0000 7f5c6d639740 1 -- start start 2024-09-10T20:51:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.247+0000 7f5c6d639740 1 Processor -- start 2024-09-10T20:51:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e59a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f1e575e700 con 0x55f1e5997480 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f1e5898110 con 0x55f1e5997da0 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f1e59a69b0 con 0x55f1e59a3d30 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46900/0 (socket says 172.21.15.67:46900) 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c63fff640 1 -- 172.21.15.67:0/267177760 learned_addr learned my addr 172.21.15.67:0/267177760 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c6d639740 10 client.0 _ll_register_callbacks cb 0x55f1e58b1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c69801640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.248+0000 7f5c69000640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e59a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 -- 172.21.15.67:0/267177760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 msgr2=0x55f1e59a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 -- 172.21.15.67:0/267177760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 msgr2=0x55f1e59a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e59a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 -- 172.21.15.67:0/267177760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e58c5c40 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c69000640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e59a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c63fff640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c50005fd0 tx=0x7f5c500ac9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf6c9d7d2a34432 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c43fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c500abec0 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5c50018d50 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c58015070 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5c500acab0 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.249+0000 7f5c6d639740 10 client.25022 fetch_fsmap learned FSMap version 27 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.250+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f1e59a9340 con 0x55f1e5997da0 2024-09-10T20:51:56.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.250+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c58015070 con 0x55f1e5997da0 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f5c500cf0c0 con 0x55f1e5997da0 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 10 client.25022 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 10 client.25022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 20 client.25022 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e59aa850 0x55f1e59accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 4 client.25022 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.251+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1e590fda0 con 0x55f1e59aa850 2024-09-10T20:51:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.252+0000 7f5c69000640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e59aa850 0x55f1e59accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.253+0000 7f5c69000640 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e59aa850 0x55f1e59accf0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b19df5df2de895 server_cookie=49edeb949e5468db in_seq=0 out_seq=0 2024-09-10T20:51:56.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.253+0000 7f5c43fff640 10 client.25022 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.254+0000 7f5c43fff640 1 -- 172.21.15.67:0/267177760 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1e590fda0 con 0x55f1e59aa850 2024-09-10T20:51:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.254+0000 7f5c43fff640 10 client.25022 handle_command_reply: tid=0 2024-09-10T20:51:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.254+0000 7f5c6d639740 1 client.25022 shutdown 2024-09-10T20:51:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 msgr2=0x55f1e59a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c50005fd0 tx=0x7f5c500ac9d0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 shutdown_connections 2024-09-10T20:51:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e59aa850 0x55f1e59accf0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59a0a70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 --2- 172.21.15.67:0/267177760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e59a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 >> 172.21.15.67:0/267177760 conn(0x55f1e59952b0 msgr2=0x55f1e599ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c43fff640 0 client.25022 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 shutdown_connections 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 1 -- 172.21.15.67:0/267177760 wait complete. 2024-09-10T20:51:56.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.255+0000 7f5c6d639740 20 client.25022 trim_cache size 0 max 16384 2024-09-10T20:51:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.290+0000 7f5c6d639740 1 Processor -- start 2024-09-10T20:51:56.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.290+0000 7f5c6d639740 1 -- start start 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e5997da0 0x55f1e599f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c69000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c69000640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47064/0 (socket says 172.21.15.67:47064) 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c69000640 1 -- 172.21.15.67:0/3972141995 learned_addr learned my addr 172.21.15.67:0/3972141995 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e59a3d30 0x55f1e599dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48010d20 con 0x55f1e5997480 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4800e5c0 con 0x55f1e59a3d30 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.291+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4800c410 con 0x55f1e5997da0 2024-09-10T20:51:56.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c63fff640 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e5997da0 0x55f1e599f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c69000640 1 -- 172.21.15.67:0/3972141995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e5997da0 msgr2=0x55f1e599f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c69000640 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e5997da0 0x55f1e599f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c69000640 1 -- 172.21.15.67:0/3972141995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e59a3d30 msgr2=0x55f1e599dc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c69000640 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e59a3d30 0x55f1e599dc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.292+0000 7f5c69000640 1 -- 172.21.15.67:0/3972141995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e599b770 con 0x55f1e5997480 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.293+0000 7f5c69000640 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b5a0 tx=0x7f5c58004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a3fd640411bea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.294+0000 7f5c4e7fc640 1 -- 172.21.15.67:0/3972141995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004640 con 0x55f1e5997480 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.294+0000 7f5c4e7fc640 1 -- 172.21.15.67:0/3972141995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c58015030 con 0x55f1e5997480 2024-09-10T20:51:56.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.294+0000 7f5c4e7fc640 1 -- 172.21.15.67:0/3972141995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58026ca0 con 0x55f1e5997480 2024-09-10T20:51:56.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 msgr2=0x55f1e599f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b5a0 tx=0x7f5c58004a50 comp rx=0 tx=0).stop 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 shutdown_connections 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e59a3d30 0x55f1e599dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e5997da0 0x55f1e599f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 --2- 172.21.15.67:0/3972141995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e5997480 0x55f1e599f2f0 secure :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b5a0 tx=0x7f5c58004a50 comp rx=0 tx=0).stop 2024-09-10T20:51:56.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.295+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 >> 172.21.15.67:0/3972141995 conn(0x55f1e59952b0 msgr2=0x55f1e599bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.296+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 shutdown_connections 2024-09-10T20:51:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.296+0000 7f5c6d639740 1 -- 172.21.15.67:0/3972141995 wait complete. 2024-09-10T20:51:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.297+0000 7f5c6d639740 1 -- start start 2024-09-10T20:51:56.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.297+0000 7f5c6d639740 1 Processor -- start 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 0x55f1e5a307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4800ca80 con 0x55f1e59af4f0 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4800def0 con 0x55f1e5997da0 2024-09-10T20:51:56.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4800d150 con 0x55f1e59a3d30 2024-09-10T20:51:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c6d639740 10 client.0 _ll_register_callbacks cb 0x7f5c5000ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:51:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69000640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46908/0 (socket says 172.21.15.67:46908) 2024-09-10T20:51:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69000640 1 -- 172.21.15.67:0/4013932988 learned_addr learned my addr 172.21.15.67:0/4013932988 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69801640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 0x55f1e5a307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69801640 1 -- 172.21.15.67:0/4013932988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 msgr2=0x55f1e59aee00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69801640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59aee00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69801640 1 -- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 msgr2=0x55f1e59ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.298+0000 7f5c69801640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.299+0000 7f5c69801640 1 -- 172.21.15.67:0/4013932988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e5a30fd0 con 0x55f1e59af4f0 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.299+0000 7f5c69801640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 0x55f1e5a307a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006010 tx=0x7f5c5c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1800f69f6eac7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.299+0000 7f5c43fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.300+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c053060 con 0x55f1e59af4f0 2024-09-10T20:51:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.300+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c58015030 con 0x55f1e59af4f0 2024-09-10T20:51:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.301+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5c5c031890 con 0x55f1e59af4f0 2024-09-10T20:51:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.301+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5c5c053060 con 0x55f1e59af4f0 2024-09-10T20:51:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.301+0000 7f5c6d639740 10 client.15402 fetch_fsmap learned FSMap version 27 2024-09-10T20:51:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.301+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f1e5a32330 con 0x55f1e59af4f0 2024-09-10T20:51:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.301+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c58015030 con 0x55f1e59af4f0 2024-09-10T20:51:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f5c5c03f7b0 con 0x55f1e59af4f0 2024-09-10T20:51:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 10 client.15402 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:51:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:51:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 20 client.15402 populate_metadata read hostname 'smithi067' 2024-09-10T20:51:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e5a32ac0 0x55f1e5a34ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 4 client.15402 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:51:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f1e590b850 con 0x55f1e5a32ac0 2024-09-10T20:51:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.302+0000 7f5c69000640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e5a32ac0 0x55f1e5a34ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.303+0000 7f5c69000640 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e5a32ac0 0x55f1e5a34ee0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e01d5cc1cef78c74 server_cookie=9567d73ad329ccda in_seq=0 out_seq=0 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.303+0000 7f5c43fff640 10 client.15402 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.303+0000 7f5c43fff640 1 -- 172.21.15.67:0/4013932988 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55f1e590b850 con 0x55f1e5a32ac0 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.303+0000 7f5c43fff640 10 client.15402 handle_command_reply: tid=0 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.303+0000 7f5c6d639740 1 client.15402 shutdown 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 msgr2=0x55f1e5a307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 0x55f1e5a307a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c006010 tx=0x7f5c5c02a6c0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 shutdown_connections 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55f1e5a32ac0 0x55f1e5a34ee0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f1e59af4f0 0x55f1e5a307a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1e59a3d30 0x55f1e59aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 --2- 172.21.15.67:0/4013932988 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1e5997da0 0x55f1e59ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 >> 172.21.15.67:0/4013932988 conn(0x55f1e59952b0 msgr2=0x55f1e599bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.304+0000 7f5c43fff640 0 client.15402 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.305+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 shutdown_connections 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.305+0000 7f5c6d639740 1 -- 172.21.15.67:0/4013932988 wait complete. 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.305+0000 7f5c6d639740 20 client.15402 trim_cache size 0 max 16384 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:51:56.310 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:51:56.311 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.306+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 msgr2=0x7f5c540b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.306+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 0x7f5c540b7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0099a0 tx=0x7f5c5c0307e0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 msgr2=0x7f5c64199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 0x7f5c64199760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000e790 tx=0x7f5c5000ec50 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 shutdown_connections 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5c64109130 0x7f5c6419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c641087b0 0x7f5c64199760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5c540b5370 0x7f5c540b7830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 --2- 172.21.15.67:0/3289271743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c64102da0 0x7f5c64199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.307+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 >> 172.21.15.67:0/3289271743 conn(0x7f5c640fe810 msgr2=0x7f5c64100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:56.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.308+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 shutdown_connections 2024-09-10T20:51:56.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:56.308+0000 7f5c6b264640 1 -- 172.21.15.67:0/3289271743 wait complete. 2024-09-10T20:51:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:56 smithi083 ceph-mon[35058]: pgmap v359: 97 pgs: 97 active+clean; 976 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-09-10T20:51:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:56 smithi172 ceph-mon[35265]: pgmap v359: 97 pgs: 97 active+clean; 976 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-09-10T20:51:56.769 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:56 smithi067 ceph-mon[30891]: pgmap v359: 97 pgs: 97 active+clean; 976 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 912 op/s 2024-09-10T20:51:57.120 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:51:57.121 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:51:57.571 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:51:58.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.179+0000 7f6407fff640 1 -- 172.21.15.67:0/315299228 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640802d5c0 con 0x7f6410108020 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.180+0000 7f641777e640 1 -- 172.21.15.67:0/315299228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6410108020 msgr2=0x7f641010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.180+0000 7f641777e640 1 --2- 172.21.15.67:0/315299228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6410108020 0x7f641010e820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6408009ca0 tx=0x7f640802cae0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.180+0000 7f641777e640 1 -- 172.21.15.67:0/315299228 shutdown_connections 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.180+0000 7f641777e640 1 --2- 172.21.15.67:0/315299228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6410108020 0x7f641010e820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.181+0000 7f641777e640 1 --2- 172.21.15.67:0/315299228 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101076a0 0x7f6410107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.181+0000 7f641777e640 1 --2- 172.21.15.67:0/315299228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 0x7f6410102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.181+0000 7f641777e640 1 -- 172.21.15.67:0/315299228 >> 172.21.15.67:0/315299228 conn(0x7f64100fd700 msgr2=0x7f64100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:58.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.181+0000 7f641777e640 1 -- 172.21.15.67:0/315299228 shutdown_connections 2024-09-10T20:51:58.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.182+0000 7f641777e640 1 -- 172.21.15.67:0/315299228 wait complete. 2024-09-10T20:51:58.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 Processor -- start 2024-09-10T20:51:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 -- start start 2024-09-10T20:51:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 0x7f64101970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:58.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6410108020 0x7f641019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:58.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6410110bd0 con 0x7f6410108020 2024-09-10T20:51:58.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6410110a50 con 0x7f64101076a0 2024-09-10T20:51:58.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.183+0000 7f641777e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6410110d50 con 0x7f6410101c90 2024-09-10T20:51:58.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:58.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46926/0 (socket says 172.21.15.67:46926) 2024-09-10T20:51:58.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 -- 172.21.15.67:0/11123806 learned_addr learned my addr 172.21.15.67:0/11123806 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:51:58.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f641551a640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 0x7f64101970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6415d1b640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6410108020 0x7f641019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 -- 172.21.15.67:0/11123806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 msgr2=0x7f64101970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 0x7f64101970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 -- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6410108020 msgr2=0x7f641019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.184+0000 7f6414d19640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6410108020 0x7f641019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f6414d19640 1 -- 172.21.15.67:0/11123806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641019d150 con 0x7f64101076a0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f6414d19640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f640000d950 tx=0x7f640000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f64101076a0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400009c30 con 0x7f64101076a0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640000f620 con 0x7f64101076a0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641019d440 con 0x7f64101076a0 2024-09-10T20:51:58.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.185+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a7f10 con 0x7f64101076a0 2024-09-10T20:51:58.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.188+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f6400010460 con 0x7f64101076a0 2024-09-10T20:51:58.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.190+0000 7f64067fc640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 0x7f63fc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:51:58.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.191+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64000a81c0 con 0x7f64101076a0 2024-09-10T20:51:58.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.191+0000 7f641551a640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 0x7f63fc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:51:58.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.192+0000 7f641551a640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 0x7f63fc0b78b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f640c0058c0 tx=0x7f640c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:51:58.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.192+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6410102070 con 0x7f64101076a0 2024-09-10T20:51:58.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.197+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64000ac650 con 0x7f64101076a0 2024-09-10T20:51:58.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.641+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6410109e00 con 0x7f64101076a0 2024-09-10T20:51:58.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.642+0000 7f64067fc640 1 -- 172.21.15.67:0/11123806 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f6400009de0 con 0x7f64101076a0 2024-09-10T20:51:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:51:58.647 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-10T20:51:30:345494+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:51:29.557607+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:51:58.647 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 msgr2=0x7f63fc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 0x7f63fc0b78b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f640c0058c0 tx=0x7f640c00a4c0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 msgr2=0x7f64101975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f640000d950 tx=0x7f640000de10 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 shutdown_connections 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.647+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6410108020 0x7f641019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.648+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64101076a0 0x7f64101975e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.648+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63fc0b53f0 0x7f63fc0b78b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.648+0000 7f641777e640 1 --2- 172.21.15.67:0/11123806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6410101c90 0x7f64101970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:51:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.648+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 >> 172.21.15.67:0/11123806 conn(0x7f64100fd700 msgr2=0x7f64100fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:51:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.650+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 shutdown_connections 2024-09-10T20:51:58.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:51:58.652+0000 7f641777e640 1 -- 172.21.15.67:0/11123806 wait complete. 2024-09-10T20:51:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:58 smithi172 ceph-mon[35265]: pgmap v360: 97 pgs: 97 active+clean; 977 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-10T20:51:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:58 smithi067 ceph-mon[30891]: pgmap v360: 97 pgs: 97 active+clean; 977 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-10T20:51:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:58 smithi083 ceph-mon[35058]: pgmap v360: 97 pgs: 97 active+clean; 977 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 13 MiB/s wr, 938 op/s 2024-09-10T20:51:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 25.0 s, 5586.4 tps, lat 17.900 ms stddev 18.052 2024-09-10T20:51:59.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:51:59 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/11123806' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:51:59 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/11123806' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:51:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:51:59 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/11123806' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:52:00.384 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:52:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:00 smithi067 ceph-mon[30891]: pgmap v361: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 884 op/s 2024-09-10T20:52:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:00 smithi083 ceph-mon[35058]: pgmap v361: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 884 op/s 2024-09-10T20:52:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:00 smithi172 ceph-mon[35265]: pgmap v361: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 MiB/s wr, 884 op/s 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.423+0000 7f879a864640 1 -- 172.21.15.67:0/346976327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87941043a0 msgr2=0x7f879410c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.423+0000 7f879a864640 1 --2- 172.21.15.67:0/346976327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87941043a0 0x7f879410c980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8784009860 tx=0x7f878402a340 comp rx=0 tx=0).stop 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 -- 172.21.15.67:0/346976327 shutdown_connections 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 --2- 172.21.15.67:0/346976327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f879410cf50 0x7f879410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 --2- 172.21.15.67:0/346976327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87941043a0 0x7f879410c980 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 --2- 172.21.15.67:0/346976327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941039a0 0x7f8794103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 -- 172.21.15.67:0/346976327 >> 172.21.15.67:0/346976327 conn(0x7f87940fd5b0 msgr2=0x7f87940ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 -- 172.21.15.67:0/346976327 shutdown_connections 2024-09-10T20:52:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.424+0000 7f879a864640 1 -- 172.21.15.67:0/346976327 wait complete. 2024-09-10T20:52:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.425+0000 7f879a864640 1 Processor -- start 2024-09-10T20:52:01.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.426+0000 7f879a864640 1 -- start start 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 0x7f8794108ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 0x7f87941093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 0x7f8794109940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799061640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 0x7f87941093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799061640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 0x7f87941093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47082/0 (socket says 172.21.15.67:47082) 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 0x7f8794108ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799061640 1 -- 172.21.15.67:0/2400193058 learned_addr learned my addr 172.21.15.67:0/2400193058 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8794102790 con 0x7f87941043a0 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8794102610 con 0x7f879410cf50 2024-09-10T20:52:01.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8794102910 con 0x7f87941039a0 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a063640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 0x7f8794109940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 -- 172.21.15.67:0/2400193058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 msgr2=0x7f8794109940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 0x7f8794109940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 -- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 msgr2=0x7f87941093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 0x7f87941093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f8799862640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87941ab860 con 0x7f87941039a0 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.427+0000 7f879a063640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 0x7f8794109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.428+0000 7f8799862640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 0x7f8794108ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f879000b3f0 tx=0x7f879000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.428+0000 7f878affd640 1 -- 172.21.15.67:0/2400193058 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790015020 con 0x7f87941039a0 2024-09-10T20:52:01.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.428+0000 7f878affd640 1 -- 172.21.15.67:0/2400193058 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8790011ce0 con 0x7f87941039a0 2024-09-10T20:52:01.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.428+0000 7f878affd640 1 -- 172.21.15.67:0/2400193058 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790010d80 con 0x7f87941039a0 2024-09-10T20:52:01.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.429+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87941abb50 con 0x7f87941039a0 2024-09-10T20:52:01.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.429+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87941ac040 con 0x7f87941039a0 2024-09-10T20:52:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.434+0000 7f879de9b740 1 Processor -- start 2024-09-10T20:52:01.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.434+0000 7f879de9b740 1 -- start start 2024-09-10T20:52:01.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f356b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f41640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ae55eabea0 con 0x55ae55f352d0 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ae55e9b2d0 con 0x55ae55f41b80 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879de9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae55e9f0e0 con 0x55ae55f35bf0 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f878affd640 1 -- 172.21.15.67:0/2400193058 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f8790011830 con 0x7f87941039a0 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f8799061640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f8799061640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46938/0 (socket says 172.21.15.67:46938) 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f8799061640 1 -- 172.21.15.67:0/2047723898 learned_addr learned my addr 172.21.15.67:0/2047723898 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:01.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.435+0000 7f879a063640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.436+0000 7f8799862640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f41640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f879a063640 1 -- 172.21.15.67:0/2047723898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 msgr2=0x55ae55f41640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f879a063640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f41640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f879a063640 1 -- 172.21.15.67:0/2047723898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 msgr2=0x55ae55f43f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f879a063640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f879a063640 1 -- 172.21.15.67:0/2047723898 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae55bf9650 con 0x55ae55f352d0 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f8799061640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f878affd640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 0x7f87800b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f8799862640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 0x7f87800b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.437+0000 7f878affd640 1 -- 172.21.15.67:0/2400193058 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f87900e5560 con 0x7f87941039a0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.438+0000 7f879a063640 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f356b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f878c005fd0 tx=0x7f878c00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc966912bb428b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.438+0000 7f8799862640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 0x7f87800b7950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87900e2f10 tx=0x7f87900047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.439+0000 7f877ffff640 1 -- 172.21.15.67:0/2047723898 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c004b20 con 0x55ae55f352d0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.439+0000 7f877ffff640 1 -- 172.21.15.67:0/2047723898 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878c004cc0 con 0x55ae55f352d0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.439+0000 7f877ffff640 1 -- 172.21.15.67:0/2047723898 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c005520 con 0x55ae55f352d0 2024-09-10T20:52:01.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.439+0000 7f879de9b740 1 -- 172.21.15.67:0/2047723898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 msgr2=0x55ae55f356b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.439+0000 7f879de9b740 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f356b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f878c005fd0 tx=0x7f878c00f7d0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.441+0000 7f879de9b740 1 -- 172.21.15.67:0/2047723898 shutdown_connections 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.441+0000 7f879de9b740 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f43f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.441+0000 7f879de9b740 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f41640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.441+0000 7f879de9b740 1 --2- 172.21.15.67:0/2047723898 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f356b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.441+0000 7f879de9b740 1 -- 172.21.15.67:0/2047723898 >> 172.21.15.67:0/2047723898 conn(0x55ae55f33100 msgr2=0x55ae55f342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.442+0000 7f879de9b740 1 -- 172.21.15.67:0/2047723898 shutdown_connections 2024-09-10T20:52:01.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.442+0000 7f879de9b740 1 -- 172.21.15.67:0/2047723898 wait complete. 2024-09-10T20:52:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.442+0000 7f879de9b740 1 -- start start 2024-09-10T20:52:01.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.442+0000 7f879de9b740 1 Processor -- start 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f41530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f3e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ae55cfc700 con 0x55ae55f352d0 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ae55e36160 con 0x55ae55f35bf0 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.443+0000 7f879de9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae55f447a0 con 0x55ae55f41b80 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879de9b740 10 client.0 _ll_register_callbacks cb 0x55ae55e4f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:01.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51462/0 (socket says 172.21.15.67:51462) 2024-09-10T20:52:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 -- 172.21.15.67:0/1420769318 learned_addr learned my addr 172.21.15.67:0/1420769318 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f8799061640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f3e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f41530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 -- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 msgr2=0x55ae55f3e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f3e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 -- 172.21.15.67:0/1420769318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 msgr2=0x55ae55f41530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f41530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 -- 172.21.15.67:0/1420769318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae55e63c90 con 0x55ae55f41b80 2024-09-10T20:52:01.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f879a063640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f878c000f80 tx=0x7f878c0099d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c707a0c86f86e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.444+0000 7f877d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c003970 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f878c003b10 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f878c004cc0 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f878c003d10 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f879de9b740 10 client.25030 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.445+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ae55f50200 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f878c005920 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f878c00b040 con 0x55ae55f41b80 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 10 client.25030 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 10 client.25030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:52:01.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 20 client.25030 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55f53a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 4 client.25030 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.446+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f878c004cc0 con 0x55ae55f51610 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.447+0000 7f8799061640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55f53a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.447+0000 7f877d7fa640 10 client.25030 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:01.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.448+0000 7f8799061640 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55f53a00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0597f7b861e7267 server_cookie=869e61b6f5cb3987 in_seq=0 out_seq=0 2024-09-10T20:52:01.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f877d7fa640 1 -- 172.21.15.67:0/1420769318 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f878c004cc0 con 0x55ae55f51610 2024-09-10T20:52:01.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f877d7fa640 10 client.25030 handle_command_reply: tid=0 2024-09-10T20:52:01.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 client.25030 shutdown 2024-09-10T20:52:01.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 msgr2=0x55ae55f3f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f878c000f80 tx=0x7f878c0099d0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 shutdown_connections 2024-09-10T20:52:01.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55f53a00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.449+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f3f050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f3e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f877d7fa640 0 client.25030 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 1 --2- 172.21.15.67:0/1420769318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f41530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 >> 172.21.15.67:0/1420769318 conn(0x55ae55f33100 msgr2=0x55ae55f38c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 shutdown_connections 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 1 -- 172.21.15.67:0/1420769318 wait complete. 2024-09-10T20:52:01.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.450+0000 7f879de9b740 20 client.25030 trim_cache size 0 max 16384 2024-09-10T20:52:01.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 Processor -- start 2024-09-10T20:52:01.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 -- start start 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f4d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b70f0 con 0x55ae55f352d0 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f8799061640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879a063640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f4d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f8799061640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46950/0 (socket says 172.21.15.67:46950) 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f8799061640 1 -- 172.21.15.67:0/1580879539 learned_addr learned my addr 172.21.15.67:0/1580879539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b4990 con 0x55ae55f35bf0 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.475+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b27e0 con 0x55ae55f41b80 2024-09-10T20:52:01.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f879a063640 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f8799061640 1 -- 172.21.15.67:0/1580879539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 msgr2=0x55ae55f32110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f8799061640 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f32110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f8799061640 1 -- 172.21.15.67:0/1580879539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 msgr2=0x55ae55f4d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f8799061640 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f4d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.476+0000 7f8799061640 1 -- 172.21.15.67:0/1580879539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae55f33b80 con 0x55ae55f35bf0 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.477+0000 7f8799061640 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8784035040 tx=0x7f8784030340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3520c59720961c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.477+0000 7f877f7fe640 1 -- 172.21.15.67:0/1580879539 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878404d030 con 0x55ae55f35bf0 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.477+0000 7f877f7fe640 1 -- 172.21.15.67:0/1580879539 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8784030450 con 0x55ae55f35bf0 2024-09-10T20:52:01.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.477+0000 7f877f7fe640 1 -- 172.21.15.67:0/1580879539 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784047070 con 0x55ae55f35bf0 2024-09-10T20:52:01.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.478+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 msgr2=0x55ae55f341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.478+0000 7f879de9b740 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8784035040 tx=0x7f8784030340 comp rx=0 tx=0).stop 2024-09-10T20:52:01.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 shutdown_connections 2024-09-10T20:52:01.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f41b80 0x55ae55f32110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f35bf0 0x55ae55f341c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 --2- 172.21.15.67:0/1580879539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f4d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 >> 172.21.15.67:0/1580879539 conn(0x55ae55f33100 msgr2=0x55ae55f31a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 shutdown_connections 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.479+0000 7f879de9b740 1 -- 172.21.15.67:0/1580879539 wait complete. 2024-09-10T20:52:01.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.480+0000 7f879de9b740 1 -- start start 2024-09-10T20:52:01.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.480+0000 7f879de9b740 1 Processor -- start 2024-09-10T20:52:01.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f49c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b2e50 con 0x55ae55f352d0 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b42c0 con 0x55ae55f41b80 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87941b3520 con 0x55ae55f35bf0 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f8799061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f8799061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51484/0 (socket says 172.21.15.67:51484) 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f8799061640 1 -- 172.21.15.67:0/3521022749 learned_addr learned my addr 172.21.15.67:0/3521022749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879a063640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f49c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.481+0000 7f879de9b740 10 client.0 _ll_register_callbacks cb 0x7f878c009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f8799061640 1 -- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 msgr2=0x55ae55f449f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:52:01.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f879a063640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f8799061640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f8799061640 1 -- 172.21.15.67:0/3521022749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 msgr2=0x55ae55f49c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:01.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f8799061640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f49c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.482+0000 7f8799061640 1 -- 172.21.15.67:0/3521022749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae55f44fe0 con 0x55ae55f35bf0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.483+0000 7f8799061640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8784009830 tx=0x7f8784030760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27f7a5314753d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.483+0000 7f877d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.483+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784058070 con 0x55ae55f35bf0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.483+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8784003700 con 0x55ae55f35bf0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.483+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8784030450 con 0x55ae55f35bf0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.484+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8784037040 con 0x55ae55f35bf0 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.484+0000 7f879de9b740 10 client.25036 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:01.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.484+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ae55fbea90 con 0x55ae55f35bf0 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8784030450 con 0x55ae55f35bf0 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8784064020 con 0x55ae55f35bf0 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 10 client.25036 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 10 client.25036 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 20 client.25036 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:01.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55fc1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:01.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 4 client.25036 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:01.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae55eaddf0 con 0x55ae55f51610 2024-09-10T20:52:01.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.485+0000 7f879a063640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55fc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.486+0000 7f877d7fa640 10 client.25036 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.486+0000 7f879a063640 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55fc1180 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aaa1d67a238c302 server_cookie=37f39a9a54887cda in_seq=0 out_seq=0 2024-09-10T20:52:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f877d7fa640 1 -- 172.21.15.67:0/3521022749 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae55eaddf0 con 0x55ae55f51610 2024-09-10T20:52:01.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f877d7fa640 10 client.25036 handle_command_reply: tid=0 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f879de9b740 1 client.25036 shutdown 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 msgr2=0x55ae55f4a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8784009830 tx=0x7f8784030760 comp rx=0 tx=0).stop 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 shutdown_connections 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.487+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55ae55f51610 0x55ae55fc1180 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ae55f41b80 0x55ae55f449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae55f35bf0 0x55ae55f4a160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 --2- 172.21.15.67:0/3521022749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ae55f352d0 0x55ae55f49c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 >> 172.21.15.67:0/3521022749 conn(0x55ae55f33100 msgr2=0x55ae55f407d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f877d7fa640 0 client.25036 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 shutdown_connections 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 1 -- 172.21.15.67:0/3521022749 wait complete. 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.488+0000 7f879de9b740 20 client.25036 trim_cache size 0 max 16384 2024-09-10T20:52:01.493 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.489+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 msgr2=0x7f87800b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.489+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 0x7f87800b7950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f87900e2f10 tx=0x7f87900047d0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.489+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 msgr2=0x7f8794108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.489+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 0x7f8794108ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f879000b3f0 tx=0x7f879000b8b0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 shutdown_connections 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f879410cf50 0x7f8794109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87941043a0 0x7f87941093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f87800b5490 0x7f87800b7950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 --2- 172.21.15.67:0/2400193058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87941039a0 0x7f8794108ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 >> 172.21.15.67:0/2400193058 conn(0x7f87940fd5b0 msgr2=0x7f879410ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 shutdown_connections 2024-09-10T20:52:01.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:01.490+0000 7f879a864640 1 -- 172.21.15.67:0/2400193058 wait complete. 2024-09-10T20:52:02.357 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:52:02.762 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:02.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:02 smithi067 ceph-mon[30891]: pgmap v362: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 910 op/s 2024-09-10T20:52:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:02 smithi083 ceph-mon[35058]: pgmap v362: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 910 op/s 2024-09-10T20:52:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:02 smithi172 ceph-mon[35265]: pgmap v362: 97 pgs: 97 active+clean; 986 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 12 MiB/s wr, 910 op/s 2024-09-10T20:52:03.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 -- 172.21.15.67:0/3326257195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4101c90 msgr2=0x7fcfe4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 --2- 172.21.15.67:0/3326257195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4101c90 0x7fcfe4102070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009900 tx=0x7fcfd402a410 comp rx=0 tx=0).stop 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 -- 172.21.15.67:0/3326257195 shutdown_connections 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 --2- 172.21.15.67:0/3326257195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe4108020 0x7fcfe410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 --2- 172.21.15.67:0/3326257195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe41076a0 0x7fcfe4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 --2- 172.21.15.67:0/3326257195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4101c90 0x7fcfe4102070 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 -- 172.21.15.67:0/3326257195 >> 172.21.15.67:0/3326257195 conn(0x7fcfe40fd700 msgr2=0x7fcfe40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 -- 172.21.15.67:0/3326257195 shutdown_connections 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.336+0000 7fcfe9627640 1 -- 172.21.15.67:0/3326257195 wait complete. 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.338+0000 7fcfe9627640 1 Processor -- start 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.338+0000 7fcfe9627640 1 -- start start 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 0x7fcfe4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 0x7fcfe4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 0x7fcfe419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4112e40 con 0x7fcfe4101c90 2024-09-10T20:52:03.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4112cc0 con 0x7fcfe41076a0 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe9627640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4112fc0 con 0x7fcfe4108020 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 0x7fcfe4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 0x7fcfe4199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56396/0 (socket says 172.21.15.67:56396) 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe27fc640 1 -- 172.21.15.67:0/520303540 learned_addr learned my addr 172.21.15.67:0/520303540 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.339+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 0x7fcfe419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 0x7fcfe4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 -- 172.21.15.67:0/520303540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 msgr2=0x7fcfe4199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 0x7fcfe4199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 -- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 msgr2=0x7fcfe4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 0x7fcfe4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 -- 172.21.15.67:0/520303540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe419f3e0 con 0x7fcfe4108020 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 0x7fcfe4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.340+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 0x7fcfe419ec10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00be20 tx=0x7fcfdc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.341+0000 7fcfcbfff640 1 -- 172.21.15.67:0/520303540 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc019070 con 0x7fcfe4108020 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.341+0000 7fcfcbfff640 1 -- 172.21.15.67:0/520303540 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfdc0148f0 con 0x7fcfe4108020 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.341+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe419f6d0 con 0x7fcfe4108020 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.341+0000 7fcfcbfff640 1 -- 172.21.15.67:0/520303540 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc012860 con 0x7fcfe4108020 2024-09-10T20:52:03.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.341+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe406cb70 con 0x7fcfe4108020 2024-09-10T20:52:03.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.344+0000 7fcfeb9fc740 1 Processor -- start 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 -- start start 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18deedb70 0x55c18deedf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defee40 0x55c18df07800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c18de66ea0 con 0x55c18defee40 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c18de562d0 con 0x55c18defe4c0 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.345+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c18de5a0e0 con 0x55c18deedb70 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56410/0 (socket says 172.21.15.67:56410) 2024-09-10T20:52:03.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2096933832 learned_addr learned my addr 172.21.15.67:0/2096933832 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2096933832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18deedb70 msgr2=0x55c18deedf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:03.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18deedb70 0x55c18deedf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2096933832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defee40 msgr2=0x55c18df07800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defee40 0x55c18df07800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.346+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2096933832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c18dbb4650 con 0x55c18defe4c0 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.347+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4005dc0 tx=0x7fcfd4004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebab456ec40d6150 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.347+0000 7fcfc97fa640 1 -- 172.21.15.67:0/2096933832 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4050070 con 0x55c18defe4c0 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.348+0000 7fcfc97fa640 1 -- 172.21.15.67:0/2096933832 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd40054f0 con 0x55c18defe4c0 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.348+0000 7fcfc97fa640 1 -- 172.21.15.67:0/2096933832 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4035030 con 0x55c18defe4c0 2024-09-10T20:52:03.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.348+0000 7fcfcbfff640 1 -- 172.21.15.67:0/520303540 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fcfdc014440 con 0x7fcfe4108020 2024-09-10T20:52:03.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.349+0000 7fcfcbfff640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 0x7fcfcc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.349+0000 7fcfcbfff640 1 -- 172.21.15.67:0/520303540 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfdc0e5850 con 0x7fcfe4108020 2024-09-10T20:52:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2096933832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 msgr2=0x55c18defe900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4005dc0 tx=0x7fcfd4004260 comp rx=0 tx=0).stop 2024-09-10T20:52:03.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 0x7fcfcc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2096933832 shutdown_connections 2024-09-10T20:52:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defee40 0x55c18df07800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.350+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18defe900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.351+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2096933832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18deedb70 0x55c18deedf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.351+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2096933832 >> 172.21.15.67:0/2096933832 conn(0x55c18def0090 msgr2=0x55c18def0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.351+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2096933832 shutdown_connections 2024-09-10T20:52:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.351+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 0x7fcfcc0b78f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4106e50 tx=0x7fcfd800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.352+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2096933832 wait complete. 2024-09-10T20:52:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.352+0000 7fcfeb9fc740 1 -- start start 2024-09-10T20:52:03.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.352+0000 7fcfeb9fc740 1 Processor -- start 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defe4c0 0x55c18def3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56426/0 (socket says 172.21.15.67:56426) 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2564036332 learned_addr learned my addr 172.21.15.67:0/2564036332 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.353+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18defd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defe4c0 0x55c18def3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c18dcb7700 con 0x55c18defe4c0 2024-09-10T20:52:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18defd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c18ddf1160 con 0x55c18deedb70 2024-09-10T20:52:03.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c18def1dd0 con 0x55c18defee40 2024-09-10T20:52:03.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.354+0000 7fcfeb9fc740 10 client.0 _ll_register_callbacks cb 0x55c18de0a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.357+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 msgr2=0x55c18defd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.357+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18defd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.357+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2564036332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defe4c0 msgr2=0x55c18def3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.357+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defe4c0 0x55c18def3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.357+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18de1ec90 con 0x55c18deedb70 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.358+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004c90 tx=0x7fcfd4004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9630e9cef1cae870 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.358+0000 7fcfc6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.360+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd405d020 con 0x55c18deedb70 2024-09-10T20:52:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.360+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd40054f0 con 0x55c18deedb70 2024-09-10T20:52:03.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.360+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfd4005290 con 0x55c18deedb70 2024-09-10T20:52:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.361+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcfd4050070 con 0x55c18deedb70 2024-09-10T20:52:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.361+0000 7fcfeb9fc740 10 client.25055 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:03.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.361+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c18df1bee0 con 0x55c18deedb70 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.361+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd40054f0 con 0x55c18deedb70 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.362+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fcfd404a040 con 0x55c18deedb70 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 10 client.25055 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 10 client.25055 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 20 client.25055 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:03.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df1d3c0 0x55c18df1f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 4 client.25055 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c18de68df0 con 0x55c18df1d3c0 2024-09-10T20:52:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.363+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df1d3c0 0x55c18df1f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.364+0000 7fcfc6ff5640 10 client.25055 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:03.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.364+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df1d3c0 0x55c18df1f840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3170f3499725a5c2 server_cookie=f54848fbe441da94 in_seq=0 out_seq=0 2024-09-10T20:52:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/2564036332 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c18de68df0 con 0x55c18df1d3c0 2024-09-10T20:52:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfc6ff5640 10 client.25055 handle_command_reply: tid=0 2024-09-10T20:52:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 client.25055 shutdown 2024-09-10T20:52:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 msgr2=0x55c18def2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004c90 tx=0x7fcfd4004580 comp rx=0 tx=0).stop 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 shutdown_connections 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df1d3c0 0x55c18df1f840 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18defd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18defe4c0 0x55c18def3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/2564036332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18deedb70 0x55c18def2f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.365+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 >> 172.21.15.67:0/2564036332 conn(0x55c18def0090 msgr2=0x55c18deef860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.366+0000 7fcfc6ff5640 0 client.25055 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.366+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 shutdown_connections 2024-09-10T20:52:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.366+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/2564036332 wait complete. 2024-09-10T20:52:03.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.366+0000 7fcfeb9fc740 20 client.25055 trim_cache size 0 max 16384 2024-09-10T20:52:03.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.390+0000 7fcfeb9fc740 1 Processor -- start 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 -- start start 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18deedb70 0x55c18deeca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18df07770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe41a6150 con 0x55c18deedb70 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4072fe0 con 0x55c18defe4c0 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4070ee0 con 0x55c18defee40 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.391+0000 7fcfe27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56436/0 (socket says 172.21.15.67:56436) 2024-09-10T20:52:03.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 -- 172.21.15.67:0/3111645056 learned_addr learned my addr 172.21.15.67:0/3111645056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18df07770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 -- 172.21.15.67:0/3111645056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 msgr2=0x55c18df07770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18df07770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 -- 172.21.15.67:0/3111645056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18deedb70 msgr2=0x55c18deeca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18deedb70 0x55c18deeca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 -- 172.21.15.67:0/3111645056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c18deee8d0 con 0x55c18defe4c0 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.392+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8004650 tx=0x7fcfd8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73fdde35f0199cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.393+0000 7fcfc8ff9640 1 -- 172.21.15.67:0/3111645056 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd802c070 con 0x55c18defe4c0 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.393+0000 7fcfc8ff9640 1 -- 172.21.15.67:0/3111645056 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd801e8d0 con 0x55c18defe4c0 2024-09-10T20:52:03.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.393+0000 7fcfc8ff9640 1 -- 172.21.15.67:0/3111645056 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80106c0 con 0x55c18defe4c0 2024-09-10T20:52:03.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.394+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/3111645056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 msgr2=0x55c18df07230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.394+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8004650 tx=0x7fcfd8013000 comp rx=0 tx=0).stop 2024-09-10T20:52:03.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.395+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/3111645056 shutdown_connections 2024-09-10T20:52:03.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.395+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defee40 0x55c18df07770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.395+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defe4c0 0x55c18df07230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.395+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/3111645056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18deedb70 0x55c18deeca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.395+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/3111645056 >> 172.21.15.67:0/3111645056 conn(0x55c18def0090 msgr2=0x55c18df1f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.396+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/3111645056 shutdown_connections 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.396+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/3111645056 wait complete. 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.396+0000 7fcfeb9fc740 1 -- start start 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.396+0000 7fcfeb9fc740 1 Processor -- start 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defee40 0x55c18df2d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 0x55c18df892e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe40714a0 con 0x55c18df2db80 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4072910 con 0x55c18defee40 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe4071b70 con 0x55c18defe4c0 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfeb9fc740 10 client.0 _ll_register_callbacks cb 0x7fcfd4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:03.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47184/0 (socket says 172.21.15.67:47184) 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfe2ffd640 1 -- 172.21.15.67:0/1206521337 learned_addr learned my addr 172.21.15.67:0/1206521337 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 0x55c18df892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.397+0000 7fcfe27fc640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defee40 0x55c18df2d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 -- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 msgr2=0x55c18df2d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 -- 172.21.15.67:0/1206521337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defee40 msgr2=0x55c18df2d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defee40 0x55c18df2d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 -- 172.21.15.67:0/1206521337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18df898a0 con 0x55c18df2db80 2024-09-10T20:52:03.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfe37fe640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 0x55c18df892e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0e31d0 tx=0x7fcfdc0a8580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddafb7dafff934b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfc6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.398+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0b5410 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.399+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfdc0b4f80 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.399+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd801e8d0 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.399+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcfdc0b5180 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.399+0000 7fcfeb9fc740 10 client.15426 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.399+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c18df8abe0 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.400+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfdc0971a0 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.400+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fcfdc0b3ce0 con 0x55c18df2db80 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:03.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 10 client.15426 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 20 client.15426 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df8b330 0x55c18df8d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 4 client.15426 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcfd801e8d0 con 0x55c18df8b330 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df8b330 0x55c18df8d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.401+0000 7fcfe2ffd640 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df8b330 0x55c18df8d750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=830281aca717134a server_cookie=34bb9397bac02b54 in_seq=0 out_seq=0 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfc6ff5640 10 client.15426 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfc6ff5640 1 -- 172.21.15.67:0/1206521337 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcfd801e8d0 con 0x55c18df8b330 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfc6ff5640 10 client.15426 handle_command_reply: tid=0 2024-09-10T20:52:03.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 client.15426 shutdown 2024-09-10T20:52:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 msgr2=0x55c18df892e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 0x55c18df892e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0e31d0 tx=0x7fcfdc0a8580 comp rx=0 tx=0).stop 2024-09-10T20:52:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 shutdown_connections 2024-09-10T20:52:03.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c18df8b330 0x55c18df8d750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c18df2db80 0x55c18df892e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c18defee40 0x55c18df2d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfc6ff5640 0 client.15426 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 --2- 172.21.15.67:0/1206521337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c18defe4c0 0x55c18df2d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.402+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 >> 172.21.15.67:0/1206521337 conn(0x55c18def0090 msgr2=0x55c18deeca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.403+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 shutdown_connections 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.403+0000 7fcfeb9fc740 1 -- 172.21.15.67:0/1206521337 wait complete. 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.403+0000 7fcfeb9fc740 20 client.15426 trim_cache size 0 max 16384 2024-09-10T20:52:03.410 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 msgr2=0x7fcfcc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 0x7fcfcc0b78f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4106e50 tx=0x7fcfd800b4a0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 msgr2=0x7fcfe419ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:03.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 0x7fcfe419ec10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00be20 tx=0x7fcfdc00bf10 comp rx=0 tx=0).stop 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 shutdown_connections 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcfcc0b5430 0x7fcfcc0b78f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe4108020 0x7fcfe419ec10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcfe41076a0 0x7fcfe4199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.406+0000 7fcfe9627640 1 --2- 172.21.15.67:0/520303540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfe4101c90 0x7fcfe4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.407+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 >> 172.21.15.67:0/520303540 conn(0x7fcfe40fd700 msgr2=0x7fcfe40fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:03.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.407+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 shutdown_connections 2024-09-10T20:52:03.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:03.408+0000 7fcfe9627640 1 -- 172.21.15.67:0/520303540 wait complete. 2024-09-10T20:52:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 30.0 s, 6105.2 tps, lat 16.387 ms stddev 18.255 2024-09-10T20:52:04.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:52:04.625 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:04.760 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:04 smithi067 ceph-mon[30891]: pgmap v363: 97 pgs: 97 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-10T20:52:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:04 smithi083 ceph-mon[35058]: pgmap v363: 97 pgs: 97 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-10T20:52:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:04 smithi172 ceph-mon[35265]: pgmap v363: 97 pgs: 97 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 1.11k op/s 2024-09-10T20:52:05.747 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 -- 172.21.15.67:0/1434123308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 msgr2=0x7fc1c0106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1434123308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c0106e20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009900 tx=0x7fc1b002b510 comp rx=0 tx=0).stop 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 -- 172.21.15.67:0/1434123308 shutdown_connections 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1434123308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c0107360 0x7fc1c010db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1434123308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c0106e20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1434123308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c0100fd0 0x7fc1c01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.217+0000 7fc1c7408640 1 -- 172.21.15.67:0/1434123308 >> 172.21.15.67:0/1434123308 conn(0x7fc1c00fca20 msgr2=0x7fc1c00fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.219+0000 7fc1c7408640 1 -- 172.21.15.67:0/1434123308 shutdown_connections 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.224+0000 7fc1c7408640 1 -- 172.21.15.67:0/1434123308 wait complete. 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.225+0000 7fc1c7408640 1 Processor -- start 2024-09-10T20:52:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.225+0000 7fc1c7408640 1 -- start start 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c0100fd0 0x7fc1c00701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c0107360 0x7fc1c006ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c006d430 con 0x7fc1c0100fd0 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c006d2b0 con 0x7fc1c01069e0 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c7408640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c006d5b0 con 0x7fc1c0107360 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c49a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c49a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56462/0 (socket says 172.21.15.67:56462) 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.226+0000 7fc1c49a3640 1 -- 172.21.15.67:0/1449798304 learned_addr learned my addr 172.21.15.67:0/1449798304 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.227+0000 7fc1c49a3640 1 -- 172.21.15.67:0/1449798304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c0107360 msgr2=0x7fc1c006ee40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:52:05.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.227+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c0107360 0x7fc1c006ee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.227+0000 7fc1c49a3640 1 -- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c0100fd0 msgr2=0x7fc1c00701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.227+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c0100fd0 0x7fc1c00701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.227+0000 7fc1c49a3640 1 -- 172.21.15.67:0/1449798304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c006f380 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.228+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0032440 tx=0x7fc1b0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.228+0000 7fc1b67fc640 1 -- 172.21.15.67:0/1449798304 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b003f030 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.228+0000 7fc1b67fc640 1 -- 172.21.15.67:0/1449798304 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b0003e00 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.228+0000 7fc1b67fc640 1 -- 172.21.15.67:0/1449798304 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0036040 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.228+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c006f610 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.229+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c01a62a0 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.234+0000 7fc1c97dd740 1 Processor -- start 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.234+0000 7fc1b67fc640 1 -- 172.21.15.67:0/1449798304 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fc1b003bb00 con 0x7fc1c01069e0 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.234+0000 7fc1c97dd740 1 -- start start 2024-09-10T20:52:05.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 0x56393a4bb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56393a431ea0 con 0x56393a4c7d80 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56393a4212d0 con 0x56393a4bbdf0 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56393a4250e0 con 0x56393a4bb4d0 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c51a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 0x56393a4bb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c51a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56472/0 (socket says 172.21.15.67:56472) 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c51a4640 1 -- 172.21.15.67:0/3414529149 learned_addr learned my addr 172.21.15.67:0/3414529149 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 -- 172.21.15.67:0/3414529149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 msgr2=0x56393a4c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 -- 172.21.15.67:0/3414529149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 msgr2=0x56393a4ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c59a5640 1 -- 172.21.15.67:0/3414529149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56393a17f650 con 0x56393a4bb4d0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.235+0000 7fc1b67fc640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 0x7fc1ac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.236+0000 7fc1b67fc640 1 -- 172.21.15.67:0/1449798304 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc1b0106070 con 0x7fc1c01069e0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.236+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 0x56393a4bb8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b8c0 tx=0x7fc1b800bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc9bddfcc7bdb31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.236+0000 7fc1ab7fe640 1 -- 172.21.15.67:0/3414529149 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8016070 con 0x56393a4bb4d0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.236+0000 7fc1ab7fe640 1 -- 172.21.15.67:0/3414529149 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b8005020 con 0x56393a4bb4d0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.237+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 0x7fc1ac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.237+0000 7fc1ab7fe640 1 -- 172.21.15.67:0/3414529149 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8004cd0 con 0x56393a4bb4d0 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.237+0000 7fc1c97dd740 1 -- 172.21.15.67:0/3414529149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 msgr2=0x56393a4bb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.237+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 0x56393a4bb8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b8c0 tx=0x7fc1b800bd80 comp rx=0 tx=0).stop 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 -- 172.21.15.67:0/3414529149 shutdown_connections 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/3414529149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bb4d0 0x56393a4bb8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 -- 172.21.15.67:0/3414529149 >> 172.21.15.67:0/3414529149 conn(0x56393a4b9300 msgr2=0x56393a4ba4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 -- 172.21.15.67:0/3414529149 shutdown_connections 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 0x7fc1ac0b78b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009fd0 tx=0x7fc1bc009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.238+0000 7fc1c97dd740 1 -- 172.21.15.67:0/3414529149 wait complete. 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.239+0000 7fc1c97dd740 1 -- start start 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.239+0000 7fc1c97dd740 1 Processor -- start 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.239+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.239+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.239+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56393a282700 con 0x56393a4bb4d0 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56393a3bc160 con 0x56393a4bbdf0 2024-09-10T20:52:05.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56393a4caa50 con 0x56393a4c7d80 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c97dd740 10 client.0 _ll_register_callbacks cb 0x56393a3d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47216/0 (socket says 172.21.15.67:47216) 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 -- 172.21.15.67:0/1518729975 learned_addr learned my addr 172.21.15.67:0/1518729975 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 -- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 msgr2=0x56393a4c4b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 -- 172.21.15.67:0/1518729975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 msgr2=0x56393a4c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.240+0000 7fc1c59a5640 1 -- 172.21.15.67:0/1518729975 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56393a3e9c90 con 0x56393a4c7d80 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80056f0 tx=0x7fc1b8005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240170ab2512baa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8016070 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc1b8004450 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b8005020 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1b802b070 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1c97dd740 10 client.25060 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.241+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56393a4d6430 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.242+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b8005020 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1b8022020 con 0x56393a4c7d80 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 10 client.25060 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 10 client.25060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:05.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 20 client.25060 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a4da030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 4 client.25060 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.243+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56393a433df0 con 0x56393a4d7bd0 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.244+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a4da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1a8ff9640 10 client.25060 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a4da030 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ea27d5341437e5 server_cookie=6835379ddad95f29 in_seq=0 out_seq=0 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/1518729975 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56393a433df0 con 0x56393a4d7bd0 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1a8ff9640 10 client.25060 handle_command_reply: tid=0 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1c97dd740 1 client.25060 shutdown 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.245+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 msgr2=0x56393a4c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80056f0 tx=0x7fc1b8005720 comp rx=0 tx=0).stop 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 shutdown_connections 2024-09-10T20:52:05.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a4da030 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4c5180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1518729975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1a8ff9640 0 client.25060 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 >> 172.21.15.67:0/1518729975 conn(0x56393a4b9300 msgr2=0x56393a4beea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 shutdown_connections 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.246+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1518729975 wait complete. 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.247+0000 7fc1c97dd740 20 client.25060 trim_cache size 0 max 16384 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.271+0000 7fc1c97dd740 1 Processor -- start 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.271+0000 7fc1c97dd740 1 -- start start 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 0x56393a4c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01c8240 con 0x56393a4c7d80 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01c5ae0 con 0x56393a4bb4d0 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c97dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01ac8e0 con 0x56393a4bbdf0 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c51a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c51a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56490/0 (socket says 172.21.15.67:56490) 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c51a4640 1 -- 172.21.15.67:0/1140478191 learned_addr learned my addr 172.21.15.67:0/1140478191 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.272+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 0x56393a4c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 -- 172.21.15.67:0/1140478191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 msgr2=0x56393a4c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 0x56393a4c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 -- 172.21.15.67:0/1140478191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 msgr2=0x56393a4c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 -- 172.21.15.67:0/1140478191 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56393a4c7a40 con 0x56393a4bb4d0 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 0x56393a4c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009270 tx=0x7fc1bc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581dcac8b762da16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.273+0000 7fc1aaffd640 1 -- 172.21.15.67:0/1140478191 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0205b0 con 0x56393a4bb4d0 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.274+0000 7fc1aaffd640 1 -- 172.21.15.67:0/1140478191 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1bc020c00 con 0x56393a4bb4d0 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.274+0000 7fc1aaffd640 1 -- 172.21.15.67:0/1140478191 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00fc40 con 0x56393a4bb4d0 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1140478191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 msgr2=0x56393a4c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009270 tx=0x7fc1bc014000 comp rx=0 tx=0).stop 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1140478191 shutdown_connections 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4c7d80 0x56393a4c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4bbdf0 0x56393a4c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/1140478191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bb4d0 0x56393a4c4fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1140478191 >> 172.21.15.67:0/1140478191 conn(0x56393a4b9300 msgr2=0x56393a4c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.275+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1140478191 shutdown_connections 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.276+0000 7fc1c97dd740 1 -- 172.21.15.67:0/1140478191 wait complete. 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.276+0000 7fc1c97dd740 1 -- start start 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.276+0000 7fc1c97dd740 1 Processor -- start 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.277+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.277+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c97dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56500/0 (socket says 172.21.15.67:56500) 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 -- 172.21.15.67:0/2981757723 learned_addr learned my addr 172.21.15.67:0/2981757723 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01acf50 con 0x56393a4bb4d0 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01ae3c0 con 0x56393a4bbdf0 2024-09-10T20:52:05.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c59a5640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01ad620 con 0x56393a4c7d80 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c97dd740 10 client.0 _ll_register_callbacks cb 0x7fc1b0109a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 -- 172.21.15.67:0/2981757723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 msgr2=0x56393a4cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 -- 172.21.15.67:0/2981757723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 msgr2=0x56393a4cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.278+0000 7fc1c49a3640 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56393a4d0890 con 0x56393a4bbdf0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.279+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.279+0000 7fc1c49a3640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00c8cd0 tx=0x7fc1b0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c6e9b4371a545f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.280+0000 7fc1a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:05.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.281+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0049040 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.281+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc1b00d5800 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.281+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1bc020c00 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.281+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1b00cc4d0 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.282+0000 7fc1c97dd740 10 client.25076 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.282+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56393a544fe0 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1bc020c00 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fc1b01080d0 con 0x56393a4bbdf0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 10 client.25076 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 10 client.25076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 20 client.25076 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a5476d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 4 client.25076 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56393a42f8a0 con 0x56393a4d7bd0 2024-09-10T20:52:05.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.283+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a5476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.285+0000 7fc1a8ff9640 10 client.25076 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.285+0000 7fc1c51a4640 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a5476d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e52588a0747bc0 server_cookie=92ee5e8df34c614e in_seq=0 out_seq=0 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.286+0000 7fc1a8ff9640 1 -- 172.21.15.67:0/2981757723 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56393a42f8a0 con 0x56393a4d7bd0 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.286+0000 7fc1a8ff9640 10 client.25076 handle_command_reply: tid=0 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.286+0000 7fc1c97dd740 1 client.25076 shutdown 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 msgr2=0x56393a4d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00c8cd0 tx=0x7fc1b0000bc0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 shutdown_connections 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56393a4d7bd0 0x56393a5476d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56393a4c7d80 0x56393a4cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56393a4bbdf0 0x56393a4d0280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 --2- 172.21.15.67:0/2981757723 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56393a4bb4d0 0x56393a4cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 >> 172.21.15.67:0/2981757723 conn(0x56393a4b9300 msgr2=0x56393a4ba210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.287+0000 7fc1a8ff9640 0 client.25076 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.288+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 shutdown_connections 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.288+0000 7fc1c97dd740 1 -- 172.21.15.67:0/2981757723 wait complete. 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.288+0000 7fc1c97dd740 20 client.25076 trim_cache size 0 max 16384 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 msgr2=0x7fc1ac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 0x7fc1ac0b78b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009fd0 tx=0x7fc1bc009700 comp rx=0 tx=0).stop 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 msgr2=0x7fc1c006e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0032440 tx=0x7fc1b0003c10 comp rx=0 tx=0).stop 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 shutdown_connections 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1ac0b53f0 0x7fc1ac0b78b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1c0107360 0x7fc1c006ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1c01069e0 0x7fc1c006e900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 --2- 172.21.15.67:0/1449798304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1c0100fd0 0x7fc1c00701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 >> 172.21.15.67:0/1449798304 conn(0x7fc1c00fca20 msgr2=0x7fc1c00fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 shutdown_connections 2024-09-10T20:52:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:05.289+0000 7fc1c7408640 1 -- 172.21.15.67:0/1449798304 wait complete. 2024-09-10T20:52:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:06 smithi067 ceph-mon[30891]: pgmap v364: 97 pgs: 97 active+clean; 1013 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-10T20:52:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:06 smithi083 ceph-mon[35058]: pgmap v364: 97 pgs: 97 active+clean; 1013 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-10T20:52:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:06 smithi172 ceph-mon[35265]: pgmap v364: 97 pgs: 97 active+clean; 1013 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-10T20:52:07.594 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:52:07.595 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:52:08.051 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:08.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 -- 172.21.15.67:0/2461747572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 msgr2=0x7fdfe4111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/2461747572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe4111b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009900 tx=0x7fdfd402a3f0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 -- 172.21.15.67:0/2461747572 shutdown_connections 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/2461747572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe4111b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/2461747572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe410a9c0 0x7fdfe410ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/2461747572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 -- 172.21.15.67:0/2461747572 >> 172.21.15.67:0/2461747572 conn(0x7fdfe4100a20 msgr2=0x7fdfe4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 -- 172.21.15.67:0/2461747572 shutdown_connections 2024-09-10T20:52:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.617+0000 7fdfeb9df640 1 -- 172.21.15.67:0/2461747572 wait complete. 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.618+0000 7fdfeb9df640 1 Processor -- start 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.618+0000 7fdfeb9df640 1 -- start start 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4110f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe410a9c0 0x7fdfe4111480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe411ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe4079120 con 0x7fdfe410a9c0 2024-09-10T20:52:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe4078fa0 con 0x7fdfe4104fb0 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfeb9df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe40792a0 con 0x7fdfe410b340 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe9f7c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe411ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe9f7c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe411ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47252/0 (socket says 172.21.15.67:47252) 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe410a9c0 0x7fdfe4111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe9f7c640 1 -- 172.21.15.67:0/1557841017 learned_addr learned my addr 172.21.15.67:0/1557841017 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4110f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 -- 172.21.15.67:0/1557841017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 msgr2=0x7fdfe411ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe411ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 -- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe410a9c0 msgr2=0x7fdfe4111480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe410a9c0 0x7fdfe4111480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.619+0000 7fdfe977b640 1 -- 172.21.15.67:0/1557841017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe411b480 con 0x7fdfe4104fb0 2024-09-10T20:52:08.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.621+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4110f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00eb00 tx=0x7fdfdc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.625+0000 7fdfda7fc640 1 -- 172.21.15.67:0/1557841017 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc010430 con 0x7fdfe4104fb0 2024-09-10T20:52:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.625+0000 7fdfda7fc640 1 -- 172.21.15.67:0/1557841017 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfdc010a80 con 0x7fdfe4104fb0 2024-09-10T20:52:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.625+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe411b770 con 0x7fdfe4104fb0 2024-09-10T20:52:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.625+0000 7fdfda7fc640 1 -- 172.21.15.67:0/1557841017 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc010430 con 0x7fdfe4104fb0 2024-09-10T20:52:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.625+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe4117d50 con 0x7fdfe4104fb0 2024-09-10T20:52:08.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.629+0000 7fdfda7fc640 1 -- 172.21.15.67:0/1557841017 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7fdfdc010c30 con 0x7fdfe4104fb0 2024-09-10T20:52:08.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.629+0000 7fdfeddb4740 1 Processor -- start 2024-09-10T20:52:08.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.630+0000 7fdfda7fc640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 0x7fdfd00b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.630+0000 7fdfda7fc640 1 -- 172.21.15.67:0/1557841017 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdfdc0e62b0 con 0x7fdfe4104fb0 2024-09-10T20:52:08.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.630+0000 7fdfe9f7c640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 0x7fdfd00b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.631+0000 7fdfeddb4740 1 -- start start 2024-09-10T20:52:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.632+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 0x55b19627c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b19628ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b1961f2e60 con 0x55b19627c800 2024-09-10T20:52:08.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b1961e2290 con 0x55b196288790 2024-09-10T20:52:08.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b1961e60a0 con 0x55b19627bee0 2024-09-10T20:52:08.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51626/0 (socket says 172.21.15.67:51626) 2024-09-10T20:52:08.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/834292355 learned_addr learned my addr 172.21.15.67:0/834292355 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:08.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe977b640 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 0x55b19627c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe9f7c640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 0x7fdfd00b7a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40096c0 tx=0x7fdfd4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/834292355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 msgr2=0x55b19627c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 0x55b19627c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/834292355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 msgr2=0x55b19628ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b19628ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/834292355 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b195f40930 con 0x55b19627c800 2024-09-10T20:52:08.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.633+0000 7fdfe977b640 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 0x55b19627c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.635+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009cc0 tx=0x7fdfe0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d87f37d9b3018 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.636+0000 7fdfcf7fe640 1 -- 172.21.15.67:0/834292355 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001e070 con 0x55b19627c800 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.636+0000 7fdfcf7fe640 1 -- 172.21.15.67:0/834292355 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe0019ae0 con 0x55b19627c800 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 -- 172.21.15.67:0/834292355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 msgr2=0x55b196288250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfcf7fe640 1 -- 172.21.15.67:0/834292355 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001e070 con 0x55b19627c800 2024-09-10T20:52:08.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009cc0 tx=0x7fdfe0011810 comp rx=0 tx=0).stop 2024-09-10T20:52:08.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 -- 172.21.15.67:0/834292355 shutdown_connections 2024-09-10T20:52:08.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b19628ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627c800 0x55b196288250 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/834292355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627bee0 0x55b19627c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.637+0000 7fdfeddb4740 1 -- 172.21.15.67:0/834292355 >> 172.21.15.67:0/834292355 conn(0x55b196279d10 msgr2=0x55b19627aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.638+0000 7fdfeddb4740 1 -- 172.21.15.67:0/834292355 shutdown_connections 2024-09-10T20:52:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.639+0000 7fdfeddb4740 1 -- 172.21.15.67:0/834292355 wait complete. 2024-09-10T20:52:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.640+0000 7fdfeddb4740 1 -- start start 2024-09-10T20:52:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.640+0000 7fdfeddb4740 1 Processor -- start 2024-09-10T20:52:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.641+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b196288230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b196288790 0x55b196285e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b196043890 con 0x55b19627bee0 2024-09-10T20:52:08.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b19617cd40 con 0x55b19627c800 2024-09-10T20:52:08.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b19628b490 con 0x55b196288790 2024-09-10T20:52:08.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56542/0 (socket says 172.21.15.67:56542) 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/3087677920 learned_addr learned my addr 172.21.15.67:0/3087677920 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.642+0000 7fdfeddb4740 10 client.0 _ll_register_callbacks cb 0x55b1961e0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.643+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/3087677920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b196288790 msgr2=0x55b196285e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.643+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b196288790 0x55b196285e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.643+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/3087677920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 msgr2=0x55b196288230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.643+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b196288230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.643+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/3087677920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b196294810 con 0x55b19627c800 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.644+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0000c00 tx=0x7fdfe0009fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b87418d8ba49041f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.644+0000 7fdfccff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.644+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0027070 con 0x55b19627c800 2024-09-10T20:52:08.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.644+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdfe0019840 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.645+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe0019ae0 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.645+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfe0031050 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.645+0000 7fdfeddb4740 10 client.25085 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.645+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b1962971c0 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe0019ae0 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fdfe0004b20 con 0x55b19627c800 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 10 client.25085 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 10 client.25085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 20 client.25085 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:08.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b196298620 0x55b19629aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 4 client.25085 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:08.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.646+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1961f4db0 con 0x55b196298620 2024-09-10T20:52:08.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.647+0000 7fdfe977b640 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b196298620 0x55b19629aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.649+0000 7fdfe977b640 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b196298620 0x55b19629aa10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d43aa92b612aa8 server_cookie=ca009778b1b31a5 in_seq=0 out_seq=0 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.649+0000 7fdfccff9640 10 client.25085 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.650+0000 7fdfccff9640 1 -- 172.21.15.67:0/3087677920 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1961f4db0 con 0x55b196298620 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.650+0000 7fdfccff9640 10 client.25085 handle_command_reply: tid=0 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.650+0000 7fdfeddb4740 1 client.25085 shutdown 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.651+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 msgr2=0x55b1962856a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.651+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0000c00 tx=0x7fdfe0009fc0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 shutdown_connections 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b196298620 0x55b19629aa10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b196288790 0x55b196285e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627c800 0x55b1962856a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/3087677920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b196288230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 >> 172.21.15.67:0/3087677920 conn(0x55b196279d10 msgr2=0x55b196278f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.652+0000 7fdfccff9640 0 client.25085 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.654+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 shutdown_connections 2024-09-10T20:52:08.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.654+0000 7fdfeddb4740 1 -- 172.21.15.67:0/3087677920 wait complete. 2024-09-10T20:52:08.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.654+0000 7fdfeddb4740 20 client.25085 trim_cache size 0 max 16384 2024-09-10T20:52:08.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.688+0000 7fdfeddb4740 1 Processor -- start 2024-09-10T20:52:08.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.688+0000 7fdfeddb4740 1 -- start start 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b19627b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b196278e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b196282890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bfae0 con 0x55b19627bee0 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bd380 con 0x55b196288790 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.689+0000 7fdfeddb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bb1d0 con 0x55b19627c800 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe9f7c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b196282890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b19627b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe9f7c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b196282890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56552/0 (socket says 172.21.15.67:56552) 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe9f7c640 1 -- 172.21.15.67:0/1188994572 learned_addr learned my addr 172.21.15.67:0/1188994572 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b196278e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 -- 172.21.15.67:0/1188994572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 msgr2=0x55b196278e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b196278e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 -- 172.21.15.67:0/1188994572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 msgr2=0x55b196282890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b196282890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.690+0000 7fdfe977b640 1 -- 172.21.15.67:0/1188994572 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19627a790 con 0x55b19627bee0 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.691+0000 7fdfe977b640 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b19627b210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0e3c90 tx=0x7fdfdc017410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb7547193378cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.691+0000 7fdfceffd640 1 -- 172.21.15.67:0/1188994572 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc096070 con 0x55b19627bee0 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.691+0000 7fdfceffd640 1 -- 172.21.15.67:0/1188994572 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfdc0ac450 con 0x55b19627bee0 2024-09-10T20:52:08.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.691+0000 7fdfceffd640 1 -- 172.21.15.67:0/1188994572 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0b11d0 con 0x55b19627bee0 2024-09-10T20:52:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.692+0000 7fdfeddb4740 1 -- 172.21.15.67:0/1188994572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 msgr2=0x55b19627b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.692+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b19627b210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0e3c90 tx=0x7fdfdc017410 comp rx=0 tx=0).stop 2024-09-10T20:52:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 -- 172.21.15.67:0/1188994572 shutdown_connections 2024-09-10T20:52:08.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b196288790 0x55b196282890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b196278e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/1188994572 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b19627bee0 0x55b19627b210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 -- 172.21.15.67:0/1188994572 >> 172.21.15.67:0/1188994572 conn(0x55b196279d10 msgr2=0x55b196278750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 -- 172.21.15.67:0/1188994572 shutdown_connections 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.693+0000 7fdfeddb4740 1 -- 172.21.15.67:0/1188994572 wait complete. 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.694+0000 7fdfeddb4740 1 -- start start 2024-09-10T20:52:08.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.694+0000 7fdfeddb4740 1 Processor -- start 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627bee0 0x55b196290e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b196288790 0x55b19628d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfe8f7a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47286/0 (socket says 172.21.15.67:47286) 2024-09-10T20:52:08.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/485118932 learned_addr learned my addr 172.21.15.67:0/485118932 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bb840 con 0x55b196288790 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bccb0 con 0x55b19627bee0 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.695+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe41bbf10 con 0x55b19627c800 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfeddb4740 10 client.0 _ll_register_callbacks cb 0x7fdfe001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe977b640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627bee0 0x55b196290e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe9f7c640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b196288790 0x55b19628d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627bee0 msgr2=0x55b196290e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627bee0 0x55b196290e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/485118932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b196288790 msgr2=0x55b19628d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b196288790 0x55b19628d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b196280420 con 0x55b19627c800 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfdc0ac450 con 0x55b19627c800 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfe8f7a640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55b196287f70 tx=0x7fdfe00099d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c06860b907c58e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.696+0000 7fdfccff9640 10 client.25081 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.697+0000 7fdfccff9640 1 -- 172.21.15.67:0/485118932 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0027040 con 0x55b19627c800 2024-09-10T20:52:08.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.697+0000 7fdfccff9640 1 -- 172.21.15.67:0/485118932 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdfe0005410 con 0x55b19627c800 2024-09-10T20:52:08.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.697+0000 7fdfccff9640 1 -- 172.21.15.67:0/485118932 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfe001e040 con 0x55b19627c800 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.697+0000 7fdfeddb4740 10 client.25081 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.697+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b1963061d0 con 0x55b19627c800 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfccff9640 1 -- 172.21.15.67:0/485118932 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fdfe00035f0 con 0x55b19627c800 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 10 client.25081 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 10 client.25081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 20 client.25081 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b1963068f0 0x55b196308d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 4 client.25081 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.698+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1961f0860 con 0x55b1963068f0 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.699+0000 7fdfe977b640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b1963068f0 0x55b196308d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:08.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.699+0000 7fdfe977b640 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b1963068f0 0x55b196308d10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7956bcf375c4fd98 server_cookie=4856cba9d34fec4b in_seq=0 out_seq=0 2024-09-10T20:52:08.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.699+0000 7fdfccff9640 10 client.25081 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.701+0000 7fdfccff9640 1 -- 172.21.15.67:0/485118932 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1961f0860 con 0x55b1963068f0 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.701+0000 7fdfccff9640 10 client.25081 handle_command_reply: tid=0 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.701+0000 7fdfeddb4740 1 client.25081 shutdown 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 msgr2=0x55b19628d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55b196287f70 tx=0x7fdfe00099d0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 shutdown_connections 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b1963068f0 0x55b196308d10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b196288790 0x55b19628d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b19627c800 0x55b19628d340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 --2- 172.21.15.67:0/485118932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b19627bee0 0x55b196290e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 >> 172.21.15.67:0/485118932 conn(0x55b196279d10 msgr2=0x55b1962874d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.702+0000 7fdfccff9640 0 client.25081 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.703+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 shutdown_connections 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.703+0000 7fdfeddb4740 1 -- 172.21.15.67:0/485118932 wait complete. 2024-09-10T20:52:08.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.703+0000 7fdfeddb4740 20 client.25081 trim_cache size 0 max 16384 2024-09-10T20:52:08.708 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:52:08.708 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:52:08.708 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "1f9d2ba2-964d-4d5b-95da-6012bce65179", 2024-09-10T20:52:08.708 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:52:08.708 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 msgr2=0x7fdfd00b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 0x7fdfd00b7a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40096c0 tx=0x7fdfd4005a40 comp rx=0 tx=0).stop 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 msgr2=0x7fdfe4110f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4110f40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00eb00 tx=0x7fdfdc00c2d0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 shutdown_connections 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfd00b5570 0x7fdfd00b7a30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfe410b340 0x7fdfe411ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfe410a9c0 0x7fdfe4111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 --2- 172.21.15.67:0/1557841017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfe4104fb0 0x7fdfe4110f40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:08.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 >> 172.21.15.67:0/1557841017 conn(0x7fdfe4100a20 msgr2=0x7fdfe4106f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:08.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 shutdown_connections 2024-09-10T20:52:08.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:08.704+0000 7fdfeb9df640 1 -- 172.21.15.67:0/1557841017 wait complete. 2024-09-10T20:52:08.726 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:08 smithi067 ceph-mon[30891]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T20:52:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:08 smithi083 ceph-mon[35058]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T20:52:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:08 smithi172 ceph-mon[35265]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T20:52:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 35.0 s, 5930.4 tps, lat 16.840 ms stddev 18.405 2024-09-10T20:52:09.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:52:09.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:09 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:09.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:09 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:09.881 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:09.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:09 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:09.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:09 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:09.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:09 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:09.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:09 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.608 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:52:10.609 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.609 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:10.609 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:10.609 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.609 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:10 smithi067 ceph-mon[30891]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 899 op/s 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.749+0000 7f1041238640 1 -- 172.21.15.67:0/567179881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c108030 msgr2=0x7f103c10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.749+0000 7f1041238640 1 --2- 172.21.15.67:0/567179881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c108030 0x7f103c10e830 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1034009900 tx=0x7f103402a410 comp rx=0 tx=0).stop 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 -- 172.21.15.67:0/567179881 shutdown_connections 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 --2- 172.21.15.67:0/567179881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c108030 0x7f103c10e830 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 --2- 172.21.15.67:0/567179881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 --2- 172.21.15.67:0/567179881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c101ca0 0x7f103c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 -- 172.21.15.67:0/567179881 >> 172.21.15.67:0/567179881 conn(0x7f103c0fd730 msgr2=0x7f103c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.750+0000 7f1041238640 1 -- 172.21.15.67:0/567179881 shutdown_connections 2024-09-10T20:52:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.751+0000 7f1041238640 1 -- 172.21.15.67:0/567179881 wait complete. 2024-09-10T20:52:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.752+0000 7f1041238640 1 Processor -- start 2024-09-10T20:52:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.752+0000 7f1041238640 1 -- start start 2024-09-10T20:52:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c101ca0 0x7f103c0ff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c108030 0x7f103c0fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f103c111cf0 con 0x7f103c101ca0 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f103c111b70 con 0x7f103c1076b0 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f1041238640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f103c111e70 con 0x7f103c108030 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.753+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c108030 0x7f103c0fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56584/0 (socket says 172.21.15.67:56584) 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 -- 172.21.15.67:0/4134115855 learned_addr learned my addr 172.21.15.67:0/4134115855 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103ad9d640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c101ca0 0x7f103c0ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 -- 172.21.15.67:0/4134115855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c108030 msgr2=0x7f103c0fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c108030 0x7f103c0fe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 -- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c101ca0 msgr2=0x7f103c0ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c101ca0 0x7f103c0ff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.754+0000 7f103a59c640 1 -- 172.21.15.67:0/4134115855 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c1abb10 con 0x7f103c1076b0 2024-09-10T20:52:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.755+0000 7f103a59c640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f102400ea60 tx=0x7f102400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.755+0000 7f1033fff640 1 -- 172.21.15.67:0/4134115855 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102400cde0 con 0x7f103c1076b0 2024-09-10T20:52:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.755+0000 7f1033fff640 1 -- 172.21.15.67:0/4134115855 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10240035f0 con 0x7f103c1076b0 2024-09-10T20:52:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.755+0000 7f1033fff640 1 -- 172.21.15.67:0/4134115855 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024010690 con 0x7f103c1076b0 2024-09-10T20:52:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.756+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c06cbd0 con 0x7f103c1076b0 2024-09-10T20:52:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.756+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c06d0e0 con 0x7f103c1076b0 2024-09-10T20:52:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 Processor -- start 2024-09-10T20:52:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 -- start start 2024-09-10T20:52:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87d9950 0x5559e87dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5559e8743e50 con 0x5559e87cd0a0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5559e8733280 con 0x5559e87d9950 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f104360d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559e8737090 con 0x5559e87cd9c0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.760+0000 7f1033fff640 1 -- 172.21.15.67:0/4134115855 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 153301+0+0 (secure 0 0 0) 0x7f1024010830 con 0x7f103c1076b0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47310/0 (socket says 172.21.15.67:47310) 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103ad9d640 1 -- 172.21.15.67:0/2125704249 learned_addr learned my addr 172.21.15.67:0/2125704249 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103a59c640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87d9950 0x5559e87dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 -- 172.21.15.67:0/2125704249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 msgr2=0x5559e87d9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 -- 172.21.15.67:0/2125704249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87d9950 msgr2=0x5559e87dbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87d9950 0x5559e87dbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103b59e640 1 -- 172.21.15.67:0/2125704249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e8491650 con 0x5559e87cd0a0 2024-09-10T20:52:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.761+0000 7f103ad9d640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.762+0000 7f103b59e640 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87cd480 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1034009850 tx=0x7f1034005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce068a14e699484 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.763+0000 7f1033fff640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 0x7f10280b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.763+0000 7f10317fa640 1 -- 172.21.15.67:0/2125704249 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034040070 con 0x5559e87cd0a0 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.763+0000 7f10317fa640 1 -- 172.21.15.67:0/2125704249 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1034004420 con 0x5559e87cd0a0 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.763+0000 7f10317fa640 1 -- 172.21.15.67:0/2125704249 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034035040 con 0x5559e87cd0a0 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.764+0000 7f103ad9d640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 0x7f10280b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.764+0000 7f1033fff640 1 -- 172.21.15.67:0/4134115855 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f10240e5f80 con 0x7f103c1076b0 2024-09-10T20:52:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.764+0000 7f104360d740 1 -- 172.21.15.67:0/2125704249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 msgr2=0x5559e87cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.764+0000 7f104360d740 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87cd480 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1034009850 tx=0x7f1034005be0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.764+0000 7f103ad9d640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 0x7f10280b79e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5559e87cbdb0 tx=0x7f102c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 -- 172.21.15.67:0/2125704249 shutdown_connections 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87d9950 0x5559e87dbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd9c0 0x5559e87d9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 --2- 172.21.15.67:0/2125704249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87cd480 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 -- 172.21.15.67:0/2125704249 >> 172.21.15.67:0/2125704249 conn(0x5559e87caed0 msgr2=0x5559e87cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 -- 172.21.15.67:0/2125704249 shutdown_connections 2024-09-10T20:52:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.765+0000 7f104360d740 1 -- 172.21.15.67:0/2125704249 wait complete. 2024-09-10T20:52:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.766+0000 7f104360d740 1 -- start start 2024-09-10T20:52:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.766+0000 7f104360d740 1 Processor -- start 2024-09-10T20:52:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.766+0000 7f104360d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87d9950 0x5559e87d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87d6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56598/0 (socket says 172.21.15.67:56598) 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47316/0 (socket says 172.21.15.67:47316) 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 -- 172.21.15.67:0/909167713 learned_addr learned my addr 172.21.15.67:0/909167713 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5559e8594700 con 0x5559e87d9950 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5559e86ce110 con 0x5559e87cd9c0 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559e87dc5c0 con 0x5559e87cd0a0 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103b59e640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87d9950 0x5559e87d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 -- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 msgr2=0x5559e87d6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87d6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 -- 172.21.15.67:0/909167713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87d9950 msgr2=0x5559e87d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87d9950 0x5559e87d6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f103ad9d640 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e86fbc40 con 0x5559e87cd0a0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.767+0000 7f104360d740 10 client.0 _ll_register_callbacks cb 0x5559e86e7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1034004420 con 0x5559e87cd0a0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f103ad9d640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f102c005fd0 tx=0x7f102c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829922d81d1aebf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f10227fc640 10 client.25093 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f10227fc640 1 -- 172.21.15.67:0/909167713 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c03d060 con 0x5559e87cd0a0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f10227fc640 1 -- 172.21.15.67:0/909167713 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f102c028030 con 0x5559e87cd0a0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.768+0000 7f10227fc640 1 -- 172.21.15.67:0/909167713 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f102c030930 con 0x5559e87cd0a0 2024-09-10T20:52:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 10 client.25093 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5559e87e7e00 con 0x5559e87cd0a0 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f10227fc640 1 -- 172.21.15.67:0/909167713 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f102c030ad0 con 0x5559e87cd0a0 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 10 client.25093 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 10 client.25093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 20 client.25093 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e87e9230 0x5559e87eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.769+0000 7f104360d740 4 client.25093 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.770+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559e8745da0 con 0x5559e87e9230 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.770+0000 7f103a59c640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e87e9230 0x5559e87eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.771+0000 7f103a59c640 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e87e9230 0x5559e87eb6f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3afdbfbce69fe4a server_cookie=ab44e6d5c42077 in_seq=0 out_seq=0 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.771+0000 7f10227fc640 10 client.25093 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.771+0000 7f10227fc640 1 -- 172.21.15.67:0/909167713 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559e8745da0 con 0x5559e87e9230 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.772+0000 7f10227fc640 10 client.25093 handle_command_reply: tid=0 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.772+0000 7f104360d740 1 client.25093 shutdown 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.772+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 msgr2=0x5559e87d9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.772+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f102c005fd0 tx=0x7f102c004ab0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 shutdown_connections 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e87e9230 0x5559e87eb6f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f10227fc640 0 client.25093 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87d9950 0x5559e87d6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87d6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 --2- 172.21.15.67:0/909167713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87cd0a0 0x5559e87d9220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.773+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 >> 172.21.15.67:0/909167713 conn(0x5559e87caed0 msgr2=0x5559e87d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.775+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 shutdown_connections 2024-09-10T20:52:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.775+0000 7f104360d740 1 -- 172.21.15.67:0/909167713 wait complete. 2024-09-10T20:52:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.775+0000 7f104360d740 20 client.25093 trim_cache size 0 max 16384 2024-09-10T20:52:10.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.807+0000 7f104360d740 1 Processor -- start 2024-09-10T20:52:10.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 -- start start 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f103c1ae910 con 0x5559e87cd0a0 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f103c1ac1b0 con 0x5559e87cd9c0 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f104360d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f103c102f50 con 0x5559e87d9950 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f103b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56608/0 (socket says 172.21.15.67:56608) 2024-09-10T20:52:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f103a59c640 1 -- 172.21.15.67:0/3052539009 learned_addr learned my addr 172.21.15.67:0/3052539009 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.808+0000 7f103ad9d640 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 -- 172.21.15.67:0/3052539009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 msgr2=0x5559e87cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 -- 172.21.15.67:0/3052539009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 msgr2=0x5559e87e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 -- 172.21.15.67:0/3052539009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e87d55d0 con 0x5559e87d9950 2024-09-10T20:52:10.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.809+0000 7f103b59e640 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87c5e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1034009850 tx=0x7f1034000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a0e18715e96da57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.810+0000 7f1030ff9640 1 -- 172.21.15.67:0/3052539009 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034040070 con 0x5559e87d9950 2024-09-10T20:52:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.810+0000 7f1030ff9640 1 -- 172.21.15.67:0/3052539009 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1034004220 con 0x5559e87d9950 2024-09-10T20:52:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.810+0000 7f1030ff9640 1 -- 172.21.15.67:0/3052539009 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034035040 con 0x5559e87d9950 2024-09-10T20:52:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 -- 172.21.15.67:0/3052539009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 msgr2=0x5559e87c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87c5e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1034009850 tx=0x7f1034000bc0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 -- 172.21.15.67:0/3052539009 shutdown_connections 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87c5e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 --2- 172.21.15.67:0/3052539009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 -- 172.21.15.67:0/3052539009 >> 172.21.15.67:0/3052539009 conn(0x5559e87caed0 msgr2=0x5559e87cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 -- 172.21.15.67:0/3052539009 shutdown_connections 2024-09-10T20:52:10.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.811+0000 7f104360d740 1 -- 172.21.15.67:0/3052539009 wait complete. 2024-09-10T20:52:10.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f104360d740 1 -- start start 2024-09-10T20:52:10.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f104360d740 1 Processor -- start 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f104360d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f104360d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f104360d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87dd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.812+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56622/0 (socket says 172.21.15.67:56622) 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47332/0 (socket says 172.21.15.67:47332) 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 -- 172.21.15.67:0/303947256 learned_addr learned my addr 172.21.15.67:0/303947256 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f103c073d10 con 0x5559e87cd0a0 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f103c075180 con 0x5559e87cd9c0 2024-09-10T20:52:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0743e0 con 0x5559e87d9950 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103ad9d640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 -- 172.21.15.67:0/303947256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 msgr2=0x5559e87dd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87dd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 -- 172.21.15.67:0/303947256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 msgr2=0x5559e87e22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e8856200 con 0x5559e87cd9c0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f104360d740 10 client.0 _ll_register_callbacks cb 0x7f102c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f103a59c640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1024000c00 tx=0x7f102400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8222073307c4c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1034004220 con 0x5559e87cd9c0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.813+0000 7f10227fc640 10 client.25106 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f10227fc640 1 -- 172.21.15.67:0/303947256 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10240ac0c0 con 0x5559e87cd9c0 2024-09-10T20:52:10.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f10227fc640 1 -- 172.21.15.67:0/303947256 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f10240e3b50 con 0x5559e87cd9c0 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f10227fc640 1 -- 172.21.15.67:0/303947256 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10240accb0 con 0x5559e87cd9c0 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f104360d740 10 client.25106 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5559e88573f0 con 0x5559e87cd9c0 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f10227fc640 1 -- 172.21.15.67:0/303947256 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f1024010b50 con 0x5559e87cd9c0 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.814+0000 7f104360d740 10 client.25106 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f104360d740 10 client.25106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f104360d740 20 client.25106 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e8857990 0x5559e8859db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f104360d740 4 client.25106 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:52:10.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1034004220 con 0x5559e8857990 2024-09-10T20:52:10.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.815+0000 7f103ad9d640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e8857990 0x5559e8859db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.816+0000 7f103ad9d640 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e8857990 0x5559e8859db0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c11b3ae4c10aacc server_cookie=d1cc5d67b8e29fc1 in_seq=0 out_seq=0 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.816+0000 7f10227fc640 10 client.25106 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.816+0000 7f10227fc640 1 -- 172.21.15.67:0/303947256 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7f1034004220 con 0x5559e8857990 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.816+0000 7f10227fc640 10 client.25106 handle_command_reply: tid=0 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.816+0000 7f104360d740 1 client.25106 shutdown 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 msgr2=0x5559e87dc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1024000c00 tx=0x7f102400ef90 comp rx=0 tx=0).stop 2024-09-10T20:52:10.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 shutdown_connections 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5559e8857990 0x5559e8859db0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559e87d9950 0x5559e87dd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5559e87cd9c0 0x5559e87dc890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 --2- 172.21.15.67:0/303947256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5559e87cd0a0 0x5559e87e22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 >> 172.21.15.67:0/303947256 conn(0x5559e87caed0 msgr2=0x5559e87c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.817+0000 7f10227fc640 0 client.25106 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.818+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 shutdown_connections 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.818+0000 7f104360d740 1 -- 172.21.15.67:0/303947256 wait complete. 2024-09-10T20:52:10.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.818+0000 7f104360d740 20 client.25106 trim_cache size 0 max 16384 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "1f9d2ba2-964d-4d5b-95da-6012bce65179", 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:52:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:52:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:10.828 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:52:10.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 msgr2=0x7f10280b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 0x7f10280b79e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5559e87cbdb0 tx=0x7f102c009500 comp rx=0 tx=0).stop 2024-09-10T20:52:10.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 msgr2=0x7f103c0fdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:10.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f102400ea60 tx=0x7f102400ef20 comp rx=0 tx=0).stop 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 shutdown_connections 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f10280b5520 0x7f10280b79e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c108030 0x7f103c0fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f103c1076b0 0x7f103c0fdc50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 --2- 172.21.15.67:0/4134115855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f103c101ca0 0x7f103c0ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 >> 172.21.15.67:0/4134115855 conn(0x7f103c0fd730 msgr2=0x7f103c06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 shutdown_connections 2024-09-10T20:52:10.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:10.819+0000 7f1041238640 1 -- 172.21.15.67:0/4134115855 wait complete. 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:10 smithi083 ceph-mon[35058]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 899 op/s 2024-09-10T20:52:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:52:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:10.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:10 smithi172 ceph-mon[35265]: pgmap v366: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 899 op/s 2024-09-10T20:52:11.640 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:11 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:11.692 INFO:tasks.cephfs.filesystem:scrub status for tag:1f9d2ba2-964d-4d5b-95da-6012bce65179 - {'path': '/', 'tag': '1f9d2ba2-964d-4d5b-95da-6012bce65179', 'options': 'recursive,force'} 2024-09-10T20:52:11.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:11 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:11.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:11 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:12 smithi067 ceph-mon[30891]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 992 op/s 2024-09-10T20:52:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:12 smithi083 ceph-mon[35058]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 992 op/s 2024-09-10T20:52:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:12 smithi172 ceph-mon[35265]: pgmap v367: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 992 op/s 2024-09-10T20:52:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 40.0 s, 4055.6 tps, lat 24.661 ms stddev 51.407 2024-09-10T20:52:14.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:14 smithi067 ceph-mon[30891]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-10T20:52:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:14 smithi083 ceph-mon[35058]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-10T20:52:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:14 smithi172 ceph-mon[35265]: pgmap v368: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-09-10T20:52:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:16 smithi067 ceph-mon[30891]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 19 MiB/s wr, 941 op/s 2024-09-10T20:52:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:16 smithi083 ceph-mon[35058]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 19 MiB/s wr, 941 op/s 2024-09-10T20:52:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:16 smithi172 ceph-mon[35265]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 19 MiB/s wr, 941 op/s 2024-09-10T20:52:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:18 smithi067 ceph-mon[30891]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 991 op/s 2024-09-10T20:52:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:18 smithi083 ceph-mon[35058]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 991 op/s 2024-09-10T20:52:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:18 smithi172 ceph-mon[35265]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 17 MiB/s wr, 991 op/s 2024-09-10T20:52:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 45.0 s, 4857.4 tps, lat 20.542 ms stddev 20.787 2024-09-10T20:52:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:20 smithi067 ceph-mon[30891]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-10T20:52:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:20 smithi083 ceph-mon[35058]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-10T20:52:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:20 smithi172 ceph-mon[35265]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 13 MiB/s wr, 936 op/s 2024-09-10T20:52:21.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:21 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:52:21.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:21 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:52:21.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:21 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:52:21.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:21 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:52:21.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:21 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:52:21.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:21 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:52:21.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:21 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:52:21.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:21 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:52:21.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:21 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:52:22.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:22 smithi067 ceph-mon[30891]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-09-10T20:52:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:22 smithi083 ceph-mon[35058]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-09-10T20:52:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:22 smithi172 ceph-mon[35265]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-09-10T20:52:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 50.0 s, 4989.1 tps, lat 20.040 ms stddev 20.686 2024-09-10T20:52:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:24 smithi067 ceph-mon[30891]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-09-10T20:52:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:24 smithi083 ceph-mon[35058]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-09-10T20:52:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:24 smithi172 ceph-mon[35265]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 12 MiB/s wr, 978 op/s 2024-09-10T20:52:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:26 smithi067 ceph-mon[30891]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 9.9 MiB/s wr, 850 op/s 2024-09-10T20:52:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:26 smithi083 ceph-mon[35058]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 9.9 MiB/s wr, 850 op/s 2024-09-10T20:52:26.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:26 smithi172 ceph-mon[35265]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 9.9 MiB/s wr, 850 op/s 2024-09-10T20:52:28.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:28 smithi067 ceph-mon[30891]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-09-10T20:52:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:28 smithi083 ceph-mon[35058]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-09-10T20:52:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:28 smithi172 ceph-mon[35265]: pgmap v375: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 877 op/s 2024-09-10T20:52:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 55.0 s, 4660.8 tps, lat 21.460 ms stddev 21.893 2024-09-10T20:52:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:30 smithi067 ceph-mon[30891]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-10T20:52:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:30 smithi083 ceph-mon[35058]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-10T20:52:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:30 smithi172 ceph-mon[35265]: pgmap v376: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-10T20:52:32.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:32 smithi067 ceph-mon[30891]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-10T20:52:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:32 smithi083 ceph-mon[35058]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-10T20:52:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:32 smithi172 ceph-mon[35265]: pgmap v377: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-09-10T20:52:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 60.0 s, 6093.0 tps, lat 16.404 ms stddev 16.720 2024-09-10T20:52:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:34 smithi067 ceph-mon[30891]: pgmap v378: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-10T20:52:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:34 smithi083 ceph-mon[35058]: pgmap v378: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-10T20:52:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:34 smithi172 ceph-mon[35265]: pgmap v378: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-10T20:52:35.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:52:35.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:35.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:35 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:52:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:35 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:35.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:52:35.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:35.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:35 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: pgmap v379: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-10T20:52:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:52:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:52:36.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:36 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: pgmap v379: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:52:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:36 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:37.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: pgmap v379: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 864 op/s 2024-09-10T20:52:37.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:37.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:37.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:52:37.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:52:37.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:36 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:52:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:38 smithi083 ceph-mon[35058]: pgmap v380: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 959 op/s 2024-09-10T20:52:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:38 smithi172 ceph-mon[35265]: pgmap v380: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 959 op/s 2024-09-10T20:52:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 65.0 s, 3836.0 tps, lat 25.632 ms stddev 26.562 2024-09-10T20:52:39.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:38 smithi067 ceph-mon[30891]: pgmap v380: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 13 MiB/s wr, 959 op/s 2024-09-10T20:52:40.847 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:40 smithi067 ceph-mon[30891]: pgmap v381: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-10T20:52:40.847 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:40 smithi067 ceph-mon[30891]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T20:52:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:40 smithi083 ceph-mon[35058]: pgmap v381: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-10T20:52:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:40 smithi083 ceph-mon[35058]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T20:52:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:40 smithi172 ceph-mon[35265]: pgmap v381: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 881 op/s 2024-09-10T20:52:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:40 smithi172 ceph-mon[35265]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-10T20:52:41.693 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:52:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:42.832 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:42 smithi067 ceph-mon[30891]: pgmap v382: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:52:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:42 smithi083 ceph-mon[35058]: pgmap v382: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:52:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:42 smithi172 ceph-mon[35265]: pgmap v382: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:52:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.966+0000 7f6a21d9b640 1 -- 172.21.15.67:0/3909083678 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c034020 con 0x7f6a2410f6e0 2024-09-10T20:52:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 -- 172.21.15.67:0/3909083678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410f6e0 msgr2=0x7f6a2410fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:42.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 --2- 172.21.15.67:0/3909083678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410f6e0 0x7f6a2410fb70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009cd0 tx=0x7f6a1c02a970 comp rx=0 tx=0).stop 2024-09-10T20:52:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 -- 172.21.15.67:0/3909083678 shutdown_connections 2024-09-10T20:52:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 --2- 172.21.15.67:0/3909083678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410f6e0 0x7f6a2410fb70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 --2- 172.21.15.67:0/3909083678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a2410f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 --2- 172.21.15.67:0/3909083678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410a150 0x7f6a2410a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.967+0000 7f6a2918f640 1 -- 172.21.15.67:0/3909083678 >> 172.21.15.67:0/3909083678 conn(0x7f6a2406e2e0 msgr2=0x7f6a2406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.970+0000 7f6a2918f640 1 -- 172.21.15.67:0/3909083678 shutdown_connections 2024-09-10T20:52:42.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.970+0000 7f6a2918f640 1 -- 172.21.15.67:0/3909083678 wait complete. 2024-09-10T20:52:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.971+0000 7f6a2918f640 1 Processor -- start 2024-09-10T20:52:42.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.971+0000 7f6a2918f640 1 -- start start 2024-09-10T20:52:42.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a241abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 0x7f6a241aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24114cb0 con 0x7f6a2410f6e0 2024-09-10T20:52:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24114b30 con 0x7f6a2410aa70 2024-09-10T20:52:42.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2918f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24114e30 con 0x7f6a2410a150 2024-09-10T20:52:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 0x7f6a241aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59760/0 (socket says 172.21.15.67:59760) 2024-09-10T20:52:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 -- 172.21.15.67:0/4107814891 learned_addr learned my addr 172.21.15.67:0/4107814891 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:42.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a2259c640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a241abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 -- 172.21.15.67:0/4107814891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 msgr2=0x7f6a241abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a241abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 -- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 msgr2=0x7f6a241aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 0x7f6a241aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.972+0000 7f6a22d9d640 1 -- 172.21.15.67:0/4107814891 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a241aaf50 con 0x7f6a2410a150 2024-09-10T20:52:42.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.973+0000 7f6a2259c640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a241abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:42.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.973+0000 7f6a2359e640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 0x7f6a241aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:42.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.973+0000 7f6a22d9d640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400e9f0 tx=0x7f6a1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:42.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.974+0000 7f6a0bfff640 1 -- 172.21.15.67:0/4107814891 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400cd80 con 0x7f6a2410a150 2024-09-10T20:52:42.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.974+0000 7f6a0bfff640 1 -- 172.21.15.67:0/4107814891 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a140108e0 con 0x7f6a2410a150 2024-09-10T20:52:42.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.974+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a241ab240 con 0x7f6a2410a150 2024-09-10T20:52:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.974+0000 7f6a0bfff640 1 -- 172.21.15.67:0/4107814891 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14018980 con 0x7f6a2410a150 2024-09-10T20:52:42.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.974+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a241b4b70 con 0x7f6a2410a150 2024-09-10T20:52:42.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 Processor -- start 2024-09-10T20:52:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 -- start start 2024-09-10T20:52:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 0x557377d87860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377d937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377d96120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.980+0000 7f6a2b564740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557377cfde50 con 0x557377d93d30 2024-09-10T20:52:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2b564740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557377ced280 con 0x557377d87da0 2024-09-10T20:52:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2b564740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557377cf1090 con 0x557377d87480 2024-09-10T20:52:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 0x557377d87860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377d96120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377d96120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59446/0 (socket says 172.21.15.67:59446) 2024-09-10T20:52:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.981+0000 7f6a2259c640 1 -- 172.21.15.67:0/4151481304 learned_addr learned my addr 172.21.15.67:0/4151481304 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:42.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a0bfff640 1 -- 172.21.15.67:0/4107814891 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6a14018b20 con 0x7f6a2410a150 2024-09-10T20:52:42.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a2359e640 1 -- 172.21.15.67:0/4151481304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 msgr2=0x557377d937f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:42.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a2359e640 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377d937f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a2359e640 1 -- 172.21.15.67:0/4151481304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 msgr2=0x557377d96120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:42.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a2359e640 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377d96120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.982+0000 7f6a2359e640 1 -- 172.21.15.67:0/4151481304 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557377a4b650 con 0x557377d87480 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.983+0000 7f6a2359e640 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 0x557377d87860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005e30 tx=0x7f6a1c005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=591a8445d35b703b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.983+0000 7f6a097fa640 1 -- 172.21.15.67:0/4151481304 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c049070 con 0x557377d87480 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.983+0000 7f6a097fa640 1 -- 172.21.15.67:0/4151481304 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c003970 con 0x557377d87480 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a0bfff640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 0x7f6a0c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a097fa640 1 -- 172.21.15.67:0/4151481304 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c034070 con 0x557377d87480 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a22d9d640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 0x7f6a0c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 -- 172.21.15.67:0/4151481304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 msgr2=0x557377d87860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 0x557377d87860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005e30 tx=0x7f6a1c005d80 comp rx=0 tx=0).stop 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 -- 172.21.15.67:0/4151481304 shutdown_connections 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377d96120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377d937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:42.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 --2- 172.21.15.67:0/4151481304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87480 0x557377d87860 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.984+0000 7f6a2b564740 1 -- 172.21.15.67:0/4151481304 >> 172.21.15.67:0/4151481304 conn(0x557377d852b0 msgr2=0x557377d86450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a2b564740 1 -- 172.21.15.67:0/4151481304 shutdown_connections 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a0bfff640 1 -- 172.21.15.67:0/4107814891 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a140e5d90 con 0x7f6a2410a150 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a2b564740 1 -- 172.21.15.67:0/4151481304 wait complete. 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a22d9d640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 0x7f6a0c0b7820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a140ac510 tx=0x7f6a140a8cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a2b564740 1 -- start start 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.985+0000 7f6a2b564740 1 Processor -- start 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 0x557377d909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d90ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557377b4e700 con 0x557377d87da0 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557377c88110 con 0x557377d87480 2024-09-10T20:52:43.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557377da7a00 con 0x557377d93d30 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2b564740 10 client.0 _ll_register_callbacks cb 0x557377ca1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60640/0 (socket says 172.21.15.67:60640) 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 -- 172.21.15.67:0/2112948122 learned_addr learned my addr 172.21.15.67:0/2112948122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d90ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2259c640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 0x557377d909b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 -- 172.21.15.67:0/2112948122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 msgr2=0x557377d90ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d90ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 -- 172.21.15.67:0/2112948122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 msgr2=0x557377d909b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 0x557377d909b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2359e640 1 -- 172.21.15.67:0/2112948122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557377cb5c40 con 0x557377d87480 2024-09-10T20:52:43.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.986+0000 7f6a2259c640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 0x557377d909b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006010 tx=0x7f6a1c009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d18f0f2cc83b765 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c049070 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a1c003970 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a1c004040 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a1c034070 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a2b564740 10 client.25115 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557377db3320 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c003970 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.987+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f6a1c0306a0 con 0x557377d87480 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 10 client.25115 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 10 client.25115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 20 client.25115 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377db4800 0x557377db6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 4 client.25115 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557377cffda0 con 0x557377db4800 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.988+0000 7f6a2259c640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377db4800 0x557377db6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.989+0000 7f6a2259c640 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377db4800 0x557377db6c60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f952e550fd528e4b server_cookie=eaa76d4201521de9 in_seq=0 out_seq=0 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.989+0000 7f6a06ff5640 10 client.25115 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.989+0000 7f6a06ff5640 1 -- 172.21.15.67:0/2112948122 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557377cffda0 con 0x557377db4800 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.989+0000 7f6a06ff5640 10 client.25115 handle_command_reply: tid=0 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.989+0000 7f6a2b564740 1 client.25115 shutdown 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 msgr2=0x557377d93560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c006010 tx=0x7f6a1c009800 comp rx=0 tx=0).stop 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 shutdown_connections 2024-09-10T20:52:43.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377db4800 0x557377db6c60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d90ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87da0 0x557377d909b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2112948122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377d93560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 >> 172.21.15.67:0/2112948122 conn(0x557377d852b0 msgr2=0x557377d8ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a06ff5640 0 client.25115 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 shutdown_connections 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 1 -- 172.21.15.67:0/2112948122 wait complete. 2024-09-10T20:52:43.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:42.990+0000 7f6a2b564740 20 client.25115 trim_cache size 0 max 16384 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.021+0000 7f6a2b564740 1 Processor -- start 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.021+0000 7f6a2b564740 1 -- start start 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377db6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10010c90 con 0x557377d87480 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000e530 con 0x557377d87da0 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2b564740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000c380 con 0x557377d93d30 2024-09-10T20:52:43.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59466/0 (socket says 172.21.15.67:59466) 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2359e640 1 -- 172.21.15.67:0/2086427347 learned_addr learned my addr 172.21.15.67:0/2086427347 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.022+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2259c640 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377db6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 -- 172.21.15.67:0/2086427347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 msgr2=0x557377d926f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d926f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 -- 172.21.15.67:0/2086427347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 msgr2=0x557377db6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377db6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 -- 172.21.15.67:0/2086427347 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557377d85d30 con 0x557377d87480 2024-09-10T20:52:43.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a2359e640 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c02ae90 tx=0x7f6a1c02a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde8aa40b463ede7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:43.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.023+0000 7f6a08ff9640 1 -- 172.21.15.67:0/2086427347 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c049040 con 0x557377d87480 2024-09-10T20:52:43.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.024+0000 7f6a08ff9640 1 -- 172.21.15.67:0/2086427347 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c064070 con 0x557377d87480 2024-09-10T20:52:43.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.024+0000 7f6a08ff9640 1 -- 172.21.15.67:0/2086427347 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0044b0 con 0x557377d87480 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 -- 172.21.15.67:0/2086427347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 msgr2=0x557377d84bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c02ae90 tx=0x7f6a1c02a970 comp rx=0 tx=0).stop 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 -- 172.21.15.67:0/2086427347 shutdown_connections 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d93d30 0x557377d926f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87da0 0x557377db6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 --2- 172.21.15.67:0/2086427347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d87480 0x557377d84bc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.025+0000 7f6a2b564740 1 -- 172.21.15.67:0/2086427347 >> 172.21.15.67:0/2086427347 conn(0x557377d852b0 msgr2=0x557377d91fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:43.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.027+0000 7f6a2b564740 1 -- 172.21.15.67:0/2086427347 shutdown_connections 2024-09-10T20:52:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.027+0000 7f6a2b564740 1 -- 172.21.15.67:0/2086427347 wait complete. 2024-09-10T20:52:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.028+0000 7f6a2b564740 1 -- start start 2024-09-10T20:52:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.028+0000 7f6a2b564740 1 Processor -- start 2024-09-10T20:52:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.028+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2b564740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87da0 0x557377da9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60666/0 (socket says 172.21.15.67:60666) 2024-09-10T20:52:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 -- 172.21.15.67:0/1129121034 learned_addr learned my addr 172.21.15.67:0/1129121034 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:43.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377da9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000c9f0 con 0x557377d93d30 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000de60 con 0x557377d87480 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1000d0c0 con 0x557377d87da0 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 -- 172.21.15.67:0/1129121034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87da0 msgr2=0x557377da9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87da0 0x557377da9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 -- 172.21.15.67:0/1129121034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 msgr2=0x557377da9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377da9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.029+0000 7f6a2359e640 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557377e207b0 con 0x557377d87480 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.030+0000 7f6a2359e640 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009620 tx=0x7f6a1c02fce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ff6a1bc5246b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.030+0000 7f6a2b564740 10 client.0 _ll_register_callbacks cb 0x7f6a1c047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.030+0000 7f6a06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:43.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.030+0000 7f6a06ff5640 1 -- 172.21.15.67:0/1129121034 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c06d060 con 0x557377d87480 2024-09-10T20:52:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.030+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a1c064070 con 0x557377d87480 2024-09-10T20:52:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.031+0000 7f6a06ff5640 1 -- 172.21.15.67:0/1129121034 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a1c004b40 con 0x557377d87480 2024-09-10T20:52:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.031+0000 7f6a06ff5640 1 -- 172.21.15.67:0/1129121034 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a1c049040 con 0x557377d87480 2024-09-10T20:52:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.031+0000 7f6a2b564740 10 client.25121 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:43.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.031+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=27}) -- 0x557377e21920 con 0x557377d87480 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a06ff5640 1 -- 172.21.15.67:0/1129121034 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f6a1c030ce0 con 0x557377d87480 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 10 client.25121 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 10 client.25121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 20 client.25121 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377e21cd0 0x557377e240f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:43.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 4 client.25121 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:52:43.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.032+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557377cfb850 con 0x557377e21cd0 2024-09-10T20:52:43.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.034+0000 7f6a2259c640 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377e21cd0 0x557377e240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.034+0000 7f6a2259c640 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377e21cd0 0x557377e240f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e692b22eb7990b96 server_cookie=4c275cf627f415e in_seq=0 out_seq=0 2024-09-10T20:52:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.034+0000 7f6a06ff5640 10 client.25121 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.035+0000 7f6a06ff5640 1 -- 172.21.15.67:0/1129121034 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x557377cfb850 con 0x557377e21cd0 2024-09-10T20:52:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.035+0000 7f6a06ff5640 10 client.25121 handle_command_reply: tid=0 2024-09-10T20:52:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.035+0000 7f6a2b564740 1 client.25121 shutdown 2024-09-10T20:52:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.035+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 msgr2=0x557377da8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:43.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.035+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009620 tx=0x7f6a1c02fce0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 shutdown_connections 2024-09-10T20:52:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557377e21cd0 0x557377e240f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557377d93d30 0x557377da9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557377d87da0 0x557377da9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 --2- 172.21.15.67:0/1129121034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557377d87480 0x557377da8ce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 >> 172.21.15.67:0/1129121034 conn(0x557377d852b0 msgr2=0x557377d92800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a06ff5640 0 client.25121 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.036+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 shutdown_connections 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.037+0000 7f6a2b564740 1 -- 172.21.15.67:0/1129121034 wait complete. 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.037+0000 7f6a2b564740 20 client.25121 trim_cache size 0 max 16384 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:52:43.043 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:52:43.044 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:43.045 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:52:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 msgr2=0x7f6a0c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 0x7f6a0c0b7820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a140ac510 tx=0x7f6a140a8cd0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 msgr2=0x7f6a241ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400e9f0 tx=0x7f6a1400eeb0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 shutdown_connections 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2410f6e0 0x7f6a241aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a2410aa70 0x7f6a241abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6a0c0b5360 0x7f6a0c0b7820 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 --2- 172.21.15.67:0/4107814891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a2410a150 0x7f6a241ab9b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.038+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 >> 172.21.15.67:0/4107814891 conn(0x7f6a2406e2e0 msgr2=0x7f6a2410b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.039+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 shutdown_connections 2024-09-10T20:52:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:43.039+0000 7f6a2918f640 1 -- 172.21.15.67:0/4107814891 wait complete. 2024-09-10T20:52:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 70.0 s, 4378.4 tps, lat 23.249 ms stddev 26.868 2024-09-10T20:52:44.182 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:52:44.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:52:44.645 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:44 smithi083 ceph-mon[35058]: pgmap v383: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 896 op/s 2024-09-10T20:52:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:44 smithi172 ceph-mon[35265]: pgmap v383: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 896 op/s 2024-09-10T20:52:44.957 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:44 smithi067 ceph-mon[30891]: pgmap v383: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 896 op/s 2024-09-10T20:52:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.267+0000 7f3da1627640 1 -- 172.21.15.67:0/3135960339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1076e0 msgr2=0x7f3d9c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.267+0000 7f3da1627640 1 --2- 172.21.15.67:0/3135960339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c107b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c01a910 tx=0x7f3d8c03b420 comp rx=0 tx=0).stop 2024-09-10T20:52:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.268+0000 7f3da1627640 1 -- 172.21.15.67:0/3135960339 shutdown_connections 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.268+0000 7f3da1627640 1 --2- 172.21.15.67:0/3135960339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c108060 0x7f3d9c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.268+0000 7f3da1627640 1 --2- 172.21.15.67:0/3135960339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c107b20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.268+0000 7f3da1627640 1 --2- 172.21.15.67:0/3135960339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.268+0000 7f3da1627640 1 -- 172.21.15.67:0/3135960339 >> 172.21.15.67:0/3135960339 conn(0x7f3d9c0fd740 msgr2=0x7f3d9c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.269+0000 7f3da1627640 1 -- 172.21.15.67:0/3135960339 shutdown_connections 2024-09-10T20:52:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.270+0000 7f3da1627640 1 -- 172.21.15.67:0/3135960339 wait complete. 2024-09-10T20:52:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.270+0000 7f3da1627640 1 Processor -- start 2024-09-10T20:52:45.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 -- start start 2024-09-10T20:52:45.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:45.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c10dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 0x7f3d9c195200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c072700 con 0x7f3d9c101cd0 2024-09-10T20:52:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c072580 con 0x7f3d9c108060 2024-09-10T20:52:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.271+0000 7f3da1627640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c072880 con 0x7f3d9c1076e0 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c10dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59494/0 (socket says 172.21.15.67:59494) 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c10dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59814/0 (socket says 172.21.15.67:59814) 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9affd640 1 -- 172.21.15.67:0/2687050672 learned_addr learned my addr 172.21.15.67:0/2687050672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 0x7f3d9c195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 -- 172.21.15.67:0/2687050672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 msgr2=0x7f3d9c10dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c10dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 -- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 msgr2=0x7f3d9c10d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9b7fe640 1 -- 172.21.15.67:0/2687050672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c195980 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.272+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3d9b7fe640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 0x7f3d9c195200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d6b0 tx=0x7f3d9000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90017070 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d90009cd0 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90003cc0 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c195c70 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.273+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9c19f5c0 con 0x7f3d9c108060 2024-09-10T20:52:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.274+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9c0cfee0 con 0x7f3d9c108060 2024-09-10T20:52:45.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.277+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3d90009820 con 0x7f3d9c108060 2024-09-10T20:52:45.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.278+0000 7f3d83fff640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 0x7f3d840b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:45.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.278+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 0x7f3d840b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:45.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.278+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3d900e52d0 con 0x7f3d9c108060 2024-09-10T20:52:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.279+0000 7f3d9affd640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 0x7f3d840b7810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d940049d0 tx=0x7f3d94009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.282+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3d900abb70 con 0x7f3d9c108060 2024-09-10T20:52:45.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.723+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d9c02e5c0 con 0x7f3d9c108060 2024-09-10T20:52:45.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.724+0000 7f3d83fff640 1 -- 172.21.15.67:0/2687050672 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f3d900b05a0 con 0x7f3d9c108060 2024-09-10T20:52:45.729 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:52:45.729 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-10T20:51:30:345494+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:51:29.557607+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:52:45.729 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 msgr2=0x7f3d840b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 0x7f3d840b7810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d940049d0 tx=0x7f3d94009500 comp rx=0 tx=0).stop 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 msgr2=0x7f3d9c195200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 0x7f3d9c195200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d6b0 tx=0x7f3d9000db70 comp rx=0 tx=0).stop 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 shutdown_connections 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108060 0x7f3d9c195200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3d840b5350 0x7f3d840b7810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d9c1076e0 0x7f3d9c10dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 --2- 172.21.15.67:0/2687050672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d9c101cd0 0x7f3d9c10d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:45.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 >> 172.21.15.67:0/2687050672 conn(0x7f3d9c0fd740 msgr2=0x7f3d9c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:45.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.730+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 shutdown_connections 2024-09-10T20:52:45.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:45.731+0000 7f3da1627640 1 -- 172.21.15.67:0/2687050672 wait complete. 2024-09-10T20:52:46.559 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:52:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:46 smithi067 ceph-mon[30891]: pgmap v384: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-09-10T20:52:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:46 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2687050672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:52:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:46 smithi083 ceph-mon[35058]: pgmap v384: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-09-10T20:52:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:46 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2687050672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:52:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:46 smithi172 ceph-mon[35265]: pgmap v384: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-09-10T20:52:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:46 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2687050672' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:52:46.987 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 -- 172.21.15.67:0/2809029562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c101660 msgr2=0x7fe97c101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 --2- 172.21.15.67:0/2809029562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c101660 0x7fe97c101a40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe974009be0 tx=0x7fe97402a710 comp rx=0 tx=0).stop 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 -- 172.21.15.67:0/2809029562 shutdown_connections 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 --2- 172.21.15.67:0/2809029562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c10f310 0x7fe97c111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 --2- 172.21.15.67:0/2809029562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe97c102060 0x7fe97c10edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 --2- 172.21.15.67:0/2809029562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c101660 0x7fe97c101a40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 -- 172.21.15.67:0/2809029562 >> 172.21.15.67:0/2809029562 conn(0x7fe97c076e20 msgr2=0x7fe97c077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 -- 172.21.15.67:0/2809029562 shutdown_connections 2024-09-10T20:52:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.543+0000 7fe98268f640 1 -- 172.21.15.67:0/2809029562 wait complete. 2024-09-10T20:52:47.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.544+0000 7fe98268f640 1 Processor -- start 2024-09-10T20:52:47.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.544+0000 7fe98268f640 1 -- start start 2024-09-10T20:52:47.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c102060 0x7fe97c10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe97c10f310 0x7fe97c10c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c114f60 con 0x7fe97c102060 2024-09-10T20:52:47.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c114de0 con 0x7fe97c10f310 2024-09-10T20:52:47.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.545+0000 7fe98268f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1150e0 con 0x7fe97c101660 2024-09-10T20:52:47.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.546+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.546+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59832/0 (socket says 172.21.15.67:59832) 2024-09-10T20:52:47.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.546+0000 7fe97bfff640 1 -- 172.21.15.67:0/3359409955 learned_addr learned my addr 172.21.15.67:0/3359409955 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.547+0000 7fe97bfff640 1 -- 172.21.15.67:0/3359409955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe97c10f310 msgr2=0x7fe97c10c310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.547+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe97c10f310 0x7fe97c10c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.547+0000 7fe97bfff640 1 -- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c102060 msgr2=0x7fe97c10bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.547+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c102060 0x7fe97c10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.547+0000 7fe97bfff640 1 -- 172.21.15.67:0/3359409955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c10cbd0 con 0x7fe97c101660 2024-09-10T20:52:47.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.548+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe974034040 tx=0x7fe974030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.548+0000 7fe9797fa640 1 -- 172.21.15.67:0/3359409955 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974041020 con 0x7fe97c101660 2024-09-10T20:52:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.548+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c1abd60 con 0x7fe97c101660 2024-09-10T20:52:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.548+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c1ac290 con 0x7fe97c101660 2024-09-10T20:52:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.549+0000 7fe9797fa640 1 -- 172.21.15.67:0/3359409955 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe974037040 con 0x7fe97c101660 2024-09-10T20:52:47.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.549+0000 7fe9797fa640 1 -- 172.21.15.67:0/3359409955 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974036070 con 0x7fe97c101660 2024-09-10T20:52:47.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.552+0000 7fe984a64740 1 Processor -- start 2024-09-10T20:52:47.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.552+0000 7fe984a64740 1 -- start start 2024-09-10T20:52:47.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c880604d0 0x564c880608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c8806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564c87fd6ea0 con 0x564c880604d0 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c87fc62d0 con 0x564c88060df0 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe984a64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c87fca0e0 con 0x564c8806cd80 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59848/0 (socket says 172.21.15.67:59848) 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe97b7fe640 1 -- 172.21.15.67:0/422298198 learned_addr learned my addr 172.21.15.67:0/422298198 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.553+0000 7fe980c2c640 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c880604d0 0x564c880608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe97b7fe640 1 -- 172.21.15.67:0/422298198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 msgr2=0x564c8806c840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:47.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c8806c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe97b7fe640 1 -- 172.21.15.67:0/422298198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c880604d0 msgr2=0x564c880608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c880604d0 0x564c880608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe97b7fe640 1 -- 172.21.15.67:0/422298198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c87d24650 con 0x564c8806cd80 2024-09-10T20:52:47.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.554+0000 7fe9797fa640 1 -- 172.21.15.67:0/3359409955 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe974031440 con 0x7fe97c101660 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.555+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe97000a9c0 tx=0x7fe97000ae80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c7665be9060b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.555+0000 7fe9627fc640 1 -- 172.21.15.67:0/422298198 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97000cde0 con 0x564c8806cd80 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.555+0000 7fe9627fc640 1 -- 172.21.15.67:0/422298198 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe97000f900 con 0x564c8806cd80 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.555+0000 7fe9627fc640 1 -- 172.21.15.67:0/422298198 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970018970 con 0x564c8806cd80 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.556+0000 7fe984a64740 1 -- 172.21.15.67:0/422298198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 msgr2=0x564c8806f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.556+0000 7fe984a64740 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe97000a9c0 tx=0x7fe97000ae80 comp rx=0 tx=0).stop 2024-09-10T20:52:47.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.556+0000 7fe9797fa640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 0x7fe9640b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.557+0000 7fe9797fa640 1 -- 172.21.15.67:0/3359409955 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe974106c20 con 0x7fe97c101660 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe980c2c640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 0x7fe9640b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 -- 172.21.15.67:0/422298198 shutdown_connections 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c8806cd80 0x564c8806f170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c8806c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 --2- 172.21.15.67:0/422298198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c880604d0 0x564c880608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 -- 172.21.15.67:0/422298198 >> 172.21.15.67:0/422298198 conn(0x564c8805e300 msgr2=0x564c8805f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 -- 172.21.15.67:0/422298198 shutdown_connections 2024-09-10T20:52:47.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.558+0000 7fe984a64740 1 -- 172.21.15.67:0/422298198 wait complete. 2024-09-10T20:52:47.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.559+0000 7fe984a64740 1 -- start start 2024-09-10T20:52:47.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.559+0000 7fe980c2c640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 0x7fe9640b78a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ab0 tx=0x7fe96c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.559+0000 7fe984a64740 1 Processor -- start 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c880604d0 0x564c8806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564c87e27700 con 0x564c8806cd80 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c87f61160 con 0x564c88060df0 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c8806fa00 con 0x564c880604d0 2024-09-10T20:52:47.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe984a64740 10 client.0 _ll_register_callbacks cb 0x564c87f7a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:47.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60706/0 (socket says 172.21.15.67:60706) 2024-09-10T20:52:47.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe97b7fe640 1 -- 172.21.15.67:0/3067766304 learned_addr learned my addr 172.21.15.67:0/3067766304 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:47.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe980c2c640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.560+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c880604d0 0x564c8806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.561+0000 7fe97b7fe640 1 -- 172.21.15.67:0/3067766304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c880604d0 msgr2=0x564c8806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.561+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c880604d0 0x564c8806c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.561+0000 7fe97b7fe640 1 -- 172.21.15.67:0/3067766304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 msgr2=0x564c8806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.561+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.561+0000 7fe97b7fe640 1 -- 172.21.15.67:0/3067766304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c87f8ec90 con 0x564c88060df0 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.562+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b010 tx=0x7fe97000f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a26057313c79fae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.563+0000 7fe95b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:47.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.563+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970027020 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.563+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe970004020 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.563+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe97000f900 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.564+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe97000f750 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.564+0000 7fe984a64740 10 client.25130 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.564+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c8807b4b0 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.565+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe970004260 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.565+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe970018770 con 0x564c88060df0 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.565+0000 7fe984a64740 10 client.25130 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:47.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.565+0000 7fe984a64740 10 client.25130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:52:47.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.566+0000 7fe984a64740 20 client.25130 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:47.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.566+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c8807c800 0x564c8807ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.566+0000 7fe984a64740 4 client.25130 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:47.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.566+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe97000f900 con 0x564c8807c800 2024-09-10T20:52:47.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.572+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c8807c800 0x564c8807ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.578+0000 7fe95b7fe640 10 client.25130 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:47.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.578+0000 7fe97bfff640 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c8807c800 0x564c8807ebf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdc84fba7cb6defb server_cookie=d6cd252c9155f12f in_seq=0 out_seq=0 2024-09-10T20:52:47.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.579+0000 7fe95b7fe640 1 -- 172.21.15.67:0/3067766304 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe97000f900 con 0x564c8807c800 2024-09-10T20:52:47.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.579+0000 7fe95b7fe640 10 client.25130 handle_command_reply: tid=0 2024-09-10T20:52:47.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.579+0000 7fe984a64740 1 client.25130 shutdown 2024-09-10T20:52:47.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 msgr2=0x564c88069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe97000b010 tx=0x7fe97000f660 comp rx=0 tx=0).stop 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 shutdown_connections 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c8807c800 0x564c8807ebf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe95b7fe640 0 client.25130 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c88060df0 0x564c88069bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 --2- 172.21.15.67:0/3067766304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c880604d0 0x564c8806c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.580+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 >> 172.21.15.67:0/3067766304 conn(0x564c8805e300 msgr2=0x564c88063e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.581+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 shutdown_connections 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.581+0000 7fe984a64740 1 -- 172.21.15.67:0/3067766304 wait complete. 2024-09-10T20:52:47.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.581+0000 7fe984a64740 20 client.25130 trim_cache size 0 max 16384 2024-09-10T20:52:47.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 Processor -- start 2024-09-10T20:52:47.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 -- start start 2024-09-10T20:52:47.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c88064540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe968010cd0 con 0x564c8806cd80 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe96800e570 con 0x564c880604d0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.608+0000 7fe984a64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe96800c3c0 con 0x564c88060df0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59856/0 (socket says 172.21.15.67:59856) 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 -- 172.21.15.67:0/1091230242 learned_addr learned my addr 172.21.15.67:0/1091230242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97bfff640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c88064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe980c2c640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 -- 172.21.15.67:0/1091230242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 msgr2=0x564c88064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c88064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 -- 172.21.15.67:0/1091230242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 msgr2=0x564c8806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97b7fe640 1 -- 172.21.15.67:0/1091230242 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8805fa30 con 0x564c88060df0 2024-09-10T20:52:47.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe97bfff640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c88064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:47.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.609+0000 7fe980c2c640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:47.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.612+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe97000a300 tx=0x7fe97000a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd4bab2ff07ce1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.612+0000 7fe961ffb640 1 -- 172.21.15.67:0/1091230242 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970004020 con 0x564c88060df0 2024-09-10T20:52:47.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.612+0000 7fe961ffb640 1 -- 172.21.15.67:0/1091230242 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe970018970 con 0x564c88060df0 2024-09-10T20:52:47.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.612+0000 7fe961ffb640 1 -- 172.21.15.67:0/1091230242 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970023ac0 con 0x564c88060df0 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.613+0000 7fe984a64740 1 -- 172.21.15.67:0/1091230242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 msgr2=0x564c88078cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.613+0000 7fe984a64740 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe97000a300 tx=0x7fe97000a330 comp rx=0 tx=0).stop 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 -- 172.21.15.67:0/1091230242 shutdown_connections 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c88078cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 --2- 172.21.15.67:0/1091230242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c88064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 -- 172.21.15.67:0/1091230242 >> 172.21.15.67:0/1091230242 conn(0x564c8805e300 msgr2=0x564c88064e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 -- 172.21.15.67:0/1091230242 shutdown_connections 2024-09-10T20:52:47.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.614+0000 7fe984a64740 1 -- 172.21.15.67:0/1091230242 wait complete. 2024-09-10T20:52:47.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.615+0000 7fe984a64740 1 -- start start 2024-09-10T20:52:47.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.615+0000 7fe984a64740 1 Processor -- start 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c880756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c8806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe96800ca30 con 0x564c8806cd80 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe96800dea0 con 0x564c880604d0 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe96800d100 con 0x564c88060df0 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe984a64740 10 client.0 _ll_register_callbacks cb 0x7fe96c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c880756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59542/0 (socket says 172.21.15.67:59542) 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 -- 172.21.15.67:0/2183775210 learned_addr learned my addr 172.21.15.67:0/2183775210 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe97b7fe640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c8806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 -- 172.21.15.67:0/2183775210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 msgr2=0x564c8806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c8806e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.616+0000 7fe980c2c640 1 -- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 msgr2=0x564c880756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.617+0000 7fe980c2c640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c880756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.617+0000 7fe980c2c640 1 -- 172.21.15.67:0/2183775210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c88071110 con 0x564c8806cd80 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.617+0000 7fe980c2c640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0109e0 tx=0x7fe96c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9d0580cb36604e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:47.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.617+0000 7fe95b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.618+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c016070 con 0x564c8806cd80 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.618+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe96c005020 con 0x564c8806cd80 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.618+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe970018970 con 0x564c8806cd80 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.619+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe96c005220 con 0x564c8806cd80 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.619+0000 7fe984a64740 10 client.15498 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:47.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.619+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c880e9760 con 0x564c8806cd80 2024-09-10T20:52:47.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe970018970 con 0x564c8806cd80 2024-09-10T20:52:47.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe96c0047a0 con 0x564c8806cd80 2024-09-10T20:52:47.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:47.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 10 client.15498 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:52:47.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 20 client.15498 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:47.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c880e9f70 0x564c880ec390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:47.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 4 client.15498 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:47.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.620+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c87fd8df0 con 0x564c880e9f70 2024-09-10T20:52:47.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.622+0000 7fe97bfff640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c880e9f70 0x564c880ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.623+0000 7fe97bfff640 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c880e9f70 0x564c880ec390 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5a1136f6d857ad2 server_cookie=30ad2fe0b1906d9f in_seq=0 out_seq=0 2024-09-10T20:52:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.623+0000 7fe95b7fe640 10 client.15498 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.623+0000 7fe95b7fe640 1 -- 172.21.15.67:0/2183775210 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c87fd8df0 con 0x564c880e9f70 2024-09-10T20:52:47.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.623+0000 7fe95b7fe640 10 client.15498 handle_command_reply: tid=0 2024-09-10T20:52:47.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.623+0000 7fe984a64740 1 client.15498 shutdown 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 msgr2=0x564c8806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0109e0 tx=0x7fe96c004730 comp rx=0 tx=0).stop 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 shutdown_connections 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x564c880e9f70 0x564c880ec390 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c8806cd80 0x564c8806e7a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe95b7fe640 0 client.15498 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c88060df0 0x564c8806e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 --2- 172.21.15.67:0/2183775210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c880604d0 0x564c880756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.624+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 >> 172.21.15.67:0/2183775210 conn(0x564c8805e300 msgr2=0x564c8806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.625+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 shutdown_connections 2024-09-10T20:52:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.625+0000 7fe984a64740 1 -- 172.21.15.67:0/2183775210 wait complete. 2024-09-10T20:52:47.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.625+0000 7fe984a64740 20 client.15498 trim_cache size 0 max 16384 2024-09-10T20:52:47.630 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.626+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 msgr2=0x7fe9640b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.626+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 0x7fe9640b78a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe96c005ab0 tx=0x7fe96c005f90 comp rx=0 tx=0).stop 2024-09-10T20:52:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.626+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 msgr2=0x7fe97c10eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:47.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.626+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe974034040 tx=0x7fe974030ce0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 shutdown_connections 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe97c10f310 0x7fe97c10c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe97c102060 0x7fe97c10bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9640b53e0 0x7fe9640b78a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 --2- 172.21.15.67:0/3359409955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c101660 0x7fe97c10eb60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:47.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.627+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 >> 172.21.15.67:0/3359409955 conn(0x7fe97c076e20 msgr2=0x7fe97c100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.629+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 shutdown_connections 2024-09-10T20:52:47.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:47.629+0000 7fe98268f640 1 -- 172.21.15.67:0/3359409955 wait complete. 2024-09-10T20:52:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:48 smithi083 ceph-mon[35058]: pgmap v385: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-10T20:52:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:48 smithi172 ceph-mon[35265]: pgmap v385: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-10T20:52:48.958 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:48 smithi067 ceph-mon[30891]: pgmap v385: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-09-10T20:52:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 75.0 s, 5187.8 tps, lat 19.298 ms stddev 21.183 2024-09-10T20:52:49.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:52:49.757 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 -- 172.21.15.67:0/998978115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540106ed0 msgr2=0x7f9540107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 --2- 172.21.15.67:0/998978115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540106ed0 0x7f9540107320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9538009860 tx=0x7f953802a360 comp rx=0 tx=0).stop 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 -- 172.21.15.67:0/998978115 shutdown_connections 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 --2- 172.21.15.67:0/998978115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540106ed0 0x7f9540107320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 --2- 172.21.15.67:0/998978115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95401023b0 0x7f9540106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 --2- 172.21.15.67:0/998978115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9540101a90 0x7f9540101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 -- 172.21.15.67:0/998978115 >> 172.21.15.67:0/998978115 conn(0x7f95400fd700 msgr2=0x7f95400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.357+0000 7f9545388640 1 -- 172.21.15.67:0/998978115 shutdown_connections 2024-09-10T20:52:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.358+0000 7f9545388640 1 -- 172.21.15.67:0/998978115 wait complete. 2024-09-10T20:52:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.358+0000 7f9545388640 1 Processor -- start 2024-09-10T20:52:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 -- start start 2024-09-10T20:52:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540101a90 0x7f9540073c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 0x7f9540116120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f954010a670 con 0x7f9540106ed0 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f954010a4f0 con 0x7f95401023b0 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.359+0000 7f9545388640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f954010a7f0 con 0x7f9540101a90 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 0x7f9540116120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60742/0 (socket says 172.21.15.67:60742) 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 -- 172.21.15.67:0/1968662738 learned_addr learned my addr 172.21.15.67:0/1968662738 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953effd640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540101a90 0x7f9540073c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 -- 172.21.15.67:0/1968662738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540101a90 msgr2=0x7f9540073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540101a90 0x7f9540073c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 -- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 msgr2=0x7f9540116120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 0x7f9540116120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 -- 172.21.15.67:0/1968662738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954010f220 con 0x7f95401023b0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953f7fe640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 0x7f9540116120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.360+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f952801e990 tx=0x7f952801ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.361+0000 7f9537fff640 1 -- 172.21.15.67:0/1968662738 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528028020 con 0x7f95401023b0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.361+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954010f510 con 0x7f95401023b0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.361+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954010faa0 con 0x7f95401023b0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.361+0000 7f9537fff640 1 -- 172.21.15.67:0/1968662738 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f952801ad20 con 0x7f95401023b0 2024-09-10T20:52:50.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.361+0000 7f9537fff640 1 -- 172.21.15.67:0/1968662738 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528028020 con 0x7f95401023b0 2024-09-10T20:52:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.365+0000 7f954775d740 1 Processor -- start 2024-09-10T20:52:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.365+0000 7f954775d740 1 -- start start 2024-09-10T20:52:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.365+0000 7f954775d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.365+0000 7f954775d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f954775d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe85d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f954775d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbdedea0 con 0x55f4cbe77a10 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f954775d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbddd2d0 con 0x55f4cbe770f0 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f954775d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbde10e0 con 0x55f4cbe839a0 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60754/0 (socket says 172.21.15.67:60754) 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59570/0 (socket says 172.21.15.67:59570) 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 -- 172.21.15.67:0/3116391703 learned_addr learned my addr 172.21.15.67:0/3116391703 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 -- 172.21.15.67:0/3116391703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 msgr2=0x55f4cbe85d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe85d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 -- 172.21.15.67:0/3116391703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 msgr2=0x55f4cbe83460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953f7fe640 1 -- 172.21.15.67:0/3116391703 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cbb3b650 con 0x55f4cbe770f0 2024-09-10T20:52:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.366+0000 7f953effd640 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.367+0000 7f953f7fe640 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9538005d00 tx=0x7f9538004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ecbc9178eeaa6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.368+0000 7f9537fff640 1 -- 172.21.15.67:0/1968662738 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f952801f040 con 0x7f95401023b0 2024-09-10T20:52:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.368+0000 7f95357fa640 1 -- 172.21.15.67:0/3116391703 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538041020 con 0x55f4cbe770f0 2024-09-10T20:52:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.369+0000 7f95357fa640 1 -- 172.21.15.67:0/3116391703 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9538004430 con 0x55f4cbe770f0 2024-09-10T20:52:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.369+0000 7f95357fa640 1 -- 172.21.15.67:0/3116391703 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538037040 con 0x55f4cbe770f0 2024-09-10T20:52:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.369+0000 7f954775d740 1 -- 172.21.15.67:0/3116391703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 msgr2=0x55f4cbe774d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.369+0000 7f954775d740 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9538005d00 tx=0x7f9538004040 comp rx=0 tx=0).stop 2024-09-10T20:52:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.369+0000 7f9537fff640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 0x7f952c0b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f9537fff640 1 -- 172.21.15.67:0/1968662738 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f95280f6220 con 0x7f95401023b0 2024-09-10T20:52:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f954775d740 1 -- 172.21.15.67:0/3116391703 shutdown_connections 2024-09-10T20:52:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f954775d740 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe85d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f954775d740 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe83460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f954775d740 1 --2- 172.21.15.67:0/3116391703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe774d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.370+0000 7f954775d740 1 -- 172.21.15.67:0/3116391703 >> 172.21.15.67:0/3116391703 conn(0x55f4cbe74f20 msgr2=0x55f4cbe760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.371+0000 7f954775d740 1 -- 172.21.15.67:0/3116391703 shutdown_connections 2024-09-10T20:52:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.371+0000 7f953f7fe640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 0x7f952c0b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.372+0000 7f954775d740 1 -- 172.21.15.67:0/3116391703 wait complete. 2024-09-10T20:52:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.372+0000 7f954775d740 1 -- start start 2024-09-10T20:52:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.372+0000 7f953f7fe640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 0x7f952c0b7ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9538009780 tx=0x7f953802a360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.372+0000 7f954775d740 1 Processor -- start 2024-09-10T20:52:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe83360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe80e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbc3e700 con 0x55f4cbe77a10 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbd78160 con 0x55f4cbe770f0 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4cbe865c0 con 0x55f4cbe839a0 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f954775d740 10 client.0 _ll_register_callbacks cb 0x55f4cbd919e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:50.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59580/0 (socket says 172.21.15.67:59580) 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f953e7fc640 1 -- 172.21.15.67:0/639115550 learned_addr learned my addr 172.21.15.67:0/639115550 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f953effd640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe83360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.373+0000 7f953f7fe640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe80e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953effd640 1 -- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 msgr2=0x55f4cbe80e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953effd640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe80e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953effd640 1 -- 172.21.15.67:0/639115550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 msgr2=0x55f4cbe807b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953effd640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953effd640 1 -- 172.21.15.67:0/639115550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cbda5c90 con 0x55f4cbe770f0 2024-09-10T20:52:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.374+0000 7f953e7fc640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f953effd640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe83360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f953000a300 tx=0x7f9530010f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec9aabcf8b08a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953000fc40 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f953000fde0 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9538004430 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9530004b20 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 10 client.25145 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4cbe920c0 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9538004430 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f95300196e0 con 0x55f4cbe770f0 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 10 client.25145 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 10 client.25145 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:52:50.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.376+0000 7f954775d740 20 client.25145 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.377+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbe93570 0x55f4cbe959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.377+0000 7f954775d740 4 client.25145 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.377+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4cbdefdf0 con 0x55f4cbe93570 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.377+0000 7f953e7fc640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbe93570 0x55f4cbe959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.377+0000 7f95267fc640 10 client.25145 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:50.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.378+0000 7f953e7fc640 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbe93570 0x55f4cbe959f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=251e9b0de43163c6 server_cookie=38291f4446e3d435 in_seq=0 out_seq=0 2024-09-10T20:52:50.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.378+0000 7f95267fc640 1 -- 172.21.15.67:0/639115550 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4cbdefdf0 con 0x55f4cbe93570 2024-09-10T20:52:50.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.378+0000 7f95267fc640 10 client.25145 handle_command_reply: tid=0 2024-09-10T20:52:50.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 client.25145 shutdown 2024-09-10T20:52:50.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 msgr2=0x55f4cbe83360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe83360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f953000a300 tx=0x7f9530010f10 comp rx=0 tx=0).stop 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 shutdown_connections 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbe93570 0x55f4cbe959f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe80e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe77a10 0x55f4cbe807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 --2- 172.21.15.67:0/639115550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe770f0 0x55f4cbe83360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f95267fc640 0 client.25145 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.379+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 >> 172.21.15.67:0/639115550 conn(0x55f4cbe74f20 msgr2=0x55f4cbe7aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.380+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 shutdown_connections 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.380+0000 7f954775d740 1 -- 172.21.15.67:0/639115550 wait complete. 2024-09-10T20:52:50.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.380+0000 7f954775d740 20 client.25145 trim_cache size 0 max 16384 2024-09-10T20:52:50.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.408+0000 7f954775d740 1 Processor -- start 2024-09-10T20:52:50.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.408+0000 7f954775d740 1 -- start start 2024-09-10T20:52:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe74840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9520010c80 con 0x55f4cbe770f0 2024-09-10T20:52:50.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f952000e520 con 0x55f4cbe77a10 2024-09-10T20:52:50.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f954775d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f952000c370 con 0x55f4cbe839a0 2024-09-10T20:52:50.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe74840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe74840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60766/0 (socket says 172.21.15.67:60766) 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f953e7fc640 1 -- 172.21.15.67:0/74485518 learned_addr learned my addr 172.21.15.67:0/74485518 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f953f7fe640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.409+0000 7f953effd640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 -- 172.21.15.67:0/74485518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 msgr2=0x55f4cbe74840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe74840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 -- 172.21.15.67:0/74485518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 msgr2=0x55f4cbe8f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 -- 172.21.15.67:0/74485518 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cbe811f0 con 0x55f4cbe839a0 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953effd640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:52:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.410+0000 7f953f7fe640 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe824f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9538035040 tx=0x7f9538004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac56ed96ccb76ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.411+0000 7f9534ff9640 1 -- 172.21.15.67:0/74485518 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538041040 con 0x55f4cbe839a0 2024-09-10T20:52:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.411+0000 7f9534ff9640 1 -- 172.21.15.67:0/74485518 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9538056070 con 0x55f4cbe839a0 2024-09-10T20:52:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.411+0000 7f9534ff9640 1 -- 172.21.15.67:0/74485518 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953803d470 con 0x55f4cbe839a0 2024-09-10T20:52:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 -- 172.21.15.67:0/74485518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 msgr2=0x55f4cbe824f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe824f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9538035040 tx=0x7f9538004040 comp rx=0 tx=0).stop 2024-09-10T20:52:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 -- 172.21.15.67:0/74485518 shutdown_connections 2024-09-10T20:52:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe839a0 0x55f4cbe824f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe74840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 --2- 172.21.15.67:0/74485518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 -- 172.21.15.67:0/74485518 >> 172.21.15.67:0/74485518 conn(0x55f4cbe74f20 msgr2=0x55f4cbe81de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 -- 172.21.15.67:0/74485518 shutdown_connections 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.412+0000 7f954775d740 1 -- 172.21.15.67:0/74485518 wait complete. 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.413+0000 7f954775d740 1 -- start start 2024-09-10T20:52:50.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.413+0000 7f954775d740 1 Processor -- start 2024-09-10T20:52:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.413+0000 7f954775d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.413+0000 7f954775d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe8be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f954775d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 0x55f4cbe7c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f954775d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f952000c9e0 con 0x55f4cbe839a0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f954775d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f952000de50 con 0x55f4cbe77a10 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f954775d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f952000d0b0 con 0x55f4cbe770f0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f954775d740 10 client.0 _ll_register_callbacks cb 0x7f953000aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe8be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59914/0 (socket says 172.21.15.67:59914) 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953effd640 1 -- 172.21.15.67:0/1204314383 learned_addr learned my addr 172.21.15.67:0/1204314383 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953f7fe640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 0x55f4cbe7c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 -- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 msgr2=0x55f4cbe8b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 -- 172.21.15.67:0/1204314383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 msgr2=0x55f4cbe7c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 0x55f4cbe7c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953e7fc640 1 -- 172.21.15.67:0/1204314383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cbe7cf10 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.414+0000 7f953effd640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f953f7fe640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 0x55f4cbe7c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f953e7fc640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe8be20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95280bc290 tx=0x7f95280bc840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506b2b1e160c29c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f95267fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95280c1490 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f95280c5ab0 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.415+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9538056070 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95280c5f40 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 10 client.25151 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4cbe7e270 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9538056070 con 0x55f4cbe77a10 2024-09-10T20:52:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f95280bbc10 con 0x55f4cbe77a10 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 10 client.25151 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 10 client.25151 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 20 client.25151 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.416+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbf014d0 0x55f4cbf038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.417+0000 7f954775d740 4 client.25151 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.417+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4cbdeb8a0 con 0x55f4cbf014d0 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.417+0000 7f953effd640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbf014d0 0x55f4cbf038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f953effd640 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbf014d0 0x55f4cbf038c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d56f2ec19713f3da server_cookie=7a75b8a62386597d in_seq=0 out_seq=0 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f95267fc640 10 client.25151 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f95267fc640 1 -- 172.21.15.67:0/1204314383 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4cbdeb8a0 con 0x55f4cbf014d0 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f95267fc640 10 client.25151 handle_command_reply: tid=0 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f954775d740 1 client.25151 shutdown 2024-09-10T20:52:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 msgr2=0x55f4cbe8be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.419+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe8be20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95280bc290 tx=0x7f95280bc840 comp rx=0 tx=0).stop 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 shutdown_connections 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55f4cbf014d0 0x55f4cbf038c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f95267fc640 0 client.25151 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f4cbe839a0 0x55f4cbe7c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f4cbe77a10 0x55f4cbe8be20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 --2- 172.21.15.67:0/1204314383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4cbe770f0 0x55f4cbe8b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 >> 172.21.15.67:0/1204314383 conn(0x55f4cbe74f20 msgr2=0x55f4cbe73f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 shutdown_connections 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.420+0000 7f954775d740 1 -- 172.21.15.67:0/1204314383 wait complete. 2024-09-10T20:52:50.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.421+0000 7f954775d740 20 client.25151 trim_cache size 0 max 16384 2024-09-10T20:52:50.429 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 msgr2=0x7f952c0b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 0x7f952c0b7ae0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9538009780 tx=0x7f953802a360 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 msgr2=0x7f9540074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f952801e990 tx=0x7f952801ee50 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 shutdown_connections 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9540106ed0 0x7f9540116120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95401023b0 0x7f9540074170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f952c0b5620 0x7f952c0b7ae0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 --2- 172.21.15.67:0/1968662738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9540101a90 0x7f9540073c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 >> 172.21.15.67:0/1968662738 conn(0x7f95400fd700 msgr2=0x7f9540104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 shutdown_connections 2024-09-10T20:52:50.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:50.423+0000 7f9545388640 1 -- 172.21.15.67:0/1968662738 wait complete. 2024-09-10T20:52:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:50 smithi083 ceph-mon[35058]: pgmap v386: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-10T20:52:50.921 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:50 smithi067 ceph-mon[30891]: pgmap v386: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-10T20:52:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:50 smithi172 ceph-mon[35265]: pgmap v386: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 749 op/s 2024-09-10T20:52:51.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:52:51.640 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 -- 172.21.15.67:0/2173023635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 msgr2=0x7fcdb8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2173023635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb8107b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009ca0 tx=0x7fcdb002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 -- 172.21.15.67:0/2173023635 shutdown_connections 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2173023635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8108040 0x7fcdb810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2173023635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb8107b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2173023635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8101cb0 0x7fcdb8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.232+0000 7fcdbf051640 1 -- 172.21.15.67:0/2173023635 >> 172.21.15.67:0/2173023635 conn(0x7fcdb80fd700 msgr2=0x7fcdb80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.233+0000 7fcdbf051640 1 -- 172.21.15.67:0/2173023635 shutdown_connections 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.233+0000 7fcdbf051640 1 -- 172.21.15.67:0/2173023635 wait complete. 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 Processor -- start 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 -- start start 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8101cb0 0x7fcdb8197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8108040 0x7fcdb819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8110c40 con 0x7fcdb8101cb0 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8110ac0 con 0x7fcdb8108040 2024-09-10T20:52:52.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.234+0000 7fcdbf051640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb8110dc0 con 0x7fcdb81076c0 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51644/0 (socket says 172.21.15.67:51644) 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 -- 172.21.15.67:0/2803634535 learned_addr learned my addr 172.21.15.67:0/2803634535 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8108040 0x7fcdb819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdbcded640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8101cb0 0x7fcdb8197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 -- 172.21.15.67:0/2803634535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8108040 msgr2=0x7fcdb819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8108040 0x7fcdb819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 -- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8101cb0 msgr2=0x7fcdb8197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8101cb0 0x7fcdb8197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.235+0000 7fcdb7fff640 1 -- 172.21.15.67:0/2803634535 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb819d1a0 con 0x7fcdb81076c0 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.236+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdb002aea0 tx=0x7fcdb0003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.237+0000 7fcdb5ffb640 1 -- 172.21.15.67:0/2803634535 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0004240 con 0x7fcdb81076c0 2024-09-10T20:52:52.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.237+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb819d430 con 0x7fcdb81076c0 2024-09-10T20:52:52.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.238+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb81a3bc0 con 0x7fcdb81076c0 2024-09-10T20:52:52.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.239+0000 7fcdb5ffb640 1 -- 172.21.15.67:0/2803634535 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb0040070 con 0x7fcdb81076c0 2024-09-10T20:52:52.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.239+0000 7fcdb5ffb640 1 -- 172.21.15.67:0/2803634535 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0031b40 con 0x7fcdb81076c0 2024-09-10T20:52:52.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.242+0000 7fcdb5ffb640 1 -- 172.21.15.67:0/2803634535 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcdb004c020 con 0x7fcdb81076c0 2024-09-10T20:52:52.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.243+0000 7fcdb5ffb640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 0x7fcda00b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.244+0000 7fcdb5ffb640 1 -- 172.21.15.67:0/2803634535 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcdb0106680 con 0x7fcdb81076c0 2024-09-10T20:52:52.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.244+0000 7fcdbcded640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 0x7fcda00b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.244+0000 7fcdc1426740 1 Processor -- start 2024-09-10T20:52:52.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.244+0000 7fcdc1426740 1 -- start start 2024-09-10T20:52:52.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 0x55bccfa6e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa7a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bccf9e4ea0 con 0x55bccfa6edf0 2024-09-10T20:52:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdbd5ee640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdbd5ee640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57632/0 (socket says 172.21.15.67:57632) 2024-09-10T20:52:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdbd5ee640 1 -- 172.21.15.67:0/348861774 learned_addr learned my addr 172.21.15.67:0/348861774 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:52.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bccf9d42d0 con 0x55bccfa7ad80 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.245+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bccf9d80e0 con 0x55bccfa6e4d0 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa7a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbcded640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 0x7fcda00b79a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbcded640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 0x55bccfa6e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 -- 172.21.15.67:0/348861774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 msgr2=0x55bccfa6e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 0x55bccfa6e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 -- 172.21.15.67:0/348861774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 msgr2=0x55bccfa7a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa7a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 -- 172.21.15.67:0/348861774 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccf732650 con 0x55bccfa7ad80 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbcded640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 0x55bccfa6e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.247+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0099e0 tx=0x7fcdac009ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e3cbac13138f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.248+0000 7fcd9effd640 1 -- 172.21.15.67:0/348861774 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac017070 con 0x55bccfa7ad80 2024-09-10T20:52:52.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.248+0000 7fcd9effd640 1 -- 172.21.15.67:0/348861774 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdac013470 con 0x55bccfa7ad80 2024-09-10T20:52:52.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.248+0000 7fcd9effd640 1 -- 172.21.15.67:0/348861774 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac012610 con 0x55bccfa7ad80 2024-09-10T20:52:52.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.250+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 msgr2=0x55bccfa7d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.251+0000 7fcdc1426740 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0099e0 tx=0x7fcdac009ea0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 shutdown_connections 2024-09-10T20:52:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa7d170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa7a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 --2- 172.21.15.67:0/348861774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6e4d0 0x55bccfa6e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 >> 172.21.15.67:0/348861774 conn(0x55bccfa6c300 msgr2=0x55bccfa6d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.258+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 shutdown_connections 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.259+0000 7fcdc1426740 1 -- 172.21.15.67:0/348861774 wait complete. 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.259+0000 7fcdc1426740 1 -- start start 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.260+0000 7fcdc1426740 1 Processor -- start 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa7ad80 0x55bccfa77f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdbcded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdbcded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57640/0 (socket says 172.21.15.67:57640) 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bccf835700 con 0x55bccfa6edf0 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bccf96f160 con 0x55bccfa6e4d0 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.261+0000 7fcdc1426740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bccfa7da50 con 0x55bccfa7ad80 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 -- 172.21.15.67:0/835791076 learned_addr learned my addr 172.21.15.67:0/835791076 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa7ad80 0x55bccfa77f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdc1426740 10 client.0 _ll_register_callbacks cb 0x55bccf9889e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 -- 172.21.15.67:0/835791076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa7ad80 msgr2=0x55bccfa77f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa7ad80 0x55bccfa77f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 -- 172.21.15.67:0/835791076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 msgr2=0x55bccfa779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.262+0000 7fcdbcded640 1 -- 172.21.15.67:0/835791076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccf99cc90 con 0x55bccfa6e4d0 2024-09-10T20:52:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.264+0000 7fcdbcded640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011440 tx=0x7fcda80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc68e126a193d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.267+0000 7fcd97fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:52.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.267+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda801e830 con 0x55bccfa6e4d0 2024-09-10T20:52:52.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.267+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcda801e9d0 con 0x55bccfa6e4d0 2024-09-10T20:52:52.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.267+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdac013470 con 0x55bccfa6e4d0 2024-09-10T20:52:52.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.269+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcda801ebd0 con 0x55bccfa6e4d0 2024-09-10T20:52:52.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.271+0000 7fcdc1426740 10 client.25163 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:52.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.271+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bccfa89320 con 0x55bccfa6e4d0 2024-09-10T20:52:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcda801ed70 con 0x55bccfa6e4d0 2024-09-10T20:52:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fcda80104e0 con 0x55bccfa6e4d0 2024-09-10T20:52:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 10 client.25163 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 10 client.25163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 20 client.25163 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfa8a880 0x55bccfa8cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 4 client.25163 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcdac013470 con 0x55bccfa8a880 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.273+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfa8a880 0x55bccfa8cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.274+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfa8a880 0x55bccfa8cc90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06b0f0367a435ba server_cookie=bb35281a50e6b96 in_seq=0 out_seq=0 2024-09-10T20:52:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.274+0000 7fcd97fff640 10 client.25163 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.276+0000 7fcd97fff640 1 -- 172.21.15.67:0/835791076 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fcdac013470 con 0x55bccfa8a880 2024-09-10T20:52:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.276+0000 7fcd97fff640 10 client.25163 handle_command_reply: tid=0 2024-09-10T20:52:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.276+0000 7fcdc1426740 1 client.25163 shutdown 2024-09-10T20:52:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.276+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 msgr2=0x55bccfa7a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.276+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011440 tx=0x7fcda80046c0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 shutdown_connections 2024-09-10T20:52:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfa8a880 0x55bccfa8cc90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa7ad80 0x55bccfa77f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6edf0 0x55bccfa779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 --2- 172.21.15.67:0/835791076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa7a590 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 >> 172.21.15.67:0/835791076 conn(0x55bccfa6c300 msgr2=0x55bccfa71e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.277+0000 7fcd97fff640 0 client.25163 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.278+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 shutdown_connections 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.278+0000 7fcdc1426740 1 -- 172.21.15.67:0/835791076 wait complete. 2024-09-10T20:52:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.278+0000 7fcdc1426740 20 client.25163 trim_cache size 0 max 16384 2024-09-10T20:52:52.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.306+0000 7fcdc1426740 1 Processor -- start 2024-09-10T20:52:52.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.306+0000 7fcdc1426740 1 -- start start 2024-09-10T20:52:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.306+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa767a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdbcded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdbcded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57650/0 (socket says 172.21.15.67:57650) 2024-09-10T20:52:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdbcded640 1 -- 172.21.15.67:0/4055354580 learned_addr learned my addr 172.21.15.67:0/4055354580 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa7ad80 0x55bccfa74bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.307+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa767a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcda4010db0 con 0x55bccfa7ad80 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcda400e650 con 0x55bccfa6e4d0 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcda400c4a0 con 0x55bccfa6edf0 2024-09-10T20:52:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbd5ee640 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa7ad80 0x55bccfa74bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbcded640 1 -- 172.21.15.67:0/4055354580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 msgr2=0x55bccfa767a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbcded640 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa767a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbcded640 1 -- 172.21.15.67:0/4055354580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa7ad80 msgr2=0x55bccfa74bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbcded640 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa7ad80 0x55bccfa74bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.308+0000 7fcdbcded640 1 -- 172.21.15.67:0/4055354580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccfa6cd80 con 0x55bccfa6e4d0 2024-09-10T20:52:52.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.310+0000 7fcdbcded640 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcda8014040 tx=0x7fcda800ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e00b3c6286b24c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.310+0000 7fcd9e7fc640 1 -- 172.21.15.67:0/4055354580 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda803f070 con 0x55bccfa6e4d0 2024-09-10T20:52:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.311+0000 7fcd9e7fc640 1 -- 172.21.15.67:0/4055354580 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcda8010d30 con 0x55bccfa6e4d0 2024-09-10T20:52:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.311+0000 7fcd9e7fc640 1 -- 172.21.15.67:0/4055354580 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8031910 con 0x55bccfa6e4d0 2024-09-10T20:52:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 msgr2=0x55bccfa76260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcda8014040 tx=0x7fcda800ba70 comp rx=0 tx=0).stop 2024-09-10T20:52:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 shutdown_connections 2024-09-10T20:52:52.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa7ad80 0x55bccfa74bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa767a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4055354580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa6e4d0 0x55bccfa76260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 >> 172.21.15.67:0/4055354580 conn(0x55bccfa6c300 msgr2=0x55bccfa6cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 shutdown_connections 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.312+0000 7fcdc1426740 1 -- 172.21.15.67:0/4055354580 wait complete. 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.313+0000 7fcdc1426740 1 -- start start 2024-09-10T20:52:52.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.313+0000 7fcdc1426740 1 Processor -- start 2024-09-10T20:52:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6e4d0 0x55bccfa836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa75120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcda400cb10 con 0x55bccfa6e4d0 2024-09-10T20:52:52.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcda400df80 con 0x55bccfa7ad80 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcda400d1e0 con 0x55bccfa6edf0 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdc1426740 10 client.0 _ll_register_callbacks cb 0x7fcda8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.314+0000 7fcdb7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51674/0 (socket says 172.21.15.67:51674) 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 -- 172.21.15.67:0/4179687158 learned_addr learned my addr 172.21.15.67:0/4179687158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 -- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 msgr2=0x55bccfa75120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa75120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 -- 172.21.15.67:0/4179687158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6e4d0 msgr2=0x55bccfa836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6e4d0 0x55bccfa836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 -- 172.21.15.67:0/4179687158 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccfa82290 con 0x55bccfa6edf0 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcdb7fff640 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb00cc890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b14e779467fdc1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.315+0000 7fcd97fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.316+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00cce10 con 0x55bccfa6edf0 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.316+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcdb00c9080 con 0x55bccfa6edf0 2024-09-10T20:52:52.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.317+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda8010d30 con 0x55bccfa6edf0 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.317+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcdb00d18f0 con 0x55bccfa6edf0 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.317+0000 7fcdc1426740 10 client.25162 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.317+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bccfaf79f0 con 0x55bccfa6edf0 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcda8010d30 con 0x55bccfa6edf0 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fcdb00cd070 con 0x55bccfa6edf0 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 10 client.25162 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 10 client.25162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 20 client.25162 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfaf8180 0x55bccfafa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 4 client.25162 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:52:52.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bccf9e6df0 con 0x55bccfaf8180 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.318+0000 7fcdbcded640 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfaf8180 0x55bccfafa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.319+0000 7fcdbcded640 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfaf8180 0x55bccfafa5a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5bbc7e57faf183 server_cookie=ba28a33f1b4b7b00 in_seq=0 out_seq=0 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.319+0000 7fcd97fff640 10 client.25162 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.319+0000 7fcd97fff640 1 -- 172.21.15.67:0/4179687158 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bccf9e6df0 con 0x55bccfaf8180 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.319+0000 7fcd97fff640 10 client.25162 handle_command_reply: tid=0 2024-09-10T20:52:52.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.319+0000 7fcdc1426740 1 client.25162 shutdown 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 msgr2=0x55bccfa74a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0006010 tx=0x7fcdb00cc890 comp rx=0 tx=0).stop 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 shutdown_connections 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bccfaf8180 0x55bccfafa5a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bccfa7ad80 0x55bccfa75120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bccfa6edf0 0x55bccfa74a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 --2- 172.21.15.67:0/4179687158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bccfa6e4d0 0x55bccfa836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 >> 172.21.15.67:0/4179687158 conn(0x55bccfa6c300 msgr2=0x55bccfa75e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.320+0000 7fcd97fff640 0 client.25162 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:52.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.321+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 shutdown_connections 2024-09-10T20:52:52.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.321+0000 7fcdc1426740 1 -- 172.21.15.67:0/4179687158 wait complete. 2024-09-10T20:52:52.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.322+0000 7fcdc1426740 20 client.25162 trim_cache size 0 max 16384 2024-09-10T20:52:52.327 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:52:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.323+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 msgr2=0x7fcda00b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.323+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 0x7fcda00b79a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8005850 comp rx=0 tx=0).stop 2024-09-10T20:52:52.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.323+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 msgr2=0x7fcdb81976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.323+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdb002aea0 tx=0x7fcdb0003ba0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 shutdown_connections 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcdb8108040 0x7fcdb819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcda00b54e0 0x7fcda00b79a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdb81076c0 0x7fcdb81976a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 --2- 172.21.15.67:0/2803634535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcdb8101cb0 0x7fcdb8197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.324+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 >> 172.21.15.67:0/2803634535 conn(0x7fcdb80fd700 msgr2=0x7fcdb80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.325+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 shutdown_connections 2024-09-10T20:52:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:52.326+0000 7fcdbf051640 1 -- 172.21.15.67:0/2803634535 wait complete. 2024-09-10T20:52:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:52 smithi083 ceph-mon[35058]: pgmap v387: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-10T20:52:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:52 smithi172 ceph-mon[35265]: pgmap v387: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-10T20:52:53.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:52 smithi067 ceph-mon[30891]: pgmap v387: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-09-10T20:52:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 80.0 s, 5947.2 tps, lat 16.799 ms stddev 16.707 2024-09-10T20:52:54.200 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:52:54.201 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:52:54.698 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:54.877 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:54 smithi067 ceph-mon[30891]: pgmap v388: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-09-10T20:52:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:54 smithi083 ceph-mon[35058]: pgmap v388: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-09-10T20:52:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:54 smithi172 ceph-mon[35265]: pgmap v388: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 13 MiB/s wr, 995 op/s 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b91ffb640 1 -- 172.21.15.67:0/632976117 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c02e320 con 0x7f8b94113710 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 -- 172.21.15.67:0/632976117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b94113710 msgr2=0x7f8b94115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 --2- 172.21.15.67:0/632976117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b94113710 0x7f8b94115bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009ca0 tx=0x7f8b8c02a970 comp rx=0 tx=0).stop 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 -- 172.21.15.67:0/632976117 shutdown_connections 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 --2- 172.21.15.67:0/632976117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b94113710 0x7f8b94115bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 --2- 172.21.15.67:0/632976117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b9410ab10 0x7f8b94113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 --2- 172.21.15.67:0/632976117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9410a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.327+0000 7f8b99949640 1 -- 172.21.15.67:0/632976117 >> 172.21.15.67:0/632976117 conn(0x7f8b940788a0 msgr2=0x7f8b9407acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.329+0000 7f8b99949640 1 -- 172.21.15.67:0/632976117 shutdown_connections 2024-09-10T20:52:55.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.329+0000 7f8b99949640 1 -- 172.21.15.67:0/632976117 wait complete. 2024-09-10T20:52:55.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.330+0000 7f8b99949640 1 Processor -- start 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 -- start start 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9410ab10 0x7f8b9419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b94113710 0x7f8b941a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b941193d0 con 0x7f8b9410a1f0 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94119250 con 0x7f8b94113710 2024-09-10T20:52:55.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b99949640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94119550 con 0x7f8b9410ab10 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b92ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b92ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50546/0 (socket says 172.21.15.67:50546) 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b92ffd640 1 -- 172.21.15.67:0/154491540 learned_addr learned my addr 172.21.15.67:0/154491540 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.331+0000 7f8b937fe640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b94113710 0x7f8b941a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b927fc640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9410ab10 0x7f8b9419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b92ffd640 1 -- 172.21.15.67:0/154491540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9410ab10 msgr2=0x7f8b9419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b92ffd640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9410ab10 0x7f8b9419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b92ffd640 1 -- 172.21.15.67:0/154491540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b94113710 msgr2=0x7f8b941a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b92ffd640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b94113710 0x7f8b941a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.332+0000 7f8b92ffd640 1 -- 172.21.15.67:0/154491540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b941a58d0 con 0x7f8b9410a1f0 2024-09-10T20:52:55.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.333+0000 7f8b92ffd640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400e9f0 tx=0x7f8b8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.335+0000 7f8b98947640 1 -- 172.21.15.67:0/154491540 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400cd80 con 0x7f8b9410a1f0 2024-09-10T20:52:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.335+0000 7f8b98947640 1 -- 172.21.15.67:0/154491540 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b840108e0 con 0x7f8b9410a1f0 2024-09-10T20:52:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.336+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b941a5bc0 con 0x7f8b9410a1f0 2024-09-10T20:52:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.336+0000 7f8b98947640 1 -- 172.21.15.67:0/154491540 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b84018980 con 0x7f8b9410a1f0 2024-09-10T20:52:55.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.336+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b941ac280 con 0x7f8b9410a1f0 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.340+0000 7f8b9bd1e740 1 Processor -- start 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.340+0000 7f8b9bd1e740 1 -- start start 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.340+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982312800 0x56398232f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x563982331b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563982288e60 con 0x563982312800 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563982278290 con 0x56398232f7a0 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56398227c0a0 con 0x563982311ee0 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51700/0 (socket says 172.21.15.67:51700) 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 -- 172.21.15.67:0/97052777 learned_addr learned my addr 172.21.15.67:0/97052777 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b927fc640 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x563982331b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 -- 172.21.15.67:0/97052777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 msgr2=0x563982331b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x563982331b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 -- 172.21.15.67:0/97052777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982312800 msgr2=0x56398232f260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982312800 0x56398232f260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.341+0000 7f8b937fe640 1 -- 172.21.15.67:0/97052777 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563981fd6930 con 0x563982311ee0 2024-09-10T20:52:55.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.342+0000 7f8b937fe640 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c035000 tx=0x7f8b8c02fb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5d55b51fd8c1de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.342+0000 7f8b79ffb640 1 -- 172.21.15.67:0/97052777 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c06a070 con 0x563982311ee0 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.342+0000 7f8b79ffb640 1 -- 172.21.15.67:0/97052777 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c003e20 con 0x563982311ee0 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.342+0000 7f8b79ffb640 1 -- 172.21.15.67:0/97052777 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c034030 con 0x563982311ee0 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.343+0000 7f8b98947640 1 -- 172.21.15.67:0/154491540 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8b84010430 con 0x7f8b9410a1f0 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.343+0000 7f8b98947640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 0x7f8b7c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.343+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/97052777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 msgr2=0x5639823122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.343+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c035000 tx=0x7f8b8c02fb70 comp rx=0 tx=0).stop 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/97052777 shutdown_connections 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x563982331b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982312800 0x56398232f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/97052777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x5639823122c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/97052777 >> 172.21.15.67:0/97052777 conn(0x56398230fd10 msgr2=0x563982310eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.344+0000 7f8b98947640 1 -- 172.21.15.67:0/154491540 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b84010d70 con 0x7f8b9410a1f0 2024-09-10T20:52:55.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.345+0000 7f8b92ffd640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 0x7f8b7c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.345+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/97052777 shutdown_connections 2024-09-10T20:52:55.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.345+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/97052777 wait complete. 2024-09-10T20:52:55.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.345+0000 7f8b9bd1e740 1 -- start start 2024-09-10T20:52:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.346+0000 7f8b92ffd640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 0x7f8b7c0b78f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b840a9890 tx=0x7f8b840b2250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.346+0000 7f8b9bd1e740 1 Processor -- start 2024-09-10T20:52:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.347+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x56398231bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.347+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x56398231bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.347+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x56398231bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51704/0 (socket says 172.21.15.67:51704) 2024-09-10T20:52:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.347+0000 7f8b937fe640 1 -- 172.21.15.67:0/647199566 learned_addr learned my addr 172.21.15.67:0/647199566 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.347+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x56398231c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982321a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b927fc640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x56398231c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5639820d9890 con 0x5639823215f0 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563982212d40 con 0x56398232f7a0 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5639823183f0 con 0x563982311ee0 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.348+0000 7f8b9bd1e740 10 client.0 _ll_register_callbacks cb 0x563982276c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 -- 172.21.15.67:0/647199566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 msgr2=0x56398231bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x56398231bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 -- 172.21.15.67:0/647199566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 msgr2=0x563982321a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982321a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639823220e0 con 0x56398232f7a0 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b927fc640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x56398231c4b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005fd0 tx=0x7f8b880117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6847cd9fe2fc0376 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.349+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88005220 con 0x56398232f7a0 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.350+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b8c003e20 con 0x56398232f7a0 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.350+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b880053c0 con 0x56398232f7a0 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.350+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b88022070 con 0x56398232f7a0 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.350+0000 7f8b9bd1e740 10 client.25178 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.350+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56398232ace0 con 0x56398232f7a0 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c003e20 con 0x56398232f7a0 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8b8801b730 con 0x56398232f7a0 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 10 client.25178 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 10 client.25178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 20 client.25178 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398232c1e0 0x56398232e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 4 client.25178 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56398228adb0 con 0x56398232c1e0 2024-09-10T20:52:55.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.351+0000 7f8b937fe640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398232c1e0 0x56398232e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.352+0000 7f8b72ffd640 10 client.25178 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:55.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.352+0000 7f8b937fe640 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398232c1e0 0x56398232e600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b573a6a121b554da server_cookie=2c0dda2552a2efd4 in_seq=0 out_seq=0 2024-09-10T20:52:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b72ffd640 1 -- 172.21.15.67:0/647199566 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56398228adb0 con 0x56398232c1e0 2024-09-10T20:52:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b72ffd640 10 client.25178 handle_command_reply: tid=0 2024-09-10T20:52:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b9bd1e740 1 client.25178 shutdown 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 msgr2=0x56398231c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x56398231c4b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b88005fd0 tx=0x7f8b880117b0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 shutdown_connections 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.355+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398232c1e0 0x56398232e600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982321a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56398232f7a0 0x56398231c4b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/647199566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563982311ee0 0x56398231bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 >> 172.21.15.67:0/647199566 conn(0x56398230fd10 msgr2=0x56398230ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b72ffd640 0 client.25178 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 shutdown_connections 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/647199566 wait complete. 2024-09-10T20:52:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.356+0000 7f8b9bd1e740 20 client.25178 trim_cache size 0 max 16384 2024-09-10T20:52:55.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.393+0000 7f8b9bd1e740 1 Processor -- start 2024-09-10T20:52:55.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.393+0000 7f8b9bd1e740 1 -- start start 2024-09-10T20:52:55.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982330e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x56398231a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b941ae300 con 0x5639823215f0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b941ae9d0 con 0x563982311ee0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94085f50 con 0x56398232f7a0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57724/0 (socket says 172.21.15.67:57724) 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 -- 172.21.15.67:0/3403916147 learned_addr learned my addr 172.21.15.67:0/3403916147 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b927fc640 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982330e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x56398231a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 -- 172.21.15.67:0/3403916147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 msgr2=0x56398231a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x56398231a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 -- 172.21.15.67:0/3403916147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 msgr2=0x563982330e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982330e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.394+0000 7f8b937fe640 1 -- 172.21.15.67:0/3403916147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56398232aad0 con 0x563982311ee0 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.395+0000 7f8b937fe640 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f80 tx=0x7f8b8c02fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2248af5d1ac0f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.395+0000 7f8b797fa640 1 -- 172.21.15.67:0/3403916147 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c034040 con 0x563982311ee0 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.395+0000 7f8b797fa640 1 -- 172.21.15.67:0/3403916147 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c003e20 con 0x563982311ee0 2024-09-10T20:52:55.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.395+0000 7f8b797fa640 1 -- 172.21.15.67:0/3403916147 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c06a040 con 0x563982311ee0 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.396+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/3403916147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 msgr2=0x563982330930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.396+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f80 tx=0x7f8b8c02fb70 comp rx=0 tx=0).stop 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/3403916147 shutdown_connections 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x56398231a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5639823215f0 0x563982330e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/3403916147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563982311ee0 0x563982330930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/3403916147 >> 172.21.15.67:0/3403916147 conn(0x56398230fd10 msgr2=0x56398231bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/3403916147 shutdown_connections 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.398+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/3403916147 wait complete. 2024-09-10T20:52:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.399+0000 7f8b9bd1e740 1 -- start start 2024-09-10T20:52:55.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.399+0000 7f8b9bd1e740 1 Processor -- start 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982311ee0 0x563982337ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5639823215f0 0x5639823333d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94084410 con 0x563982311ee0 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94085880 con 0x5639823215f0 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b94084ae0 con 0x56398232f7a0 2024-09-10T20:52:55.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b9bd1e740 10 client.0 _ll_register_callbacks cb 0x7f8b8800d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b927fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5639823215f0 0x5639823333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51722/0 (socket says 172.21.15.67:51722) 2024-09-10T20:52:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 -- 172.21.15.67:0/956014963 learned_addr learned my addr 172.21.15.67:0/956014963 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982311ee0 0x563982337ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 -- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5639823215f0 msgr2=0x5639823333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5639823215f0 0x5639823333d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 -- 172.21.15.67:0/956014963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982311ee0 msgr2=0x563982337ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982311ee0 0x563982337ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.401+0000 7f8b937fe640 1 -- 172.21.15.67:0/956014963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56398239b440 con 0x56398232f7a0 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.402+0000 7f8b937fe640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c02f770 tx=0x7f8b8c005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f51e27ee492a6402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.402+0000 7f8b72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.402+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c06a020 con 0x56398232f7a0 2024-09-10T20:52:55.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.402+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b8c003b80 con 0x56398232f7a0 2024-09-10T20:52:55.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.402+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b8c003e20 con 0x56398232f7a0 2024-09-10T20:52:55.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.403+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8b8c034040 con 0x56398232f7a0 2024-09-10T20:52:55.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.403+0000 7f8b9bd1e740 10 client.25180 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:55.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.403+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56398239c5d0 con 0x56398232f7a0 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.403+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b8c003e20 con 0x56398232f7a0 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8b8c070070 con 0x56398232f7a0 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 10 client.25180 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 10 client.25180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 20 client.25180 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398239c8c0 0x56398239ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 4 client.25180 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563982286860 con 0x56398239c8c0 2024-09-10T20:52:55.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b927fc640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398239c8c0 0x56398239ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:55.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b927fc640 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398239c8c0 0x56398239ecb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9528a220ec7b2 server_cookie=e91ee383b15dcfc5 in_seq=0 out_seq=0 2024-09-10T20:52:55.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.404+0000 7f8b72ffd640 10 client.25180 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:55.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b72ffd640 1 -- 172.21.15.67:0/956014963 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563982286860 con 0x56398239c8c0 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b72ffd640 10 client.25180 handle_command_reply: tid=0 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 client.25180 shutdown 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 msgr2=0x563982333a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c02f770 tx=0x7f8b8c005d80 comp rx=0 tx=0).stop 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 shutdown_connections 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56398239c8c0 0x56398239ecb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56398232f7a0 0x563982333a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5639823215f0 0x5639823333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 --2- 172.21.15.67:0/956014963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563982311ee0 0x563982337ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 >> 172.21.15.67:0/956014963 conn(0x56398230fd10 msgr2=0x56398231b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b72ffd640 0 client.25180 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.406+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 shutdown_connections 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.407+0000 7f8b9bd1e740 1 -- 172.21.15.67:0/956014963 wait complete. 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "4417332c-b083-4bcd-9cd4-3276ff51958b", 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:52:55.412 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:52:55.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.407+0000 7f8b9bd1e740 20 client.25180 trim_cache size 0 max 16384 2024-09-10T20:52:55.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 msgr2=0x7f8b7c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 0x7f8b7c0b78f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b840a9890 tx=0x7f8b840b2250 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 msgr2=0x7f8b9419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400e9f0 tx=0x7f8b8400eeb0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 shutdown_connections 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b94113710 0x7f8b941a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8b7c0b5430 0x7f8b7c0b78f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9410ab10 0x7f8b9419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 --2- 172.21.15.67:0/154491540 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8b9410a1f0 0x7f8b9419f820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 >> 172.21.15.67:0/154491540 conn(0x7f8b940788a0 msgr2=0x7f8b940794a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.408+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 shutdown_connections 2024-09-10T20:52:55.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:55.409+0000 7f8b99949640 1 -- 172.21.15.67:0/154491540 wait complete. 2024-09-10T20:52:55.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:55 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:52:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:55 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:55 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:55 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:55.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:55 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:55 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:52:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:55 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:55 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:55 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:55.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:55 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:55 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:52:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:55 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:55 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:55 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:55 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:52:56.760 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:52:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:56 smithi083 ceph-mon[35058]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-09-10T20:52:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:56 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:52:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:56 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:56 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.898 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:56 smithi067 ceph-mon[30891]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-09-10T20:52:56.898 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:56 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:52:56.898 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:56 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.899 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:56 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:56 smithi172 ceph-mon[35265]: pgmap v389: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-09-10T20:52:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:56 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:52:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:56 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:56 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:52:57.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.385+0000 7ff603360640 1 -- 172.21.15.67:0/1613711048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1137f0 msgr2=0x7ff5fc115be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.385+0000 7ff603360640 1 --2- 172.21.15.67:0/1613711048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc115be0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009be0 tx=0x7ff5f402a6d0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 -- 172.21.15.67:0/1613711048 shutdown_connections 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 --2- 172.21.15.67:0/1613711048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc115be0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 --2- 172.21.15.67:0/1613711048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1013f0 0x7ff5fc1132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 --2- 172.21.15.67:0/1613711048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 0x7ff5fc100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 -- 172.21.15.67:0/1613711048 >> 172.21.15.67:0/1613711048 conn(0x7ff5fc0fca20 msgr2=0x7ff5fc0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.386+0000 7ff603360640 1 -- 172.21.15.67:0/1613711048 shutdown_connections 2024-09-10T20:52:57.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.387+0000 7ff603360640 1 -- 172.21.15.67:0/1613711048 wait complete. 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.387+0000 7ff603360640 1 Processor -- start 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.387+0000 7ff603360640 1 -- start start 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 0x7ff5fc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1013f0 0x7ff5fc19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc119330 con 0x7ff5fc1013f0 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1191b0 con 0x7ff5fc100ad0 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff603360640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1194b0 con 0x7ff5fc1137f0 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff6018fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff6018fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51726/0 (socket says 172.21.15.67:51726) 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff6018fd640 1 -- 172.21.15.67:0/3287487250 learned_addr learned my addr 172.21.15.67:0/3287487250 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.388+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1013f0 0x7ff5fc19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 0x7ff5fc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 -- 172.21.15.67:0/3287487250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 msgr2=0x7ff5fc19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 0x7ff5fc19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 -- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1013f0 msgr2=0x7ff5fc19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1013f0 0x7ff5fc19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 -- 172.21.15.67:0/3287487250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc1a56f0 con 0x7ff5fc1137f0 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.389+0000 7ff6018fd640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009370 tx=0x7ff5f4003ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.390+0000 7ff5ee7fc640 1 -- 172.21.15.67:0/3287487250 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4041020 con 0x7ff5fc1137f0 2024-09-10T20:52:57.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.390+0000 7ff5ee7fc640 1 -- 172.21.15.67:0/3287487250 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5f4030e20 con 0x7ff5fc1137f0 2024-09-10T20:52:57.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.391+0000 7ff5ee7fc640 1 -- 172.21.15.67:0/3287487250 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4036040 con 0x7ff5fc1137f0 2024-09-10T20:52:57.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.391+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc1a5980 con 0x7ff5fc1137f0 2024-09-10T20:52:57.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.391+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc1a5d20 con 0x7ff5fc1137f0 2024-09-10T20:52:57.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.395+0000 7ff605735740 1 Processor -- start 2024-09-10T20:52:57.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.396+0000 7ff5ee7fc640 1 -- 172.21.15.67:0/3287487250 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff5f40046b0 con 0x7ff5fc1137f0 2024-09-10T20:52:57.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 -- start start 2024-09-10T20:52:57.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 0x55c08e37f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e38b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e38dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c08e2f5e50 con 0x55c08e37f0a0 2024-09-10T20:52:57.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c08e2e5280 con 0x55c08e37f9c0 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.397+0000 7ff605735740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c08e2e9090 con 0x55c08e38b950 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 0x55c08e37f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 0x55c08e37f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50600/0 (socket says 172.21.15.67:50600) 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff6008fb640 1 -- 172.21.15.67:0/73775402 learned_addr learned my addr 172.21.15.67:0/73775402 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff6008fb640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e38dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff5ee7fc640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 0x7ff5e80b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.398+0000 7ff6010fc640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e38b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff5ee7fc640 1 -- 172.21.15.67:0/3287487250 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff5f4106540 con 0x7ff5fc1137f0 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6018fd640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 0x7ff5e80b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6010fc640 1 -- 172.21.15.67:0/73775402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 msgr2=0x55c08e38dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6010fc640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e38dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6010fc640 1 -- 172.21.15.67:0/73775402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 msgr2=0x55c08e37f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6010fc640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 0x55c08e37f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.399+0000 7ff6010fc640 1 -- 172.21.15.67:0/73775402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c08e043650 con 0x55c08e37f9c0 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.400+0000 7ff6008fb640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e38dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:52:57.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.400+0000 7ff6010fc640 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e38b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bbe0 tx=0x7ff5f000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8473c37b87415c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.400+0000 7ff5e77fe640 1 -- 172.21.15.67:0/73775402 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0015070 con 0x55c08e37f9c0 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.400+0000 7ff5e77fe640 1 -- 172.21.15.67:0/73775402 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5f00035f0 con 0x55c08e37f9c0 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.400+0000 7ff5e77fe640 1 -- 172.21.15.67:0/73775402 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00116a0 con 0x55c08e37f9c0 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.401+0000 7ff605735740 1 -- 172.21.15.67:0/73775402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 msgr2=0x55c08e38b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.401+0000 7ff605735740 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e38b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bbe0 tx=0x7ff5f000f730 comp rx=0 tx=0).stop 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.401+0000 7ff6018fd640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 0x7ff5e80b7840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40c9f40 tx=0x7ff5f402a6d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 -- 172.21.15.67:0/73775402 shutdown_connections 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e38dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e38b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 --2- 172.21.15.67:0/73775402 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f0a0 0x55c08e37f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 -- 172.21.15.67:0/73775402 >> 172.21.15.67:0/73775402 conn(0x55c08e37ced0 msgr2=0x55c08e37e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 -- 172.21.15.67:0/73775402 shutdown_connections 2024-09-10T20:52:57.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.402+0000 7ff605735740 1 -- 172.21.15.67:0/73775402 wait complete. 2024-09-10T20:52:57.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 -- start start 2024-09-10T20:52:57.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 Processor -- start 2024-09-10T20:52:57.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f9c0 0x55c08e3886d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e38b950 0x55c08e388d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c08e146700 con 0x55c08e37f9c0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c08e280110 con 0x55c08e38b950 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.403+0000 7ff605735740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c08e38e5d0 con 0x55c08e37f0a0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff605735740 10 client.0 _ll_register_callbacks cb 0x55c08e299990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e38b950 0x55c08e388d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6010fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f9c0 0x55c08e3886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51746/0 (socket says 172.21.15.67:51746) 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 -- 172.21.15.67:0/3383164879 learned_addr learned my addr 172.21.15.67:0/3383164879 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 -- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e38b950 msgr2=0x55c08e388d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e38b950 0x55c08e388d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 -- 172.21.15.67:0/3383164879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f9c0 msgr2=0x55c08e3886d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f9c0 0x55c08e3886d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.404+0000 7ff6008fb640 1 -- 172.21.15.67:0/3383164879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c08e2adc40 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.405+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80143e0 tx=0x7ff5f800b400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f96ee7985a95cd93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.405+0000 7ff5e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.405+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8004260 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.405+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff5f8004400 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.405+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5f00035f0 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5f803a050 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff605735740 10 client.25192 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c08e399f70 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5f00035f0 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff5f80038f0 con 0x55c08e37f0a0 2024-09-10T20:52:57.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff605735740 10 client.25192 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff605735740 10 client.25192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.406+0000 7ff605735740 20 client.25192 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.407+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e39b7e0 0x55c08e39dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.407+0000 7ff605735740 4 client.25192 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.407+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c08e2f7da0 con 0x55c08e39b7e0 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.407+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e39b7e0 0x55c08e39dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.408+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e39b7e0 0x55c08e39dc60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7e661c28cc36d3 server_cookie=53239abc407a8bde in_seq=0 out_seq=0 2024-09-10T20:52:57.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.408+0000 7ff5e4ff9640 10 client.25192 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.408+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/3383164879 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c08e2f7da0 con 0x55c08e39b7e0 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.408+0000 7ff5e4ff9640 10 client.25192 handle_command_reply: tid=0 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.408+0000 7ff605735740 1 client.25192 shutdown 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 msgr2=0x55c08e38b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80143e0 tx=0x7ff5f800b400 comp rx=0 tx=0).stop 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 shutdown_connections 2024-09-10T20:52:57.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e39b7e0 0x55c08e39dc60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e38b950 0x55c08e388d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e37f9c0 0x55c08e3886d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 --2- 172.21.15.67:0/3383164879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f0a0 0x55c08e38b280 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80143e0 tx=0x7ff5f800b400 comp rx=0 tx=0).stop 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff5e4ff9640 0 client.25192 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.409+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 >> 172.21.15.67:0/3383164879 conn(0x55c08e37ced0 msgr2=0x55c08e382a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.411+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 shutdown_connections 2024-09-10T20:52:57.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.411+0000 7ff605735740 1 -- 172.21.15.67:0/3383164879 wait complete. 2024-09-10T20:52:57.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.411+0000 7ff605735740 20 client.25192 trim_cache size 0 max 16384 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.442+0000 7ff605735740 1 Processor -- start 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.442+0000 7ff605735740 1 -- start start 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.442+0000 7ff605735740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e397830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff605735740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff605735740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e384010 0x55c08e386f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff605735740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1ae710 con 0x55c08e384010 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff605735740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1ac160 con 0x55c08e37f9c0 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff605735740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1a0770 con 0x55c08e38b950 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51754/0 (socket says 172.21.15.67:51754) 2024-09-10T20:52:57.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 -- 172.21.15.67:0/3361531520 learned_addr learned my addr 172.21.15.67:0/3361531520 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e397830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 -- 172.21.15.67:0/3361531520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 msgr2=0x55c08e397830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e397830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 -- 172.21.15.67:0/3361531520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e384010 msgr2=0x55c08e386f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.443+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e384010 0x55c08e386f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.444+0000 7ff6010fc640 1 -- 172.21.15.67:0/3361531520 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c08e37dbb0 con 0x55c08e38b950 2024-09-10T20:52:57.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.444+0000 7ff6008fb640 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e397830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:52:57.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.444+0000 7ff6010fc640 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bbe0 tx=0x7ff5f000b530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3def11c13d6d261 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.445+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/3361531520 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0015040 con 0x55c08e38b950 2024-09-10T20:52:57.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.445+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/3361531520 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5f0004410 con 0x55c08e38b950 2024-09-10T20:52:57.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.445+0000 7ff5e6ffd640 1 -- 172.21.15.67:0/3361531520 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0015040 con 0x55c08e38b950 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 -- 172.21.15.67:0/3361531520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 msgr2=0x55c08e37e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bbe0 tx=0x7ff5f000b530 comp rx=0 tx=0).stop 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 -- 172.21.15.67:0/3361531520 shutdown_connections 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e384010 0x55c08e386f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e38b950 0x55c08e37e000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 --2- 172.21.15.67:0/3361531520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e37f9c0 0x55c08e397830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 -- 172.21.15.67:0/3361531520 >> 172.21.15.67:0/3361531520 conn(0x55c08e37ced0 msgr2=0x55c08e383900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 -- 172.21.15.67:0/3361531520 shutdown_connections 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.446+0000 7ff605735740 1 -- 172.21.15.67:0/3361531520 wait complete. 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 -- start start 2024-09-10T20:52:57.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 Processor -- start 2024-09-10T20:52:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e384010 0x55c08e393de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e38b950 0x55c08e38e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc10f620 con 0x55c08e38b950 2024-09-10T20:52:57.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc110a90 con 0x55c08e384010 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc10fcf0 con 0x55c08e37f9c0 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff605735740 10 client.0 _ll_register_callbacks cb 0x7ff5f8014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff6008fb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51764/0 (socket says 172.21.15.67:51764) 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff6008fb640 1 -- 172.21.15.67:0/2038225109 learned_addr learned my addr 172.21.15.67:0/2038225109 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.447+0000 7ff6008fb640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e38b950 0x55c08e38e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6010fc640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e384010 0x55c08e393de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6008fb640 1 -- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e384010 msgr2=0x55c08e393de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6008fb640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e384010 0x55c08e393de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6008fb640 1 -- 172.21.15.67:0/2038225109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e38b950 msgr2=0x55c08e38e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6008fb640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e38b950 0x55c08e38e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.448+0000 7ff6008fb640 1 -- 172.21.15.67:0/2038225109 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c08e38ed90 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.449+0000 7ff6008fb640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80058c0 tx=0x7ff5f8005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf7089b08d1963b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.449+0000 7ff5e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80052d0 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff5f8005470 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5f0004410 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff5f80035f0 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff605735740 10 client.25198 fetch_fsmap learned FSMap version 27 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c08e408ef0 con 0x55c08e37f9c0 2024-09-10T20:52:57.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.450+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5f80127c0 con 0x55c08e37f9c0 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7ff5f80116f0 con 0x55c08e37f9c0 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 10 client.25198 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 10 client.25198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 20 client.25198 populate_metadata read hostname 'smithi067' 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e409650 0x55c08e40ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 4 client.25198 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff5f0004410 con 0x55c08e409650 2024-09-10T20:52:57.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.451+0000 7ff6010fc640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e409650 0x55c08e40ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:52:57.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff5e4ff9640 10 client.25198 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff6010fc640 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e409650 0x55c08e40ba70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b1bd32d932320f server_cookie=b225aab0453e6c72 in_seq=0 out_seq=0 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff5e4ff9640 1 -- 172.21.15.67:0/2038225109 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x7ff5f0004410 con 0x55c08e409650 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff5e4ff9640 10 client.25198 handle_command_reply: tid=0 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff605735740 1 client.25198 shutdown 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 msgr2=0x55c08e3938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.452+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80058c0 tx=0x7ff5f8005850 comp rx=0 tx=0).stop 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 shutdown_connections 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c08e409650 0x55c08e40ba70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c08e38b950 0x55c08e38e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c08e384010 0x55c08e393de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 --2- 172.21.15.67:0/2038225109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c08e37f9c0 0x55c08e3938a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff5e4ff9640 0 client.25198 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 >> 172.21.15.67:0/2038225109 conn(0x55c08e37ced0 msgr2=0x55c08e39d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 shutdown_connections 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.453+0000 7ff605735740 1 -- 172.21.15.67:0/2038225109 wait complete. 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.454+0000 7ff605735740 20 client.25198 trim_cache size 0 max 16384 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:52:57.459 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "4417332c-b083-4bcd-9cd4-3276ff51958b", 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:57.460 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:52:57.461 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 msgr2=0x7ff5e80b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 0x7ff5e80b7840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40c9f40 tx=0x7ff5f402a6d0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 msgr2=0x7ff5fc1a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009370 tx=0x7ff5f4003ef0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 shutdown_connections 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff5e80b5380 0x7ff5e80b7840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5fc1137f0 0x7ff5fc1a4f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5fc1013f0 0x7ff5fc19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 --2- 172.21.15.67:0/3287487250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5fc100ad0 0x7ff5fc19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 >> 172.21.15.67:0/3287487250 conn(0x7ff5fc0fca20 msgr2=0x7ff5fc102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 shutdown_connections 2024-09-10T20:52:57.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:52:57.455+0000 7ff603360640 1 -- 172.21.15.67:0/3287487250 wait complete. 2024-09-10T20:52:58.332 INFO:tasks.cephfs.filesystem:scrub status for tag:4417332c-b083-4bcd-9cd4-3276ff51958b - {'path': '/', 'tag': '4417332c-b083-4bcd-9cd4-3276ff51958b', 'options': 'recursive,force'} 2024-09-10T20:52:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:52:58 smithi083 ceph-mon[35058]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 967 op/s 2024-09-10T20:52:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:52:58 smithi172 ceph-mon[35265]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 967 op/s 2024-09-10T20:52:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 85.0 s, 5689.8 tps, lat 17.393 ms stddev 21.929 2024-09-10T20:52:59.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:52:58 smithi067 ceph-mon[30891]: pgmap v390: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 967 op/s 2024-09-10T20:53:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:00 smithi083 ceph-mon[35058]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 12 MiB/s wr, 924 op/s 2024-09-10T20:53:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:00 smithi172 ceph-mon[35265]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 12 MiB/s wr, 924 op/s 2024-09-10T20:53:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:00 smithi067 ceph-mon[30891]: pgmap v391: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 12 MiB/s wr, 924 op/s 2024-09-10T20:53:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:02 smithi083 ceph-mon[35058]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-10T20:53:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:02 smithi172 ceph-mon[35265]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-10T20:53:03.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:02 smithi067 ceph-mon[30891]: pgmap v392: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-10T20:53:03.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:03 smithi172 ceph-mon[35265]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-10T20:53:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 90.0 s, 5256.0 tps, lat 19.221 ms stddev 20.537 2024-09-10T20:53:04.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:03 smithi067 ceph-mon[30891]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-10T20:53:04.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:03 smithi083 ceph-mon[35058]: pgmap v393: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.03k op/s 2024-09-10T20:53:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:05 smithi083 ceph-mon[35058]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-09-10T20:53:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:05 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:06.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:05 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:05 smithi172 ceph-mon[35265]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-09-10T20:53:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:05 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:06.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:05 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:05 smithi067 ceph-mon[30891]: pgmap v394: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 922 op/s 2024-09-10T20:53:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:05 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:06.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:05 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:07.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:06 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:07.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:06 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:07.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:06 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:08.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:07 smithi172 ceph-mon[35265]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-09-10T20:53:08.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:07 smithi067 ceph-mon[30891]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-09-10T20:53:08.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:07 smithi083 ceph-mon[35058]: pgmap v395: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.08k op/s 2024-09-10T20:53:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 95.0 s, 5256.4 tps, lat 19.012 ms stddev 20.312 2024-09-10T20:53:10.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:09 smithi172 ceph-mon[35265]: pgmap v396: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-09-10T20:53:10.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:09 smithi067 ceph-mon[30891]: pgmap v396: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-09-10T20:53:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:09 smithi083 ceph-mon[35058]: pgmap v396: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-09-10T20:53:12.180 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:11 smithi067 ceph-mon[30891]: pgmap v397: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-09-10T20:53:12.198 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:11 smithi172 ceph-mon[35265]: pgmap v397: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-09-10T20:53:12.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:11 smithi083 ceph-mon[35058]: pgmap v397: 97 pgs: 97 active+clean; 1.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 856 op/s 2024-09-10T20:53:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 100.0 s, 5213.4 tps, lat 19.176 ms stddev 21.745 2024-09-10T20:53:14.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:13 smithi172 ceph-mon[35265]: pgmap v398: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 997 op/s 2024-09-10T20:53:14.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:13 smithi067 ceph-mon[30891]: pgmap v398: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 997 op/s 2024-09-10T20:53:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:13 smithi083 ceph-mon[35058]: pgmap v398: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 997 op/s 2024-09-10T20:53:16.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:15 smithi172 ceph-mon[35265]: pgmap v399: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 887 op/s 2024-09-10T20:53:16.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:15 smithi067 ceph-mon[30891]: pgmap v399: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 887 op/s 2024-09-10T20:53:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:15 smithi083 ceph-mon[35058]: pgmap v399: 97 pgs: 97 active+clean; 1.2 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 887 op/s 2024-09-10T20:53:18.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:17 smithi172 ceph-mon[35265]: pgmap v400: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 925 op/s 2024-09-10T20:53:18.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:17 smithi067 ceph-mon[30891]: pgmap v400: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 925 op/s 2024-09-10T20:53:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:17 smithi083 ceph-mon[35058]: pgmap v400: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 925 op/s 2024-09-10T20:53:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 105.0 s, 4780.4 tps, lat 20.844 ms stddev 21.783 2024-09-10T20:53:20.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:19 smithi172 ceph-mon[35265]: pgmap v401: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-10T20:53:20.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:19 smithi067 ceph-mon[30891]: pgmap v401: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-10T20:53:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:19 smithi083 ceph-mon[35058]: pgmap v401: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-10T20:53:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:21 smithi172 ceph-mon[35265]: pgmap v402: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:53:22.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:21 smithi067 ceph-mon[30891]: pgmap v402: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:53:22.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:21 smithi083 ceph-mon[35058]: pgmap v402: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:53:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 110.0 s, 4997.8 tps, lat 20.069 ms stddev 22.713 2024-09-10T20:53:24.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:23 smithi172 ceph-mon[35265]: pgmap v403: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 969 op/s 2024-09-10T20:53:24.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:23 smithi067 ceph-mon[30891]: pgmap v403: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 969 op/s 2024-09-10T20:53:24.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:23 smithi083 ceph-mon[35058]: pgmap v403: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 14 MiB/s wr, 969 op/s 2024-09-10T20:53:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:26 smithi083 ceph-mon[35058]: pgmap v404: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-09-10T20:53:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:26 smithi172 ceph-mon[35265]: pgmap v404: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-09-10T20:53:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:26 smithi067 ceph-mon[30891]: pgmap v404: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 12 MiB/s wr, 843 op/s 2024-09-10T20:53:28.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:53:28.369 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:28 smithi067 ceph-mon[30891]: pgmap v405: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-10T20:53:28.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:28 smithi083 ceph-mon[35058]: pgmap v405: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-10T20:53:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:28 smithi172 ceph-mon[35265]: pgmap v405: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-10T20:53:28.749 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 115.0 s, 4541.8 tps, lat 21.981 ms stddev 25.877 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 -- 172.21.15.67:0/2379755596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8101c90 msgr2=0x7f02f8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/2379755596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8101c90 0x7f02f8102070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009860 tx=0x7f02e802c550 comp rx=0 tx=0).stop 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 -- 172.21.15.67:0/2379755596 shutdown_connections 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/2379755596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8108020 0x7f02f810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/2379755596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/2379755596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8101c90 0x7f02f8102070 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.369+0000 7f02fdbd8640 1 -- 172.21.15.67:0/2379755596 >> 172.21.15.67:0/2379755596 conn(0x7f02f80fd700 msgr2=0x7f02f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.370+0000 7f02fdbd8640 1 -- 172.21.15.67:0/2379755596 shutdown_connections 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.370+0000 7f02fdbd8640 1 -- 172.21.15.67:0/2379755596 wait complete. 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.371+0000 7f02fdbd8640 1 Processor -- start 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.371+0000 7f02fdbd8640 1 -- start start 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 0x7f02f819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8108020 0x7f02f81a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8110c20 con 0x7f02f8101c90 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8110aa0 con 0x7f02f8108020 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02fdbd8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8110da0 con 0x7f02f81076a0 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34876/0 (socket says 172.21.15.67:34876) 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f6ffd640 1 -- 172.21.15.67:0/3288948059 learned_addr learned my addr 172.21.15.67:0/3288948059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8108020 0x7f02f81a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f77fe640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 0x7f02f819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f6ffd640 1 -- 172.21.15.67:0/3288948059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8108020 msgr2=0x7f02f81a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.372+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8108020 0x7f02f81a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f6ffd640 1 -- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 msgr2=0x7f02f819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 0x7f02f819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f6ffd640 1 -- 172.21.15.67:0/3288948059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f81a5990 con 0x7f02f81076a0 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f77fe640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 0x7f02f819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b4a0 tx=0x7f02ec00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.373+0000 7f02f4ff9640 1 -- 172.21.15.67:0/3288948059 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec014070 con 0x7f02f81076a0 2024-09-10T20:53:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.374+0000 7f02f4ff9640 1 -- 172.21.15.67:0/3288948059 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ec010ac0 con 0x7f02f81076a0 2024-09-10T20:53:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.374+0000 7f02f4ff9640 1 -- 172.21.15.67:0/3288948059 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec017c30 con 0x7f02f81076a0 2024-09-10T20:53:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.374+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f81a5c80 con 0x7f02f81076a0 2024-09-10T20:53:29.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.374+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f806cbf0 con 0x7f02f81076a0 2024-09-10T20:53:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.378+0000 7f02fffad740 1 Processor -- start 2024-09-10T20:53:29.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.378+0000 7f02fffad740 1 -- start start 2024-09-10T20:53:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.378+0000 7f02fffad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696480 0x55d729696860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.378+0000 7f02fffad740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02fffad740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02fffad740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d72960ce50 con 0x55d729696da0 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02fffad740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d7295fc280 con 0x55d7296a2d30 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02fffad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d729600090 con 0x55d729696480 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57054/0 (socket says 172.21.15.67:57054) 2024-09-10T20:53:29.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 -- 172.21.15.67:0/624320892 learned_addr learned my addr 172.21.15.67:0/624320892 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f4ff9640 1 -- 172.21.15.67:0/3288948059 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f02ec010610 con 0x7f02f81076a0 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 -- 172.21.15.67:0/624320892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696480 msgr2=0x55d729696860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696480 0x55d729696860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 -- 172.21.15.67:0/624320892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 msgr2=0x55d7296a5120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.379+0000 7f02f77fe640 1 -- 172.21.15.67:0/624320892 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72935a650 con 0x55d729696da0 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.380+0000 7f02f77fe640 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f02e8005b60 tx=0x7f02e8032420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1368cac43c0d7fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.380+0000 7f02ddffb640 1 -- 172.21.15.67:0/624320892 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8041020 con 0x55d729696da0 2024-09-10T20:53:29.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.380+0000 7f02ddffb640 1 -- 172.21.15.67:0/624320892 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e8032980 con 0x55d729696da0 2024-09-10T20:53:29.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.381+0000 7f02fffad740 1 -- 172.21.15.67:0/624320892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 msgr2=0x55d7296a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.381+0000 7f02fffad740 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f02e8005b60 tx=0x7f02e8032420 comp rx=0 tx=0).stop 2024-09-10T20:53:29.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.382+0000 7f02f4ff9640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 0x7f02e00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 -- 172.21.15.67:0/624320892 shutdown_connections 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d7296a27f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 --2- 172.21.15.67:0/624320892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696480 0x55d729696860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02f4ff9640 1 -- 172.21.15.67:0/3288948059 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02ec0e5390 con 0x7f02f81076a0 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 0x7f02e00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 -- 172.21.15.67:0/624320892 >> 172.21.15.67:0/624320892 conn(0x55d7296942b0 msgr2=0x55d729695450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.383+0000 7f02fffad740 1 -- 172.21.15.67:0/624320892 shutdown_connections 2024-09-10T20:53:29.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.384+0000 7f02fffad740 1 -- 172.21.15.67:0/624320892 wait complete. 2024-09-10T20:53:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.384+0000 7f02fffad740 1 -- start start 2024-09-10T20:53:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.384+0000 7f02fffad740 1 Processor -- start 2024-09-10T20:53:29.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 0x7f02e00b78f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005fd0 tx=0x7f02f0010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d72945d700 con 0x55d729696da0 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d729597110 con 0x55d729696480 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d7296a59a0 con 0x55d7296a2d30 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.385+0000 7f02fffad740 10 client.0 _ll_register_callbacks cb 0x55d7295b0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57066/0 (socket says 172.21.15.67:57066) 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 -- 172.21.15.67:0/470553645 learned_addr learned my addr 172.21.15.67:0/470553645 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 -- 172.21.15.67:0/470553645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 msgr2=0x55d7296a0020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:53:29.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a0020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 -- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 msgr2=0x55d7296a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.386+0000 7f02f6ffd640 1 -- 172.21.15.67:0/470553645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7295c4c40 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02ec017600 tx=0x7f02ec0ab4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9098f51191a12b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec01e040 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e8032980 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02ec0a7df0 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02ec017360 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.387+0000 7f02fffad740 10 client.15561 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d7296b13a0 con 0x55d729696da0 2024-09-10T20:53:29.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e8032980 con 0x55d729696da0 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f02ec0b4c80 con 0x55d729696da0 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 20 client.15561 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7296b28a0 0x55d7296b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 4 client.15561 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.388+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d72960eda0 con 0x55d7296b28a0 2024-09-10T20:53:29.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.389+0000 7f02f77fe640 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7296b28a0 0x55d7296b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.390+0000 7f02f77fe640 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7296b28a0 0x55d7296b4d00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d8daf14cb8e241a server_cookie=4e425b7113fa9889 in_seq=0 out_seq=0 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.390+0000 7f02d6ffd640 10 client.15561 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.391+0000 7f02d6ffd640 1 -- 172.21.15.67:0/470553645 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d72960eda0 con 0x55d7296b28a0 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.391+0000 7f02d6ffd640 10 client.15561 handle_command_reply: tid=0 2024-09-10T20:53:29.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.391+0000 7f02fffad740 1 client.15561 shutdown 2024-09-10T20:53:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 msgr2=0x55d72969fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f02ec017600 tx=0x7f02ec0ab4d0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 shutdown_connections 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7296b28a0 0x55d7296b4d00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d72969fa40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 --2- 172.21.15.67:0/470553645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 >> 172.21.15.67:0/470553645 conn(0x55d7296942b0 msgr2=0x55d729699e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02d6ffd640 0 client.15561 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 shutdown_connections 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 1 -- 172.21.15.67:0/470553645 wait complete. 2024-09-10T20:53:29.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.393+0000 7f02fffad740 20 client.15561 trim_cache size 0 max 16384 2024-09-10T20:53:29.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.427+0000 7f02fffad740 1 Processor -- start 2024-09-10T20:53:29.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.428+0000 7f02fffad740 1 -- start start 2024-09-10T20:53:29.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.428+0000 7f02fffad740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.428+0000 7f02fffad740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d729693bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.428+0000 7f02fffad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.428+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02fffad740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81bf9e0 con 0x55d729696da0 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:59940/0 (socket says 172.21.15.67:59940) 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 -- 172.21.15.67:0/1093859526 learned_addr learned my addr 172.21.15.67:0/1093859526 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d729693bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81bd350 con 0x55d729696480 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81020b0 con 0x55d7296a2d30 2024-09-10T20:53:29.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f7fff640 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 -- 172.21.15.67:0/1093859526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 msgr2=0x55d7296a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:29.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 -- 172.21.15.67:0/1093859526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 msgr2=0x55d729693bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d729693bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.429+0000 7f02f77fe640 1 -- 172.21.15.67:0/1093859526 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d72969df40 con 0x55d729696480 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.430+0000 7f02f77fe640 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02e802cb40 tx=0x7f02e8009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d584e472baa5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.430+0000 7f02dd7fa640 1 -- 172.21.15.67:0/1093859526 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8054020 con 0x55d729696480 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.430+0000 7f02dd7fa640 1 -- 172.21.15.67:0/1093859526 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02e8032dc0 con 0x55d729696480 2024-09-10T20:53:29.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.430+0000 7f02dd7fa640 1 -- 172.21.15.67:0/1093859526 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8041070 con 0x55d729696480 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.431+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 msgr2=0x55d7296b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.431+0000 7f02fffad740 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02e802cb40 tx=0x7f02e8009490 comp rx=0 tx=0).stop 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.432+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 shutdown_connections 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.432+0000 7f02fffad740 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d7296a2d30 0x55d7296a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.432+0000 7f02fffad740 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696da0 0x55d729693bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.432+0000 7f02fffad740 1 --2- 172.21.15.67:0/1093859526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d729696480 0x55d7296b48b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.432+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 >> 172.21.15.67:0/1093859526 conn(0x55d7296942b0 msgr2=0x55d7296a1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.433+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 shutdown_connections 2024-09-10T20:53:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.433+0000 7f02fffad740 1 -- 172.21.15.67:0/1093859526 wait complete. 2024-09-10T20:53:29.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.434+0000 7f02fffad740 1 -- start start 2024-09-10T20:53:29.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.434+0000 7f02fffad740 1 Processor -- start 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.435+0000 7f02fffad740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 0x55d7296ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.435+0000 7f02fffad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696da0 0x55d7296ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.435+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 0x55d7296ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.435+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 0x55d7296ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57092/0 (socket says 172.21.15.67:57092) 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.435+0000 7f02f77fe640 1 -- 172.21.15.67:0/3868283158 learned_addr learned my addr 172.21.15.67:0/3868283158 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f6ffd640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696da0 0x55d7296ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8073760 con 0x55d729696480 2024-09-10T20:53:29.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8074bd0 con 0x55d7296a2d30 2024-09-10T20:53:29.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8073e30 con 0x55d729696da0 2024-09-10T20:53:29.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02fffad740 10 client.0 _ll_register_callbacks cb 0x7f02ec017550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 -- 172.21.15.67:0/3868283158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696da0 msgr2=0x55d7296ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696da0 0x55d7296ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 -- 172.21.15.67:0/3868283158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 msgr2=0x55d7296ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 0x55d7296ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.436+0000 7f02f7fff640 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7296aa350 con 0x55d7296a2d30 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.437+0000 7f02f7fff640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296bacc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55d7296af620 tx=0x7f02f0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b1e569add16b746 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.437+0000 7f02d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.437+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0003970 con 0x55d7296a2d30 2024-09-10T20:53:29.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.437+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02f0009020 con 0x55d7296a2d30 2024-09-10T20:53:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.438+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e8032dc0 con 0x55d7296a2d30 2024-09-10T20:53:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.438+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02f0003b10 con 0x55d7296a2d30 2024-09-10T20:53:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.438+0000 7f02fffad740 10 client.25211 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:29.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.438+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d72971fb90 con 0x55d7296a2d30 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.438+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02f0003cb0 con 0x55d7296a2d30 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f02f000b040 con 0x55d7296a2d30 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 10 client.25211 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 10 client.25211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 20 client.25211 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7297203a0 0x55d7297227c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 4 client.25211 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:53:29.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.439+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f02e8032dc0 con 0x55d7297203a0 2024-09-10T20:53:29.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.440+0000 7f02f77fe640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7297203a0 0x55d7297227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:29.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.441+0000 7f02f77fe640 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7297203a0 0x55d7297227c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ad8f7f2a9cd1f1 server_cookie=a607d99902a0e8b9 in_seq=0 out_seq=0 2024-09-10T20:53:29.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.441+0000 7f02d6ffd640 10 client.25211 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:29.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.441+0000 7f02d6ffd640 1 -- 172.21.15.67:0/3868283158 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x7f02e8032dc0 con 0x55d7297203a0 2024-09-10T20:53:29.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.441+0000 7f02d6ffd640 10 client.25211 handle_command_reply: tid=0 2024-09-10T20:53:29.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.442+0000 7f02fffad740 1 client.25211 shutdown 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.442+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 msgr2=0x55d7296bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.442+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296bacc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55d7296af620 tx=0x7f02f0004a40 comp rx=0 tx=0).stop 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 shutdown_connections 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d7297203a0 0x55d7297227c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d7296a2d30 0x55d7296bacc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d729696da0 0x55d7296ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 --2- 172.21.15.67:0/3868283158 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d729696480 0x55d7296ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 >> 172.21.15.67:0/3868283158 conn(0x55d7296942b0 msgr2=0x55d7296a1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02d6ffd640 0 client.25211 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 shutdown_connections 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 1 -- 172.21.15.67:0/3868283158 wait complete. 2024-09-10T20:53:29.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.443+0000 7f02fffad740 20 client.25211 trim_cache size 0 max 16384 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:29.449 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:29.450 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:29.451 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:29.451 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:53:29.451 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:53:29.451 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 msgr2=0x7f02e00b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 0x7f02e00b78f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005fd0 tx=0x7f02f0010040 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 msgr2=0x7f02f819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b4a0 tx=0x7f02ec00b960 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 shutdown_connections 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02f8108020 0x7f02f81a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f02e00b5430 0x7f02e00b78f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02f81076a0 0x7f02f819fe20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 --2- 172.21.15.67:0/3288948059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f02f8101c90 0x7f02f819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 >> 172.21.15.67:0/3288948059 conn(0x7f02f80fd700 msgr2=0x7f02f80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:29.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 shutdown_connections 2024-09-10T20:53:29.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:29.446+0000 7f02fdbd8640 1 -- 172.21.15.67:0/3288948059 wait complete. 2024-09-10T20:53:30.203 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:30 smithi067 ceph-mon[30891]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-09-10T20:53:30.205 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:53:30.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:53:30.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:30 smithi083 ceph-mon[35058]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-09-10T20:53:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:30 smithi172 ceph-mon[35265]: pgmap v406: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-09-10T20:53:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 -- 172.21.15.67:0/880017354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410103ce0 msgr2=0x7fe4101040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 --2- 172.21.15.67:0/880017354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410103ce0 0x7fe4101040c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe400009900 tx=0x7fe40002a410 comp rx=0 tx=0).stop 2024-09-10T20:53:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 -- 172.21.15.67:0/880017354 shutdown_connections 2024-09-10T20:53:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 --2- 172.21.15.67:0/880017354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 --2- 172.21.15.67:0/880017354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410104600 0x7fe41010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 --2- 172.21.15.67:0/880017354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410103ce0 0x7fe4101040c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 -- 172.21.15.67:0/880017354 >> 172.21.15.67:0/880017354 conn(0x7fe4100fd740 msgr2=0x7fe4100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 -- 172.21.15.67:0/880017354 shutdown_connections 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 -- 172.21.15.67:0/880017354 wait complete. 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.600+0000 7fe414ed9640 1 Processor -- start 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 -- start start 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410103ce0 0x7fe410199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe410112db0 con 0x7fe41010d140 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe410112c30 con 0x7fe410104600 2024-09-10T20:53:31.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe414ed9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe410112f30 con 0x7fe410103ce0 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:59962/0 (socket says 172.21.15.67:59962) 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 -- 172.21.15.67:0/1611337287 learned_addr learned my addr 172.21.15.67:0/1611337287 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57122/0 (socket says 172.21.15.67:57122) 2024-09-10T20:53:31.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40e59c640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410103ce0 0x7fe410199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 -- 172.21.15.67:0/1611337287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410103ce0 msgr2=0x7fe410199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410103ce0 0x7fe410199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 -- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 msgr2=0x7fe41019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.601+0000 7fe40dd9b640 1 -- 172.21.15.67:0/1611337287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41019f3b0 con 0x7fe410104600 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe40dd9b640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e9c0 tx=0x7fe40400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40400ccc0 con 0x7fe410104600 2024-09-10T20:53:31.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4040035f0 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41019f6a0 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40400ce60 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.602+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe410101870 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.603+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4101040c0 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.604+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe404004000 con 0x7fe410104600 2024-09-10T20:53:31.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.605+0000 7fe3ff7fe640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 0x7fe3f80c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.606+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe4040e5e40 con 0x7fe410104600 2024-09-10T20:53:31.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.606+0000 7fe40e59c640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 0x7fe3f80c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:31.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.607+0000 7fe40e59c640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 0x7fe3f80c0030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe400031440 tx=0x7fe400005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:31.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:31.609+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe4040accd0 con 0x7fe410104600 2024-09-10T20:53:32.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.002+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe41019a430 con 0x7fe410104600 2024-09-10T20:53:32.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.003+0000 7fe3ff7fe640 1 -- 172.21.15.67:0/1611337287 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7fe4040ac5d0 con 0x7fe410104600 2024-09-10T20:53:32.007 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:53:32.007 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 27 2024-09-10T20:53:32.008 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":27,"btime":"2024-09-10T20:51:30:345494+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:51:29.557607+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 msgr2=0x7fe3f80c0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 0x7fe3f80c0030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe400031440 tx=0x7fe400005b50 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 msgr2=0x7fe410199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e9c0 tx=0x7fe40400ee80 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 shutdown_connections 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe41010d140 0x7fe41019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe410104600 0x7fe410199840 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e9c0 tx=0x7fe40400ee80 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe3f80bdb70 0x7fe3f80c0030 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe400031440 tx=0x7fe400005b50 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 --2- 172.21.15.67:0/1611337287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe410103ce0 0x7fe410199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.007+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 >> 172.21.15.67:0/1611337287 conn(0x7fe4100fd740 msgr2=0x7fe4100fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.008+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 shutdown_connections 2024-09-10T20:53:32.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:32.008+0000 7fe414ed9640 1 -- 172.21.15.67:0/1611337287 wait complete. 2024-09-10T20:53:32.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:32 smithi067 ceph-mon[30891]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-10T20:53:32.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:32 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1611337287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:53:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:32 smithi083 ceph-mon[35058]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-10T20:53:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:32 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1611337287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:53:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:32 smithi172 ceph-mon[35265]: pgmap v407: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-10T20:53:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:32 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1611337287' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:53:32.838 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:53:33.274 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 -- 172.21.15.67:0/2404184694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075e60 msgr2=0x7f66a81135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 --2- 172.21.15.67:0/2404184694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075e60 0x7f66a81135d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6698009860 tx=0x7f669802a340 comp rx=0 tx=0).stop 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 -- 172.21.15.67:0/2404184694 shutdown_connections 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 --2- 172.21.15.67:0/2404184694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 0x7f66a8115f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 --2- 172.21.15.67:0/2404184694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075e60 0x7f66a81135d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 --2- 172.21.15.67:0/2404184694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075540 0x7f66a8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 -- 172.21.15.67:0/2404184694 >> 172.21.15.67:0/2404184694 conn(0x7f66a80fe800 msgr2=0x7f66a8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 -- 172.21.15.67:0/2404184694 shutdown_connections 2024-09-10T20:53:33.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.900+0000 7f66afec8640 1 -- 172.21.15.67:0/2404184694 wait complete. 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.901+0000 7f66afec8640 1 Processor -- start 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.901+0000 7f66afec8640 1 -- start start 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.902+0000 7f66afec8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 0x7f66a819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.902+0000 7f66afec8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.902+0000 7f66afec8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 0x7f66a81a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.902+0000 7f66afec8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8119390 con 0x7f66a8075e60 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.902+0000 7f66afec8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8119210 con 0x7f66a8113b10 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66afec8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8119510 con 0x7f66a8075540 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40870/0 (socket says 172.21.15.67:40870) 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ae465640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 0x7f66a81a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 -- 172.21.15.67:0/3845202191 learned_addr learned my addr 172.21.15.67:0/3845202191 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:33.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66adc64640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 0x7f66a819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 -- 172.21.15.67:0/3845202191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 msgr2=0x7f66a819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 0x7f66a819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 -- 172.21.15.67:0/3845202191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 msgr2=0x7f66a81a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 0x7f66a81a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66ad463640 1 -- 172.21.15.67:0/3845202191 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a81a5990 con 0x7f66a8075e60 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.903+0000 7f66adc64640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 0x7f66a819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.904+0000 7f66ad463640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6698035040 tx=0x7f6698032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.904+0000 7f669effd640 1 -- 172.21.15.67:0/3845202191 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698037040 con 0x7f66a8075e60 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.904+0000 7f669effd640 1 -- 172.21.15.67:0/3845202191 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6698041070 con 0x7f66a8075e60 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.904+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a81a5c20 con 0x7f66a8075e60 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.904+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81ac340 con 0x7f66a8075e60 2024-09-10T20:53:33.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.905+0000 7f669effd640 1 -- 172.21.15.67:0/3845202191 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698003850 con 0x7f66a8075e60 2024-09-10T20:53:33.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.909+0000 7f66b229d740 1 Processor -- start 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 -- start start 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574b0f0 0x5602b574b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 0x5602b5759d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5602b56c1ea0 con 0x5602b57579a0 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5602b56b12d0 con 0x5602b574b0f0 2024-09-10T20:53:33.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66b229d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5602b56b50e0 con 0x5602b574ba10 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.910+0000 7f66adc64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50936/0 (socket says 172.21.15.67:50936) 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 -- 172.21.15.67:0/1655691031 learned_addr learned my addr 172.21.15.67:0/1655691031 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66ae465640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574b0f0 0x5602b574b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f669effd640 1 -- 172.21.15.67:0/3845202191 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6698004050 con 0x7f66a8075e60 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 -- 172.21.15.67:0/1655691031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574b0f0 msgr2=0x5602b574b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574b0f0 0x5602b574b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 -- 172.21.15.67:0/1655691031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 msgr2=0x5602b5759d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66ad463640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 0x5602b5759d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 0x5602b5759d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66adc64640 1 -- 172.21.15.67:0/1655691031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b540f650 con 0x5602b574ba10 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.911+0000 7f66ad463640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 0x5602b5759d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:53:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.912+0000 7f66adc64640 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a4011510 tx=0x7f66a40119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207ff0a35d1f9cc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.912+0000 7f6693fff640 1 -- 172.21.15.67:0/1655691031 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4004020 con 0x5602b574ba10 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.912+0000 7f6693fff640 1 -- 172.21.15.67:0/1655691031 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a40041c0 con 0x5602b574ba10 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.912+0000 7f6693fff640 1 -- 172.21.15.67:0/1655691031 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a400f800 con 0x5602b574ba10 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.913+0000 7f669effd640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 0x7f66940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66ae465640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 0x7f66940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 -- 172.21.15.67:0/1655691031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 msgr2=0x5602b5757460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f669effd640 1 -- 172.21.15.67:0/3845202191 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6698105900 con 0x7f66a8075e60 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66a4011510 tx=0x7f66a40119d0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 -- 172.21.15.67:0/1655691031 shutdown_connections 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b57579a0 0x5602b5759d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b5757460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 --2- 172.21.15.67:0/1655691031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574b0f0 0x5602b574b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66b229d740 1 -- 172.21.15.67:0/1655691031 >> 172.21.15.67:0/1655691031 conn(0x5602b5748f20 msgr2=0x5602b574a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.914+0000 7f66ae465640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 0x7f66940b7820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66a806c3c0 tx=0x7f66a0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.915+0000 7f66b229d740 1 -- 172.21.15.67:0/1655691031 shutdown_connections 2024-09-10T20:53:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.916+0000 7f66b229d740 1 -- 172.21.15.67:0/1655691031 wait complete. 2024-09-10T20:53:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.916+0000 7f66b229d740 1 -- start start 2024-09-10T20:53:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.917+0000 7f66b229d740 1 Processor -- start 2024-09-10T20:53:33.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.917+0000 7f66b229d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b5757250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b5754c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5602b5512700 con 0x5602b574b0f0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5602b564c160 con 0x5602b574ba10 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5602b575a620 con 0x5602b57579a0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66b229d740 10 client.0 _ll_register_callbacks cb 0x5602b56659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39452/0 (socket says 172.21.15.67:39452) 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 -- 172.21.15.67:0/1433157103 learned_addr learned my addr 172.21.15.67:0/1433157103 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ae465640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b5754c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66adc64640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b5757250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 -- 172.21.15.67:0/1433157103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 msgr2=0x5602b5754c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b5754c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 -- 172.21.15.67:0/1433157103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 msgr2=0x5602b5757250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b5757250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.918+0000 7f66ad463640 1 -- 172.21.15.67:0/1433157103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b5679c90 con 0x5602b574ba10 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66ad463640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66980c8660 tx=0x7f6698030dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8765764f0ee0f643 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66917fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980cb800 con 0x5602b574ba10 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f66980d5190 con 0x5602b574ba10 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a40041c0 con 0x5602b574ba10 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6698030450 con 0x5602b574ba10 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66b229d740 10 client.25229 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.919+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602b5765ee0 con 0x5602b574ba10 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66980cbba0 con 0x5602b574ba10 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f66980c79e0 con 0x5602b574ba10 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 10 client.25229 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 10 client.25229 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 20 client.25229 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b5767320 0x5602b57697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 4 client.25229 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f66a40041c0 con 0x5602b5767320 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.920+0000 7f66adc64640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b5767320 0x5602b57697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.921+0000 7f66917fa640 10 client.25229 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.921+0000 7f66adc64640 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b5767320 0x5602b57697a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1febc24b5e932eb8 server_cookie=af44ec82eef627d7 in_seq=0 out_seq=0 2024-09-10T20:53:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.922+0000 7f66917fa640 1 -- 172.21.15.67:0/1433157103 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f66a40041c0 con 0x5602b5767320 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.922+0000 7f66917fa640 10 client.25229 handle_command_reply: tid=0 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.922+0000 7f66b229d740 1 client.25229 shutdown 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.922+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 msgr2=0x5602b57546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.922+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f66980c8660 tx=0x7f6698030dd0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 shutdown_connections 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b5767320 0x5602b57697a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b5754c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57546a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 --2- 172.21.15.67:0/1433157103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b5757250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 >> 172.21.15.67:0/1433157103 conn(0x5602b5748f20 msgr2=0x5602b574ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66917fa640 0 client.25229 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 shutdown_connections 2024-09-10T20:53:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.923+0000 7f66b229d740 1 -- 172.21.15.67:0/1433157103 wait complete. 2024-09-10T20:53:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.924+0000 7f66b229d740 20 client.25229 trim_cache size 0 max 16384 2024-09-10T20:53:33.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 Processor -- start 2024-09-10T20:53:33.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 -- start start 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b57638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b57518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b71d0 con 0x5602b574b0f0 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b4a70 con 0x5602b574ba10 2024-09-10T20:53:33.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.948+0000 7f66b229d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b28c0 con 0x5602b57579a0 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ae465640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b57518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66adc64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b57638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ae465640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b57518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50966/0 (socket says 172.21.15.67:50966) 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ae465640 1 -- 172.21.15.67:0/647679910 learned_addr learned my addr 172.21.15.67:0/647679910 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 -- 172.21.15.67:0/647679910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 msgr2=0x5602b57518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b57518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 -- 172.21.15.67:0/647679910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 msgr2=0x5602b57638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b57638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 -- 172.21.15.67:0/647679910 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b574b840 con 0x5602b574ba10 2024-09-10T20:53:33.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.949+0000 7f66ad463640 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57563e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6698045000 tx=0x7f6698105b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979b237f3604e869 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.950+0000 7f66937fe640 1 -- 172.21.15.67:0/647679910 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980cb800 con 0x5602b574ba10 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.950+0000 7f66937fe640 1 -- 172.21.15.67:0/647679910 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66980cc790 con 0x5602b574ba10 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.950+0000 7f66937fe640 1 -- 172.21.15.67:0/647679910 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980c86e0 con 0x5602b574ba10 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.951+0000 7f66b229d740 1 -- 172.21.15.67:0/647679910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 msgr2=0x5602b57563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.951+0000 7f66b229d740 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57563e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6698045000 tx=0x7f6698105b80 comp rx=0 tx=0).stop 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 -- 172.21.15.67:0/647679910 shutdown_connections 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b57579a0 0x5602b57518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b574ba10 0x5602b57563e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 --2- 172.21.15.67:0/647679910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b57638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 -- 172.21.15.67:0/647679910 >> 172.21.15.67:0/647679910 conn(0x5602b5748f20 msgr2=0x5602b5755cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 -- 172.21.15.67:0/647679910 shutdown_connections 2024-09-10T20:53:33.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.952+0000 7f66b229d740 1 -- 172.21.15.67:0/647679910 wait complete. 2024-09-10T20:53:33.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.953+0000 7f66b229d740 1 -- start start 2024-09-10T20:53:33.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.953+0000 7f66b229d740 1 Processor -- start 2024-09-10T20:53:33.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b575c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66adc64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66adc64640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40908/0 (socket says 172.21.15.67:40908) 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66adc64640 1 -- 172.21.15.67:0/3213334790 learned_addr learned my addr 172.21.15.67:0/3213334790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b57579a0 0x5602b575c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b2f30 con 0x5602b574b0f0 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b43a0 con 0x5602b57579a0 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66a81b3600 con 0x5602b574ba10 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66ad463640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b575c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.954+0000 7f66b229d740 10 client.0 _ll_register_callbacks cb 0x7f6698005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ae465640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b57579a0 0x5602b575c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 -- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b57579a0 msgr2=0x5602b575c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b57579a0 0x5602b575c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 -- 172.21.15.67:0/3213334790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 msgr2=0x5602b575feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:33.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b575cf10 con 0x5602b574ba10 2024-09-10T20:53:33.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66adc64640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:53:33.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66ad463640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b575c390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66980cbb50 tx=0x7f6698030dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b55a82a7bd8cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:33.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.955+0000 7f66917fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:53:33.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.956+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980c86e0 con 0x5602b574ba10 2024-09-10T20:53:33.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.956+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f66980b7200 con 0x5602b574ba10 2024-09-10T20:53:33.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.956+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66980cc790 con 0x5602b574ba10 2024-09-10T20:53:33.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.957+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f66980cb800 con 0x5602b574ba10 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 10 client.25231 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602b575cf10 con 0x5602b574ba10 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66980cbba0 con 0x5602b574ba10 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f66980d1d00 con 0x5602b574ba10 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 10 client.25231 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 10 client.25231 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 20 client.25231 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b57d5420 0x5602b57d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 4 client.25231 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:53:33.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f66980cc790 con 0x5602b57d5420 2024-09-10T20:53:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.958+0000 7f66adc64640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b57d5420 0x5602b57d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.959+0000 7f66adc64640 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b57d5420 0x5602b57d7840 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af32d9c62a260622 server_cookie=994765085758f6ba in_seq=0 out_seq=0 2024-09-10T20:53:33.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.959+0000 7f66917fa640 10 client.25231 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:53:33.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.960+0000 7f66917fa640 1 -- 172.21.15.67:0/3213334790 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f66980cc790 con 0x5602b57d5420 2024-09-10T20:53:33.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.960+0000 7f66917fa640 10 client.25231 handle_command_reply: tid=0 2024-09-10T20:53:33.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.960+0000 7f66b229d740 1 client.25231 shutdown 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.960+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 msgr2=0x5602b575c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.960+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b575c390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66980cbb50 tx=0x7f6698030dd0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 shutdown_connections 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5602b57d5420 0x5602b57d7840 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602b57579a0 0x5602b575c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66917fa640 0 client.25231 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602b574ba10 0x5602b575c390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 --2- 172.21.15.67:0/3213334790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602b574b0f0 0x5602b575feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 >> 172.21.15.67:0/3213334790 conn(0x5602b5748f20 msgr2=0x5602b57564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 shutdown_connections 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 1 -- 172.21.15.67:0/3213334790 wait complete. 2024-09-10T20:53:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.961+0000 7f66b229d740 20 client.25231 trim_cache size 0 max 16384 2024-09-10T20:53:33.968 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:53:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 msgr2=0x7f66940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 0x7f66940b7820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66a806c3c0 tx=0x7f66a0009600 comp rx=0 tx=0).stop 2024-09-10T20:53:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 msgr2=0x7f66a819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6698035040 tx=0x7f6698032dc0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 shutdown_connections 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a8113b10 0x7f66a81a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a8075e60 0x7f66a819fe20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b5360 0x7f66940b7820 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 --2- 172.21.15.67:0/3845202191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a8075540 0x7f66a819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.962+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 >> 172.21.15.67:0/3845202191 conn(0x7f66a80fe800 msgr2=0x7f66a80ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.963+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 shutdown_connections 2024-09-10T20:53:33.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:33.963+0000 7f66afec8640 1 -- 172.21.15.67:0/3845202191 wait complete. 2024-09-10T20:53:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 120.0 s, 3238.8 tps, lat 30.803 ms stddev 42.153 2024-09-10T20:53:34.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:34 smithi067 ceph-mon[30891]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 28 MiB/s wr, 999 op/s 2024-09-10T20:53:34.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:34 smithi083 ceph-mon[35058]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 28 MiB/s wr, 999 op/s 2024-09-10T20:53:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:34 smithi172 ceph-mon[35265]: pgmap v408: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 28 MiB/s wr, 999 op/s 2024-09-10T20:53:34.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:53:35.267 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 -- 172.21.15.67:0/497770827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 msgr2=0x7fe254115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 --2- 172.21.15.67:0/497770827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe254115f60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe24402a410 comp rx=0 tx=0).stop 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 -- 172.21.15.67:0/497770827 shutdown_connections 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 --2- 172.21.15.67:0/497770827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe254115f60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 --2- 172.21.15.67:0/497770827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 --2- 172.21.15.67:0/497770827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 0x7fe2541097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 -- 172.21.15.67:0/497770827 >> 172.21.15.67:0/497770827 conn(0x7fe254078a40 msgr2=0x7fe25407ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 -- 172.21.15.67:0/497770827 shutdown_connections 2024-09-10T20:53:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.871+0000 7fe25b27b640 1 -- 172.21.15.67:0/497770827 wait complete. 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 Processor -- start 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 -- start start 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 0x7fe25419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe2541a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe254119390 con 0x7fe25410f760 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe254119210 con 0x7fe2541093d0 2024-09-10T20:53:35.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.872+0000 7fe25b27b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe254119510 con 0x7fe25410ede0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe259818640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe2541a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe259818640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe2541a5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40924/0 (socket says 172.21.15.67:40924) 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe259818640 1 -- 172.21.15.67:0/1295818479 learned_addr learned my addr 172.21.15.67:0/1295818479 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe259017640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 0x7fe25419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 -- 172.21.15.67:0/1295818479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 msgr2=0x7fe25419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 0x7fe25419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 -- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 msgr2=0x7fe2541a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe2541a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 -- 172.21.15.67:0/1295818479 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2541a58d0 con 0x7fe25410ede0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.873+0000 7fe258816640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25419fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005fd0 tx=0x7fe24c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.874+0000 7fe24a7fc640 1 -- 172.21.15.67:0/1295818479 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00cd80 con 0x7fe25410ede0 2024-09-10T20:53:35.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.874+0000 7fe24a7fc640 1 -- 172.21.15.67:0/1295818479 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe24c005020 con 0x7fe25410ede0 2024-09-10T20:53:35.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.874+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2541a5bc0 con 0x7fe25410ede0 2024-09-10T20:53:35.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.874+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541ac280 con 0x7fe25410ede0 2024-09-10T20:53:35.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.875+0000 7fe24a7fc640 1 -- 172.21.15.67:0/1295818479 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0116d0 con 0x7fe25410ede0 2024-09-10T20:53:35.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.878+0000 7fe24a7fc640 1 -- 172.21.15.67:0/1295818479 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe24c00f040 con 0x7fe25410ede0 2024-09-10T20:53:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.878+0000 7fe25d650740 1 Processor -- start 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 -- start start 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e1274d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e135d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c51e09dea0 con 0x55c51e1270f0 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c51e08d2d0 con 0x55c51e127a10 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe25d650740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c51e0910e0 con 0x55c51e1339a0 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe259017640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe259017640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39498/0 (socket says 172.21.15.67:39498) 2024-09-10T20:53:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.879+0000 7fe259017640 1 -- 172.21.15.67:0/1157405822 learned_addr learned my addr 172.21.15.67:0/1157405822 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 -- 172.21.15.67:0/1157405822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 msgr2=0x55c51e135d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e135d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 -- 172.21.15.67:0/1157405822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 msgr2=0x55c51e1274d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e1274d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 -- 172.21.15.67:0/1157405822 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51ddeb650 con 0x55c51e127a10 2024-09-10T20:53:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe259017640 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe250009cf0 tx=0x7fe250011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7d7e3049dccd90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe23f7fe640 1 -- 172.21.15.67:0/1157405822 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250004230 con 0x55c51e127a10 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe23f7fe640 1 -- 172.21.15.67:0/1157405822 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2500043d0 con 0x55c51e127a10 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.880+0000 7fe23f7fe640 1 -- 172.21.15.67:0/1157405822 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250019880 con 0x55c51e127a10 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe24a7fc640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 0x7fe2400b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 -- 172.21.15.67:0/1157405822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 msgr2=0x55c51e133460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe250009cf0 tx=0x7fe250011810 comp rx=0 tx=0).stop 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe259818640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 0x7fe2400b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 -- 172.21.15.67:0/1157405822 shutdown_connections 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e133460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 --2- 172.21.15.67:0/1157405822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e1274d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 -- 172.21.15.67:0/1157405822 >> 172.21.15.67:0/1157405822 conn(0x55c51e124f20 msgr2=0x55c51e1260c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe24a7fc640 1 -- 172.21.15.67:0/1295818479 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe24c0e58c0 con 0x7fe25410ede0 2024-09-10T20:53:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.881+0000 7fe25d650740 1 -- 172.21.15.67:0/1157405822 shutdown_connections 2024-09-10T20:53:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.882+0000 7fe25d650740 1 -- 172.21.15.67:0/1157405822 wait complete. 2024-09-10T20:53:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.882+0000 7fe259818640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 0x7fe2400b7970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2440096c0 tx=0x7fe244005b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.882+0000 7fe25d650740 1 -- start start 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.882+0000 7fe25d650740 1 Processor -- start 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e130e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c51deee700 con 0x55c51e1270f0 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c51e028160 con 0x55c51e127a10 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.883+0000 7fe25d650740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c51e147630 con 0x55c51e1339a0 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe25d650740 10 client.0 _ll_register_callbacks cb 0x55c51e0419e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:35.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe259818640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e130e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39510/0 (socket says 172.21.15.67:39510) 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 -- 172.21.15.67:0/1569936680 learned_addr learned my addr 172.21.15.67:0/1569936680 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe259017640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 -- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 msgr2=0x55c51e130e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e130e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 -- 172.21.15.67:0/1569936680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 msgr2=0x55c51e133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 -- 172.21.15.67:0/1569936680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51e055c90 con 0x55c51e127a10 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe258816640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cfd0 tx=0x7fe24c0abb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=443bc2ce4df7063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.884+0000 7fe23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c01f040 con 0x55c51e127a10 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe24c0054d0 con 0x55c51e127a10 2024-09-10T20:53:35.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2500043d0 con 0x55c51e127a10 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe24c0b0b30 con 0x55c51e127a10 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 10 client.25247 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c51e153090 con 0x55c51e127a10 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2500043d0 con 0x55c51e127a10 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe24c0ab3f0 con 0x55c51e127a10 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 10 client.25247 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 10 client.25247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.885+0000 7fe25d650740 20 client.25247 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1544a0 0x55c51e1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe25d650740 4 client.25247 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c51e09fdf0 con 0x55c51e1544a0 2024-09-10T20:53:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe259017640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1544a0 0x55c51e1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe259017640 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1544a0 0x55c51e1568c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da5538c4b8b2a864 server_cookie=e33217654e772d60 in_seq=0 out_seq=0 2024-09-10T20:53:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.886+0000 7fe23cff9640 10 client.25247 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:53:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe23cff9640 1 -- 172.21.15.67:0/1569936680 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c51e09fdf0 con 0x55c51e1544a0 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe23cff9640 10 client.25247 handle_command_reply: tid=0 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 client.25247 shutdown 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 msgr2=0x55c51e1307b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cfd0 tx=0x7fe24c0abb40 comp rx=0 tx=0).stop 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 shutdown_connections 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1544a0 0x55c51e1568c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e130e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e127a10 0x55c51e1307b0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cfd0 tx=0x7fe24c0abb40 comp rx=0 tx=0).stop 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 --2- 172.21.15.67:0/1569936680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 >> 172.21.15.67:0/1569936680 conn(0x55c51e124f20 msgr2=0x55c51e12aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.887+0000 7fe23cff9640 0 client.25247 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:53:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.890+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 shutdown_connections 2024-09-10T20:53:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.890+0000 7fe25d650740 1 -- 172.21.15.67:0/1569936680 wait complete. 2024-09-10T20:53:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.890+0000 7fe25d650740 20 client.25247 trim_cache size 0 max 16384 2024-09-10T20:53:35.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.917+0000 7fe25d650740 1 Processor -- start 2024-09-10T20:53:35.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.917+0000 7fe25d650740 1 -- start start 2024-09-10T20:53:35.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.918+0000 7fe25d650740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.918+0000 7fe25d650740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1339a0 0x55c51e150860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.918+0000 7fe259017640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.918+0000 7fe259017640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40938/0 (socket says 172.21.15.67:40938) 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 -- 172.21.15.67:0/3496025049 learned_addr learned my addr 172.21.15.67:0/3496025049 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe258816640 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1339a0 0x55c51e150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe25d650740 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e12d9c0 0x55c51e12de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ae910 con 0x55c51e1270f0 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe254074f70 con 0x55c51e1339a0 2024-09-10T20:53:35.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541097b0 con 0x55c51e12d9c0 2024-09-10T20:53:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 -- 172.21.15.67:0/3496025049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e12d9c0 msgr2=0x55c51e12de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e12d9c0 0x55c51e12de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 -- 172.21.15.67:0/3496025049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1339a0 msgr2=0x55c51e150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1339a0 0x55c51e150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.919+0000 7fe259017640 1 -- 172.21.15.67:0/3496025049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51e12ecb0 con 0x55c51e1270f0 2024-09-10T20:53:35.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.920+0000 7fe259017640 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe250009230 tx=0x7fe250011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ab76939540285 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.921+0000 7fe23effd640 1 -- 172.21.15.67:0/3496025049 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250003a00 con 0x55c51e1270f0 2024-09-10T20:53:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.921+0000 7fe23effd640 1 -- 172.21.15.67:0/3496025049 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe250031070 con 0x55c51e1270f0 2024-09-10T20:53:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.921+0000 7fe23effd640 1 -- 172.21.15.67:0/3496025049 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500196f0 con 0x55c51e1270f0 2024-09-10T20:53:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.923+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 msgr2=0x55c51e126540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.923+0000 7fe25d650740 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe250009230 tx=0x7fe250011810 comp rx=0 tx=0).stop 2024-09-10T20:53:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.924+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 shutdown_connections 2024-09-10T20:53:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.924+0000 7fe25d650740 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e12d9c0 0x55c51e12de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.924+0000 7fe25d650740 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1339a0 0x55c51e150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.924+0000 7fe25d650740 1 --2- 172.21.15.67:0/3496025049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e1270f0 0x55c51e126540 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.924+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 >> 172.21.15.67:0/3496025049 conn(0x55c51e124f20 msgr2=0x55c51e125e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.933+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 shutdown_connections 2024-09-10T20:53:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.936+0000 7fe25d650740 1 -- 172.21.15.67:0/3496025049 wait complete. 2024-09-10T20:53:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.936+0000 7fe25d650740 1 -- start start 2024-09-10T20:53:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 Processor -- start 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 0x55c51e14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 0x55c51e14d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e133d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe254073430 con 0x55c51e12d9c0 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe2540748a0 con 0x55c51e1270f0 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe254073b00 con 0x55c51e1339a0 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.937+0000 7fe25d650740 10 client.0 _ll_register_callbacks cb 0x7fe24c0abf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259818640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 0x55c51e14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259818640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e133d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51024/0 (socket says 172.21.15.67:51024) 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259818640 1 -- 172.21.15.67:0/1088149826 learned_addr learned my addr 172.21.15.67:0/1088149826 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe258816640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 0x55c51e14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 -- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 msgr2=0x55c51e133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e133d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 -- 172.21.15.67:0/1088149826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 msgr2=0x55c51e14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 0x55c51e14d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.938+0000 7fe259017640 1 -- 172.21.15.67:0/1088149826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51e134590 con 0x55c51e1270f0 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe258816640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 0x55c51e14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:53:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe259017640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 0x55c51e14cb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe250011d10 tx=0x7fe250003a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bedb0dcd4364f6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25003b020 con 0x55c51e1270f0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe250037440 con 0x55c51e1270f0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.939+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe250031070 con 0x55c51e1270f0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe2500376a0 con 0x55c51e1270f0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 10 client.25253 fetch_fsmap learned FSMap version 27 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c51e135890 con 0x55c51e1270f0 2024-09-10T20:53:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe250031070 con 0x55c51e1270f0 2024-09-10T20:53:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7fe250019540 con 0x55c51e1270f0 2024-09-10T20:53:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 10 client.25253 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T20:53:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 10 client.25253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:53:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 20 client.25253 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.940+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1c2410 0x55c51e1c4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.941+0000 7fe25d650740 4 client.25253 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.941+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c51e09b8a0 con 0x55c51e1c2410 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.941+0000 7fe258816640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1c2410 0x55c51e1c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe23cff9640 10 client.25253 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe258816640 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1c2410 0x55c51e1c4830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90cc5dd86f1b4a27 server_cookie=55fe7d3f15a8d004 in_seq=0 out_seq=0 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe23cff9640 1 -- 172.21.15.67:0/1088149826 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c51e09b8a0 con 0x55c51e1c2410 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe23cff9640 10 client.25253 handle_command_reply: tid=0 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 client.25253 shutdown 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 msgr2=0x55c51e14cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 0x55c51e14cb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe250011d10 tx=0x7fe250003a30 comp rx=0 tx=0).stop 2024-09-10T20:53:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 shutdown_connections 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55c51e1c2410 0x55c51e1c4830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c51e1339a0 0x55c51e133d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c51e12d9c0 0x55c51e14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe23cff9640 0 client.25253 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 --2- 172.21.15.67:0/1088149826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c51e1270f0 0x55c51e14cb10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.942+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 >> 172.21.15.67:0/1088149826 conn(0x55c51e124f20 msgr2=0x55c51e125e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.943+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 shutdown_connections 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.943+0000 7fe25d650740 1 -- 172.21.15.67:0/1088149826 wait complete. 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.943+0000 7fe25d650740 20 client.25253 trim_cache size 0 max 16384 2024-09-10T20:53:35.949 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:53:35.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 msgr2=0x7fe2400b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 0x7fe2400b7970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2440096c0 tx=0x7fe244005b70 comp rx=0 tx=0).stop 2024-09-10T20:53:35.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 msgr2=0x7fe25419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25419fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005fd0 tx=0x7fe24c00ee80 comp rx=0 tx=0).stop 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 shutdown_connections 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe25410f760 0x7fe2541a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe2400b54b0 0x7fe2400b7970 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe25410ede0 0x7fe25419fd60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 --2- 172.21.15.67:0/1295818479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2541093d0 0x7fe25419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 >> 172.21.15.67:0/1295818479 conn(0x7fe254078a40 msgr2=0x7fe25407ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 shutdown_connections 2024-09-10T20:53:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:35.944+0000 7fe25b27b640 1 -- 172.21.15.67:0/1295818479 wait complete. 2024-09-10T20:53:36.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:36 smithi083 ceph-mon[35058]: pgmap v409: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 921 op/s 2024-09-10T20:53:36.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:36 smithi172 ceph-mon[35265]: pgmap v409: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 921 op/s 2024-09-10T20:53:36.542 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:36 smithi067 ceph-mon[30891]: pgmap v409: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 32 MiB/s wr, 921 op/s 2024-09-10T20:53:37.113 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:53:37.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:37 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:37.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:37 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:53:37.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:37 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:37.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:37 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:37.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:37 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:37.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:37 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:53:37.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:37 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:37.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:37 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:37.571 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:37 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:37 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:53:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:37 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:37.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:37 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.178+0000 7f964ad74640 1 -- 172.21.15.67:0/545883046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96440776d0 msgr2=0x7f9644077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.178+0000 7f964ad74640 1 --2- 172.21.15.67:0/545883046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96440776d0 0x7f9644077ab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9634009900 tx=0x7f963402a410 comp rx=0 tx=0).stop 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 -- 172.21.15.67:0/545883046 shutdown_connections 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 --2- 172.21.15.67:0/545883046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f9644115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 --2- 172.21.15.67:0/545883046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9644077ff0 0x7f9644113470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 --2- 172.21.15.67:0/545883046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96440776d0 0x7f9644077ab0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 -- 172.21.15.67:0/545883046 >> 172.21.15.67:0/545883046 conn(0x7f96441009f0 msgr2=0x7f9644102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 -- 172.21.15.67:0/545883046 shutdown_connections 2024-09-10T20:53:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 -- 172.21.15.67:0/545883046 wait complete. 2024-09-10T20:53:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.179+0000 7f964ad74640 1 Processor -- start 2024-09-10T20:53:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 -- start start 2024-09-10T20:53:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9644077ff0 0x7f964419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f96441a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96441193a0 con 0x7f9644077ff0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9644119220 con 0x7f96440776d0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f964ad74640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9644119520 con 0x7f96441139b0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39562/0 (socket says 172.21.15.67:39562) 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9644077ff0 0x7f964419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 -- 172.21.15.67:0/2261704534 learned_addr learned my addr 172.21.15.67:0/2261704534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9649311640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f96441a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 -- 172.21.15.67:0/2261704534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 msgr2=0x7f96441a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f96441a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 -- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9644077ff0 msgr2=0x7f964419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9644077ff0 0x7f964419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.180+0000 7f9648b10640 1 -- 172.21.15.67:0/2261704534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96441a5920 con 0x7f96440776d0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f9649311640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f96441a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f9648b10640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9634004770 tx=0x7f9634004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f9641ffb640 1 -- 172.21.15.67:0/2261704534 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963403f030 con 0x7f96440776d0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96441a5bb0 con 0x7f96440776d0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f9641ffb640 1 -- 172.21.15.67:0/2261704534 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9634003aa0 con 0x7f96440776d0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f9641ffb640 1 -- 172.21.15.67:0/2261704534 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634035070 con 0x7f96440776d0 2024-09-10T20:53:38.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.181+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96441ac2d0 con 0x7f96440776d0 2024-09-10T20:53:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.186+0000 7f964d149740 1 Processor -- start 2024-09-10T20:53:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.187+0000 7f9641ffb640 1 -- 172.21.15.67:0/2261704534 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f963403bc80 con 0x7f96440776d0 2024-09-10T20:53:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 -- start start 2024-09-10T20:53:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56004335aea0 con 0x5600433f09a0 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56004334a2d0 con 0x5600433e4a10 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f964d149740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56004334e0e0 con 0x5600433e40f0 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f9643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f9643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40986/0 (socket says 172.21.15.67:40986) 2024-09-10T20:53:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f9643fff640 1 -- 172.21.15.67:0/4276610125 learned_addr learned my addr 172.21.15.67:0/4276610125 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.188+0000 7f9648b10640 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 -- 172.21.15.67:0/4276610125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 msgr2=0x5600433e44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 -- 172.21.15.67:0/4276610125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 msgr2=0x5600433f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 -- 172.21.15.67:0/4276610125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600430a8650 con 0x5600433f09a0 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9643fff640 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f963c011470 tx=0x7f963c011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587e9c7d5eaed626 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f9641ffb640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 0x7f962c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.189+0000 7f962affd640 1 -- 172.21.15.67:0/4276610125 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c01e070 con 0x5600433f09a0 2024-09-10T20:53:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.190+0000 7f962affd640 1 -- 172.21.15.67:0/4276610125 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f963c003c30 con 0x5600433f09a0 2024-09-10T20:53:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.190+0000 7f962affd640 1 -- 172.21.15.67:0/4276610125 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c00f950 con 0x5600433f09a0 2024-09-10T20:53:38.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.190+0000 7f9641ffb640 1 -- 172.21.15.67:0/2261704534 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9634106290 con 0x7f96440776d0 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 -- 172.21.15.67:0/4276610125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 msgr2=0x5600433f2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f963c011470 tx=0x7f963c011930 comp rx=0 tx=0).stop 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f9649311640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 0x7f962c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 -- 172.21.15.67:0/4276610125 shutdown_connections 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433f09a0 0x5600433f2d90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 --2- 172.21.15.67:0/4276610125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433e44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.191+0000 7f964d149740 1 -- 172.21.15.67:0/4276610125 >> 172.21.15.67:0/4276610125 conn(0x5600433e1f20 msgr2=0x5600433e30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.192+0000 7f964d149740 1 -- 172.21.15.67:0/4276610125 shutdown_connections 2024-09-10T20:53:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.192+0000 7f9649311640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 0x7f962c0b78a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f964406c1a0 tx=0x7f9638009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.192+0000 7f964d149740 1 -- 172.21.15.67:0/4276610125 wait complete. 2024-09-10T20:53:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 -- start start 2024-09-10T20:53:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 Processor -- start 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433f0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433ed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433edbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5600431ab700 con 0x5600433e40f0 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5600432e5160 con 0x5600433e4a10 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600433f3620 con 0x5600433f09a0 2024-09-10T20:53:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.193+0000 7f964d149740 10 client.0 _ll_register_callbacks cb 0x5600432fe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9649311640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433edbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9649311640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433edbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51056/0 (socket says 172.21.15.67:51056) 2024-09-10T20:53:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9649311640 1 -- 172.21.15.67:0/2965127398 learned_addr learned my addr 172.21.15.67:0/2965127398 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9643fff640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 -- 172.21.15.67:0/2965127398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 msgr2=0x5600433edbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433edbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 -- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 msgr2=0x5600433ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.194+0000 7f9648b10640 1 -- 172.21.15.67:0/2965127398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560043312c90 con 0x5600433e40f0 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.195+0000 7f9648b10640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433f0210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5600433e2e00 tx=0x7f96340c9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8f9794ba14891a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.195+0000 7f9623fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.195+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96340cc370 con 0x5600433e40f0 2024-09-10T20:53:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.196+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9634109cb0 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.196+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f963c003c30 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.196+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f96340cc190 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.196+0000 7f964d149740 10 client.15609 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.196+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5600433fef30 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f963c003c30 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9634003c50 con 0x5600433e40f0 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 10 client.15609 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 20 client.15609 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560043400390 0x5600434027f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 4 client.15609 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56004335cdf0 con 0x560043400390 2024-09-10T20:53:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.197+0000 7f9643fff640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560043400390 0x5600434027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.198+0000 7f9643fff640 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560043400390 0x5600434027f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467ac3f531c452b6 server_cookie=af8c14b36d1897a5 in_seq=0 out_seq=0 2024-09-10T20:53:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.198+0000 7f9623fff640 10 client.15609 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.200+0000 7f9623fff640 1 -- 172.21.15.67:0/2965127398 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56004335cdf0 con 0x560043400390 2024-09-10T20:53:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.200+0000 7f9623fff640 10 client.15609 handle_command_reply: tid=0 2024-09-10T20:53:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.200+0000 7f964d149740 1 client.15609 shutdown 2024-09-10T20:53:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 msgr2=0x5600433f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433f0210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5600433e2e00 tx=0x7f96340c9070 comp rx=0 tx=0).stop 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 shutdown_connections 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560043400390 0x5600434027f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433edbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f9623fff640 0 client.15609 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 --2- 172.21.15.67:0/2965127398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433f0210 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 >> 172.21.15.67:0/2965127398 conn(0x5600433e1f20 msgr2=0x5600433e7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 shutdown_connections 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.201+0000 7f964d149740 1 -- 172.21.15.67:0/2965127398 wait complete. 2024-09-10T20:53:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.202+0000 7f964d149740 20 client.15609 trim_cache size 0 max 16384 2024-09-10T20:53:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 Processor -- start 2024-09-10T20:53:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 -- start start 2024-09-10T20:53:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f9648b10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f9648b10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41006/0 (socket says 172.21.15.67:41006) 2024-09-10T20:53:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f9648b10640 1 -- 172.21.15.67:0/2870403977 learned_addr learned my addr 172.21.15.67:0/2870403977 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b7240 con 0x5600433e40f0 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b4ae0 con 0x5600433e4a10 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.225+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b2930 con 0x5600433f09a0 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 -- 172.21.15.67:0/2870403977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 msgr2=0x5600433f1d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f1d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 -- 172.21.15.67:0/2870403977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 msgr2=0x5600433e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9649311640 1 -- 172.21.15.67:0/2870403977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600433f3670 con 0x5600433f09a0 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.226+0000 7f9648b10640 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:53:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.227+0000 7f9649311640 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433f22d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f96380117b0 tx=0x7f9638014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e0969b67fd2594f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.227+0000 7f962a7fc640 1 -- 172.21.15.67:0/2870403977 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638029640 con 0x5600433f09a0 2024-09-10T20:53:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.227+0000 7f962a7fc640 1 -- 172.21.15.67:0/2870403977 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638029c90 con 0x5600433f09a0 2024-09-10T20:53:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.227+0000 7f962a7fc640 1 -- 172.21.15.67:0/2870403977 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963801fbf0 con 0x5600433f09a0 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 msgr2=0x5600433f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433f22d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f96380117b0 tx=0x7f9638014000 comp rx=0 tx=0).stop 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 shutdown_connections 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433f09a0 0x5600433f22d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433e4a10 0x5600433f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 --2- 172.21.15.67:0/2870403977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e40f0 0x5600433e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 >> 172.21.15.67:0/2870403977 conn(0x5600433e1f20 msgr2=0x5600433ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 shutdown_connections 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.228+0000 7f964d149740 1 -- 172.21.15.67:0/2870403977 wait complete. 2024-09-10T20:53:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.229+0000 7f964d149740 1 -- start start 2024-09-10T20:53:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.229+0000 7f964d149740 1 Processor -- start 2024-09-10T20:53:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 0x5600433f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9648b10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9648b10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51068/0 (socket says 172.21.15.67:51068) 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9649311640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9649311640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39604/0 (socket says 172.21.15.67:39604) 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 0x5600433f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9643fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 0x5600433f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41008/0 (socket says 172.21.15.67:41008) 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f9648b10640 1 -- 172.21.15.67:0/2920103392 learned_addr learned my addr 172.21.15.67:0/2920103392 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b2fa0 con 0x5600433e4a10 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b4410 con 0x5600433f09a0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96441b3670 con 0x5600433e40f0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.230+0000 7f964d149740 10 client.0 _ll_register_callbacks cb 0x7f9634009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 -- 172.21.15.67:0/2920103392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 msgr2=0x5600433f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 -- 172.21.15.67:0/2920103392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 msgr2=0x5600433f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 0x5600433f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600433e29a0 con 0x5600433f09a0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9649311640 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9638012fd0 tx=0x7f9638005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84bcd691009ec2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.231+0000 7f9623fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963801fa80 con 0x5600433f09a0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f963801fc20 con 0x5600433f09a0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9638029c90 con 0x5600433f09a0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f963801fe60 con 0x5600433f09a0 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f964d149740 10 client.25268 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.232+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56004346df20 con 0x5600433f09a0 2024-09-10T20:53:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.233+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9638029c90 con 0x5600433f09a0 2024-09-10T20:53:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.233+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9638027020 con 0x5600433f09a0 2024-09-10T20:53:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 10 client.25268 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 20 client.25268 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56004346e580 0x5600434709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 4 client.25268 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600433588a0 con 0x56004346e580 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.234+0000 7f9648b10640 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56004346e580 0x5600434709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.235+0000 7f9648b10640 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56004346e580 0x5600434709a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d93c668433eedf1f server_cookie=8f7a506510814ae9 in_seq=0 out_seq=0 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.235+0000 7f9623fff640 10 client.25268 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.235+0000 7f9623fff640 1 -- 172.21.15.67:0/2920103392 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600433588a0 con 0x56004346e580 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.235+0000 7f9623fff640 10 client.25268 handle_command_reply: tid=0 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.235+0000 7f964d149740 1 client.25268 shutdown 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 msgr2=0x5600433f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9638012fd0 tx=0x7f9638005570 comp rx=0 tx=0).stop 2024-09-10T20:53:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 shutdown_connections 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56004346e580 0x5600434709a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600433f09a0 0x5600433f3e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600433e4a10 0x5600433f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 --2- 172.21.15.67:0/2920103392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600433e40f0 0x5600433f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 >> 172.21.15.67:0/2920103392 conn(0x5600433e1f20 msgr2=0x5600433ebee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f9623fff640 0 client.25268 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 shutdown_connections 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 1 -- 172.21.15.67:0/2920103392 wait complete. 2024-09-10T20:53:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.236+0000 7f964d149740 20 client.25268 trim_cache size 0 max 16384 2024-09-10T20:53:38.244 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.238+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 msgr2=0x7f962c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.238+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 0x7f962c0b78a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f964406c1a0 tx=0x7f9638009530 comp rx=0 tx=0).stop 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.238+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 msgr2=0x7f964419f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.238+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9634004770 tx=0x7f9634004270 comp rx=0 tx=0).stop 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 shutdown_connections 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f962c0b53e0 0x7f962c0b78a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96441139b0 0x7f96441a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9644077ff0 0x7f964419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 --2- 172.21.15.67:0/2261704534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96440776d0 0x7f964419f870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 >> 172.21.15.67:0/2261704534 conn(0x7f96441009f0 msgr2=0x7f9644102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 shutdown_connections 2024-09-10T20:53:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:38.239+0000 7f964ad74640 1 -- 172.21.15.67:0/2261704534 wait complete. 2024-09-10T20:53:38.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:38 smithi067 ceph-mon[30891]: pgmap v410: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 45 MiB/s wr, 1.05k op/s 2024-09-10T20:53:38.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:53:38.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:53:38.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:38 smithi172 ceph-mon[35265]: pgmap v410: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 45 MiB/s wr, 1.05k op/s 2024-09-10T20:53:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:53:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:53:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:38 smithi083 ceph-mon[35058]: pgmap v410: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 45 MiB/s wr, 1.05k op/s 2024-09-10T20:53:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:53:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:53:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:53:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 125.0 s, 3620.2 tps, lat 27.691 ms stddev 33.347 2024-09-10T20:53:40.342 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:53:40.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:53:40.447 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:40 smithi067 ceph-mon[30891]: pgmap v411: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 46 MiB/s wr, 879 op/s 2024-09-10T20:53:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:40 smithi172 ceph-mon[35265]: pgmap v411: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 46 MiB/s wr, 879 op/s 2024-09-10T20:53:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:40 smithi083 ceph-mon[35058]: pgmap v411: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 46 MiB/s wr, 879 op/s 2024-09-10T20:53:40.662 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:41.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.274+0000 7f5be1be1640 1 -- 172.21.15.67:0/2077887850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 msgr2=0x7f5bdc115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.274+0000 7f5be1be1640 1 --2- 172.21.15.67:0/2077887850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc115d70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009ca0 tx=0x7f5bd402a8b0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 -- 172.21.15.67:0/2077887850 shutdown_connections 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 --2- 172.21.15.67:0/2077887850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc115d70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 --2- 172.21.15.67:0/2077887850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 0x7f5bdc10efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 --2- 172.21.15.67:0/2077887850 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 0x7f5bdc1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 -- 172.21.15.67:0/2077887850 >> 172.21.15.67:0/2077887850 conn(0x7f5bdc078830 msgr2=0x7f5bdc07ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 -- 172.21.15.67:0/2077887850 shutdown_connections 2024-09-10T20:53:41.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.275+0000 7f5be1be1640 1 -- 172.21.15.67:0/2077887850 wait complete. 2024-09-10T20:53:41.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 Processor -- start 2024-09-10T20:53:41.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 -- start start 2024-09-10T20:53:41.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 0x7f5bdc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 0x7f5bdc19fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc119200 con 0x7f5bdc1091e0 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc119080 con 0x7f5bdc10f520 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be1be1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc119380 con 0x7f5bdc10eba0 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be13e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be13e0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39634/0 (socket says 172.21.15.67:39634) 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be13e0640 1 -- 172.21.15.67:0/1875148862 learned_addr learned my addr 172.21.15.67:0/1875148862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.276+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 0x7f5bdc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 0x7f5bdc19fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 -- 172.21.15.67:0/1875148862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 msgr2=0x7f5bdc19fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 0x7f5bdc19fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 -- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 msgr2=0x7f5bdc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 0x7f5bdc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 -- 172.21.15.67:0/1875148862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc1a5640 con 0x7f5bdc10f520 2024-09-10T20:53:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.277+0000 7f5be13e0640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005e30 tx=0x7f5bd4030dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.278+0000 7f5bd9ffb640 1 -- 172.21.15.67:0/1875148862 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4004040 con 0x7f5bdc10f520 2024-09-10T20:53:41.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.278+0000 7f5bd9ffb640 1 -- 172.21.15.67:0/1875148862 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd4040070 con 0x7f5bdc10f520 2024-09-10T20:53:41.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.278+0000 7f5bd9ffb640 1 -- 172.21.15.67:0/1875148862 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4045aa0 con 0x7f5bdc10f520 2024-09-10T20:53:41.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.278+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc1a58d0 con 0x7f5bdc10f520 2024-09-10T20:53:41.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.279+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc1abff0 con 0x7f5bdc10f520 2024-09-10T20:53:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.281+0000 7f5bd9ffb640 1 -- 172.21.15.67:0/1875148862 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5bd40041e0 con 0x7f5bdc10f520 2024-09-10T20:53:41.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 Processor -- start 2024-09-10T20:53:41.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 -- start start 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5dcf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5ddb9a0 0x564cf5dddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564cf5d45e60 con 0x564cf5ddb9a0 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564cf5d35290 con 0x564cf5dcf0f0 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.282+0000 7f5be5218740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cf5d390a0 con 0x564cf5dcfa10 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5bd9ffb640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 0x7f5bcc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51088/0 (socket says 172.21.15.67:51088) 2024-09-10T20:53:41.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1978723490 learned_addr learned my addr 172.21.15.67:0/1978723490 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5bd9ffb640 1 -- 172.21.15.67:0/1875148862 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5bd4106f90 con 0x7f5bdc10f520 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5ddb9a0 0x564cf5dddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.283+0000 7f5be13e0640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 0x7f5bcc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5dcf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1978723490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 msgr2=0x564cf5dcf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5dcf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1978723490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5ddb9a0 msgr2=0x564cf5dddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5ddb9a0 0x564cf5dddd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1978723490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf5a93930 con 0x564cf5dcfa10 2024-09-10T20:53:41.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be13e0640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 0x7f5bcc0b78d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40c9cf0 tx=0x7f5bd4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.284+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009d50 tx=0x7f5bd0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44b3f898743d32a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.285+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1978723490 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd001e070 con 0x564cf5dcfa10 2024-09-10T20:53:41.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.285+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1978723490 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd0019ae0 con 0x564cf5dcfa10 2024-09-10T20:53:41.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.285+0000 7f5bc6ffd640 1 -- 172.21.15.67:0/1978723490 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000ea80 con 0x564cf5dcfa10 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 -- 172.21.15.67:0/1978723490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 msgr2=0x564cf5ddb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009d50 tx=0x7f5bd0011810 comp rx=0 tx=0).stop 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 -- 172.21.15.67:0/1978723490 shutdown_connections 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5ddb9a0 0x564cf5dddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5dcfa10 0x564cf5ddb460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 --2- 172.21.15.67:0/1978723490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5dcf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 -- 172.21.15.67:0/1978723490 >> 172.21.15.67:0/1978723490 conn(0x564cf5dccf20 msgr2=0x564cf5dce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.286+0000 7f5be5218740 1 -- 172.21.15.67:0/1978723490 shutdown_connections 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.287+0000 7f5be5218740 1 -- 172.21.15.67:0/1978723490 wait complete. 2024-09-10T20:53:41.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.287+0000 7f5be5218740 1 -- start start 2024-09-10T20:53:41.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.287+0000 7f5be5218740 1 Processor -- start 2024-09-10T20:53:41.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5ddb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 0x564cf5dd8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564cf5b96890 con 0x564cf5dcfa10 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564cf5ccfd40 con 0x564cf5dcf0f0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cf5dde6f0 con 0x564cf5ddb9a0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be5218740 10 client.0 _ll_register_callbacks cb 0x564cf5d33c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5ddb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 0x564cf5dd8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 0x564cf5dd8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41038/0 (socket says 172.21.15.67:41038) 2024-09-10T20:53:41.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.288+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1947968148 learned_addr learned my addr 172.21.15.67:0/1947968148 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:41.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.289+0000 7f5bdbfff640 1 -- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 msgr2=0x564cf5ddb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.289+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5ddb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.289+0000 7f5bdbfff640 1 -- 172.21.15.67:0/1947968148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 msgr2=0x564cf5dd8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.289+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 0x564cf5dd8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.289+0000 7f5bdbfff640 1 -- 172.21.15.67:0/1947968148 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf5de7a50 con 0x564cf5ddb9a0 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.290+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd8ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc07afd0 tx=0x7f5bc8009670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=884de7e4c4314ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.290+0000 7f5bbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.290+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8011e80 con 0x564cf5ddb9a0 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.290+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5bc8005020 con 0x564cf5ddb9a0 2024-09-10T20:53:41.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.290+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd0019ae0 con 0x564cf5ddb9a0 2024-09-10T20:53:41.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.291+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bc8005220 con 0x564cf5ddb9a0 2024-09-10T20:53:41.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.291+0000 7f5be5218740 10 client.25267 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.291+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564cf5dea460 con 0x564cf5ddb9a0 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.291+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd0019ae0 con 0x564cf5ddb9a0 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5bc8021440 con 0x564cf5ddb9a0 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 10 client.25267 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 10 client.25267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 20 client.25267 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5dee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 4 client.25267 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cf5d47db0 con 0x564cf5debd70 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5dee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5bbbfff640 10 client.25267 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:41.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.292+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5dee1d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=362672295388f757 server_cookie=a3d17d7d0dc7f25c in_seq=0 out_seq=0 2024-09-10T20:53:41.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.293+0000 7f5bbbfff640 1 -- 172.21.15.67:0/1947968148 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564cf5d47db0 con 0x564cf5debd70 2024-09-10T20:53:41.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.293+0000 7f5bbbfff640 10 client.25267 handle_command_reply: tid=0 2024-09-10T20:53:41.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.293+0000 7f5be5218740 1 client.25267 shutdown 2024-09-10T20:53:41.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 msgr2=0x564cf5dd8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd8ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc07afd0 tx=0x7f5bc8009670 comp rx=0 tx=0).stop 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 shutdown_connections 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5dee1d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd8ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5bbbfff640 0 client.25267 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcfa10 0x564cf5dd8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 --2- 172.21.15.67:0/1947968148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcf0f0 0x564cf5ddb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.294+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 >> 172.21.15.67:0/1947968148 conn(0x564cf5dccf20 msgr2=0x564cf5dd2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.295+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 shutdown_connections 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.295+0000 7f5be5218740 1 -- 172.21.15.67:0/1947968148 wait complete. 2024-09-10T20:53:41.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.295+0000 7f5be5218740 20 client.25267 trim_cache size 0 max 16384 2024-09-10T20:53:41.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.331+0000 7f5be5218740 1 Processor -- start 2024-09-10T20:53:41.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.331+0000 7f5be5218740 1 -- start start 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.331+0000 7f5be5218740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5dd70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.331+0000 7f5be5218740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5dd7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.331+0000 7f5be5218740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be5218740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b6f00 con 0x564cf5dcf0f0 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be5218740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b47a0 con 0x564cf5dcfa10 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be5218740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b25f0 con 0x564cf5ddb9a0 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5dd70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5dd7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5dd70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41054/0 (socket says 172.21.15.67:41054) 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5bdbfff640 1 -- 172.21.15.67:0/1730796478 learned_addr learned my addr 172.21.15.67:0/1730796478 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1730796478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 msgr2=0x564cf5dd5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1730796478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 msgr2=0x564cf5dd70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5dd70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 -- 172.21.15.67:0/1730796478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf5dcd9a0 con 0x564cf5dcfa10 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.332+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5dd7620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e6a0 tx=0x7f5bd000e700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1feffe610a8bcf19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.333+0000 7f5bc67fc640 1 -- 172.21.15.67:0/1730796478 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd001e040 con 0x564cf5dcfa10 2024-09-10T20:53:41.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.333+0000 7f5bc67fc640 1 -- 172.21.15.67:0/1730796478 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd001f040 con 0x564cf5dcfa10 2024-09-10T20:53:41.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.333+0000 7f5bc67fc640 1 -- 172.21.15.67:0/1730796478 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00035f0 con 0x564cf5dcfa10 2024-09-10T20:53:41.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.334+0000 7f5be5218740 1 -- 172.21.15.67:0/1730796478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 msgr2=0x564cf5dd7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.334+0000 7f5be5218740 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5dd7620 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e6a0 tx=0x7f5bd000e700 comp rx=0 tx=0).stop 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 -- 172.21.15.67:0/1730796478 shutdown_connections 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dd5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5dd7620 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 --2- 172.21.15.67:0/1730796478 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5dd70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 -- 172.21.15.67:0/1730796478 >> 172.21.15.67:0/1730796478 conn(0x564cf5dccf20 msgr2=0x564cf5dd3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 -- 172.21.15.67:0/1730796478 shutdown_connections 2024-09-10T20:53:41.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.336+0000 7f5be5218740 1 -- 172.21.15.67:0/1730796478 wait complete. 2024-09-10T20:53:41.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.337+0000 7f5be5218740 1 -- start start 2024-09-10T20:53:41.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.337+0000 7f5be5218740 1 Processor -- start 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5de3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dde970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b2c60 con 0x564cf5dcf0f0 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b40d0 con 0x564cf5dcfa10 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1b3330 con 0x564cf5ddb9a0 2024-09-10T20:53:41.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be5218740 10 client.0 _ll_register_callbacks cb 0x7f5bc8009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:41.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be0bdf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:39670/0 (socket says 172.21.15.67:39670) 2024-09-10T20:53:41.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.338+0000 7f5be0bdf640 1 -- 172.21.15.67:0/2461881217 learned_addr learned my addr 172.21.15.67:0/2461881217 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:41.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 -- 172.21.15.67:0/2461881217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 msgr2=0x564cf5dde970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dde970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 -- 172.21.15.67:0/2461881217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 msgr2=0x564cf5de3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5de3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 -- 172.21.15.67:0/2461881217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf5ddf060 con 0x564cf5dcfa10 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5be0bdf640 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x564cf5dd9870 tx=0x7f5bd0009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f683bfe0ad60bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:41.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.339+0000 7f5bbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:53:41.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd001e070 con 0x564cf5dcfa10 2024-09-10T20:53:41.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5bd000e970 con 0x564cf5dcfa10 2024-09-10T20:53:41.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd001f040 con 0x564cf5dcfa10 2024-09-10T20:53:41.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5bd00050b0 con 0x564cf5dcfa10 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5be5218740 10 client.25286 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564cf5e596c0 con 0x564cf5dcfa10 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.340+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd001f040 con 0x564cf5dcfa10 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5bd0035030 con 0x564cf5dcfa10 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 10 client.25286 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 10 client.25286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 20 client.25286 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5e5bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 4 client.25286 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:53:41.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.341+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564cf5d43860 con 0x564cf5debd70 2024-09-10T20:53:41.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.343+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5e5bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:41.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.344+0000 7f5bbbfff640 10 client.25286 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:41.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.344+0000 7f5bdbfff640 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5e5bd00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df1576c177fccdc0 server_cookie=6d9961b6ab585aeb in_seq=0 out_seq=0 2024-09-10T20:53:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.345+0000 7f5bbbfff640 1 -- 172.21.15.67:0/2461881217 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564cf5d43860 con 0x564cf5debd70 2024-09-10T20:53:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.345+0000 7f5bbbfff640 10 client.25286 handle_command_reply: tid=0 2024-09-10T20:53:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.345+0000 7f5be5218740 1 client.25286 shutdown 2024-09-10T20:53:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.345+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 msgr2=0x564cf5de40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.345+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x564cf5dd9870 tx=0x7f5bd0009a20 comp rx=0 tx=0).stop 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 shutdown_connections 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cf5debd70 0x564cf5e5bd00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cf5ddb9a0 0x564cf5dde970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cf5dcfa10 0x564cf5de40e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 --2- 172.21.15.67:0/2461881217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cf5dcf0f0 0x564cf5de3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 >> 172.21.15.67:0/2461881217 conn(0x564cf5dccf20 msgr2=0x564cf5dd70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5bbbfff640 0 client.25286 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.346+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 shutdown_connections 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.347+0000 7f5be5218740 1 -- 172.21.15.67:0/2461881217 wait complete. 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.347+0000 7f5be5218740 20 client.25286 trim_cache size 0 max 16384 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "981f879a-3122-4d40-b6b6-eac2b02991bb", 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:53:41.352 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 msgr2=0x7f5bcc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 0x7f5bcc0b78d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40c9cf0 tx=0x7f5bd4031000 comp rx=0 tx=0).stop 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 msgr2=0x7f5bdc1a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4005e30 tx=0x7f5bd4030dc0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 shutdown_connections 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bdc10f520 0x7f5bdc1a4e70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5bcc0b5410 0x7f5bcc0b78d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bdc10eba0 0x7f5bdc19fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 --2- 172.21.15.67:0/1875148862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5bdc1091e0 0x7f5bdc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 >> 172.21.15.67:0/1875148862 conn(0x7f5bdc078830 msgr2=0x7f5bdc078c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 shutdown_connections 2024-09-10T20:53:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:41.348+0000 7f5be1be1640 1 -- 172.21.15.67:0/1875148862 wait complete. 2024-09-10T20:53:42.252 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:53:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: pgmap v412: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 50 MiB/s wr, 835 op/s 2024-09-10T20:53:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:53:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:53:42.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:53:42.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:53:42.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: pgmap v412: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 50 MiB/s wr, 835 op/s 2024-09-10T20:53:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:53:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: pgmap v412: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 50 MiB/s wr, 835 op/s 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:53:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:53:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:42.652 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 -- 172.21.15.67:0/4024783591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd41076a0 msgr2=0x7f0fd4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 --2- 172.21.15.67:0/4024783591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd41076a0 0x7f0fd4107ae0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009900 tx=0x7f0fbc02a3f0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 -- 172.21.15.67:0/4024783591 shutdown_connections 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 --2- 172.21.15.67:0/4024783591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 --2- 172.21.15.67:0/4024783591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd41076a0 0x7f0fd4107ae0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 --2- 172.21.15.67:0/4024783591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd4101c90 0x7f0fd4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 -- 172.21.15.67:0/4024783591 >> 172.21.15.67:0/4024783591 conn(0x7f0fd40fd700 msgr2=0x7f0fd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 -- 172.21.15.67:0/4024783591 shutdown_connections 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.228+0000 7f0fda341640 1 -- 172.21.15.67:0/4024783591 wait complete. 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 Processor -- start 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 -- start start 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd41076a0 0x7f0fd4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4111ce0 con 0x7f0fd4101c90 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4111b60 con 0x7f0fd4108020 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.229+0000 7f0fda341640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4111e60 con 0x7f0fd41076a0 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39854/0 (socket says 172.21.15.67:39854) 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 -- 172.21.15.67:0/4194363450 learned_addr learned my addr 172.21.15.67:0/4194363450 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd88de640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd41076a0 0x7f0fd4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 -- 172.21.15.67:0/4194363450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd41076a0 msgr2=0x7f0fd4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd41076a0 0x7f0fd4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 -- 172.21.15.67:0/4194363450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 msgr2=0x7f0fd419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 -- 172.21.15.67:0/4194363450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd419f400 con 0x7f0fd4101c90 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd88de640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.230+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c970 tx=0x7f0fc400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.231+0000 7f0fd1ffb640 1 -- 172.21.15.67:0/4194363450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4007bb0 con 0x7f0fd4101c90 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.231+0000 7f0fd1ffb640 1 -- 172.21.15.67:0/4194363450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fc4007d50 con 0x7f0fd4101c90 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.231+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd419f6f0 con 0x7f0fd4101c90 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.231+0000 7f0fd1ffb640 1 -- 172.21.15.67:0/4194363450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400f450 con 0x7f0fd4101c90 2024-09-10T20:53:43.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.231+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd40fdae0 con 0x7f0fd4101c90 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.234+0000 7f0fdc716740 1 Processor -- start 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 -- start start 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d818fd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fdda0 0x555d81912000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d81914930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555d81873e50 con 0x555d818fdda0 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555d81863280 con 0x555d81912540 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fdc716740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d81867090 con 0x555d818fd480 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fd88de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d818fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fd88de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d818fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:33648/0 (socket says 172.21.15.67:33648) 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fd88de640 1 -- 172.21.15.67:0/1145967889 learned_addr learned my addr 172.21.15.67:0/1145967889 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.235+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d81914930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 -- 172.21.15.67:0/1145967889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 msgr2=0x555d818fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d818fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 -- 172.21.15.67:0/1145967889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fdda0 msgr2=0x555d81912000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fdda0 0x555d81912000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 -- 172.21.15.67:0/1145967889 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d815c1650 con 0x555d81912540 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.236+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d81914930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009230 tx=0x7f0fbc032e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7209fd9913aa5672 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.237+0000 7f0fca7fc640 1 -- 172.21.15.67:0/1145967889 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc040070 con 0x555d81912540 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.237+0000 7f0fca7fc640 1 -- 172.21.15.67:0/1145967889 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fbc0316a0 con 0x555d81912540 2024-09-10T20:53:43.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.237+0000 7f0fca7fc640 1 -- 172.21.15.67:0/1145967889 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc035040 con 0x555d81912540 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 -- 172.21.15.67:0/1145967889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 msgr2=0x555d81914930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d81914930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009230 tx=0x7f0fbc032e60 comp rx=0 tx=0).stop 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 -- 172.21.15.67:0/1145967889 shutdown_connections 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d81914930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fdda0 0x555d81912000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1145967889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d818fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fdc716740 1 -- 172.21.15.67:0/1145967889 >> 172.21.15.67:0/1145967889 conn(0x555d818fb2b0 msgr2=0x555d818fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.238+0000 7f0fd1ffb640 1 -- 172.21.15.67:0/4194363450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0fc4004f20 con 0x7f0fd4101c90 2024-09-10T20:53:43.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.239+0000 7f0fd1ffb640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 0x7f0fc00b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.240+0000 7f0fd1ffb640 1 -- 172.21.15.67:0/4194363450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0fc40e5820 con 0x7f0fd4101c90 2024-09-10T20:53:43.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.240+0000 7f0fdc716740 1 -- 172.21.15.67:0/1145967889 shutdown_connections 2024-09-10T20:53:43.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.240+0000 7f0fdc716740 1 -- 172.21.15.67:0/1145967889 wait complete. 2024-09-10T20:53:43.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.240+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 0x7f0fc00b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fdc716740 1 -- start start 2024-09-10T20:53:43.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 0x7f0fc00b7730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc02a910 tx=0x7f0fbc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fdc716740 1 Processor -- start 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8190f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.241+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8190f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8190f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39866/0 (socket says 172.21.15.67:39866) 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fcbfff640 1 -- 172.21.15.67:0/1034649962 learned_addr learned my addr 172.21.15.67:0/1034649962 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555d816c4700 con 0x555d81912540 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555d817fe110 con 0x555d8190ff10 2024-09-10T20:53:43.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d81915160 con 0x555d818fd480 2024-09-10T20:53:43.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fdc716740 10 client.0 _ll_register_callbacks cb 0x555d81817990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:43.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd88de640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 -- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 msgr2=0x555d8191e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 -- 172.21.15.67:0/1034649962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 msgr2=0x555d8190f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8190f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.242+0000 7f0fd3fff640 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8182bc40 con 0x555d818fd480 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fbc0316a0 con 0x555d818fd480 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190f490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555d818fc190 tx=0x7f0fc40ab890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce4089f4a543623a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fb37fe640 10 client.25279 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:53:43.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fb37fe640 1 -- 172.21.15.67:0/1034649962 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc401d040 con 0x555d818fd480 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fb37fe640 1 -- 172.21.15.67:0/1034649962 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0fc40971a0 con 0x555d818fd480 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fb37fe640 1 -- 172.21.15.67:0/1034649962 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fc40973e0 con 0x555d818fd480 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fdc716740 10 client.25279 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.243+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=28}) -- 0x555d81920fb0 con 0x555d818fd480 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fb37fe640 1 -- 172.21.15.67:0/1034649962 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0fc40ab2c0 con 0x555d818fd480 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 10 client.25279 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 10 client.25279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 20 client.25279 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d819227e0 0x555d81924c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 4 client.25279 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d81875da0 con 0x555d819227e0 2024-09-10T20:53:43.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.244+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d819227e0 0x555d81924c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.245+0000 7f0fb37fe640 10 client.25279 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:43.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.245+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d819227e0 0x555d81924c30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a661d754297af223 server_cookie=9f8becafb892ea13 in_seq=0 out_seq=0 2024-09-10T20:53:43.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.245+0000 7f0fb37fe640 1 -- 172.21.15.67:0/1034649962 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d81875da0 con 0x555d819227e0 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.245+0000 7f0fb37fe640 10 client.25279 handle_command_reply: tid=0 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.246+0000 7f0fdc716740 1 client.25279 shutdown 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 msgr2=0x555d8190f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190f490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555d818fc190 tx=0x7f0fc40ab890 comp rx=0 tx=0).stop 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 shutdown_connections 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d819227e0 0x555d81924c30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8190f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 --2- 172.21.15.67:0/1034649962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190f490 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 >> 172.21.15.67:0/1034649962 conn(0x555d818fb2b0 msgr2=0x555d81900e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fb37fe640 0 client.25279 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 shutdown_connections 2024-09-10T20:53:43.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 1 -- 172.21.15.67:0/1034649962 wait complete. 2024-09-10T20:53:43.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.247+0000 7f0fdc716740 20 client.25279 trim_cache size 0 max 16384 2024-09-10T20:53:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 Processor -- start 2024-09-10T20:53:43.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 -- start start 2024-09-10T20:53:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8191e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aea10 con 0x555d81912540 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41ac2b0 con 0x555d8190ff10 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.280+0000 7f0fdc716740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aa100 con 0x555d818fd480 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fd3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fd3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:33666/0 (socket says 172.21.15.67:33666) 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fd3fff640 1 -- 172.21.15.67:0/2352871109 learned_addr learned my addr 172.21.15.67:0/2352871109 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fd88de640 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8191e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 -- 172.21.15.67:0/2352871109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 msgr2=0x555d8190cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 -- 172.21.15.67:0/2352871109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 msgr2=0x555d8191e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8191e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 -- 172.21.15.67:0/2352871109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d818fbf90 con 0x555d8190ff10 2024-09-10T20:53:43.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.281+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x555d81925470 tx=0x7f0fbc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4f7ccf6fdab069 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.282+0000 7f0fc9ffb640 1 -- 172.21.15.67:0/2352871109 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc040040 con 0x555d8190ff10 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.282+0000 7f0fc9ffb640 1 -- 172.21.15.67:0/2352871109 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fbc031cd0 con 0x555d8190ff10 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.282+0000 7f0fc9ffb640 1 -- 172.21.15.67:0/2352871109 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc05a860 con 0x555d8190ff10 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 -- 172.21.15.67:0/2352871109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 msgr2=0x555d8191e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x555d81925470 tx=0x7f0fbc009260 comp rx=0 tx=0).stop 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 -- 172.21.15.67:0/2352871109 shutdown_connections 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d81912540 0x555d8191e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d8190ff10 0x555d8191e390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 --2- 172.21.15.67:0/2352871109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d818fd480 0x555d8190cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 -- 172.21.15.67:0/2352871109 >> 172.21.15.67:0/2352871109 conn(0x555d818fb2b0 msgr2=0x555d81913510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 -- 172.21.15.67:0/2352871109 shutdown_connections 2024-09-10T20:53:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.283+0000 7f0fdc716740 1 -- 172.21.15.67:0/2352871109 wait complete. 2024-09-10T20:53:43.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.284+0000 7f0fdc716740 1 -- start start 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.284+0000 7f0fdc716740 1 Processor -- start 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 0x555d8191a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d8192a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aa770 con 0x555d818fd480 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41abbe0 con 0x555d81912540 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aae40 con 0x555d8190ff10 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.285+0000 7f0fdc716740 10 client.0 _ll_register_callbacks cb 0x7f0fc4007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:33680/0 (socket says 172.21.15.67:33680) 2024-09-10T20:53:43.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 -- 172.21.15.67:0/3958407049 learned_addr learned my addr 172.21.15.67:0/3958407049 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fd88de640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d8192a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 0x555d8191a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 -- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 msgr2=0x555d8192a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d8192a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 -- 172.21.15.67:0/3958407049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 msgr2=0x555d8191a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 0x555d8191a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 -- 172.21.15.67:0/3958407049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8192a980 con 0x555d8190ff10 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fd88de640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d8192a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:53:43.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 0x555d8191a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:53:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fcbfff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc031eb0 tx=0x7f0fbc031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5478f2c6cf335fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:53:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:53:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.286+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc040070 con 0x555d8190ff10 2024-09-10T20:53:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.287+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0fbc031ad0 con 0x555d8190ff10 2024-09-10T20:53:43.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.287+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fbc031cd0 con 0x555d8190ff10 2024-09-10T20:53:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.288+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0fbc005030 con 0x555d8190ff10 2024-09-10T20:53:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.288+0000 7f0fdc716740 10 client.25285 fetch_fsmap learned FSMap version 28 2024-09-10T20:53:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.288+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555d8198f500 con 0x555d8190ff10 2024-09-10T20:53:43.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fbc031cd0 con 0x555d8190ff10 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f0fbc0035f0 con 0x555d8190ff10 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 10 client.25285 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 10 client.25285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 20 client.25285 populate_metadata read hostname 'smithi067' 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d8198fbd0 0x555d81991ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 4 client.25285 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555d81871850 con 0x555d8198fbd0 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.289+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d8198fbd0 0x555d81991ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.290+0000 7f0fd3fff640 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d8198fbd0 0x555d81991ff0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f216974b09f6e723 server_cookie=7d82a12a203d1ec6 in_seq=0 out_seq=0 2024-09-10T20:53:43.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.290+0000 7f0fb37fe640 10 client.25285 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.290+0000 7f0fb37fe640 1 -- 172.21.15.67:0/3958407049 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x555d81871850 con 0x555d8198fbd0 2024-09-10T20:53:43.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.290+0000 7f0fb37fe640 10 client.25285 handle_command_reply: tid=0 2024-09-10T20:53:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.291+0000 7f0fdc716740 1 client.25285 shutdown 2024-09-10T20:53:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 msgr2=0x555d81929e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc031eb0 tx=0x7f0fbc031400 comp rx=0 tx=0).stop 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 shutdown_connections 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x555d8198fbd0 0x555d81991ff0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x555d81912540 0x555d8192a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d8190ff10 0x555d81929e80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.292+0000 7f0fdc716740 1 --2- 172.21.15.67:0/3958407049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x555d818fd480 0x555d8191a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.293+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 >> 172.21.15.67:0/3958407049 conn(0x555d818fb2b0 msgr2=0x555d81910ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.293+0000 7f0fb37fe640 0 client.25285 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.293+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 shutdown_connections 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.293+0000 7f0fdc716740 1 -- 172.21.15.67:0/3958407049 wait complete. 2024-09-10T20:53:43.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.293+0000 7f0fdc716740 20 client.25285 trim_cache size 0 max 16384 2024-09-10T20:53:43.300 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:53:43.300 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:53:43.300 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "981f879a-3122-4d40-b6b6-eac2b02991bb", 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:53:43.301 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:43.302 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:53:43.303 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 msgr2=0x7f0fc00b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 0x7f0fc00b7730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc02a910 tx=0x7f0fbc005fd0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 msgr2=0x7f0fd4199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c970 tx=0x7f0fc400ce30 comp rx=0 tx=0).stop 2024-09-10T20:53:43.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 shutdown_connections 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd4108020 0x7f0fd419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0fc00b5270 0x7f0fc00b7730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd41076a0 0x7f0fd4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 --2- 172.21.15.67:0/4194363450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fd4101c90 0x7f0fd4199350 secure :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c970 tx=0x7f0fc400ce30 comp rx=0 tx=0).stop 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.294+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 >> 172.21.15.67:0/4194363450 conn(0x7f0fd40fd700 msgr2=0x7f0fd406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.296+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 shutdown_connections 2024-09-10T20:53:43.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:53:43.296+0000 7f0fda341640 1 -- 172.21.15.67:0/4194363450 wait complete. 2024-09-10T20:53:43.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:43 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:43 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:43 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:53:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 130.0 s, 3131.6 tps, lat 31.940 ms stddev 53.235 2024-09-10T20:53:44.174 INFO:tasks.cephfs.filesystem:scrub status for tag:981f879a-3122-4d40-b6b6-eac2b02991bb - {'path': '/', 'tag': '981f879a-3122-4d40-b6b6-eac2b02991bb', 'options': 'recursive,force'} 2024-09-10T20:53:44.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:44 smithi067 ceph-mon[30891]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-09-10T20:53:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:44 smithi172 ceph-mon[35265]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-09-10T20:53:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:44 smithi083 ceph-mon[35058]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 53 MiB/s wr, 916 op/s 2024-09-10T20:53:46.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:46 smithi067 ceph-mon[30891]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 MiB/s wr, 792 op/s 2024-09-10T20:53:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:46 smithi083 ceph-mon[35058]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 MiB/s wr, 792 op/s 2024-09-10T20:53:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:46 smithi172 ceph-mon[35265]: pgmap v414: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 45 MiB/s wr, 792 op/s 2024-09-10T20:53:48.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:48 smithi067 ceph-mon[30891]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 MiB/s wr, 988 op/s 2024-09-10T20:53:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:48 smithi083 ceph-mon[35058]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 MiB/s wr, 988 op/s 2024-09-10T20:53:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:48 smithi172 ceph-mon[35265]: pgmap v415: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 MiB/s wr, 988 op/s 2024-09-10T20:53:49.038 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 135.0 s, 432.4 tps, lat 50.595 ms stddev 146.144 2024-09-10T20:53:50.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:50 smithi067 ceph-mon[30891]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 MiB/s wr, 1.00k op/s 2024-09-10T20:53:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:50 smithi083 ceph-mon[35058]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 MiB/s wr, 1.00k op/s 2024-09-10T20:53:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:50 smithi172 ceph-mon[35265]: pgmap v416: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 MiB/s wr, 1.00k op/s 2024-09-10T20:53:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:52 smithi067 ceph-mon[30891]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 MiB/s wr, 1.04k op/s 2024-09-10T20:53:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:52 smithi083 ceph-mon[35058]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 MiB/s wr, 1.04k op/s 2024-09-10T20:53:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:52 smithi172 ceph-mon[35265]: pgmap v417: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 MiB/s wr, 1.04k op/s 2024-09-10T20:53:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 140.0 s, 3686.4 tps, lat 48.252 ms stddev 331.424 2024-09-10T20:53:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:54 smithi067 ceph-mon[30891]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-10T20:53:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:54 smithi083 ceph-mon[35058]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-10T20:53:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:54 smithi172 ceph-mon[35265]: pgmap v418: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 56 MiB/s wr, 1.13k op/s 2024-09-10T20:53:56.501 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:56 smithi172 ceph-mon[35265]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 52 MiB/s wr, 1.09k op/s 2024-09-10T20:53:56.502 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:56.502 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:56.502 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:53:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:56 smithi067 ceph-mon[30891]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 52 MiB/s wr, 1.09k op/s 2024-09-10T20:53:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:56.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:53:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:56 smithi083 ceph-mon[35058]: pgmap v419: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 52 MiB/s wr, 1.09k op/s 2024-09-10T20:53:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:53:58.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:58 smithi067 ceph-mon[30891]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 48 MiB/s wr, 1.10k op/s 2024-09-10T20:53:58.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:53:58 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:58 smithi083 ceph-mon[35058]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 48 MiB/s wr, 1.10k op/s 2024-09-10T20:53:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:53:58 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:58 smithi172 ceph-mon[35265]: pgmap v420: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 48 MiB/s wr, 1.10k op/s 2024-09-10T20:53:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:53:58 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:53:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 145.0 s, 4337.8 tps, lat 23.140 ms stddev 24.478 2024-09-10T20:54:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:00 smithi067 ceph-mon[30891]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 879 op/s 2024-09-10T20:54:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:00 smithi083 ceph-mon[35058]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 879 op/s 2024-09-10T20:54:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:00 smithi172 ceph-mon[35265]: pgmap v421: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 34 MiB/s wr, 879 op/s 2024-09-10T20:54:02.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:02 smithi067 ceph-mon[30891]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 25 MiB/s wr, 763 op/s 2024-09-10T20:54:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:02 smithi083 ceph-mon[35058]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 25 MiB/s wr, 763 op/s 2024-09-10T20:54:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:02 smithi172 ceph-mon[35265]: pgmap v422: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 25 MiB/s wr, 763 op/s 2024-09-10T20:54:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 150.0 s, 4554.4 tps, lat 21.882 ms stddev 27.815 2024-09-10T20:54:04.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:04 smithi067 ceph-mon[30891]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 23 MiB/s wr, 893 op/s 2024-09-10T20:54:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:04 smithi083 ceph-mon[35058]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 23 MiB/s wr, 893 op/s 2024-09-10T20:54:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:04 smithi172 ceph-mon[35265]: pgmap v423: 97 pgs: 97 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 23 MiB/s wr, 893 op/s 2024-09-10T20:54:06.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:06 smithi067 ceph-mon[30891]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-10T20:54:06.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:06 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:06 smithi083 ceph-mon[35058]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-10T20:54:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:06 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:06 smithi172 ceph-mon[35265]: pgmap v424: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 835 op/s 2024-09-10T20:54:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:06 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:08 smithi067 ceph-mon[30891]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 881 op/s 2024-09-10T20:54:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:08 smithi083 ceph-mon[35058]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 881 op/s 2024-09-10T20:54:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:08 smithi172 ceph-mon[35265]: pgmap v425: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 881 op/s 2024-09-10T20:54:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 155.0 s, 4314.8 tps, lat 23.237 ms stddev 25.142 2024-09-10T20:54:10.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:10 smithi067 ceph-mon[30891]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-09-10T20:54:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:10 smithi083 ceph-mon[35058]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-09-10T20:54:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:10 smithi172 ceph-mon[35265]: pgmap v426: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 872 op/s 2024-09-10T20:54:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:12 smithi067 ceph-mon[30891]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 14 MiB/s wr, 851 op/s 2024-09-10T20:54:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:12 smithi083 ceph-mon[35058]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 14 MiB/s wr, 851 op/s 2024-09-10T20:54:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:12 smithi172 ceph-mon[35265]: pgmap v427: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 14 MiB/s wr, 851 op/s 2024-09-10T20:54:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 160.0 s, 3689.6 tps, lat 27.100 ms stddev 33.635 2024-09-10T20:54:14.175 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:54:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:14 smithi067 ceph-mon[30891]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 975 op/s 2024-09-10T20:54:14.613 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:14 smithi083 ceph-mon[35058]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 975 op/s 2024-09-10T20:54:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:14 smithi172 ceph-mon[35265]: pgmap v428: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 15 MiB/s wr, 975 op/s 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 -- 172.21.15.67:0/119886539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054106ed0 msgr2=0x7f4054107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 --2- 172.21.15.67:0/119886539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054106ed0 0x7f4054107320 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4048009900 tx=0x7f404802a410 comp rx=0 tx=0).stop 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 -- 172.21.15.67:0/119886539 shutdown_connections 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 --2- 172.21.15.67:0/119886539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054106ed0 0x7f4054107320 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 --2- 172.21.15.67:0/119886539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f4054106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 --2- 172.21.15.67:0/119886539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054101a90 0x7f4054101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 -- 172.21.15.67:0/119886539 >> 172.21.15.67:0/119886539 conn(0x7f40540fd700 msgr2=0x7f40540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 -- 172.21.15.67:0/119886539 shutdown_connections 2024-09-10T20:54:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.234+0000 7f405a1af640 1 -- 172.21.15.67:0/119886539 wait complete. 2024-09-10T20:54:15.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.235+0000 7f405a1af640 1 Processor -- start 2024-09-10T20:54:15.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 -- start start 2024-09-10T20:54:15.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054101a90 0x7f405419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f405419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4054119350 con 0x7f4054101a90 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f40541191d0 con 0x7f4054106ed0 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.236+0000 7f405a1af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40541194d0 con 0x7f40541023b0 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.237+0000 7f4053fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.237+0000 7f4053fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55844/0 (socket says 172.21.15.67:55844) 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.237+0000 7f4053fff640 1 -- 172.21.15.67:0/798625970 learned_addr learned my addr 172.21.15.67:0/798625970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.237+0000 7f4052ffd640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f405419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4052ffd640 1 -- 172.21.15.67:0/798625970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 msgr2=0x7f40541a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4052ffd640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4052ffd640 1 -- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054101a90 msgr2=0x7f405419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4052ffd640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054101a90 0x7f405419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4052ffd640 1 -- 172.21.15.67:0/798625970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40541a58f0 con 0x7f40541023b0 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.238+0000 7f4053fff640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.239+0000 7f4052ffd640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f405419fd80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f404400e770 tx=0x7f404400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.239+0000 7f4050ff9640 1 -- 172.21.15.67:0/798625970 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404400ccc0 con 0x7f40541023b0 2024-09-10T20:54:15.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.239+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40541a5be0 con 0x7f40541023b0 2024-09-10T20:54:15.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.240+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405406cb70 con 0x7f40541023b0 2024-09-10T20:54:15.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.240+0000 7f4050ff9640 1 -- 172.21.15.67:0/798625970 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f404400ee80 con 0x7f40541023b0 2024-09-10T20:54:15.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.241+0000 7f4050ff9640 1 -- 172.21.15.67:0/798625970 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044003e40 con 0x7f40541023b0 2024-09-10T20:54:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.245+0000 7f405c584740 1 Processor -- start 2024-09-10T20:54:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.246+0000 7f405c584740 1 -- start start 2024-09-10T20:54:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.246+0000 7f405c584740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c492860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.246+0000 7f405c584740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c49e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f405c584740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f405c584740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563d0c408e50 con 0x563d0c492da0 2024-09-10T20:54:15.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f405c584740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563d0c3f8280 con 0x563d0c492480 2024-09-10T20:54:15.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f405c584740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d0c3fc090 con 0x563d0c49ed30 2024-09-10T20:54:15.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f4050ff9640 1 -- 172.21.15.67:0/798625970 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4044003fe0 con 0x7f40541023b0 2024-09-10T20:54:15.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60582/0 (socket says 172.21.15.67:60582) 2024-09-10T20:54:15.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f4052ffd640 1 -- 172.21.15.67:0/3226241882 learned_addr learned my addr 172.21.15.67:0/3226241882 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:15.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.247+0000 7f40537fe640 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c49e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.248+0000 7f4052ffd640 1 -- 172.21.15.67:0/3226241882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 msgr2=0x563d0c492860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.248+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c492860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.248+0000 7f4052ffd640 1 -- 172.21.15.67:0/3226241882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 msgr2=0x563d0c49e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.248+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c49e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.248+0000 7f4052ffd640 1 -- 172.21.15.67:0/3226241882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d0c156650 con 0x563d0c49ed30 2024-09-10T20:54:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.249+0000 7f4050ff9640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 0x7f403c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.250+0000 7f4053fff640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 0x7f403c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.251+0000 7f4050ff9640 1 -- 172.21.15.67:0/798625970 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f40440e5d70 con 0x7f40541023b0 2024-09-10T20:54:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.251+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40440e9ca0 tx=0x7f40440ee750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c2b6f06fe8030b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.251+0000 7f4053fff640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 0x7f403c0b7880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40480096c0 tx=0x7f4048005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.252+0000 7f4039ffb640 1 -- 172.21.15.67:0/3226241882 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440a8b50 con 0x563d0c49ed30 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.252+0000 7f4039ffb640 1 -- 172.21.15.67:0/3226241882 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40440ac010 con 0x563d0c49ed30 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 -- 172.21.15.67:0/3226241882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 msgr2=0x563d0c4a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40440e9ca0 tx=0x7f40440ee750 comp rx=0 tx=0).stop 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 -- 172.21.15.67:0/3226241882 shutdown_connections 2024-09-10T20:54:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49ed30 0x563d0c4a1120 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40440e9ca0 tx=0x7f40440ee750 comp rx=0 tx=0).stop 2024-09-10T20:54:15.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c49e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 --2- 172.21.15.67:0/3226241882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c492860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.253+0000 7f405c584740 1 -- 172.21.15.67:0/3226241882 >> 172.21.15.67:0/3226241882 conn(0x563d0c4902b0 msgr2=0x563d0c491450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.256+0000 7f405c584740 1 -- 172.21.15.67:0/3226241882 shutdown_connections 2024-09-10T20:54:15.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.256+0000 7f405c584740 1 -- 172.21.15.67:0/3226241882 wait complete. 2024-09-10T20:54:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.257+0000 7f405c584740 1 -- start start 2024-09-10T20:54:15.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.257+0000 7f405c584740 1 Processor -- start 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c49bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c4aae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563d0c259700 con 0x563d0c492480 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563d0c393110 con 0x563d0c492da0 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d0c4a1a00 con 0x563d0c49c360 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f405c584740 10 client.0 _ll_register_callbacks cb 0x563d0c3ac990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f40537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f40537fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47540/0 (socket says 172.21.15.67:47540) 2024-09-10T20:54:15.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.258+0000 7f40537fe640 1 -- 172.21.15.67:0/3089118968 learned_addr learned my addr 172.21.15.67:0/3089118968 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 -- 172.21.15.67:0/3089118968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 msgr2=0x563d0c4aae10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c4aae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 -- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 msgr2=0x563d0c49bc70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c49bc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 -- 172.21.15.67:0/3089118968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d0c3c0c40 con 0x563d0c492480 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.259+0000 7f40537fe640 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f404c011810 tx=0x7f404c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e6c5a2b3d7f6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f4032ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:54:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c003e40 con 0x563d0c492480 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40440ac010 con 0x563d0c492480 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f404c004b20 con 0x563d0c492480 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f404c004d20 con 0x563d0c492480 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f405c584740 10 client.15651 fetch_fsmap learned FSMap version 30 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.261+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563d0c4bea40 con 0x563d0c492480 2024-09-10T20:54:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.262+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f404c00fdd0 con 0x563d0c492480 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f404c018070 con 0x563d0c492480 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 10 client.15651 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 20 client.15651 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c4c0350 0x563d0c4c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 4 client.15651 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.263+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f40440ac010 con 0x563d0c4c0350 2024-09-10T20:54:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.264+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c4c0350 0x563d0c4c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.271+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c4c0350 0x563d0c4c2810 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d6da8c97f4cefb server_cookie=9e05ee4136a4d112 in_seq=0 out_seq=0 2024-09-10T20:54:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.271+0000 7f4032ffd640 10 client.15651 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:15.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.272+0000 7f4032ffd640 1 -- 172.21.15.67:0/3089118968 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f40440ac010 con 0x563d0c4c0350 2024-09-10T20:54:15.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.272+0000 7f4032ffd640 10 client.15651 handle_command_reply: tid=0 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.272+0000 7f405c584740 1 client.15651 shutdown 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 msgr2=0x563d0c49e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f404c011810 tx=0x7f404c011cd0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 shutdown_connections 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c4c0350 0x563d0c4c2810 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c4aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c49bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 --2- 172.21.15.67:0/3089118968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492480 0x563d0c49e7e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 >> 172.21.15.67:0/3089118968 conn(0x563d0c4902b0 msgr2=0x563d0c495e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f4032ffd640 0 client.15651 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 shutdown_connections 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.273+0000 7f405c584740 1 -- 172.21.15.67:0/3089118968 wait complete. 2024-09-10T20:54:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.274+0000 7f405c584740 20 client.15651 trim_cache size 0 max 16384 2024-09-10T20:54:15.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 Processor -- start 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 -- start start 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c491370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c48fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c49a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4040010c60 con 0x563d0c492da0 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f404000e500 con 0x563d0c492480 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f405c584740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f404000c400 con 0x563d0c49c360 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f40537fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c491370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f40537fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c491370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55862/0 (socket says 172.21.15.67:55862) 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f40537fe640 1 -- 172.21.15.67:0/3967717785 learned_addr learned my addr 172.21.15.67:0/3967717785 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.308+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c48fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4053fff640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c49a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 -- 172.21.15.67:0/3967717785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 msgr2=0x563d0c49a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c49a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 -- 172.21.15.67:0/3967717785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 msgr2=0x563d0c491370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c491370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 -- 172.21.15.67:0/3967717785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d0c49bfe0 con 0x563d0c492da0 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4053fff640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c49a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:15.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.309+0000 7f4052ffd640 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c48fbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x563d0c4923f0 tx=0x7f4044010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87825711de3d7619 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.310+0000 7f40397fa640 1 -- 172.21.15.67:0/3967717785 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440abc70 con 0x563d0c492da0 2024-09-10T20:54:15.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.310+0000 7f40397fa640 1 -- 172.21.15.67:0/3967717785 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40440ac010 con 0x563d0c492da0 2024-09-10T20:54:15.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.310+0000 7f40397fa640 1 -- 172.21.15.67:0/3967717785 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440abe50 con 0x563d0c492da0 2024-09-10T20:54:15.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.311+0000 7f405c584740 1 -- 172.21.15.67:0/3967717785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 msgr2=0x563d0c48fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c48fbc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x563d0c4923f0 tx=0x7f4044010430 comp rx=0 tx=0).stop 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 -- 172.21.15.67:0/3967717785 shutdown_connections 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c49c360 0x563d0c49a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c492da0 0x563d0c48fbc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 --2- 172.21.15.67:0/3967717785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492480 0x563d0c491370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 -- 172.21.15.67:0/3967717785 >> 172.21.15.67:0/3967717785 conn(0x563d0c4902b0 msgr2=0x563d0c496e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 -- 172.21.15.67:0/3967717785 shutdown_connections 2024-09-10T20:54:15.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.312+0000 7f405c584740 1 -- 172.21.15.67:0/3967717785 wait complete. 2024-09-10T20:54:15.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.313+0000 7f405c584740 1 -- start start 2024-09-10T20:54:15.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.313+0000 7f405c584740 1 Processor -- start 2024-09-10T20:54:15.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.314+0000 7f405c584740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 0x563d0c4a73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.314+0000 7f405c584740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.314+0000 7f40537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 0x563d0c4a73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f40537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 0x563d0c4a73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60612/0 (socket says 172.21.15.67:60612) 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f4052ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55872/0 (socket says 172.21.15.67:55872) 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f40537fe640 1 -- 172.21.15.67:0/101087656 learned_addr learned my addr 172.21.15.67:0/101087656 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c49c360 0x563d0c4a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f404000c9c0 con 0x563d0c49c360 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f404000de30 con 0x563d0c492da0 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f4053fff640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c49c360 0x563d0c4a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.315+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f404000d090 con 0x563d0c492480 2024-09-10T20:54:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f405c584740 10 client.0 _ll_register_callbacks cb 0x7f404c009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 -- 172.21.15.67:0/101087656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 msgr2=0x563d0c4a73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 0x563d0c4a73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 -- 172.21.15.67:0/101087656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c49c360 msgr2=0x563d0c4a2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:15.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c49c360 0x563d0c4a2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d0c4a3480 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4052ffd640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x563d0c4bc800 tx=0x7f4044009670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1025af2df3897f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4032ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044097070 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f40440c72b0 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.316+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40440ac010 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.317+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f40440ac2d0 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.317+0000 7f405c584740 10 client.25316 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.317+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563d0c52d1c0 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40440acc00 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f40440b5ce0 con 0x563d0c492da0 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 10 client.25316 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 20 client.25316 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:15.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c52d3f0 0x563d0c52f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 4 client.25316 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:54:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f40440ac010 con 0x563d0c52d3f0 2024-09-10T20:54:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.318+0000 7f40537fe640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c52d3f0 0x563d0c52f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.319+0000 7f40537fe640 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c52d3f0 0x563d0c52f7e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3957e6a70e70df64 server_cookie=d9d789094370e930 in_seq=0 out_seq=0 2024-09-10T20:54:15.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.319+0000 7f4032ffd640 10 client.25316 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:15.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.320+0000 7f4032ffd640 1 -- 172.21.15.67:0/101087656 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x7f40440ac010 con 0x563d0c52d3f0 2024-09-10T20:54:15.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.320+0000 7f4032ffd640 10 client.25316 handle_command_reply: tid=0 2024-09-10T20:54:15.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.320+0000 7f405c584740 1 client.25316 shutdown 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 msgr2=0x563d0c4a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x563d0c4bc800 tx=0x7f4044009670 comp rx=0 tx=0).stop 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 shutdown_connections 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563d0c52d3f0 0x563d0c52f7e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563d0c49c360 0x563d0c4a2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563d0c492da0 0x563d0c4a2880 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 --2- 172.21.15.67:0/101087656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d0c492480 0x563d0c4a73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 >> 172.21.15.67:0/101087656 conn(0x563d0c4902b0 msgr2=0x563d0c496e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f4032ffd640 0 client.25316 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 shutdown_connections 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.321+0000 7f405c584740 1 -- 172.21.15.67:0/101087656 wait complete. 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.322+0000 7f405c584740 20 client.25316 trim_cache size 0 max 16384 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:15.327 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:54:15.328 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:54:15.329 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 msgr2=0x7f403c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 0x7f403c0b7880 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f40480096c0 tx=0x7f4048005b50 comp rx=0 tx=0).stop 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 msgr2=0x7f405419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f405419fd80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f404400e770 tx=0x7f404400ec30 comp rx=0 tx=0).stop 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 shutdown_connections 2024-09-10T20:54:15.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4054106ed0 0x7f40541a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f403c0b53c0 0x7f403c0b7880 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40541023b0 0x7f405419fd80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 --2- 172.21.15.67:0/798625970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4054101a90 0x7f405419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 >> 172.21.15.67:0/798625970 conn(0x7f40540fd700 msgr2=0x7f4054104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 shutdown_connections 2024-09-10T20:54:15.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:15.323+0000 7f405a1af640 1 -- 172.21.15.67:0/798625970 wait complete. 2024-09-10T20:54:16.179 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:54:16.180 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:54:16.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:16 smithi067 ceph-mon[30891]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T20:54:16.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:16 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:16.640 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:16 smithi083 ceph-mon[35058]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T20:54:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:16 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:16 smithi172 ceph-mon[35265]: pgmap v429: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T20:54:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:16 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.200+0000 7f66a3f1c640 1 -- 172.21.15.67:0/923926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c10f760 msgr2=0x7f669c115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:17.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.200+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/923926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c10f760 0x7f669c115f60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6694009be0 tx=0x7f669402a710 comp rx=0 tx=0).stop 2024-09-10T20:54:17.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.206+0000 7f66a3f1c640 1 -- 172.21.15.67:0/923926193 shutdown_connections 2024-09-10T20:54:17.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.206+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/923926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c10f760 0x7f669c115f60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.206+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/923926193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10ede0 0x7f669c10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.206+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/923926193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c1093d0 0x7f669c1097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.206+0000 7f66a3f1c640 1 -- 172.21.15.67:0/923926193 >> 172.21.15.67:0/923926193 conn(0x7f669c078a40 msgr2=0x7f669c07ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:17.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.207+0000 7f66a3f1c640 1 -- 172.21.15.67:0/923926193 shutdown_connections 2024-09-10T20:54:17.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.207+0000 7f66a3f1c640 1 -- 172.21.15.67:0/923926193 wait complete. 2024-09-10T20:54:17.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 Processor -- start 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 -- start start 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c1093d0 0x7f669c111d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10f760 0x7f669c19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f669c07e240 con 0x7f669c10ede0 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f669c07e0c0 con 0x7f669c1093d0 2024-09-10T20:54:17.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.208+0000 7f66a3f1c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f669c07e3c0 con 0x7f669c10f760 2024-09-10T20:54:17.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.209+0000 7f66a1cb8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c1093d0 0x7f669c111d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:17.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.209+0000 7f66a14b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:17.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.209+0000 7f66a14b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47580/0 (socket says 172.21.15.67:47580) 2024-09-10T20:54:17.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.209+0000 7f66a14b7640 1 -- 172.21.15.67:0/2603960345 learned_addr learned my addr 172.21.15.67:0/2603960345 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:17.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.209+0000 7f66a24b9640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10f760 0x7f669c19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.210+0000 7f66a14b7640 1 -- 172.21.15.67:0/2603960345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10f760 msgr2=0x7f669c19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.210+0000 7f66a14b7640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10f760 0x7f669c19ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.210+0000 7f66a14b7640 1 -- 172.21.15.67:0/2603960345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c1093d0 msgr2=0x7f669c111d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.210+0000 7f66a14b7640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c1093d0 0x7f669c111d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.210+0000 7f66a14b7640 1 -- 172.21.15.67:0/2603960345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c19d240 con 0x7f669c10ede0 2024-09-10T20:54:17.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.211+0000 7f66a14b7640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f668c01fa60 tx=0x7f668c01fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.214+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c01db90 con 0x7f669c10ede0 2024-09-10T20:54:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.214+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f668c01dd30 con 0x7f669c10ede0 2024-09-10T20:54:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.214+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c021440 con 0x7f669c10ede0 2024-09-10T20:54:17.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.214+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c19d530 con 0x7f669c10ede0 2024-09-10T20:54:17.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.214+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c06cb70 con 0x7f669c10ede0 2024-09-10T20:54:17.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.216+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669c1097b0 con 0x7f669c10ede0 2024-09-10T20:54:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.219+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f668c004f10 con 0x7f669c10ede0 2024-09-10T20:54:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.220+0000 7f6692ffd640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 0x7f66880b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.221+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f668c0f6e50 con 0x7f669c10ede0 2024-09-10T20:54:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.221+0000 7f66a1cb8640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 0x7f66880b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.222+0000 7f66a1cb8640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 0x7f66880b78e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6698009990 tx=0x7f6698009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:17.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.227+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f668c0bdce0 con 0x7f669c10ede0 2024-09-10T20:54:17.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.586+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f669c02e5c0 con 0x7f669c10ede0 2024-09-10T20:54:17.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.587+0000 7f6692ffd640 1 -- 172.21.15.67:0/2603960345 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11908 (secure 0 0 0) 0x7f668c0bd5e0 con 0x7f669c10ede0 2024-09-10T20:54:17.592 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:54:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":31,"btime":"2024-09-10T20:54:15:271247+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:54:14.560097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24608,24583,24581]},"id":1}]} 2024-09-10T20:54:17.593 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 31 2024-09-10T20:54:17.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 msgr2=0x7f66880b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 0x7f66880b78e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6698009990 tx=0x7f6698009110 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 msgr2=0x7f669c112280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f668c01fa60 tx=0x7f668c01fe60 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 shutdown_connections 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66880b5420 0x7f66880b78e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f669c10f760 0x7f669c19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f669c10ede0 0x7f669c112280 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 --2- 172.21.15.67:0/2603960345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f669c1093d0 0x7f669c111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 >> 172.21.15.67:0/2603960345 conn(0x7f669c078a40 msgr2=0x7f669c079310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 shutdown_connections 2024-09-10T20:54:17.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:17.591+0000 7f66a3f1c640 1 -- 172.21.15.67:0/2603960345 wait complete. 2024-09-10T20:54:18.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:54:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:18 smithi067 ceph-mon[30891]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 963 op/s 2024-09-10T20:54:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2603960345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:54:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:18 smithi083 ceph-mon[35058]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 963 op/s 2024-09-10T20:54:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:18 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2603960345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:54:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:18 smithi172 ceph-mon[35265]: pgmap v430: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 13 MiB/s wr, 963 op/s 2024-09-10T20:54:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:18 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2603960345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:54:18.818 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 165.0 s, 3965.8 tps, lat 25.111 ms stddev 30.116 2024-09-10T20:54:19.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 -- 172.21.15.67:0/4049665295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 msgr2=0x7f2170107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 --2- 172.21.15.67:0/4049665295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170107ae0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2160009900 tx=0x7f216002a410 comp rx=0 tx=0).stop 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 -- 172.21.15.67:0/4049665295 shutdown_connections 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 --2- 172.21.15.67:0/4049665295 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170108020 0x7f217010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 --2- 172.21.15.67:0/4049665295 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170107ae0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 --2- 172.21.15.67:0/4049665295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170101c90 0x7f2170102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.390+0000 7f21773f8640 1 -- 172.21.15.67:0/4049665295 >> 172.21.15.67:0/4049665295 conn(0x7f21700fd700 msgr2=0x7f21700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.391+0000 7f21773f8640 1 -- 172.21.15.67:0/4049665295 shutdown_connections 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.391+0000 7f21773f8640 1 -- 172.21.15.67:0/4049665295 wait complete. 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 Processor -- start 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 -- start start 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 0x7f217019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111cc0 con 0x7f2170101c90 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111b40 con 0x7f21701076a0 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f21773f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2170111e40 con 0x7f2170108020 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47586/0 (socket says 172.21.15.67:47586) 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f2175194640 1 -- 172.21.15.67:0/293800484 learned_addr learned my addr 172.21.15.67:0/293800484 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f2174993640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.392+0000 7f2175995640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 0x7f217019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 -- 172.21.15.67:0/293800484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 msgr2=0x7f217019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 0x7f217019da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 -- 172.21.15.67:0/293800484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 msgr2=0x7f2170198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 -- 172.21.15.67:0/293800484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217019e200 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2174993640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175995640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 0x7f217019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f2175194640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e9f0 tx=0x7f216c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f21667fc640 1 -- 172.21.15.67:0/293800484 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c00cd80 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f21667fc640 1 -- 172.21.15.67:0/293800484 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0108e0 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217019e4f0 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f21667fc640 1 -- 172.21.15.67:0/293800484 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c018980 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.393+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f217006ac80 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.396+0000 7f21667fc640 1 -- 172.21.15.67:0/293800484 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f216c010430 con 0x7f2170101c90 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.396+0000 7f21797cd740 1 Processor -- start 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.396+0000 7f21797cd740 1 -- start start 2024-09-10T20:54:19.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efdfb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe09d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5585efd71ea0 con 0x5585efdfba10 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5585efd612d0 con 0x5585efdfb0f0 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21797cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5585efd650e0 con 0x5585efe079a0 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21667fc640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 0x7f215c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47598/0 (socket says 172.21.15.67:47598) 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 -- 172.21.15.67:0/126155596 learned_addr learned my addr 172.21.15.67:0/126155596 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175995640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efdfb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2174993640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe09d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f21667fc640 1 -- 172.21.15.67:0/293800484 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f216c0e5fc0 con 0x7f2170101c90 2024-09-10T20:54:19.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175995640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 0x7f215c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 -- 172.21.15.67:0/126155596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 msgr2=0x5585efe09d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe09d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 -- 172.21.15.67:0/126155596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 msgr2=0x5585efdfb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efdfb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 -- 172.21.15.67:0/126155596 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585efabf650 con 0x5585efdfba10 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175995640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efdfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175194640 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f216c018460 tx=0x7f216c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5ceecf7f128e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.397+0000 7f2175995640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 0x7f215c0b7820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2168005c40 tx=0x7f2168009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f215b7fe640 1 -- 172.21.15.67:0/126155596 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ac260 con 0x5585efdfba10 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f215b7fe640 1 -- 172.21.15.67:0/126155596 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0a6e50 con 0x5585efdfba10 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f215b7fe640 1 -- 172.21.15.67:0/126155596 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0a89e0 con 0x5585efdfba10 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 -- 172.21.15.67:0/126155596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 msgr2=0x5585efe07460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f216c018460 tx=0x7f216c00cf20 comp rx=0 tx=0).stop 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 -- 172.21.15.67:0/126155596 shutdown_connections 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe09d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe07460 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 --2- 172.21.15.67:0/126155596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efdfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 -- 172.21.15.67:0/126155596 >> 172.21.15.67:0/126155596 conn(0x5585efdf8f20 msgr2=0x5585efdfa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.398+0000 7f21797cd740 1 -- 172.21.15.67:0/126155596 shutdown_connections 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 -- 172.21.15.67:0/126155596 wait complete. 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 -- start start 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 Processor -- start 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe04c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5585efbc2700 con 0x5585efdfb0f0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5585efcfc160 con 0x5585efe079a0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.399+0000 7f21797cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5585efe0a560 con 0x5585efdfba10 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f21797cd740 10 client.0 _ll_register_callbacks cb 0x5585efd159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47610/0 (socket says 172.21.15.67:47610) 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 -- 172.21.15.67:0/2161831263 learned_addr learned my addr 172.21.15.67:0/2161831263 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2174993640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175995640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe04c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 -- 172.21.15.67:0/2161831263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 msgr2=0x5585efe046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 -- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 msgr2=0x5585efe04c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe04c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 -- 172.21.15.67:0/2161831263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585efd29c90 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175995640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe04c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2175194640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f216c0a8d20 tx=0x7f216c0ac260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38428ee9d25fcaa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2158ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0acbb0 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f216c0b5850 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216c0a6e50 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.400+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f216c0ace50 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 10 client.15672 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585efe1a270 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0a6e50 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f216c0a80a0 con 0x5585efdfb0f0 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 10 client.15672 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 10 client.15672 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:54:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 20 client.15672 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe1b5c0 0x5585efe1d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 4 client.15672 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585efd73df0 con 0x5585efe1b5c0 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.401+0000 7f2174993640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe1b5c0 0x5585efe1d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f2174993640 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe1b5c0 0x5585efe1d9b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f731c30c6b3596cf server_cookie=14ce3603893fbe81 in_seq=0 out_seq=0 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f2158ff9640 10 client.15672 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f2158ff9640 1 -- 172.21.15.67:0/2161831263 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585efd73df0 con 0x5585efe1b5c0 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f2158ff9640 10 client.15672 handle_command_reply: tid=0 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f21797cd740 1 client.15672 shutdown 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 msgr2=0x5585efe07260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.402+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f216c0a8d20 tx=0x7f216c0ac260 comp rx=0 tx=0).stop 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 shutdown_connections 2024-09-10T20:54:19.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe1b5c0 0x5585efe1d9b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe04c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 --2- 172.21.15.67:0/2161831263 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efe07260 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 >> 172.21.15.67:0/2161831263 conn(0x5585efdf8f20 msgr2=0x5585efdfeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f2158ff9640 0 client.15672 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 shutdown_connections 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 1 -- 172.21.15.67:0/2161831263 wait complete. 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.403+0000 7f21797cd740 20 client.15672 trim_cache size 0 max 16384 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 Processor -- start 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 -- start start 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21701aea80 con 0x5585efdfb0f0 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f21701ac2f0 con 0x5585efe079a0 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f21797cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21701aa140 con 0x5585efdfba10 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f2175194640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47626/0 (socket says 172.21.15.67:47626) 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f2175194640 1 -- 172.21.15.67:0/927575721 learned_addr learned my addr 172.21.15.67:0/927575721 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f2174993640 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.416+0000 7f2175194640 1 -- 172.21.15.67:0/927575721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 msgr2=0x5585efe018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f2175194640 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f2175194640 1 -- 172.21.15.67:0/927575721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 msgr2=0x5585efe01e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f2175194640 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f2175194640 1 -- 172.21.15.67:0/927575721 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585efdf99a0 con 0x5585efdfb0f0 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f2175194640 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ac450 tx=0x7f216c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a574b5e28d97e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f215affd640 1 -- 172.21.15.67:0/927575721 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ace50 con 0x5585efdfb0f0 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f215affd640 1 -- 172.21.15.67:0/927575721 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0a6e50 con 0x5585efdfb0f0 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f215affd640 1 -- 172.21.15.67:0/927575721 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ab420 con 0x5585efdfb0f0 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f21797cd740 1 -- 172.21.15.67:0/927575721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 msgr2=0x5585efdf40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.417+0000 7f21797cd740 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ac450 tx=0x7f216c00cf20 comp rx=0 tx=0).stop 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- 172.21.15.67:0/927575721 shutdown_connections 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efe079a0 0x5585efe01e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efdfba10 0x5585efe018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- 172.21.15.67:0/927575721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfb0f0 0x5585efdf40b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- 172.21.15.67:0/927575721 >> 172.21.15.67:0/927575721 conn(0x5585efdf8f20 msgr2=0x5585efdf9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- 172.21.15.67:0/927575721 shutdown_connections 2024-09-10T20:54:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- 172.21.15.67:0/927575721 wait complete. 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- start start 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 Processor -- start 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f21701aa7b0 con 0x5585efdfba10 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f21701abc20 con 0x5585efdfb0f0 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21701aae80 con 0x5585efe079a0 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.418+0000 7f21797cd740 10 client.0 _ll_register_callbacks cb 0x7f216c0e3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2174993640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55946/0 (socket says 172.21.15.67:55946) 2024-09-10T20:54:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 -- 172.21.15.67:0/557657017 learned_addr learned my addr 172.21.15.67:0/557657017 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175995640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe1eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2174993640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47636/0 (socket says 172.21.15.67:47636) 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 -- 172.21.15.67:0/557657017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 msgr2=0x5585efe1eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe1eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 -- 172.21.15.67:0/557657017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 msgr2=0x5585efe1e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 -- 172.21.15.67:0/557657017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585efe87130 con 0x5585efdfb0f0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2174993640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2175194640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f216c0a8d20 tx=0x7f216c018db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5278083ac2e9ed3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2158ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ace50 con 0x5585efdfb0f0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f216c0b5850 con 0x5585efdfb0f0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.419+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216c0a6e50 con 0x5585efdfb0f0 2024-09-10T20:54:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f216c0ac750 con 0x5585efdfb0f0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 10 client.25334 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5585efe87130 con 0x5585efdfb0f0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f216c0a6e50 con 0x5585efdfb0f0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f216c0cfaa0 con 0x5585efdfb0f0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 10 client.25334 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 10 client.25334 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 20 client.25334 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe88660 0x5585efe8aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 4 client.25334 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585efd6f8a0 con 0x5585efe88660 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.420+0000 7f2174993640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe88660 0x5585efe8aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f2174993640 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe88660 0x5585efe8aa80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f624ef390d1b2018 server_cookie=57025d2b5c5d90ec in_seq=0 out_seq=0 2024-09-10T20:54:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f2158ff9640 10 client.25334 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f2158ff9640 1 -- 172.21.15.67:0/557657017 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585efd6f8a0 con 0x5585efe88660 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f2158ff9640 10 client.25334 handle_command_reply: tid=0 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 client.25334 shutdown 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 msgr2=0x5585efe20f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f216c0a8d20 tx=0x7f216c018db0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 shutdown_connections 2024-09-10T20:54:19.633 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5585efe88660 0x5585efe8aa80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585efe079a0 0x5585efe1eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5585efdfba10 0x5585efe1e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f2158ff9640 0 client.25334 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 --2- 172.21.15.67:0/557657017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5585efdfb0f0 0x5585efe20f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 >> 172.21.15.67:0/557657017 conn(0x5585efdf8f20 msgr2=0x5585efe05ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 shutdown_connections 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 1 -- 172.21.15.67:0/557657017 wait complete. 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.421+0000 7f21797cd740 20 client.25334 trim_cache size 0 max 16384 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 msgr2=0x7f215c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 0x7f215c0b7820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2168005c40 tx=0x7f2168009500 comp rx=0 tx=0).stop 2024-09-10T20:54:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 msgr2=0x7f2170198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f216c00e9f0 tx=0x7f216c00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 shutdown_connections 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f215c0b5360 0x7f215c0b7820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2170108020 0x7f217019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21701076a0 0x7f2170198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 --2- 172.21.15.67:0/293800484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2170101c90 0x7f2170198150 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 >> 172.21.15.67:0/293800484 conn(0x7f21700fd700 msgr2=0x7f21700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 shutdown_connections 2024-09-10T20:54:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:19.422+0000 7f21773f8640 1 -- 172.21.15.67:0/293800484 wait complete. 2024-09-10T20:54:20.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:20 smithi067 ceph-mon[30891]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-10T20:54:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:20 smithi083 ceph-mon[35058]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-10T20:54:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:20 smithi172 ceph-mon[35265]: pgmap v431: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-09-10T20:54:20.766 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:54:21.194 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:21.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.750+0000 7fcafca9c640 1 -- 172.21.15.67:0/603942690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 msgr2=0x7fcaf8115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 --2- 172.21.15.67:0/603942690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf8115f60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009ca0 tx=0x7fcaf002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 -- 172.21.15.67:0/603942690 shutdown_connections 2024-09-10T20:54:21.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 --2- 172.21.15.67:0/603942690 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf8115f60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 --2- 172.21.15.67:0/603942690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf810ede0 0x7fcaf810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 --2- 172.21.15.67:0/603942690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf81093d0 0x7fcaf81097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.751+0000 7fcafca9c640 1 -- 172.21.15.67:0/603942690 >> 172.21.15.67:0/603942690 conn(0x7fcaf8078a40 msgr2=0x7fcaf807ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.752+0000 7fcafca9c640 1 -- 172.21.15.67:0/603942690 shutdown_connections 2024-09-10T20:54:21.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.752+0000 7fcafca9c640 1 -- 172.21.15.67:0/603942690 wait complete. 2024-09-10T20:54:21.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.753+0000 7fcafca9c640 1 Processor -- start 2024-09-10T20:54:21.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.753+0000 7fcafca9c640 1 -- start start 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.753+0000 7fcafca9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 0x7fcaf819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcafca9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcafca9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf81a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcafca9c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8119390 con 0x7fcaf810f760 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcafca9c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8119210 con 0x7fcaf81093d0 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcaf5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcaf5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60702/0 (socket says 172.21.15.67:60702) 2024-09-10T20:54:21.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2810480257 learned_addr learned my addr 172.21.15.67:0/2810480257 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:21.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8119510 con 0x7fcaf810ede0 2024-09-10T20:54:21.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf81a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.754+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 0x7fcaf819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2810480257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 msgr2=0x7fcaf819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 0x7fcaf819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 msgr2=0x7fcaf81a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf81a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2810480257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf81a58b0 con 0x7fcaf810ede0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 0x7fcaf819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaef7fe640 1 -- 172.21.15.67:0/2810480257 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cd80 con 0x7fcaf810ede0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaef7fe640 1 -- 172.21.15.67:0/2810480257 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcae00108e0 con 0x7fcaf810ede0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.755+0000 7fcaef7fe640 1 -- 172.21.15.67:0/2810480257 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0018880 con 0x7fcaf810ede0 2024-09-10T20:54:21.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.756+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf81a5ba0 con 0x7fcaf810ede0 2024-09-10T20:54:21.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.756+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf81ac260 con 0x7fcaf810ede0 2024-09-10T20:54:21.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.760+0000 7fcafee71740 1 Processor -- start 2024-09-10T20:54:21.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.761+0000 7fcaef7fe640 1 -- 172.21.15.67:0/2810480257 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcae0010430 con 0x7fcaf810ede0 2024-09-10T20:54:21.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.761+0000 7fcafee71740 1 -- start start 2024-09-10T20:54:21.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfbe08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560cbfb56ea0 con 0x560cbfbe04d0 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560cbfb462d0 con 0x560cbfbe0df0 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcafee71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560cbfb4a0e0 con 0x560cbfbecd80 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfbe08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcaf659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcaf659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55970/0 (socket says 172.21.15.67:55970) 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcaf659c640 1 -- 172.21.15.67:0/3652347155 learned_addr learned my addr 172.21.15.67:0/3652347155 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:21.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.762+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 -- 172.21.15.67:0/3652347155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 msgr2=0x560cbfbef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 -- 172.21.15.67:0/3652347155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 msgr2=0x560cbfbe08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfbe08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 -- 172.21.15.67:0/3652347155 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cbf8a4650 con 0x560cbfbe0df0 2024-09-10T20:54:21.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfbe08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009d50 tx=0x7fcae80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0b0c5ae086f475 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaecff9640 1 -- 172.21.15.67:0/3652347155 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8012650 con 0x560cbfbe0df0 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.763+0000 7fcaef7fe640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 0x7fcae40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.764+0000 7fcaecff9640 1 -- 172.21.15.67:0/3652347155 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcae8009e40 con 0x560cbfbe0df0 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.764+0000 7fcaecff9640 1 -- 172.21.15.67:0/3652347155 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae800fbf0 con 0x560cbfbe0df0 2024-09-10T20:54:21.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.764+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 0x7fcae40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.764+0000 7fcaef7fe640 1 -- 172.21.15.67:0/2810480257 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcae00e6180 con 0x7fcaf810ede0 2024-09-10T20:54:21.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 -- 172.21.15.67:0/3652347155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 msgr2=0x560cbfbec840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009d50 tx=0x7fcae80117b0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 -- 172.21.15.67:0/3652347155 shutdown_connections 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfbec840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 --2- 172.21.15.67:0/3652347155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfbe08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 0x7fcae40b7860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005e30 tx=0x7fcaf002adc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 -- 172.21.15.67:0/3652347155 >> 172.21.15.67:0/3652347155 conn(0x560cbfbde300 msgr2=0x560cbfbdf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 -- 172.21.15.67:0/3652347155 shutdown_connections 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.765+0000 7fcafee71740 1 -- 172.21.15.67:0/3652347155 wait complete. 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 -- start start 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 Processor -- start 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbe9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560cbf9a7700 con 0x560cbfbe0df0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560cbfae1160 con 0x560cbfbe04d0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560cbfc00a10 con 0x560cbfbecd80 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.766+0000 7fcafee71740 10 client.0 _ll_register_callbacks cb 0x560cbfafa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbe9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60728/0 (socket says 172.21.15.67:60728) 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3339491696 learned_addr learned my addr 172.21.15.67:0/3339491696 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3339491696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 msgr2=0x560cbfbec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbec650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3339491696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 msgr2=0x560cbfbe9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbe9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.767+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3339491696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cbfb0ec90 con 0x560cbfbecd80 2024-09-10T20:54:21.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.769+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0035000 tx=0x7fcaf002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49babd8c5efb0257 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.769+0000 7fcaddffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.769+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf002f610 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.769+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cbfb58df0 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.769+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcaf002f7b0 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcaf002f9b0 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 10 client.25333 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560cbfc0c320 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560cbfb58df0 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fcaf0051070 con 0x560cbfbecd80 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 10 client.25333 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 10 client.25333 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 20 client.25333 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:21.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc0da90 0x560cbfc0ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 4 client.25333 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:21.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.770+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cbfb548a0 con 0x560cbfc0da90 2024-09-10T20:54:21.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.772+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc0da90 0x560cbfc0ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc0da90 0x560cbfc0ff10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1306f25d0e07fb0d server_cookie=e0a156977df646d8 in_seq=0 out_seq=0 2024-09-10T20:54:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcaddffb640 10 client.25333 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:54:21.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcaddffb640 1 -- 172.21.15.67:0/3339491696 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560cbfb548a0 con 0x560cbfc0da90 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcaddffb640 10 client.25333 handle_command_reply: tid=0 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcafee71740 1 client.25333 shutdown 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.773+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 msgr2=0x560cbfbea080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0035000 tx=0x7fcaf002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 shutdown_connections 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc0da90 0x560cbfc0ff10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbea080 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbe9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 --2- 172.21.15.67:0/3339491696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.774+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 >> 172.21.15.67:0/3339491696 conn(0x560cbfbde300 msgr2=0x560cbfbe3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.775+0000 7fcaddffb640 0 client.25333 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:54:21.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.775+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 shutdown_connections 2024-09-10T20:54:21.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.775+0000 7fcafee71740 1 -- 172.21.15.67:0/3339491696 wait complete. 2024-09-10T20:54:21.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.776+0000 7fcafee71740 20 client.25333 trim_cache size 0 max 16384 2024-09-10T20:54:21.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.799+0000 7fcafee71740 1 Processor -- start 2024-09-10T20:54:21.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.799+0000 7fcafee71740 1 -- start start 2024-09-10T20:54:21.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbdf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbddc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81aea10 con 0x560cbfbe0df0 2024-09-10T20:54:21.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8084000 con 0x560cbfbe04d0 2024-09-10T20:54:21.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcafee71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8081e50 con 0x560cbfbecd80 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60742/0 (socket says 172.21.15.67:60742) 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3413721886 learned_addr learned my addr 172.21.15.67:0/3413721886 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.800+0000 7fcaf659c640 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbdf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3413721886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 msgr2=0x560cbfbdf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbdf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3413721886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 msgr2=0x560cbfbddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbddc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/3413721886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cbfbec9c0 con 0x560cbfbecd80 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcaf6d9d640 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0030e70 tx=0x7fcaf00099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5977fb14c22bb571 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.801+0000 7fcadffff640 1 -- 172.21.15.67:0/3413721886 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf002f610 con 0x560cbfbecd80 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.802+0000 7fcadffff640 1 -- 172.21.15.67:0/3413721886 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf0036040 con 0x560cbfbecd80 2024-09-10T20:54:21.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.802+0000 7fcadffff640 1 -- 172.21.15.67:0/3413721886 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00308d0 con 0x560cbfbecd80 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 -- 172.21.15.67:0/3413721886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 msgr2=0x560cbfbee170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0030e70 tx=0x7fcaf00099a0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 -- 172.21.15.67:0/3413721886 shutdown_connections 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfbee170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe0df0 0x560cbfbddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 --2- 172.21.15.67:0/3413721886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe04d0 0x560cbfbdf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 -- 172.21.15.67:0/3413721886 >> 172.21.15.67:0/3413721886 conn(0x560cbfbde300 msgr2=0x560cbfbdf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 -- 172.21.15.67:0/3413721886 shutdown_connections 2024-09-10T20:54:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.803+0000 7fcafee71740 1 -- 172.21.15.67:0/3413721886 wait complete. 2024-09-10T20:54:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.804+0000 7fcafee71740 1 -- start start 2024-09-10T20:54:21.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.804+0000 7fcafee71740 1 Processor -- start 2024-09-10T20:54:21.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.804+0000 7fcafee71740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfc05cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfc061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfc00c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80824c0 con 0x560cbfbe04d0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8083930 con 0x560cbfbe0df0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf8082b90 con 0x560cbfbecd80 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcafee71740 10 client.0 _ll_register_callbacks cb 0x7fcae8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfc00c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfc00c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60758/0 (socket says 172.21.15.67:60758) 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf6d9d640 1 -- 172.21.15.67:0/2622478382 learned_addr learned my addr 172.21.15.67:0/2622478382 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfc05cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfc061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 msgr2=0x560cbfc00c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfc00c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2622478382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 msgr2=0x560cbfc05cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfc05cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.805+0000 7fcaf5d9b640 1 -- 172.21.15.67:0/2622478382 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cbfc011f0 con 0x560cbfbe0df0 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.806+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfc05cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.806+0000 7fcaf5d9b640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfc061f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000c00 tx=0x7fcae00a88a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35609844dbd80cff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.806+0000 7fcaddffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.806+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae00a8080 con 0x560cbfbe0df0 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.806+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcae00e96f0 con 0x560cbfbe0df0 2024-09-10T20:54:21.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.807+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0036040 con 0x560cbfbe0df0 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.807+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcae00ac420 con 0x560cbfbe0df0 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.807+0000 7fcafee71740 10 client.25352 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.807+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560cbfc7b280 con 0x560cbfbe0df0 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcae00ad010 con 0x560cbfbe0df0 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fcae00cf040 con 0x560cbfbe0df0 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 10 client.25352 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 10 client.25352 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:54:21.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 20 client.25352 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:21.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc7ba10 0x560cbfc7de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:21.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 4 client.25352 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:54:21.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.808+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcaf0036040 con 0x560cbfc7ba10 2024-09-10T20:54:21.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.809+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc7ba10 0x560cbfc7de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:21.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.809+0000 7fcaf659c640 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc7ba10 0x560cbfc7de30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85fdea01aa26bdeb server_cookie=82ea3e073575d4da in_seq=0 out_seq=0 2024-09-10T20:54:21.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcaddffb640 10 client.25352 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:54:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcaddffb640 1 -- 172.21.15.67:0/2622478382 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcaf0036040 con 0x560cbfc7ba10 2024-09-10T20:54:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcaddffb640 10 client.25352 handle_command_reply: tid=0 2024-09-10T20:54:21.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcafee71740 1 client.25352 shutdown 2024-09-10T20:54:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 msgr2=0x560cbfc061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.810+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfc061f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000c00 tx=0x7fcae00a88a0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 shutdown_connections 2024-09-10T20:54:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560cbfc7ba10 0x560cbfc7de30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560cbfbecd80 0x560cbfc00c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560cbfbe0df0 0x560cbfc061f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 --2- 172.21.15.67:0/2622478382 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560cbfbe04d0 0x560cbfc05cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 >> 172.21.15.67:0/2622478382 conn(0x560cbfbde300 msgr2=0x560cbfbeb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcaddffb640 0 client.25352 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 shutdown_connections 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 1 -- 172.21.15.67:0/2622478382 wait complete. 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.811+0000 7fcafee71740 20 client.25352 trim_cache size 0 max 16384 2024-09-10T20:54:21.819 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:54:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.812+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 msgr2=0x7fcae40b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.812+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 0x7fcae40b7860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005e30 tx=0x7fcaf002adc0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.812+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 msgr2=0x7fcaf819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.812+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9f0 tx=0x7fcae000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 shutdown_connections 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcaf810f760 0x7fcaf81a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcae40b53a0 0x7fcae40b7860 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf810ede0 0x7fcaf819fd40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 --2- 172.21.15.67:0/2810480257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcaf81093d0 0x7fcaf819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 >> 172.21.15.67:0/2810480257 conn(0x7fcaf8078a40 msgr2=0x7fcaf807ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 shutdown_connections 2024-09-10T20:54:21.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:21.814+0000 7fcafca9c640 1 -- 172.21.15.67:0/2810480257 wait complete. 2024-09-10T20:54:22.598 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:22 smithi067 ceph-mon[30891]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 799 op/s 2024-09-10T20:54:22.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:54:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:22 smithi083 ceph-mon[35058]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 799 op/s 2024-09-10T20:54:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:22 smithi172 ceph-mon[35265]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 799 op/s 2024-09-10T20:54:23.052 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3957274053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b88115a10 msgr2=0x7f1b88117e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3957274053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b88115a10 0x7f1b88117e00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009ca0 tx=0x7f1b8002a950 comp rx=0 tx=0).stop 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3957274053 shutdown_connections 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3957274053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b88115a10 0x7f1b88117e00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3957274053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3957274053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b8810a150 0x7f1b8810a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3957274053 >> 172.21.15.67:0/3957274053 conn(0x7f1b8806dfc0 msgr2=0x7f1b8806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.617+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3957274053 shutdown_connections 2024-09-10T20:54:23.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.618+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3957274053 wait complete. 2024-09-10T20:54:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.618+0000 7f1b8ef5a640 1 Processor -- start 2024-09-10T20:54:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.619+0000 7f1b8ef5a640 1 -- start start 2024-09-10T20:54:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.619+0000 7f1b8ef5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8810a150 0x7f1b881a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.619+0000 7f1b8ef5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b8ef5a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b88115a10 0x7f1b881a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b8ef5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8811b590 con 0x7f1b8810a150 2024-09-10T20:54:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56268/0 (socket says 172.21.15.67:56268) 2024-09-10T20:54:23.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b87fff640 1 -- 172.21.15.67:0/3884129431 learned_addr learned my addr 172.21.15.67:0/3884129431 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8811b410 con 0x7f1b88115a10 2024-09-10T20:54:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.620+0000 7f1b8d4f7640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b88115a10 0x7f1b881a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8811b710 con 0x7f1b8810aa70 2024-09-10T20:54:23.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8810a150 0x7f1b881a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b87fff640 1 -- 172.21.15.67:0/3884129431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b88115a10 msgr2=0x7f1b881a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b87fff640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b88115a10 0x7f1b881a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b87fff640 1 -- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8810a150 msgr2=0x7f1b881a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b87fff640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8810a150 0x7f1b881a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.621+0000 7f1b87fff640 1 -- 172.21.15.67:0/3884129431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881a7ab0 con 0x7f1b8810aa70 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b87fff640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009f20 tx=0x7f1b7c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b85ffb640 1 -- 172.21.15.67:0/3884129431 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c020070 con 0x7f1b8810aa70 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b85ffb640 1 -- 172.21.15.67:0/3884129431 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b7c00cd80 con 0x7f1b8810aa70 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b85ffb640 1 -- 172.21.15.67:0/3884129431 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c01bae0 con 0x7f1b8810aa70 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b881a7da0 con 0x7f1b8810aa70 2024-09-10T20:54:23.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.622+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8810b260 con 0x7f1b8810aa70 2024-09-10T20:54:23.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.626+0000 7f1b9132f740 1 Processor -- start 2024-09-10T20:54:23.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.626+0000 7f1b9132f740 1 -- start start 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefd7d80 0x556fdefda170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556fdef41ea0 con 0x556fdefcb4d0 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556fdef312d0 con 0x556fdefcbdf0 2024-09-10T20:54:23.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b9132f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556fdef350e0 con 0x556fdefd7d80 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38804/0 (socket says 172.21.15.67:38804) 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 -- 172.21.15.67:0/157124380 learned_addr learned my addr 172.21.15.67:0/157124380 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b85ffb640 1 -- 172.21.15.67:0/3884129431 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1b7c0137d0 con 0x7f1b8810aa70 2024-09-10T20:54:23.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 -- 172.21.15.67:0/157124380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefd7d80 msgr2=0x556fdefda170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefd7d80 0x556fdefda170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 -- 172.21.15.67:0/157124380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 msgr2=0x556fdefd7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8d4f7640 1 -- 172.21.15.67:0/157124380 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fdec8f650 con 0x556fdefcb4d0 2024-09-10T20:54:23.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.627+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:54:23.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.630+0000 7f1b8d4f7640 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b80035000 tx=0x7f1b80009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef9eccfb86dfa16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.630+0000 7f1b85ffb640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 0x7f1b780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.631+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 0x7f1b780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.631+0000 7f1b85ffb640 1 -- 172.21.15.67:0/3884129431 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1b7c0e9f10 con 0x7f1b8810aa70 2024-09-10T20:54:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.631+0000 7f1b72ffd640 1 -- 172.21.15.67:0/157124380 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80034040 con 0x556fdefcb4d0 2024-09-10T20:54:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.631+0000 7f1b72ffd640 1 -- 172.21.15.67:0/157124380 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b80003e20 con 0x556fdefcb4d0 2024-09-10T20:54:23.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.631+0000 7f1b72ffd640 1 -- 172.21.15.67:0/157124380 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800042a0 con 0x556fdefcb4d0 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- 172.21.15.67:0/157124380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 msgr2=0x556fdefcb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 0x7f1b780b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556fdefca1e0 tx=0x7f1b7400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b80035000 tx=0x7f1b80009a20 comp rx=0 tx=0).stop 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- 172.21.15.67:0/157124380 shutdown_connections 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefd7d80 0x556fdefda170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 --2- 172.21.15.67:0/157124380 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefcb4d0 0x556fdefcb8b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- 172.21.15.67:0/157124380 >> 172.21.15.67:0/157124380 conn(0x556fdefc9300 msgr2=0x556fdefca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- 172.21.15.67:0/157124380 shutdown_connections 2024-09-10T20:54:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- 172.21.15.67:0/157124380 wait complete. 2024-09-10T20:54:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.632+0000 7f1b9132f740 1 -- start start 2024-09-10T20:54:23.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 Processor -- start 2024-09-10T20:54:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefd5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556fded92700 con 0x556fdefd7d80 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556fdeecc160 con 0x556fdefcbdf0 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.633+0000 7f1b9132f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556fdefda9a0 con 0x556fdefcb4d0 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b9132f740 10 client.0 _ll_register_callbacks cb 0x556fdeee59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56284/0 (socket says 172.21.15.67:56284) 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 -- 172.21.15.67:0/421165199 learned_addr learned my addr 172.21.15.67:0/421165199 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 -- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 msgr2=0x556fdefd4b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd4b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 -- 172.21.15.67:0/421165199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 msgr2=0x556fdefd5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefd5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.634+0000 7f1b8ccf6640 1 -- 172.21.15.67:0/421165199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fdeef9c90 con 0x556fdefcb4d0 2024-09-10T20:54:23.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b74003d30 tx=0x7f1b74004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3142759c3f65ca91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7402c060 con 0x556fdefcb4d0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b80003e20 con 0x556fdefcb4d0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1b74017030 con 0x556fdefcb4d0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1b74027410 con 0x556fdefcb4d0 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b9132f740 10 client.25348 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:23.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.635+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556fdefe6450 con 0x556fdefcb4d0 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b80003e20 con 0x556fdefcb4d0 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f1b74033610 con 0x556fdefcb4d0 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 10 client.25348 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 20 client.25348 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:23.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdefe7cb0 0x556fdefea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 4 client.25348 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fdef43df0 con 0x556fdefe7cb0 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.636+0000 7f1b87fff640 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdefe7cb0 0x556fdefea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.637+0000 7f1b87fff640 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdefe7cb0 0x556fdefea130 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f14f071d3199124 server_cookie=fc429477fd3c2794 in_seq=0 out_seq=0 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.637+0000 7f1b67fff640 10 client.25348 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.638+0000 7f1b67fff640 1 -- 172.21.15.67:0/421165199 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556fdef43df0 con 0x556fdefe7cb0 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.638+0000 7f1b67fff640 10 client.25348 handle_command_reply: tid=0 2024-09-10T20:54:23.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.638+0000 7f1b9132f740 1 client.25348 shutdown 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.638+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 msgr2=0x556fdefd7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.638+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b74003d30 tx=0x7f1b74004730 comp rx=0 tx=0).stop 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 shutdown_connections 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdefe7cb0 0x556fdefea130 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefd5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcbdf0 0x556fdefd4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 --2- 172.21.15.67:0/421165199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcb4d0 0x556fdefd7710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 >> 172.21.15.67:0/421165199 conn(0x556fdefc9300 msgr2=0x556fdefcee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b67fff640 0 client.25348 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:23.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 shutdown_connections 2024-09-10T20:54:23.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 1 -- 172.21.15.67:0/421165199 wait complete. 2024-09-10T20:54:23.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.639+0000 7f1b9132f740 20 client.25348 trim_cache size 0 max 16384 2024-09-10T20:54:23.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 Processor -- start 2024-09-10T20:54:23.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 -- start start 2024-09-10T20:54:23.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefd4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b71d0 con 0x556fdefd7d80 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b4a40 con 0x556fdefcb4d0 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b9132f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b2890 con 0x556fdefcbdf0 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56286/0 (socket says 172.21.15.67:56286) 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b87fff640 1 -- 172.21.15.67:0/510465725 learned_addr learned my addr 172.21.15.67:0/510465725 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefd4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.660+0000 7f1b8d4f7640 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 -- 172.21.15.67:0/510465725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 msgr2=0x556fdefd4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefd4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 -- 172.21.15.67:0/510465725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 msgr2=0x556fdefca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 -- 172.21.15.67:0/510465725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fdefcbc20 con 0x556fdefcbdf0 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b87fff640 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ad9c0 tx=0x7f1b7c00efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562c97733a6540e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b727fc640 1 -- 172.21.15.67:0/510465725 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0b0260 con 0x556fdefcbdf0 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b727fc640 1 -- 172.21.15.67:0/510465725 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b7c0aae50 con 0x556fdefcbdf0 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.661+0000 7f1b727fc640 1 -- 172.21.15.67:0/510465725 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0b9a00 con 0x556fdefcbdf0 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 -- 172.21.15.67:0/510465725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 msgr2=0x556fdefc8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ad9c0 tx=0x7f1b7c00efb0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 -- 172.21.15.67:0/510465725 shutdown_connections 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefc8c10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 --2- 172.21.15.67:0/510465725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefd4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 -- 172.21.15.67:0/510465725 >> 172.21.15.67:0/510465725 conn(0x556fdefc9300 msgr2=0x556fdefd33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 -- 172.21.15.67:0/510465725 shutdown_connections 2024-09-10T20:54:23.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.662+0000 7f1b9132f740 1 -- 172.21.15.67:0/510465725 wait complete. 2024-09-10T20:54:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.663+0000 7f1b9132f740 1 -- start start 2024-09-10T20:54:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.663+0000 7f1b9132f740 1 Processor -- start 2024-09-10T20:54:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b9132f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b8ccf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.664+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56294/0 (socket says 172.21.15.67:56294) 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b8d4f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b8d4f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38832/0 (socket says 172.21.15.67:38832) 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b8ccf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43860/0 (socket says 172.21.15.67:43860) 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b87fff640 1 -- 172.21.15.67:0/377690837 learned_addr learned my addr 172.21.15.67:0/377690837 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b2f00 con 0x556fdefd7d80 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b4370 con 0x556fdefcb4d0 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b35d0 con 0x556fdefcbdf0 2024-09-10T20:54:23.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b9132f740 10 client.0 _ll_register_callbacks cb 0x7f1b7400b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:23.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.665+0000 7f1b87fff640 1 -- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 msgr2=0x556fdefe02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b87fff640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b87fff640 1 -- 172.21.15.67:0/377690837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 msgr2=0x556fdefef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b87fff640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b87fff640 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fdeff0080 con 0x556fdefcbdf0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b87fff640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0e79b0 tx=0x7f1b7c0b02d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12d1053666487a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0d7040 con 0x556fdefcbdf0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1b7c0b99a0 con 0x556fdefcbdf0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b7c0aae50 con 0x556fdefcbdf0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.666+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c0b5180 con 0x556fdefcbdf0 2024-09-10T20:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.667+0000 7f1b9132f740 10 client.25354 fetch_fsmap learned FSMap version 31 2024-09-10T20:54:23.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.667+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556fdf054c40 con 0x556fdefcbdf0 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.667+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b7c0aae50 con 0x556fdefcbdf0 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.668+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f1b7c0af420 con 0x556fdefcbdf0 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.668+0000 7f1b9132f740 10 client.25354 fetch_fsmap finished waiting for FSMap version 31 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.669+0000 7f1b9132f740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.669+0000 7f1b9132f740 20 client.25354 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.669+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdf055180 0x556fdf0575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.669+0000 7f1b9132f740 4 client.25354 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.669+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fdef3f8a0 con 0x556fdf055180 2024-09-10T20:54:23.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdf055180 0x556fdf0575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b67fff640 10 client.25354 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b8ccf6640 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdf055180 0x556fdf0575a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f66787823448c21c server_cookie=c4869b90308701b3 in_seq=0 out_seq=0 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b67fff640 1 -- 172.21.15.67:0/377690837 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fdef3f8a0 con 0x556fdf055180 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b67fff640 10 client.25354 handle_command_reply: tid=0 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.670+0000 7f1b9132f740 1 client.25354 shutdown 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 msgr2=0x556fdefef4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0e79b0 tx=0x7f1b7c0b02d0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 shutdown_connections 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556fdf055180 0x556fdf0575a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556fdefd7d80 0x556fdefef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556fdefcbdf0 0x556fdefef4a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 --2- 172.21.15.67:0/377690837 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556fdefcb4d0 0x556fdefe02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 >> 172.21.15.67:0/377690837 conn(0x556fdefc9300 msgr2=0x556fdefca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b67fff640 0 client.25354 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.671+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 shutdown_connections 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.672+0000 7f1b9132f740 1 -- 172.21.15.67:0/377690837 wait complete. 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.672+0000 7f1b9132f740 20 client.25354 trim_cache size 0 max 16384 2024-09-10T20:54:23.678 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:54:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 msgr2=0x7f1b780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 0x7f1b780b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x556fdefca1e0 tx=0x7f1b7400b390 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 msgr2=0x7f1b881a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009f20 tx=0x7f1b7c00ee80 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 shutdown_connections 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b88115a10 0x7f1b881a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b780b5360 0x7f1b780b7820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b8810aa70 0x7f1b881a1f40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 --2- 172.21.15.67:0/3884129431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b8810a150 0x7f1b881a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 >> 172.21.15.67:0/3884129431 conn(0x7f1b8806dfc0 msgr2=0x7f1b880716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 shutdown_connections 2024-09-10T20:54:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:23.673+0000 7f1b8ef5a640 1 -- 172.21.15.67:0/3884129431 wait complete. 2024-09-10T20:54:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 170.0 s, 3332.8 tps, lat 30.019 ms stddev 33.179 2024-09-10T20:54:24.384 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:24 smithi067 ceph-mon[30891]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-10T20:54:24.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:24 smithi083 ceph-mon[35058]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-10T20:54:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:24 smithi172 ceph-mon[35265]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-09-10T20:54:25.436 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:54:25.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:54:25.860 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:26.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.465+0000 7fa082f17640 1 -- 172.21.15.67:0/811813504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c10f740 msgr2=0x7fa07c115f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.465+0000 7fa082f17640 1 --2- 172.21.15.67:0/811813504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c10f740 0x7fa07c115f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa074009860 tx=0x7fa07402a340 comp rx=0 tx=0).stop 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 -- 172.21.15.67:0/811813504 shutdown_connections 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 --2- 172.21.15.67:0/811813504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c10f740 0x7fa07c115f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 --2- 172.21.15.67:0/811813504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 --2- 172.21.15.67:0/811813504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c1093b0 0x7fa07c109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 -- 172.21.15.67:0/811813504 >> 172.21.15.67:0/811813504 conn(0x7fa07c078a30 msgr2=0x7fa07c07ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 -- 172.21.15.67:0/811813504 shutdown_connections 2024-09-10T20:54:26.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.466+0000 7fa082f17640 1 -- 172.21.15.67:0/811813504 wait complete. 2024-09-10T20:54:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.467+0000 7fa082f17640 1 Processor -- start 2024-09-10T20:54:26.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.467+0000 7fa082f17640 1 -- start start 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c1093b0 0x7fa07c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10f740 0x7fa07c1a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c119370 con 0x7fa07c10edc0 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1191f0 con 0x7fa07c1093b0 2024-09-10T20:54:26.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.469+0000 7fa082f17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c1194f0 con 0x7fa07c10f740 2024-09-10T20:54:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.470+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.470+0000 7fa07bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38854/0 (socket says 172.21.15.67:38854) 2024-09-10T20:54:26.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.470+0000 7fa07bfff640 1 -- 172.21.15.67:0/3738743813 learned_addr learned my addr 172.21.15.67:0/3738743813 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.470+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c1093b0 0x7fa07c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.471+0000 7fa07bfff640 1 -- 172.21.15.67:0/3738743813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10f740 msgr2=0x7fa07c1a51a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.471+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10f740 0x7fa07c1a51a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.471+0000 7fa07bfff640 1 -- 172.21.15.67:0/3738743813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c1093b0 msgr2=0x7fa07c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.471+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c1093b0 0x7fa07c19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.471+0000 7fa07bfff640 1 -- 172.21.15.67:0/3738743813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c1a5970 con 0x7fa07c10edc0 2024-09-10T20:54:26.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.472+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa06400e9c0 tx=0x7fa06400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.472+0000 7fa079ffb640 1 -- 172.21.15.67:0/3738743813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06400ccc0 con 0x7fa07c10edc0 2024-09-10T20:54:26.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.472+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c1a5c60 con 0x7fa07c10edc0 2024-09-10T20:54:26.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.473+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c1ac320 con 0x7fa07c10edc0 2024-09-10T20:54:26.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.473+0000 7fa079ffb640 1 -- 172.21.15.67:0/3738743813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0640054d0 con 0x7fa07c10edc0 2024-09-10T20:54:26.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.473+0000 7fa079ffb640 1 -- 172.21.15.67:0/3738743813 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064010430 con 0x7fa07c10edc0 2024-09-10T20:54:26.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.478+0000 7fa0852ec740 1 Processor -- start 2024-09-10T20:54:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa079ffb640 1 -- 172.21.15.67:0/3738743813 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa0640105d0 con 0x7fa07c10edc0 2024-09-10T20:54:26.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 -- start start 2024-09-10T20:54:26.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561a1862fe60 con 0x561a186c5790 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561a1861f290 con 0x561a186b8ee0 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0852ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a186230a0 con 0x561a186b9800 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0814b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0814b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43888/0 (socket says 172.21.15.67:43888) 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa0814b4640 1 -- 172.21.15.67:0/1545486512 learned_addr learned my addr 172.21.15.67:0/1545486512 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.479+0000 7fa080cb3640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa07bfff640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa0814b4640 1 -- 172.21.15.67:0/1545486512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 msgr2=0x561a186c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa0814b4640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa0814b4640 1 -- 172.21.15.67:0/1545486512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 msgr2=0x561a186c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa0814b4640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa0814b4640 1 -- 172.21.15.67:0/1545486512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a1837d930 con 0x561a186b8ee0 2024-09-10T20:54:26.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.480+0000 7fa080cb3640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:26.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.482+0000 7fa0814b4640 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa074009450 tx=0x7fa074009480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec184b80adac58f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.482+0000 7fa072ffd640 1 -- 172.21.15.67:0/1545486512 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037040 con 0x561a186b8ee0 2024-09-10T20:54:26.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.482+0000 7fa072ffd640 1 -- 172.21.15.67:0/1545486512 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa074040070 con 0x561a186b8ee0 2024-09-10T20:54:26.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.482+0000 7fa072ffd640 1 -- 172.21.15.67:0/1545486512 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074003850 con 0x561a186b8ee0 2024-09-10T20:54:26.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.483+0000 7fa079ffb640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 0x7fa0680b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.483+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 0x7fa0680b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.483+0000 7fa079ffb640 1 -- 172.21.15.67:0/3738743813 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa0640e5c20 con 0x7fa07c10edc0 2024-09-10T20:54:26.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.484+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 0x7fa0680b78f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x561a186bc060 tx=0x7fa06c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 -- 172.21.15.67:0/1545486512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 msgr2=0x561a186b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa074009450 tx=0x7fa074009480 comp rx=0 tx=0).stop 2024-09-10T20:54:26.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 -- 172.21.15.67:0/1545486512 shutdown_connections 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 --2- 172.21.15.67:0/1545486512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b8ee0 0x561a186b92c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.486+0000 7fa0852ec740 1 -- 172.21.15.67:0/1545486512 >> 172.21.15.67:0/1545486512 conn(0x561a186b6d10 msgr2=0x561a186b7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.487+0000 7fa0852ec740 1 -- 172.21.15.67:0/1545486512 shutdown_connections 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.487+0000 7fa0852ec740 1 -- 172.21.15.67:0/1545486512 wait complete. 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 -- start start 2024-09-10T20:54:26.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 Processor -- start 2024-09-10T20:54:26.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b9800 0x561a186c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561a18480890 con 0x561a186b9800 2024-09-10T20:54:26.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561a185b9d40 con 0x561a186c5790 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a186c83e0 con 0x561a186b8ee0 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa0852ec740 10 client.0 _ll_register_callbacks cb 0x561a1861dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa080cb3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa080cb3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56324/0 (socket says 172.21.15.67:56324) 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.488+0000 7fa080cb3640 1 -- 172.21.15.67:0/3426459862 learned_addr learned my addr 172.21.15.67:0/3426459862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b9800 0x561a186c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa0814b4640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 -- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 msgr2=0x561a186c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 -- 172.21.15.67:0/3426459862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b9800 msgr2=0x561a186c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b9800 0x561a186c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 -- 172.21.15.67:0/3426459862 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a186d1870 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa0814b4640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa080cb3640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00fb10 tx=0x7fa06c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6147f4c5f145db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa05bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c004b20 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa06c018030 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.489+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa074040070 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa06c004cc0 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 10 client.25363 fetch_fsmap learned FSMap version 32 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561a186d4280 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa074040070 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fa06c0357e0 con 0x561a186b8ee0 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 10 client.25363 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:54:26.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 10 client.25363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:26.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 20 client.25363 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:26.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a186d5700 0x561a186d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 4 client.25363 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:26.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a18631db0 con 0x561a186d5700 2024-09-10T20:54:26.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.490+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a186d5700 0x561a186d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.491+0000 7fa05bfff640 10 client.25363 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:26.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.491+0000 7fa07bfff640 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a186d5700 0x561a186d7bc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7350ef13bfbe1650 server_cookie=c9cb5c92e52b5af9 in_seq=0 out_seq=0 2024-09-10T20:54:26.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.491+0000 7fa05bfff640 1 -- 172.21.15.67:0/3426459862 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a18631db0 con 0x561a186d5700 2024-09-10T20:54:26.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.491+0000 7fa05bfff640 10 client.25363 handle_command_reply: tid=0 2024-09-10T20:54:26.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.491+0000 7fa0852ec740 1 client.25363 shutdown 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 msgr2=0x561a186c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00fb10 tx=0x7fa06c004ab0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 shutdown_connections 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a186d5700 0x561a186d7bc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b9800 0x561a186c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 --2- 172.21.15.67:0/3426459862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c2770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 >> 172.21.15.67:0/3426459862 conn(0x561a186b6d10 msgr2=0x561a186b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa05bfff640 0 client.25363 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 shutdown_connections 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 1 -- 172.21.15.67:0/3426459862 wait complete. 2024-09-10T20:54:26.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.492+0000 7fa0852ec740 20 client.25363 trim_cache size 0 max 16384 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 Processor -- start 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 -- start start 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b9800 0x561a186dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c010cc0 con 0x561a186c5790 2024-09-10T20:54:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c00e530 con 0x561a186b9800 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0852ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c00c380 con 0x561a186b8ee0 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38886/0 (socket says 172.21.15.67:38886) 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 -- 172.21.15.67:0/922166498 learned_addr learned my addr 172.21.15.67:0/922166498 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa07bfff640 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b9800 0x561a186dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa080cb3640 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 -- 172.21.15.67:0/922166498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 msgr2=0x561a186c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 -- 172.21.15.67:0/922166498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b9800 msgr2=0x561a186dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b9800 0x561a186dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.511+0000 7fa0814b4640 1 -- 172.21.15.67:0/922166498 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a186d16a0 con 0x561a186c5790 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0814b4640 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0740094f0 tx=0x7fa074000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42111e31db69a81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0727fc640 1 -- 172.21.15.67:0/922166498 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074048020 con 0x561a186c5790 2024-09-10T20:54:26.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0727fc640 1 -- 172.21.15.67:0/922166498 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa074040040 con 0x561a186c5790 2024-09-10T20:54:26.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0727fc640 1 -- 172.21.15.67:0/922166498 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074037040 con 0x561a186c5790 2024-09-10T20:54:26.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0852ec740 1 -- 172.21.15.67:0/922166498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 msgr2=0x561a186dda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0852ec740 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa0740094f0 tx=0x7fa074000bc0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0852ec740 1 -- 172.21.15.67:0/922166498 shutdown_connections 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0852ec740 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186c5790 0x561a186dda20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.512+0000 7fa0852ec740 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186b9800 0x561a186dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 --2- 172.21.15.67:0/922166498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b8ee0 0x561a186c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- 172.21.15.67:0/922166498 >> 172.21.15.67:0/922166498 conn(0x561a186b6d10 msgr2=0x561a186bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- 172.21.15.67:0/922166498 shutdown_connections 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- 172.21.15.67:0/922166498 wait complete. 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- start start 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 Processor -- start 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c00c9f0 con 0x561a186b8ee0 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c00de60 con 0x561a186c5790 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.513+0000 7fa0852ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c00d0c0 con 0x561a186b9800 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa0852ec740 10 client.0 _ll_register_callbacks cb 0x7fa06c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38890/0 (socket says 172.21.15.67:38890) 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa07bfff640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 -- 172.21.15.67:0/2754582104 learned_addr learned my addr 172.21.15.67:0/2754582104 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa0814b4640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 -- 172.21.15.67:0/2754582104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 msgr2=0x561a186cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 -- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 msgr2=0x561a186c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 -- 172.21.15.67:0/2754582104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a186c8d00 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa080cb3640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000f80 tx=0x7fa06c012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4937d1633a498151 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa05bfff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c039070 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa074040040 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa06c035690 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.514+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa06c045050 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 10 client.15726 fetch_fsmap learned FSMap version 32 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561a18743060 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa074040040 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fa06c01e560 con 0x561a186b8ee0 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 10 client.15726 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:54:26.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 20 client.15726 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a18743750 0x561a18745b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 4 client.15726 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561a1862d860 con 0x561a18743750 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.515+0000 7fa07bfff640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a18743750 0x561a18745b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.516+0000 7fa07bfff640 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a18743750 0x561a18745b70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d11b4cbd6a50337 server_cookie=78b9b3856c8cf92b in_seq=0 out_seq=0 2024-09-10T20:54:26.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.516+0000 7fa05bfff640 10 client.15726 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:26.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.517+0000 7fa05bfff640 1 -- 172.21.15.67:0/2754582104 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561a1862d860 con 0x561a18743750 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.517+0000 7fa05bfff640 10 client.15726 handle_command_reply: tid=0 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.517+0000 7fa0852ec740 1 client.15726 shutdown 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 msgr2=0x561a186cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000f80 tx=0x7fa06c012ef0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 shutdown_connections 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561a18743750 0x561a18745b70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561a186c5790 0x561a186c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a186b9800 0x561a186cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 --2- 172.21.15.67:0/2754582104 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561a186b8ee0 0x561a186cd8f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 >> 172.21.15.67:0/2754582104 conn(0x561a186b6d10 msgr2=0x561a186bc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa05bfff640 0 client.15726 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 shutdown_connections 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 1 -- 172.21.15.67:0/2754582104 wait complete. 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.518+0000 7fa0852ec740 20 client.15726 trim_cache size 0 max 16384 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68", 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:54:26.527 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:54:26.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 msgr2=0x7fa0680b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 0x7fa0680b78f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x561a186bc060 tx=0x7fa06c009500 comp rx=0 tx=0).stop 2024-09-10T20:54:26.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 msgr2=0x7fa07c19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:26.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa06400e9c0 tx=0x7fa06400ee80 comp rx=0 tx=0).stop 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 shutdown_connections 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa0680b5430 0x7fa0680b78f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10f740 0x7fa07c1a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa07c10edc0 0x7fa07c19fe00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 --2- 172.21.15.67:0/3738743813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa07c1093b0 0x7fa07c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 >> 172.21.15.67:0/3738743813 conn(0x7fa07c078a30 msgr2=0x7fa07c07ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 shutdown_connections 2024-09-10T20:54:26.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:26.519+0000 7fa082f17640 1 -- 172.21.15.67:0/3738743813 wait complete. 2024-09-10T20:54:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:26 smithi083 ceph-mon[35058]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 785 op/s 2024-09-10T20:54:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:26 smithi172 ceph-mon[35265]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 785 op/s 2024-09-10T20:54:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:26 smithi067 ceph-mon[30891]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 785 op/s 2024-09-10T20:54:27.387 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:54:27.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:54:27.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:54:27.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:54:27.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:27.836 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.421+0000 7eff201f3640 1 -- 172.21.15.67:0/3771331819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff18104fb0 msgr2=0x7eff18105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.421+0000 7eff201f3640 1 --2- 172.21.15.67:0/3771331819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff18104fb0 0x7eff18105390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff14009900 tx=0x7eff1402a440 comp rx=0 tx=0).stop 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 -- 172.21.15.67:0/3771331819 shutdown_connections 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 --2- 172.21.15.67:0/3771331819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff1810b340 0x7eff18111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 --2- 172.21.15.67:0/3771331819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff1810a9c0 0x7eff1810ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 --2- 172.21.15.67:0/3771331819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff18104fb0 0x7eff18105390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 -- 172.21.15.67:0/3771331819 >> 172.21.15.67:0/3771331819 conn(0x7eff18100a20 msgr2=0x7eff18102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.422+0000 7eff201f3640 1 -- 172.21.15.67:0/3771331819 shutdown_connections 2024-09-10T20:54:28.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.425+0000 7eff201f3640 1 -- 172.21.15.67:0/3771331819 wait complete. 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 Processor -- start 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 -- start start 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff1810a9c0 0x7eff18110800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff1810b340 0x7eff181ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7eff18078620 con 0x7eff18104fb0 2024-09-10T20:54:28.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff180784a0 con 0x7eff1810b340 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff201f3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff180787a0 con 0x7eff1810a9c0 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff1df8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff1df8f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38906/0 (socket says 172.21.15.67:38906) 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff1df8f640 1 -- 172.21.15.67:0/4006766200 learned_addr learned my addr 172.21.15.67:0/4006766200 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.426+0000 7eff1e790640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff1810b340 0x7eff181ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 -- 172.21.15.67:0/4006766200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff1810a9c0 msgr2=0x7eff18110800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:54:28.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff1810a9c0 0x7eff18110800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 -- 172.21.15.67:0/4006766200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff1810b340 msgr2=0x7eff181ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff1810b340 0x7eff181ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 -- 172.21.15.67:0/4006766200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff181abad0 con 0x7eff18104fb0 2024-09-10T20:54:28.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.427+0000 7eff1df8f640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7eff14006010 tx=0x7eff14003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.428+0000 7eff0effd640 1 -- 172.21.15.67:0/4006766200 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1403f070 con 0x7eff18104fb0 2024-09-10T20:54:28.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.428+0000 7eff0effd640 1 -- 172.21.15.67:0/4006766200 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff1403bb10 con 0x7eff18104fb0 2024-09-10T20:54:28.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.428+0000 7eff0effd640 1 -- 172.21.15.67:0/4006766200 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14035030 con 0x7eff18104fb0 2024-09-10T20:54:28.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.428+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff181abd60 con 0x7eff18104fb0 2024-09-10T20:54:28.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.428+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff181ac190 con 0x7eff18104fb0 2024-09-10T20:54:28.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.433+0000 7eff225c8740 1 Processor -- start 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.434+0000 7eff225c8740 1 -- start start 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.435+0000 7eff225c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff225c8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c52410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff225c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c54d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff225c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ac15bbce50 con 0x55ac15c52950 2024-09-10T20:54:28.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff225c8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ac15bac280 con 0x55ac15c469c0 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff225c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac15bb0090 con 0x55ac15c460a0 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56358/0 (socket says 172.21.15.67:56358) 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 -- 172.21.15.67:0/1274584881 learned_addr learned my addr 172.21.15.67:0/1274584881 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 -- 172.21.15.67:0/1274584881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 msgr2=0x55ac15c52410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:54:28.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c52410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 -- 172.21.15.67:0/1274584881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 msgr2=0x55ac15c54d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c54d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.436+0000 7eff1e790640 1 -- 172.21.15.67:0/1274584881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1590a650 con 0x55ac15c460a0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.437+0000 7eff0effd640 1 -- 172.21.15.67:0/4006766200 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7eff1403b660 con 0x7eff18104fb0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.437+0000 7eff1e790640 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b500 tx=0x7eff10009630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267d4f9d3ff70529 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.437+0000 7eff03fff640 1 -- 172.21.15.67:0/1274584881 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1000a970 con 0x55ac15c460a0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.437+0000 7eff03fff640 1 -- 172.21.15.67:0/1274584881 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff10019070 con 0x55ac15c460a0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.437+0000 7eff03fff640 1 -- 172.21.15.67:0/1274584881 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10013380 con 0x55ac15c460a0 2024-09-10T20:54:28.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.438+0000 7eff225c8740 1 -- 172.21.15.67:0/1274584881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 msgr2=0x55ac15c46480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.438+0000 7eff225c8740 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b500 tx=0x7eff10009630 comp rx=0 tx=0).stop 2024-09-10T20:54:28.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff0effd640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff225c8740 1 -- 172.21.15.67:0/1274584881 shutdown_connections 2024-09-10T20:54:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff225c8740 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c54d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff225c8740 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c52410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff225c8740 1 --2- 172.21.15.67:0/1274584881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c46480 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff225c8740 1 -- 172.21.15.67:0/1274584881 >> 172.21.15.67:0/1274584881 conn(0x55ac15c43ed0 msgr2=0x55ac15c45070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.440+0000 7eff1e790640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.441+0000 7eff0effd640 1 -- 172.21.15.67:0/4006766200 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff14106370 con 0x7eff18104fb0 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.441+0000 7eff225c8740 1 -- 172.21.15.67:0/1274584881 shutdown_connections 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.441+0000 7eff225c8740 1 -- 172.21.15.67:0/1274584881 wait complete. 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.441+0000 7eff225c8740 1 -- start start 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.442+0000 7eff1e790640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 0x7eff040b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d010 tx=0x7eff10014af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.442+0000 7eff225c8740 1 Processor -- start 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c460a0 0x55ac15c52210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ac15a0d700 con 0x55ac15c52950 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ac15b47110 con 0x55ac15c460a0 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac15c555d0 con 0x55ac15c469c0 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff225c8740 10 client.0 _ll_register_callbacks cb 0x55ac15b60990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:28.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff1e790640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56372/0 (socket says 172.21.15.67:56372) 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.443+0000 7eff1d78e640 1 -- 172.21.15.67:0/2446609132 learned_addr learned my addr 172.21.15.67:0/2446609132 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1df8f640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c460a0 0x55ac15c52210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1d78e640 1 -- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c460a0 msgr2=0x55ac15c52210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c460a0 0x55ac15c52210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1d78e640 1 -- 172.21.15.67:0/2446609132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 msgr2=0x55ac15c4fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1d78e640 1 -- 172.21.15.67:0/2446609132 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac15b74c40 con 0x55ac15c469c0 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.444+0000 7eff1e790640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.445+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff0800bb30 tx=0x7eff0800d2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a8525682cde1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.445+0000 7eff017fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.445+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08016070 con 0x55ac15c469c0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.445+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff10019070 con 0x55ac15c469c0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.445+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff08010460 con 0x55ac15c469c0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.446+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7eff08022050 con 0x55ac15c469c0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.446+0000 7eff225c8740 10 client.25375 fetch_fsmap learned FSMap version 32 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.446+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ac15c61040 con 0x55ac15c469c0 2024-09-10T20:54:28.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.446+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff10019070 con 0x55ac15c469c0 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.447+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7eff0800f6c0 con 0x55ac15c469c0 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.447+0000 7eff225c8740 10 client.25375 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.447+0000 7eff225c8740 10 client.25375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.447+0000 7eff225c8740 20 client.25375 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.447+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15c624f0 0x55ac15c648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.448+0000 7eff225c8740 4 client.25375 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:54:28.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.448+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac15bbeda0 con 0x55ac15c624f0 2024-09-10T20:54:28.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.449+0000 7eff1df8f640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15c624f0 0x55ac15c648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.450+0000 7eff1df8f640 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15c624f0 0x55ac15c648e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f2092d6ca903162 server_cookie=8b79116f44ed31b1 in_seq=0 out_seq=0 2024-09-10T20:54:28.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.450+0000 7eff017fa640 10 client.25375 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:28.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.451+0000 7eff017fa640 1 -- 172.21.15.67:0/2446609132 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac15bbeda0 con 0x55ac15c624f0 2024-09-10T20:54:28.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.451+0000 7eff017fa640 10 client.25375 handle_command_reply: tid=0 2024-09-10T20:54:28.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.451+0000 7eff225c8740 1 client.25375 shutdown 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 msgr2=0x55ac15c4f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff0800bb30 tx=0x7eff0800d2e0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 shutdown_connections 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15c624f0 0x55ac15c648e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c469c0 0x55ac15c4f660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 --2- 172.21.15.67:0/2446609132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c460a0 0x55ac15c52210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 >> 172.21.15.67:0/2446609132 conn(0x55ac15c43ed0 msgr2=0x55ac15c49a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff017fa640 0 client.25375 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:28.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 shutdown_connections 2024-09-10T20:54:28.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.452+0000 7eff225c8740 1 -- 172.21.15.67:0/2446609132 wait complete. 2024-09-10T20:54:28.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.453+0000 7eff225c8740 20 client.25375 trim_cache size 0 max 16384 2024-09-10T20:54:28.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.488+0000 7eff225c8740 1 Processor -- start 2024-09-10T20:54:28.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.488+0000 7eff225c8740 1 -- start start 2024-09-10T20:54:28.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff225c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 0x55ac15c43710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff225c8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff225c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c52950 0x55ac15c49de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43950/0 (socket says 172.21.15.67:43950) 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.489+0000 7eff1d78e640 1 -- 172.21.15.67:0/2439736309 learned_addr learned my addr 172.21.15.67:0/2439736309 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.490+0000 7eff1e790640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c52950 0x55ac15c49de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.490+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efefc010b20 con 0x55ac15c460a0 2024-09-10T20:54:28.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.490+0000 7eff1df8f640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 0x55ac15c43710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.490+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efefc00e390 con 0x55ac15c469c0 2024-09-10T20:54:28.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.490+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efefc00c290 con 0x55ac15c52950 2024-09-10T20:54:28.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 -- 172.21.15.67:0/2439736309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c52950 msgr2=0x55ac15c49de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c52950 0x55ac15c49de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 -- 172.21.15.67:0/2439736309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 msgr2=0x55ac15c43710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 0x55ac15c43710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 -- 172.21.15.67:0/2439736309 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac15c64c50 con 0x55ac15c469c0 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.491+0000 7eff1d78e640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff0800b630 tx=0x7eff08000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3cd2c93d731ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.492+0000 7eff1df8f640 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 0x55ac15c43710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.492+0000 7eff037fe640 1 -- 172.21.15.67:0/2439736309 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0802b070 con 0x55ac15c469c0 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.492+0000 7eff037fe640 1 -- 172.21.15.67:0/2439736309 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff0801f070 con 0x55ac15c469c0 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.492+0000 7eff037fe640 1 -- 172.21.15.67:0/2439736309 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08016030 con 0x55ac15c469c0 2024-09-10T20:54:28.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.493+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 msgr2=0x55ac15c498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.493+0000 7eff225c8740 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff0800b630 tx=0x7eff08000bc0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.493+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 shutdown_connections 2024-09-10T20:54:28.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.493+0000 7eff225c8740 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c52950 0x55ac15c49de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c498a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 --2- 172.21.15.67:0/2439736309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c460a0 0x55ac15c43710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 >> 172.21.15.67:0/2439736309 conn(0x55ac15c43ed0 msgr2=0x55ac15c49190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 shutdown_connections 2024-09-10T20:54:28.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 -- 172.21.15.67:0/2439736309 wait complete. 2024-09-10T20:54:28.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 -- start start 2024-09-10T20:54:28.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.494+0000 7eff225c8740 1 Processor -- start 2024-09-10T20:54:28.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff225c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c5adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff225c8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c4b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff225c8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c4b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff1d78e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c4b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43956/0 (socket says 172.21.15.67:43956) 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff1d78e640 1 -- 172.21.15.67:0/3266768459 learned_addr learned my addr 172.21.15.67:0/3266768459 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:54:28.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.495+0000 7eff1df8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c5adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efefc00c850 con 0x55ac15c52950 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efefc00dcc0 con 0x55ac15c469c0 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efefc00cf20 con 0x55ac15c460a0 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff225c8740 10 client.0 _ll_register_callbacks cb 0x7eff08005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 -- 172.21.15.67:0/3266768459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 msgr2=0x55ac15c5adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c5adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 -- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 msgr2=0x55ac15c4b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:54:28.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c4b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.496+0000 7eff1e790640 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac15c4ffb0 con 0x55ac15c52950 2024-09-10T20:54:28.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.497+0000 7eff1e790640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4bdc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b4d0 tx=0x7eff1000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a603d9b17585794a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:54:28.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.497+0000 7eff017fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:54:28.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.497+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10047020 con 0x55ac15c52950 2024-09-10T20:54:28.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.497+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff1000ae00 con 0x55ac15c52950 2024-09-10T20:54:28.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.499+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff0801f070 con 0x55ac15c52950 2024-09-10T20:54:28.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.499+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7eff10023070 con 0x55ac15c52950 2024-09-10T20:54:28.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.499+0000 7eff225c8740 10 client.15738 fetch_fsmap learned FSMap version 32 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.499+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ac15c4d3c0 con 0x55ac15c52950 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff10019050 con 0x55ac15c52950 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7eff10028410 con 0x55ac15c52950 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 10 client.15738 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 20 client.15738 populate_metadata read hostname 'smithi067' 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15cd03e0 0x55ac15cd27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 4 client.15738 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7eff0801f070 con 0x55ac15cd03e0 2024-09-10T20:54:28.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.500+0000 7eff1df8f640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15cd03e0 0x55ac15cd27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:54:28.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.501+0000 7eff017fa640 10 client.15738 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:28.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.501+0000 7eff1df8f640 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15cd03e0 0x55ac15cd27d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b9011bd50f7134 server_cookie=239528921ce11800 in_seq=0 out_seq=0 2024-09-10T20:54:28.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.502+0000 7eff017fa640 1 -- 172.21.15.67:0/3266768459 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x7eff0801f070 con 0x55ac15cd03e0 2024-09-10T20:54:28.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.502+0000 7eff017fa640 10 client.15738 handle_command_reply: tid=0 2024-09-10T20:54:28.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.502+0000 7eff225c8740 1 client.15738 shutdown 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 msgr2=0x55ac15c4bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4bdc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b4d0 tx=0x7eff1000d040 comp rx=0 tx=0).stop 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 shutdown_connections 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ac15cd03e0 0x55ac15cd27d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff017fa640 0 client.15738 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ac15c52950 0x55ac15c4bdc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ac15c469c0 0x55ac15c4b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 --2- 172.21.15.67:0/3266768459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac15c460a0 0x55ac15c5adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.503+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 >> 172.21.15.67:0/3266768459 conn(0x55ac15c43ed0 msgr2=0x55ac15c49920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.504+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 shutdown_connections 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.504+0000 7eff225c8740 1 -- 172.21.15.67:0/3266768459 wait complete. 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.504+0000 7eff225c8740 20 client.15738 trim_cache size 0 max 16384 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:54:28.509 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68", 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:28.510 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:28.511 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:54:28.512 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:54:28.513 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.505+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 msgr2=0x7eff040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.505+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 0x7eff040b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d010 tx=0x7eff10014af0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 msgr2=0x7eff181102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7eff14006010 tx=0x7eff14003c00 comp rx=0 tx=0).stop 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 shutdown_connections 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff1810b340 0x7eff181ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff1810a9c0 0x7eff18110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 --2- 172.21.15.67:0/4006766200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff18104fb0 0x7eff181102c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:54:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.506+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 >> 172.21.15.67:0/4006766200 conn(0x7eff18100a20 msgr2=0x7eff18102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:54:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.509+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 shutdown_connections 2024-09-10T20:54:28.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:54:28.510+0000 7eff201f3640 1 -- 172.21.15.67:0/4006766200 wait complete. 2024-09-10T20:54:28.529 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:28 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:28.529 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:28 smithi067 ceph-mon[30891]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 893 op/s 2024-09-10T20:54:28.529 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:28 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:28 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:28 smithi083 ceph-mon[35058]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 893 op/s 2024-09-10T20:54:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:28 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:28 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:28 smithi172 ceph-mon[35265]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 893 op/s 2024-09-10T20:54:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:28 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:54:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 175.0 s, 5016.1 tps, lat 19.921 ms stddev 24.908 2024-09-10T20:54:29.519 INFO:tasks.cephfs.filesystem:scrub status for tag:8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68 - {'path': '/', 'tag': '8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68', 'options': 'recursive,force'} 2024-09-10T20:54:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:30 smithi083 ceph-mon[35058]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 723 op/s 2024-09-10T20:54:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:30 smithi172 ceph-mon[35265]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 723 op/s 2024-09-10T20:54:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:30 smithi067 ceph-mon[30891]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 723 op/s 2024-09-10T20:54:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:32 smithi083 ceph-mon[35058]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 753 op/s 2024-09-10T20:54:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:32 smithi172 ceph-mon[35265]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 753 op/s 2024-09-10T20:54:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:32 smithi067 ceph-mon[30891]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 753 op/s 2024-09-10T20:54:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 180.0 s, 4583.0 tps, lat 21.878 ms stddev 26.335 2024-09-10T20:54:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:34 smithi083 ceph-mon[35058]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 930 op/s 2024-09-10T20:54:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:34 smithi172 ceph-mon[35265]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 930 op/s 2024-09-10T20:54:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:34 smithi067 ceph-mon[30891]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 930 op/s 2024-09-10T20:54:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:36 smithi083 ceph-mon[35058]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 779 op/s 2024-09-10T20:54:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:36 smithi172 ceph-mon[35265]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 779 op/s 2024-09-10T20:54:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:36 smithi067 ceph-mon[30891]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.9 MiB/s wr, 779 op/s 2024-09-10T20:54:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:38 smithi083 ceph-mon[35058]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 950 op/s 2024-09-10T20:54:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:54:38.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:54:38.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:54:38.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:54:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:38 smithi172 ceph-mon[35265]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 950 op/s 2024-09-10T20:54:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:54:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:54:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:54:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:54:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:38 smithi067 ceph-mon[30891]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 11 MiB/s wr, 950 op/s 2024-09-10T20:54:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:54:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:54:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:54:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:54:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 185.0 s, 3887.8 tps, lat 25.773 ms stddev 30.370 2024-09-10T20:54:40.612 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:40 smithi067 ceph-mon[30891]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.7 MiB/s wr, 771 op/s 2024-09-10T20:54:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:40 smithi083 ceph-mon[35058]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.7 MiB/s wr, 771 op/s 2024-09-10T20:54:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:40 smithi172 ceph-mon[35265]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.7 MiB/s wr, 771 op/s 2024-09-10T20:54:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:54:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:54:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:54:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:54:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:54:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:54:41.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:54:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:54:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:54:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:42 smithi083 ceph-mon[35058]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.3 MiB/s wr, 800 op/s 2024-09-10T20:54:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:42 smithi172 ceph-mon[35265]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.3 MiB/s wr, 800 op/s 2024-09-10T20:54:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:42 smithi067 ceph-mon[30891]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 9.3 MiB/s wr, 800 op/s 2024-09-10T20:54:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 190.0 s, 4015.2 tps, lat 24.715 ms stddev 29.875 2024-09-10T20:54:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:44 smithi083 ceph-mon[35058]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-09-10T20:54:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:44 smithi172 ceph-mon[35265]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-09-10T20:54:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:44 smithi067 ceph-mon[30891]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 914 op/s 2024-09-10T20:54:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:46 smithi083 ceph-mon[35058]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-09-10T20:54:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:46 smithi172 ceph-mon[35265]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-09-10T20:54:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:46 smithi067 ceph-mon[30891]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.6 MiB/s wr, 782 op/s 2024-09-10T20:54:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:48 smithi083 ceph-mon[35058]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 897 op/s 2024-09-10T20:54:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:48 smithi172 ceph-mon[35265]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 897 op/s 2024-09-10T20:54:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:48 smithi067 ceph-mon[30891]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 897 op/s 2024-09-10T20:54:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 195.0 s, 4003.4 tps, lat 24.980 ms stddev 28.967 2024-09-10T20:54:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:50 smithi083 ceph-mon[35058]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 776 op/s 2024-09-10T20:54:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:50 smithi172 ceph-mon[35265]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 776 op/s 2024-09-10T20:54:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:50 smithi067 ceph-mon[30891]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 776 op/s 2024-09-10T20:54:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:52 smithi083 ceph-mon[35058]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 MiB/s wr, 813 op/s 2024-09-10T20:54:52.696 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:52 smithi067 ceph-mon[30891]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 MiB/s wr, 813 op/s 2024-09-10T20:54:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:52 smithi172 ceph-mon[35265]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.7 MiB/s wr, 813 op/s 2024-09-10T20:54:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 200.0 s, 2959.0 tps, lat 33.995 ms stddev 36.954 2024-09-10T20:54:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:54 smithi172 ceph-mon[35265]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 MiB/s wr, 883 op/s 2024-09-10T20:54:54.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:54 smithi067 ceph-mon[30891]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 MiB/s wr, 883 op/s 2024-09-10T20:54:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:54 smithi083 ceph-mon[35058]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 MiB/s wr, 883 op/s 2024-09-10T20:54:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:56 smithi083 ceph-mon[35058]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.8 MiB/s wr, 741 op/s 2024-09-10T20:54:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:56 smithi172 ceph-mon[35265]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.8 MiB/s wr, 741 op/s 2024-09-10T20:54:56.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:56 smithi067 ceph-mon[30891]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.8 MiB/s wr, 741 op/s 2024-09-10T20:54:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:54:58 smithi172 ceph-mon[35265]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 855 op/s 2024-09-10T20:54:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:54:58 smithi067 ceph-mon[30891]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 855 op/s 2024-09-10T20:54:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:54:58 smithi083 ceph-mon[35058]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 10 MiB/s wr, 855 op/s 2024-09-10T20:54:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 205.0 s, 4352.0 tps, lat 22.992 ms stddev 23.403 2024-09-10T20:54:59.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:54:59.918 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.527+0000 7fbd988f6640 1 -- 172.21.15.67:0/437314592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94106f20 msgr2=0x7fbd94107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.527+0000 7fbd988f6640 1 --2- 172.21.15.67:0/437314592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94106f20 0x7fbd94107360 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800aa10 tx=0x7fbd8802b720 comp rx=0 tx=0).stop 2024-09-10T20:55:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 -- 172.21.15.67:0/437314592 shutdown_connections 2024-09-10T20:55:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 --2- 172.21.15.67:0/437314592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd9410bb50 0x7fbd9410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 --2- 172.21.15.67:0/437314592 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94106f20 0x7fbd94107360 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 --2- 172.21.15.67:0/437314592 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd94101600 0x7fbd941069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 -- 172.21.15.67:0/437314592 >> 172.21.15.67:0/437314592 conn(0x7fbd940fca20 msgr2=0x7fbd940fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 -- 172.21.15.67:0/437314592 shutdown_connections 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.528+0000 7fbd988f6640 1 -- 172.21.15.67:0/437314592 wait complete. 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.529+0000 7fbd988f6640 1 Processor -- start 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.529+0000 7fbd988f6640 1 -- start start 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.529+0000 7fbd988f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94101600 0x7fbd94199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd988f6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94106f20 0x7fbd94196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd988f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd988f6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94110bd0 con 0x7fbd94101600 2024-09-10T20:55:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd92d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd92d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:41502/0 (socket says 172.21.15.67:41502) 2024-09-10T20:55:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd92d9d640 1 -- 172.21.15.67:0/569007550 learned_addr learned my addr 172.21.15.67:0/569007550 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94110a50 con 0x7fbd9410bb50 2024-09-10T20:55:00.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.530+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94110d50 con 0x7fbd94106f20 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 -- 172.21.15.67:0/569007550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94106f20 msgr2=0x7fbd94196f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94106f20 0x7fbd94196f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 -- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94101600 msgr2=0x7fbd94199d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94101600 0x7fbd94199d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 -- 172.21.15.67:0/569007550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd941abce0 con 0x7fbd9410bb50 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00eb10 tx=0x7fbd8c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd837fe640 1 -- 172.21.15.67:0/569007550 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c004b20 con 0x7fbd9410bb50 2024-09-10T20:55:00.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.531+0000 7fbd837fe640 1 -- 172.21.15.67:0/569007550 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd8c004cc0 con 0x7fbd9410bb50 2024-09-10T20:55:00.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.532+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd941abeb0 con 0x7fbd9410bb50 2024-09-10T20:55:00.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.532+0000 7fbd837fe640 1 -- 172.21.15.67:0/569007550 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c010690 con 0x7fbd9410bb50 2024-09-10T20:55:00.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.532+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd941ac360 con 0x7fbd9410bb50 2024-09-10T20:55:00.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.536+0000 7fbd9accb740 1 Processor -- start 2024-09-10T20:55:00.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 -- start start 2024-09-10T20:55:00.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd837fe640 1 -- 172.21.15.67:0/569007550 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbd8c005020 con 0x7fbd9410bb50 2024-09-10T20:55:00.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a26a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d5a260be50 con 0x55d5a26a1d30 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d5a25fb280 con 0x55d5a2695da0 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd9accb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d5a25ff090 con 0x55d5a2695480 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42474/0 (socket says 172.21.15.67:42474) 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd91d9b640 1 -- 172.21.15.67:0/2776051445 learned_addr learned my addr 172.21.15.67:0/2776051445 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:00.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.537+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd91d9b640 1 -- 172.21.15.67:0/2776051445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 msgr2=0x55d5a26a17f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:55:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a26a17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd91d9b640 1 -- 172.21.15.67:0/2776051445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 msgr2=0x55d5a26a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd91d9b640 1 -- 172.21.15.67:0/2776051445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a2359650 con 0x55d5a2695480 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.538+0000 7fbd837fe640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 0x7fbd7c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd88005c20 tx=0x7fbd88030510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1531c6e8192c8e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd837fe640 1 -- 172.21.15.67:0/569007550 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbd8c0e62a0 con 0x7fbd9410bb50 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd9259c640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 0x7fbd7c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd80ff9640 1 -- 172.21.15.67:0/2776051445 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88036070 con 0x55d5a2695480 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd80ff9640 1 -- 172.21.15.67:0/2776051445 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd88030d90 con 0x55d5a2695480 2024-09-10T20:55:00.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.539+0000 7fbd80ff9640 1 -- 172.21.15.67:0/2776051445 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003c30 con 0x55d5a2695480 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 -- 172.21.15.67:0/2776051445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 msgr2=0x55d5a2695860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbd88005c20 tx=0x7fbd88030510 comp rx=0 tx=0).stop 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 -- 172.21.15.67:0/2776051445 shutdown_connections 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a26a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2776051445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a2695860 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.540+0000 7fbd9accb740 1 -- 172.21.15.67:0/2776051445 >> 172.21.15.67:0/2776051445 conn(0x55d5a26932b0 msgr2=0x55d5a2694450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.541+0000 7fbd9accb740 1 -- 172.21.15.67:0/2776051445 shutdown_connections 2024-09-10T20:55:00.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.541+0000 7fbd9259c640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 0x7fbd7c0b7960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55d5a2694190 tx=0x7fbd8400b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.541+0000 7fbd9accb740 1 -- 172.21.15.67:0/2776051445 wait complete. 2024-09-10T20:55:00.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.542+0000 7fbd9accb740 1 -- start start 2024-09-10T20:55:00.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.542+0000 7fbd9accb740 1 Processor -- start 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.542+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a269ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a269f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d5a245c700 con 0x55d5a26a1d30 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d5a2596110 con 0x55d5a2695da0 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d5a26a4950 con 0x55d5a2695480 2024-09-10T20:55:00.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42478/0 (socket says 172.21.15.67:42478) 2024-09-10T20:55:00.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 -- 172.21.15.67:0/2710976053 learned_addr learned my addr 172.21.15.67:0/2710976053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:00.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a269ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9accb740 10 client.0 _ll_register_callbacks cb 0x55d5a25af990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:00.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a269f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 -- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 msgr2=0x55d5a269ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a269ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 -- 172.21.15.67:0/2710976053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 msgr2=0x55d5a269f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a269f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd9259c640 1 -- 172.21.15.67:0/2710976053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a25c3c40 con 0x55d5a2695480 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.543+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a269f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400ddb0 tx=0x7fbd84004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a2310193f8b87c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84021020 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbd8401d440 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd88030d90 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd8401d640 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd9accb740 10 client.25390 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.544+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d5a26b0330 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd84016030 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fbd840287e0 con 0x55d5a2695480 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 10 client.25390 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 10 client.25390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 20 client.25390 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a26b1890 0x55d5a26b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 4 client.25390 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:00.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbd88030d90 con 0x55d5a26b1890 2024-09-10T20:55:00.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.545+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a26b1890 0x55d5a26b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.546+0000 7fbd91d9b640 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a26b1890 0x55d5a26b3c80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ebf6585d4485285 server_cookie=dcaa164f52989451 in_seq=0 out_seq=0 2024-09-10T20:55:00.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.546+0000 7fbd79ffb640 10 client.25390 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:00.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.547+0000 7fbd79ffb640 1 -- 172.21.15.67:0/2710976053 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fbd88030d90 con 0x55d5a26b1890 2024-09-10T20:55:00.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.547+0000 7fbd79ffb640 10 client.25390 handle_command_reply: tid=0 2024-09-10T20:55:00.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.547+0000 7fbd9accb740 1 client.25390 shutdown 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 msgr2=0x55d5a26a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400ddb0 tx=0x7fbd84004730 comp rx=0 tx=0).stop 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 shutdown_connections 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a26b1890 0x55d5a26b3c80 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a269f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695da0 0x55d5a269ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2710976053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a1680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 >> 172.21.15.67:0/2710976053 conn(0x55d5a26932b0 msgr2=0x55d5a2698e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd79ffb640 0 client.25390 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 shutdown_connections 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 1 -- 172.21.15.67:0/2710976053 wait complete. 2024-09-10T20:55:00.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.548+0000 7fbd9accb740 20 client.25390 trim_cache size 0 max 16384 2024-09-10T20:55:00.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 Processor -- start 2024-09-10T20:55:00.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 -- start start 2024-09-10T20:55:00.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 0x55d5a2694370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b7210 con 0x55d5a26a1d30 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b4a80 con 0x55d5a2695480 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.581+0000 7fbd9accb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b28d0 con 0x55d5a2695da0 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 0x55d5a2694370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:41522/0 (socket says 172.21.15.67:41522) 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 0x55d5a2694370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42492/0 (socket says 172.21.15.67:42492) 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 -- 172.21.15.67:0/2029891519 learned_addr learned my addr 172.21.15.67:0/2029891519 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 -- 172.21.15.67:0/2029891519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 msgr2=0x55d5a2694370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 0x55d5a2694370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 -- 172.21.15.67:0/2029891519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 msgr2=0x55d5a26922c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26922c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd9259c640 1 -- 172.21.15.67:0/2029891519 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a2693f90 con 0x55d5a2695480 2024-09-10T20:55:00.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.582+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:00.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.583+0000 7fbd9259c640 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd84006010 tx=0x7fbd84010cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccb4b771a65cc7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.583+0000 7fbd7bfff640 1 -- 172.21.15.67:0/2029891519 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037020 con 0x55d5a2695480 2024-09-10T20:55:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.583+0000 7fbd7bfff640 1 -- 172.21.15.67:0/2029891519 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd84016040 con 0x55d5a2695480 2024-09-10T20:55:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.583+0000 7fbd7bfff640 1 -- 172.21.15.67:0/2029891519 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8401da40 con 0x55d5a2695480 2024-09-10T20:55:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.584+0000 7fbd9accb740 1 -- 172.21.15.67:0/2029891519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 msgr2=0x55d5a26adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.584+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd84006010 tx=0x7fbd84010cc0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 -- 172.21.15.67:0/2029891519 shutdown_connections 2024-09-10T20:55:00.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a26a1d30 0x55d5a26922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695da0 0x55d5a2694370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 --2- 172.21.15.67:0/2029891519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a2695480 0x55d5a26adbb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 -- 172.21.15.67:0/2029891519 >> 172.21.15.67:0/2029891519 conn(0x55d5a26932b0 msgr2=0x55d5a2691bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 -- 172.21.15.67:0/2029891519 shutdown_connections 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.586+0000 7fbd9accb740 1 -- 172.21.15.67:0/2029891519 wait complete. 2024-09-10T20:55:00.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.587+0000 7fbd9accb740 1 -- start start 2024-09-10T20:55:00.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.587+0000 7fbd9accb740 1 Processor -- start 2024-09-10T20:55:00.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.587+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a2695da0 0x55d5a26aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42500/0 (socket says 172.21.15.67:42500) 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b2f40 con 0x55d5a2695da0 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b43b0 con 0x55d5a26a1d30 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd941b3610 con 0x55d5a2695480 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9259c640 1 -- 172.21.15.67:0/4226558022 learned_addr learned my addr 172.21.15.67:0/4226558022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd9accb740 10 client.0 _ll_register_callbacks cb 0x7fbd84005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 -- 172.21.15.67:0/4226558022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 msgr2=0x55d5a26a9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 -- 172.21.15.67:0/4226558022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a2695da0 msgr2=0x55d5a26aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a2695da0 0x55d5a26aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.588+0000 7fbd92d9d640 1 -- 172.21.15.67:0/4226558022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a26a52c0 con 0x55d5a26a1d30 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd92d9d640 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0a9ca0 tx=0x7fbd8c0b1400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5cc9188db9e4656 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:00.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0ac540 con 0x55d5a26a1d30 2024-09-10T20:55:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbd8c0b5b30 con 0x55d5a26a1d30 2024-09-10T20:55:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd84016040 con 0x55d5a26a1d30 2024-09-10T20:55:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbd8c0ad130 con 0x55d5a26a1d30 2024-09-10T20:55:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd9accb740 10 client.25415 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:00.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.589+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d5a271f140 con 0x55d5a26a1d30 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd84016040 con 0x55d5a26a1d30 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fbd8c016b80 con 0x55d5a26a1d30 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 10 client.25415 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 10 client.25415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 20 client.25415 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a271f8e0 0x55d5a2721d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 4 client.25415 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.590+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d5a260dda0 con 0x55d5a271f8e0 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.591+0000 7fbd9259c640 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a271f8e0 0x55d5a2721d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.592+0000 7fbd9259c640 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a271f8e0 0x55d5a2721d00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85636dc3efeb5b06 server_cookie=605169848088f8d8 in_seq=0 out_seq=0 2024-09-10T20:55:00.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.592+0000 7fbd79ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.592+0000 7fbd79ffb640 1 -- 172.21.15.67:0/4226558022 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55d5a260dda0 con 0x55d5a271f8e0 2024-09-10T20:55:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.592+0000 7fbd79ffb640 10 client.25415 handle_command_reply: tid=0 2024-09-10T20:55:00.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.592+0000 7fbd9accb740 1 client.25415 shutdown 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.593+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 msgr2=0x55d5a26a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.593+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0a9ca0 tx=0x7fbd8c0b1400 comp rx=0 tx=0).stop 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.593+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 shutdown_connections 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d5a271f8e0 0x55d5a2721d00 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d5a26a1d30 0x55d5a26a4bd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d5a2695da0 0x55d5a26aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 --2- 172.21.15.67:0/4226558022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d5a2695480 0x55d5a26a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 >> 172.21.15.67:0/4226558022 conn(0x55d5a26932b0 msgr2=0x55d5a26a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd79ffb640 0 client.25415 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 shutdown_connections 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 1 -- 172.21.15.67:0/4226558022 wait complete. 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.594+0000 7fbd9accb740 20 client.25415 trim_cache size 0 max 16384 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:55:00.599 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:00.600 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:55:00.601 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:00.602 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:00.603 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:00.603 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:00.603 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:55:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.595+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 msgr2=0x7fbd7c0b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.595+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 0x7fbd7c0b7960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55d5a2694190 tx=0x7fbd8400b370 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.595+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 msgr2=0x7fbd941974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.595+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00eb10 tx=0x7fbd8c00c2d0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 shutdown_connections 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd9410bb50 0x7fbd941974f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbd7c0b54a0 0x7fbd7c0b7960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd94106f20 0x7fbd94196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 --2- 172.21.15.67:0/569007550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbd94101600 0x7fbd94199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.596+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 >> 172.21.15.67:0/569007550 conn(0x7fbd940fca20 msgr2=0x7fbd94103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.597+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 shutdown_connections 2024-09-10T20:55:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:00.597+0000 7fbd988f6640 1 -- 172.21.15.67:0/569007550 wait complete. 2024-09-10T20:55:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:00 smithi172 ceph-mon[35265]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 731 op/s 2024-09-10T20:55:00.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:00 smithi067 ceph-mon[30891]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 731 op/s 2024-09-10T20:55:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:00 smithi083 ceph-mon[35058]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 731 op/s 2024-09-10T20:55:01.495 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:55:01.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:55:01.966 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:02.664 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:02 smithi067 ceph-mon[30891]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 666 op/s 2024-09-10T20:55:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:02 smithi172 ceph-mon[35265]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 666 op/s 2024-09-10T20:55:02.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 -- 172.21.15.67:0/3844621615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc101cd0 msgr2=0x7fcefc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 --2- 172.21.15.67:0/3844621615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc101cd0 0x7fcefc1020b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fceec009900 tx=0x7fceec02a410 comp rx=0 tx=0).stop 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 -- 172.21.15.67:0/3844621615 shutdown_connections 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 --2- 172.21.15.67:0/3844621615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc108060 0x7fcefc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 --2- 172.21.15.67:0/3844621615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc1076e0 0x7fcefc107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 --2- 172.21.15.67:0/3844621615 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc101cd0 0x7fcefc1020b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 -- 172.21.15.67:0/3844621615 >> 172.21.15.67:0/3844621615 conn(0x7fcefc0fd740 msgr2=0x7fcefc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 -- 172.21.15.67:0/3844621615 shutdown_connections 2024-09-10T20:55:02.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.791+0000 7fcf01a96640 1 -- 172.21.15.67:0/3844621615 wait complete. 2024-09-10T20:55:02.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.792+0000 7fcf01a96640 1 Processor -- start 2024-09-10T20:55:02.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 -- start start 2024-09-10T20:55:02.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:02.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 0x7fcefc199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 0x7fcefc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111d70 con 0x7fcefc1076e0 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111bf0 con 0x7fcefc108060 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcf01a96640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111ef0 con 0x7fcefc101cd0 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcefb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcefb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52138/0 (socket says 172.21.15.67:52138) 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.793+0000 7fcefb7fe640 1 -- 172.21.15.67:0/209686112 learned_addr learned my addr 172.21.15.67:0/209686112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefbfff640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 0x7fcefc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefaffd640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 0x7fcefc199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 -- 172.21.15.67:0/209686112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 msgr2=0x7fcefc19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 0x7fcefc19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:02.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 -- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 msgr2=0x7fcefc199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 0x7fcefc199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 -- 172.21.15.67:0/209686112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc19c120 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefaffd640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 0x7fcefc199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefbfff640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 0x7fcefc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcefb7fe640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fceec031440 tx=0x7fceec003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec03f070 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceec031b50 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec035030 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcefc19c3b0 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.794+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcefc1124d0 con 0x7fcefc101cd0 2024-09-10T20:55:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.795+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcefc102f80 con 0x7fcefc101cd0 2024-09-10T20:55:02.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.797+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fceec03bbd0 con 0x7fcefc101cd0 2024-09-10T20:55:02.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.799+0000 7fcef8ff9640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 0x7fcee40b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:02.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.799+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fceec106620 con 0x7fcefc101cd0 2024-09-10T20:55:02.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.799+0000 7fcefaffd640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 0x7fcee40b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:02.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.800+0000 7fcefaffd640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 0x7fcee40b78e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcefc100000 tx=0x7fcef0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:02.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:02.800+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fceec0cd4b0 con 0x7fcefc101cd0 2024-09-10T20:55:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:02 smithi083 ceph-mon[35058]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 666 op/s 2024-09-10T20:55:03.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.175+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcefc19a3e0 con 0x7fcefc101cd0 2024-09-10T20:55:03.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.176+0000 7fcef8ff9640 1 -- 172.21.15.67:0/209686112 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11907 (secure 0 0 0) 0x7fceec0ccdb0 con 0x7fcefc101cd0 2024-09-10T20:55:03.180 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:55:03.180 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"btime":"2024-09-10T20:54:26:300672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:54:25.547459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:55:03.181 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 32 2024-09-10T20:55:03.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 msgr2=0x7fcee40b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:03.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 0x7fcee40b78e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcefc100000 tx=0x7fcef0005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 msgr2=0x7fcefc1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fceec031440 tx=0x7fceec003b90 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 shutdown_connections 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcefc108060 0x7fcefc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcefc1076e0 0x7fcefc199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcee40b5420 0x7fcee40b78e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 --2- 172.21.15.67:0/209686112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcefc101cd0 0x7fcefc1995c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.179+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 >> 172.21.15.67:0/209686112 conn(0x7fcefc0fd740 msgr2=0x7fcefc0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.180+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 shutdown_connections 2024-09-10T20:55:03.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:03.180+0000 7fcf01a96640 1 -- 172.21.15.67:0/209686112 wait complete. 2024-09-10T20:55:03.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:03 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/209686112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:03.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:03 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/209686112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:03.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:03 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/209686112' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:03.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:55:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 210.0 s, 3376.6 tps, lat 29.473 ms stddev 33.651 2024-09-10T20:55:04.312 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:04 smithi172 ceph-mon[35265]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.2 MiB/s wr, 789 op/s 2024-09-10T20:55:04.772 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:04 smithi067 ceph-mon[30891]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.2 MiB/s wr, 789 op/s 2024-09-10T20:55:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:04 smithi083 ceph-mon[35058]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.2 MiB/s wr, 789 op/s 2024-09-10T20:55:05.023 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 -- 172.21.15.67:0/1245568548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 msgr2=0x7f860410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 --2- 172.21.15.67:0/1245568548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f860410e820 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009ca0 tx=0x7f85fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 -- 172.21.15.67:0/1245568548 shutdown_connections 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 --2- 172.21.15.67:0/1245568548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f860410e820 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 --2- 172.21.15.67:0/1245568548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f8604107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 --2- 172.21.15.67:0/1245568548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f8604102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 -- 172.21.15.67:0/1245568548 >> 172.21.15.67:0/1245568548 conn(0x7f86040fd700 msgr2=0x7f86040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 -- 172.21.15.67:0/1245568548 shutdown_connections 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.942+0000 7f86097a4640 1 -- 172.21.15.67:0/1245568548 wait complete. 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 Processor -- start 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 -- start start 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f860419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f86041a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8604110be0 con 0x7f8604108020 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8604110a60 con 0x7f86041076a0 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86097a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8604110d60 con 0x7f8604101c90 2024-09-10T20:55:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46794/0 (socket says 172.21.15.67:46794) 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f85fbfff640 1 -- 172.21.15.67:0/558157672 learned_addr learned my addr 172.21.15.67:0/558157672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f86037fe640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f86041a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.943+0000 7f8602ffd640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f860419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.944+0000 7f8602ffd640 1 -- 172.21.15.67:0/558157672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 msgr2=0x7f860419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.944+0000 7f8602ffd640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.944+0000 7f8602ffd640 1 -- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 msgr2=0x7f86041a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.944+0000 7f8602ffd640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f86041a4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.944+0000 7f8602ffd640 1 -- 172.21.15.67:0/558157672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86041a5710 con 0x7f8604101c90 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.945+0000 7f86037fe640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f86041a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.945+0000 7f85fbfff640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.945+0000 7f8602ffd640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f860419f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f85f400e9f0 tx=0x7f85f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.946+0000 7f8600ff9640 1 -- 172.21.15.67:0/558157672 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f400ccc0 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.946+0000 7f8600ff9640 1 -- 172.21.15.67:0/558157672 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85f4005020 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.946+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86041a5a00 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.946+0000 7f8600ff9640 1 -- 172.21.15.67:0/558157672 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4004a00 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.946+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86041ac0c0 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.949+0000 7f8600ff9640 1 -- 172.21.15.67:0/558157672 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f85f4004ba0 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f860bb79740 1 Processor -- start 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f860bb79740 1 -- start start 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f8600ff9640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 0x7f85f00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f86037fe640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 0x7f85f00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f8600ff9640 1 -- 172.21.15.67:0/558157672 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85f40e5b30 con 0x7f8604101c90 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f860bb79740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.951+0000 7f860bb79740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f860bb79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 0x55f19a950170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f860bb79740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f19a8b7ea0 con 0x55f19a9414d0 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f860bb79740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f19a8a72d0 con 0x55f19a941df0 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f860bb79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f19a8ab0e0 con 0x55f19a94dd80 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43604/0 (socket says 172.21.15.67:43604) 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f8602ffd640 1 -- 172.21.15.67:0/1375487300 learned_addr learned my addr 172.21.15.67:0/1375487300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f86037fe640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 0x55f19a950170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 -- 172.21.15.67:0/1375487300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 msgr2=0x55f19a950170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 0x55f19a950170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 -- 172.21.15.67:0/1375487300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 msgr2=0x55f19a9418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 -- 172.21.15.67:0/1375487300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19a605650 con 0x55f19a941df0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f86037fe640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 0x55f19a950170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94d840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86040fff30 tx=0x7f85ec005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a4658b457bac0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85f97fa640 1 -- 172.21.15.67:0/1375487300 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec004230 con 0x55f19a941df0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85f97fa640 1 -- 172.21.15.67:0/1375487300 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85ec0043d0 con 0x55f19a941df0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.952+0000 7f85f97fa640 1 -- 172.21.15.67:0/1375487300 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0178d0 con 0x55f19a941df0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.953+0000 7f86037fe640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 0x7f85f00b7930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f85fc001190 tx=0x7f85fc02f450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 -- 172.21.15.67:0/1375487300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 msgr2=0x55f19a94d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94d840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86040fff30 tx=0x7f85ec005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 -- 172.21.15.67:0/1375487300 shutdown_connections 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a94dd80 0x55f19a950170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94d840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 --2- 172.21.15.67:0/1375487300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a9414d0 0x55f19a9418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.954+0000 7f860bb79740 1 -- 172.21.15.67:0/1375487300 >> 172.21.15.67:0/1375487300 conn(0x55f19a93f300 msgr2=0x55f19a9404a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 -- 172.21.15.67:0/1375487300 shutdown_connections 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 -- 172.21.15.67:0/1375487300 wait complete. 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 -- start start 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 Processor -- start 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a94d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.955+0000 7f860bb79740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f860bb79740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f860bb79740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55f19a708700 con 0x55f19a94dd80 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f860bb79740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f19a842160 con 0x55f19a941df0 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46812/0 (socket says 172.21.15.67:46812) 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f8602ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a94d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 -- 172.21.15.67:0/2534068896 learned_addr learned my addr 172.21.15.67:0/2534068896 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f860bb79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f19a950a00 con 0x55f19a9414d0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f86037fe640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f860bb79740 10 client.0 _ll_register_callbacks cb 0x55f19a85b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 -- 172.21.15.67:0/2534068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 msgr2=0x55f19a94d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a94d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 -- 172.21.15.67:0/2534068896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 msgr2=0x55f19a94b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.956+0000 7f85fbfff640 1 -- 172.21.15.67:0/2534068896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19a86fc90 con 0x55f19a941df0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f8602ffd640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a94d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f85fbfff640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00f010 tx=0x7f85ec005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9835f13b9a437cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f85ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec027070 con 0x55f19a941df0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85ec0043d0 con 0x55f19a941df0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85ec003b00 con 0x55f19a941df0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.957+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f85ec033050 con 0x55f19a941df0 2024-09-10T20:55:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 10 client.25433 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f19a95c240 con 0x55f19a941df0 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85ec0043d0 con 0x55f19a941df0 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f85ec023790 con 0x55f19a941df0 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 10 client.25433 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 10 client.25433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 20 client.25433 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a95d590 0x55f19a95f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 4 client.25433 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.958+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f19a8b9df0 con 0x55f19a95d590 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.959+0000 7f8602ffd640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a95d590 0x55f19a95f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.959+0000 7f85ea7fc640 10 client.25433 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.960+0000 7f8602ffd640 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a95d590 0x55f19a95f980 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3d76a5e37b5e07b server_cookie=2b05229f90345008 in_seq=0 out_seq=0 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f85ea7fc640 1 -- 172.21.15.67:0/2534068896 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f19a8b9df0 con 0x55f19a95d590 2024-09-10T20:55:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f85ea7fc640 10 client.25433 handle_command_reply: tid=0 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 client.25433 shutdown 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 msgr2=0x55f19a94aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00f010 tx=0x7f85ec005ce0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 shutdown_connections 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a95d590 0x55f19a95f980 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a94aaa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 --2- 172.21.15.67:0/2534068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a94d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 >> 172.21.15.67:0/2534068896 conn(0x55f19a93f300 msgr2=0x55f19a944ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f85ea7fc640 0 client.25433 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 shutdown_connections 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 1 -- 172.21.15.67:0/2534068896 wait complete. 2024-09-10T20:55:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.961+0000 7f860bb79740 20 client.25433 trim_cache size 0 max 16384 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 Processor -- start 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 -- start start 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a9408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a93ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b7200 con 0x55f19a94dd80 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b4a70 con 0x55f19a941df0 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.984+0000 7f860bb79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b28c0 con 0x55f19a9414d0 2024-09-10T20:55:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43622/0 (socket says 172.21.15.67:43622) 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 -- 172.21.15.67:0/1297232299 learned_addr learned my addr 172.21.15.67:0/1297232299 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a9408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a93ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 -- 172.21.15.67:0/1297232299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 msgr2=0x55f19a9408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a9408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 -- 172.21.15.67:0/1297232299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 msgr2=0x55f19a93ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a93ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.985+0000 7f86037fe640 1 -- 172.21.15.67:0/1297232299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19a93fd80 con 0x55f19a94dd80 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.986+0000 7f86037fe640 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f85fc031d60 tx=0x7f85fc03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa29ff7a2de20300 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.986+0000 7f85f8ff9640 1 -- 172.21.15.67:0/1297232299 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc004040 con 0x55f19a94dd80 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.987+0000 7f85f8ff9640 1 -- 172.21.15.67:0/1297232299 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85fc053070 con 0x55f19a94dd80 2024-09-10T20:55:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.987+0000 7f85f8ff9640 1 -- 172.21.15.67:0/1297232299 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc02fb70 con 0x55f19a94dd80 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.987+0000 7f860bb79740 1 -- 172.21.15.67:0/1297232299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 msgr2=0x55f19a94c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.987+0000 7f860bb79740 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f85fc031d60 tx=0x7f85fc03b000 comp rx=0 tx=0).stop 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 -- 172.21.15.67:0/1297232299 shutdown_connections 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a94dd80 0x55f19a94c7e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a941df0 0x55f19a93ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 --2- 172.21.15.67:0/1297232299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a9408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 -- 172.21.15.67:0/1297232299 >> 172.21.15.67:0/1297232299 conn(0x55f19a93f300 msgr2=0x55f19a94c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 -- 172.21.15.67:0/1297232299 shutdown_connections 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 -- 172.21.15.67:0/1297232299 wait complete. 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 -- start start 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.988+0000 7f860bb79740 1 Processor -- start 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a955ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 0x55f19a9561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 0x55f19a950c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b2f30 con 0x55f19a941df0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b43a0 con 0x55f19a94dd80 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86041b3600 con 0x55f19a9414d0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f860bb79740 10 client.0 _ll_register_callbacks cb 0x7f85ec00de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f86037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 0x55f19a950c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f85fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 0x55f19a9561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f86037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 0x55f19a950c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46822/0 (socket says 172.21.15.67:46822) 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f86037fe640 1 -- 172.21.15.67:0/1485297324 learned_addr learned my addr 172.21.15.67:0/1485297324 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.989+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a955ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 -- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 msgr2=0x55f19a950c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 0x55f19a950c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 -- 172.21.15.67:0/1485297324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 msgr2=0x55f19a9561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 0x55f19a9561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 -- 172.21.15.67:0/1485297324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19a951190 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 0x55f19a9561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f8602ffd640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a955ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c6a0 tx=0x7f85f4009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7300dc9eaf269f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.990+0000 7f85ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f401c040 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85fc053070 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85f40054f0 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f85f40ac2c0 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f860bb79740 10 client.25417 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f19a9db9a0 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.991+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85fc053070 con 0x55f19a9414d0 2024-09-10T20:55:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f85f40cf0b0 con 0x55f19a9414d0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 10 client.25417 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 10 client.25417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 20 client.25417 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a9dc1f0 0x55f19a9de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 4 client.25417 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f19a8b58a0 con 0x55f19a9dc1f0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a9dc1f0 0x55f19a9de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f85ea7fc640 10 client.25417 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.992+0000 7f85fbfff640 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a9dc1f0 0x55f19a9de610 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7754d39b66cf8019 server_cookie=fbdb456d01ecacfc in_seq=0 out_seq=0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.993+0000 7f85ea7fc640 1 -- 172.21.15.67:0/1485297324 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f19a8b58a0 con 0x55f19a9dc1f0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.993+0000 7f85ea7fc640 10 client.25417 handle_command_reply: tid=0 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.993+0000 7f860bb79740 1 client.25417 shutdown 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.993+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 msgr2=0x55f19a955ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.993+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a955ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c6a0 tx=0x7f85f4009f60 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 shutdown_connections 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55f19a9dc1f0 0x55f19a9de610 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f19a94dd80 0x55f19a950c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55f19a941df0 0x55f19a9561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 --2- 172.21.15.67:0/1485297324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19a9414d0 0x55f19a955ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f85ea7fc640 0 client.25417 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 >> 172.21.15.67:0/1485297324 conn(0x55f19a93f300 msgr2=0x55f19a940760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 shutdown_connections 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.994+0000 7f860bb79740 1 -- 172.21.15.67:0/1485297324 wait complete. 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f860bb79740 20 client.25417 trim_cache size 0 max 16384 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 msgr2=0x7f85f00b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 0x7f85f00b7930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f85fc001190 tx=0x7f85fc02f450 comp rx=0 tx=0).stop 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 msgr2=0x7f860419f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f860419f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f85f400e9f0 tx=0x7f85f400eeb0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.995+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 shutdown_connections 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8604108020 0x7f86041a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86041076a0 0x7f860419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85f00b5470 0x7f85f00b7930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 --2- 172.21.15.67:0/558157672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8604101c90 0x7f860419f660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 >> 172.21.15.67:0/558157672 conn(0x7f86040fd700 msgr2=0x7f86040fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 shutdown_connections 2024-09-10T20:55:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:04.996+0000 7f86097a4640 1 -- 172.21.15.67:0/558157672 wait complete. 2024-09-10T20:55:05.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:55:06.401 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:06 smithi172 ceph-mon[35265]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.5 MiB/s wr, 727 op/s 2024-09-10T20:55:06.700 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:06 smithi067 ceph-mon[30891]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.5 MiB/s wr, 727 op/s 2024-09-10T20:55:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:06 smithi083 ceph-mon[35058]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.5 MiB/s wr, 727 op/s 2024-09-10T20:55:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 -- 172.21.15.67:0/3154689130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107530 msgr2=0x7f88a4107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 --2- 172.21.15.67:0/3154689130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107530 0x7f88a4107970 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8894009900 tx=0x7f889402a410 comp rx=0 tx=0).stop 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 -- 172.21.15.67:0/3154689130 shutdown_connections 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 --2- 172.21.15.67:0/3154689130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4107eb0 0x7f88a410e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 --2- 172.21.15.67:0/3154689130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107530 0x7f88a4107970 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 --2- 172.21.15.67:0/3154689130 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4101b20 0x7f88a4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 -- 172.21.15.67:0/3154689130 >> 172.21.15.67:0/3154689130 conn(0x7f88a40fd5d0 msgr2=0x7f88a40ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 -- 172.21.15.67:0/3154689130 shutdown_connections 2024-09-10T20:55:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.982+0000 7f88aa115640 1 -- 172.21.15.67:0/3154689130 wait complete. 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.983+0000 7f88aa115640 1 Processor -- start 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.983+0000 7f88aa115640 1 -- start start 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4101b20 0x7f88a410e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107eb0 0x7f88a410ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4110900 con 0x7f88a4107eb0 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4110780 con 0x7f88a4107530 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88aa115640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4110a80 con 0x7f88a4101b20 2024-09-10T20:55:06.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46834/0 (socket says 172.21.15.67:46834) 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 -- 172.21.15.67:0/2597557160 learned_addr learned my addr 172.21.15.67:0/2597557160 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a3fff640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107eb0 0x7f88a410ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a37fe640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4101b20 0x7f88a410e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 -- 172.21.15.67:0/2597557160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4101b20 msgr2=0x7f88a410e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4101b20 0x7f88a410e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 -- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107eb0 msgr2=0x7f88a410ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107eb0 0x7f88a410ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.984+0000 7f88a2ffd640 1 -- 172.21.15.67:0/2597557160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a410c1a0 con 0x7f88a4107530 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8894005ab0 tx=0x7f8894003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88a0ff9640 1 -- 172.21.15.67:0/2597557160 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889403f070 con 0x7f88a4107530 2024-09-10T20:55:06.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88a0ff9640 1 -- 172.21.15.67:0/2597557160 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8894031d60 con 0x7f88a4107530 2024-09-10T20:55:06.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88a0ff9640 1 -- 172.21.15.67:0/2597557160 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894035030 con 0x7f88a4107530 2024-09-10T20:55:06.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a41abc10 con 0x7f88a4107530 2024-09-10T20:55:06.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.985+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a41abfb0 con 0x7f88a4107530 2024-09-10T20:55:06.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.988+0000 7f88a0ff9640 1 -- 172.21.15.67:0/2597557160 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f889403b580 con 0x7f88a4107530 2024-09-10T20:55:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.989+0000 7f88a0ff9640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 0x7f888c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.990+0000 7f88a37fe640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 0x7f888c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.990+0000 7f88a0ff9640 1 -- 172.21.15.67:0/2597557160 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f88941065c0 con 0x7f88a4107530 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.990+0000 7f88a37fe640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 0x7f888c0b78d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f88980095f0 tx=0x7f8898005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.990+0000 7f88ac4ea740 1 Processor -- start 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.990+0000 7f88ac4ea740 1 -- start start 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560a49dbfea0 con 0x560a49e49fc0 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560a49daf2d0 con 0x560a49e496a0 2024-09-10T20:55:06.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a49db30e0 con 0x560a49e55f50 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43650/0 (socket says 172.21.15.67:43650) 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a2ffd640 1 -- 172.21.15.67:0/563088218 learned_addr learned my addr 172.21.15.67:0/563088218 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46850/0 (socket says 172.21.15.67:46850) 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 -- 172.21.15.67:0/563088218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 msgr2=0x560a49e49a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 -- 172.21.15.67:0/563088218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 msgr2=0x560a49e55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a3fff640 1 -- 172.21.15.67:0/563088218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a49b0d650 con 0x560a49e55f50 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.991+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.992+0000 7f88a37fe640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.992+0000 7f88a3fff640 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e58340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f889c009f50 tx=0x7f889c003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d262770535bb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.992+0000 7f8889ffb640 1 -- 172.21.15.67:0/563088218 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c011440 con 0x560a49e55f50 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.992+0000 7f8889ffb640 1 -- 172.21.15.67:0/563088218 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889c015030 con 0x560a49e55f50 2024-09-10T20:55:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.992+0000 7f8889ffb640 1 -- 172.21.15.67:0/563088218 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c010880 con 0x560a49e55f50 2024-09-10T20:55:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.993+0000 7f88ac4ea740 1 -- 172.21.15.67:0/563088218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 msgr2=0x560a49e58340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.993+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e58340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f889c009f50 tx=0x7f889c003e00 comp rx=0 tx=0).stop 2024-09-10T20:55:07.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 -- 172.21.15.67:0/563088218 shutdown_connections 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e58340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/563088218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e49a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 -- 172.21.15.67:0/563088218 >> 172.21.15.67:0/563088218 conn(0x560a49e474d0 msgr2=0x560a49e48670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 -- 172.21.15.67:0/563088218 shutdown_connections 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 -- 172.21.15.67:0/563088218 wait complete. 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.994+0000 7f88ac4ea740 1 -- start start 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 Processor -- start 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e55f50 0x560a49e53350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560a49c10700 con 0x560a49e496a0 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560a49d4a160 con 0x560a49e55f50 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a49e58bd0 con 0x560a49e49fc0 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52224/0 (socket says 172.21.15.67:52224) 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 -- 172.21.15.67:0/3357049346 learned_addr learned my addr 172.21.15.67:0/3357049346 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a3fff640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e55f50 0x560a49e53350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 -- 172.21.15.67:0/3357049346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e55f50 msgr2=0x560a49e53350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e55f50 0x560a49e53350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 -- 172.21.15.67:0/3357049346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 msgr2=0x560a49e55880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e55880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.995+0000 7f88a2ffd640 1 -- 172.21.15.67:0/3357049346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a49d77c90 con 0x560a49e49fc0 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8894104140 tx=0x7f889402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac1a420d2f6b1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f8882ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f8882ffd640 1 -- 172.21.15.67:0/3357049346 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894049070 con 0x560a49e49fc0 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f8882ffd640 1 -- 172.21.15.67:0/3357049346 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f88940b8170 con 0x560a49e49fc0 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f8882ffd640 10 client.0 inactive, discarding osd_map(75..75 src has 1..75) 2024-09-10T20:55:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.996+0000 7f88ac4ea740 10 client.0 _ll_register_callbacks cb 0x560a49d639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.997+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f889c015030 con 0x560a49e49fc0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.997+0000 7f8882ffd640 1 -- 172.21.15.67:0/3357049346 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f88940cc970 con 0x560a49e49fc0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.997+0000 7f88ac4ea740 10 client.25429 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.997+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=32}) -- 0x560a49e640d0 con 0x560a49e49fc0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f8882ffd640 1 -- 172.21.15.67:0/3357049346 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f88940cd0c0 con 0x560a49e49fc0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 10 client.25429 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 10 client.25429 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 20 client.25429 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49e657a0 0x560a49e67c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 4 client.25429 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f889c015030 con 0x560a49e657a0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.998+0000 7f88a37fe640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49e657a0 0x560a49e67c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.999+0000 7f88a37fe640 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49e657a0 0x560a49e67c60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bbfdbb59ae3a040a server_cookie=c6aaaf1644f23aa1 in_seq=0 out_seq=0 2024-09-10T20:55:07.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:06.999+0000 7f8882ffd640 10 client.25429 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:07.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.000+0000 7f8882ffd640 1 -- 172.21.15.67:0/3357049346 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f889c015030 con 0x560a49e657a0 2024-09-10T20:55:07.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.000+0000 7f8882ffd640 10 client.25429 handle_command_reply: tid=0 2024-09-10T20:55:07.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.000+0000 7f88ac4ea740 1 client.25429 shutdown 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 msgr2=0x560a49e52cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8894104140 tx=0x7f889402a410 comp rx=0 tx=0).stop 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 shutdown_connections 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49e657a0 0x560a49e67c60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f8882ffd640 0 client.25429 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e55f50 0x560a49e53350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e49fc0 0x560a49e52cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3357049346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e55880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 >> 172.21.15.67:0/3357049346 conn(0x560a49e474d0 msgr2=0x560a49e4d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.001+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 shutdown_connections 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.002+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3357049346 wait complete. 2024-09-10T20:55:07.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.002+0000 7f88ac4ea740 20 client.25429 trim_cache size 0 max 16384 2024-09-10T20:55:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.023+0000 7f88ac4ea740 1 Processor -- start 2024-09-10T20:55:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.023+0000 7f88ac4ea740 1 -- start start 2024-09-10T20:55:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e49fc0 0x560a49e488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e57340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b6f30 con 0x560a49e496a0 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b47a0 con 0x560a49e49fc0 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b25f0 con 0x560a49e55f50 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43674/0 (socket says 172.21.15.67:43674) 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e49fc0 0x560a49e488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a37fe640 1 -- 172.21.15.67:0/2572137672 learned_addr learned my addr 172.21.15.67:0/2572137672 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e57340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 -- 172.21.15.67:0/2572137672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e49fc0 msgr2=0x560a49e488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e49fc0 0x560a49e488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 -- 172.21.15.67:0/2572137672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 msgr2=0x560a49e46e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.024+0000 7f88a3fff640 1 -- 172.21.15.67:0/2572137672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a49e682e0 con 0x560a49e55f50 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.025+0000 7f88a37fe640 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.025+0000 7f88a3fff640 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e57340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f80 tx=0x7f889c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f44f37d12baa22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.025+0000 7f88897fa640 1 -- 172.21.15.67:0/2572137672 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c02a070 con 0x560a49e55f50 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.025+0000 7f88897fa640 1 -- 172.21.15.67:0/2572137672 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889c015070 con 0x560a49e55f50 2024-09-10T20:55:07.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.025+0000 7f88897fa640 1 -- 172.21.15.67:0/2572137672 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c011ac0 con 0x560a49e55f50 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- 172.21.15.67:0/2572137672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 msgr2=0x560a49e57340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e57340 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f889c000f80 tx=0x7f889c009bb0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- 172.21.15.67:0/2572137672 shutdown_connections 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49e57340 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e49fc0 0x560a49e488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/2572137672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e496a0 0x560a49e46e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- 172.21.15.67:0/2572137672 >> 172.21.15.67:0/2572137672 conn(0x560a49e474d0 msgr2=0x560a49e481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- 172.21.15.67:0/2572137672 shutdown_connections 2024-09-10T20:55:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- 172.21.15.67:0/2572137672 wait complete. 2024-09-10T20:55:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.027+0000 7f88ac4ea740 1 -- start start 2024-09-10T20:55:07.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.028+0000 7f88ac4ea740 1 Processor -- start 2024-09-10T20:55:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.028+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.028+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e59b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e59b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88ac4ea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49ed2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b2c60 con 0x560a49e49fc0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b40d0 con 0x560a49e496a0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88ac4ea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88a41b3330 con 0x560a49e55f50 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88ac4ea740 10 client.0 _ll_register_callbacks cb 0x7f88940c8dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88a37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46874/0 (socket says 172.21.15.67:46874) 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88a37fe640 1 -- 172.21.15.67:0/3920208798 learned_addr learned my addr 172.21.15.67:0/3920208798 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.029+0000 7f88a3fff640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49ed2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a37fe640 1 -- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 msgr2=0x560a49ed2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a37fe640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49ed2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a37fe640 1 -- 172.21.15.67:0/3920208798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 msgr2=0x560a49e59b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a37fe640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e59b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a37fe640 1 -- 172.21.15.67:0/3920208798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a49e47f50 con 0x560a49e496a0 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f889c015070 con 0x560a49e496a0 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e59b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.030+0000 7f88a3fff640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49ed2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f88a37fe640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f889800e9f0 tx=0x7f8898004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6bbee93fd6b7b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f8882ffd640 10 client.25454 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f8882ffd640 1 -- 172.21.15.67:0/3920208798 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898033020 con 0x560a49e496a0 2024-09-10T20:55:07.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f8882ffd640 1 -- 172.21.15.67:0/3920208798 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8898004320 con 0x560a49e496a0 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f8882ffd640 1 -- 172.21.15.67:0/3920208798 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f88980035f0 con 0x560a49e496a0 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f88ac4ea740 10 client.25454 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.031+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=32}) -- 0x560a49e53930 con 0x560a49e496a0 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f8882ffd640 1 -- 172.21.15.67:0/3920208798 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f8898040020 con 0x560a49e496a0 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 10 client.25454 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 10 client.25454 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 20 client.25454 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49ed4350 0x560a49ed6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 4 client.25454 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a49dc1df0 con 0x560a49ed4350 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49ed4350 0x560a49ed6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f8882ffd640 10 client.25454 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:07.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.032+0000 7f88a2ffd640 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49ed4350 0x560a49ed6770 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cc98b0894683b32 server_cookie=b6bea97f63dc05ff in_seq=0 out_seq=0 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f8882ffd640 1 -- 172.21.15.67:0/3920208798 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a49dc1df0 con 0x560a49ed4350 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f8882ffd640 10 client.25454 handle_command_reply: tid=0 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f88ac4ea740 1 client.25454 shutdown 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 msgr2=0x560a49e59610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f889800e9f0 tx=0x7f8898004730 comp rx=0 tx=0).stop 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 shutdown_connections 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.033+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x560a49ed4350 0x560a49ed6770 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a49e55f50 0x560a49ed2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560a49e49fc0 0x560a49e59b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 --2- 172.21.15.67:0/3920208798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560a49e496a0 0x560a49e59610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 >> 172.21.15.67:0/3920208798 conn(0x560a49e474d0 msgr2=0x560a49e54300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f8882ffd640 0 client.25454 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 shutdown_connections 2024-09-10T20:55:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 1 -- 172.21.15.67:0/3920208798 wait complete. 2024-09-10T20:55:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.034+0000 7f88ac4ea740 20 client.25454 trim_cache size 0 max 16384 2024-09-10T20:55:07.041 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 msgr2=0x7f888c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 0x7f888c0b78d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f88980095f0 tx=0x7f8898005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 msgr2=0x7f88a410b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8894005ab0 tx=0x7f8894003c80 comp rx=0 tx=0).stop 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 shutdown_connections 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88a4107eb0 0x7f88a410ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88a4107530 0x7f88a410b510 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f888c0b5410 0x7f888c0b78d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 --2- 172.21.15.67:0/2597557160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4101b20 0x7f88a410e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.035+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 >> 172.21.15.67:0/2597557160 conn(0x7f88a40fd5d0 msgr2=0x7f88a40ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.036+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 shutdown_connections 2024-09-10T20:55:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:07.036+0000 7f88aa115640 1 -- 172.21.15.67:0/2597557160 wait complete. 2024-09-10T20:55:07.889 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:55:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:08.692 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:08 smithi067 ceph-mon[30891]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9.2 MiB/s wr, 843 op/s 2024-09-10T20:55:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:08 smithi172 ceph-mon[35265]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9.2 MiB/s wr, 843 op/s 2024-09-10T20:55:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:08 smithi083 ceph-mon[35058]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 9.2 MiB/s wr, 843 op/s 2024-09-10T20:55:08.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 -- 172.21.15.67:0/922763831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 msgr2=0x7fc034107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/922763831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc034107320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009ca0 tx=0x7fc02c02a8b0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 -- 172.21.15.67:0/922763831 shutdown_connections 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/922763831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc034107320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/922763831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc0341023b0 0x7fc034106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/922763831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc034101a90 0x7fc034101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 -- 172.21.15.67:0/922763831 >> 172.21.15.67:0/922763831 conn(0x7fc0340fd700 msgr2=0x7fc0340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 -- 172.21.15.67:0/922763831 shutdown_connections 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.966+0000 7fc03a3d5640 1 -- 172.21.15.67:0/922763831 wait complete. 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.967+0000 7fc03a3d5640 1 Processor -- start 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.967+0000 7fc03a3d5640 1 -- start start 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc034101a90 0x7fc034074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0341023b0 0x7fc034074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc034119350 con 0x7fc034101a90 2024-09-10T20:55:08.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341191d0 con 0x7fc0341023b0 2024-09-10T20:55:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc03a3d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341194d0 con 0x7fc034106ed0 2024-09-10T20:55:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52244/0 (socket says 172.21.15.67:52244) 2024-09-10T20:55:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 -- 172.21.15.67:0/545898259 learned_addr learned my addr 172.21.15.67:0/545898259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:08.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc033fff640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc034101a90 0x7fc034074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc02bfff640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0341023b0 0x7fc034074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 -- 172.21.15.67:0/545898259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0341023b0 msgr2=0x7fc034074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0341023b0 0x7fc034074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 -- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc034101a90 msgr2=0x7fc034074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc034101a90 0x7fc034074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.968+0000 7fc038972640 1 -- 172.21.15.67:0/545898259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03406e420 con 0x7fc034106ed0 2024-09-10T20:55:08.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc038972640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005cc0 tx=0x7fc02c030d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc031ffb640 1 -- 172.21.15.67:0/545898259 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004040 con 0x7fc034106ed0 2024-09-10T20:55:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc031ffb640 1 -- 172.21.15.67:0/545898259 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02c040070 con 0x7fc034106ed0 2024-09-10T20:55:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03406e6b0 con 0x7fc034106ed0 2024-09-10T20:55:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc034073620 con 0x7fc034106ed0 2024-09-10T20:55:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.969+0000 7fc031ffb640 1 -- 172.21.15.67:0/545898259 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c045b10 con 0x7fc034106ed0 2024-09-10T20:55:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.973+0000 7fc03c7aa740 1 Processor -- start 2024-09-10T20:55:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.973+0000 7fc031ffb640 1 -- 172.21.15.67:0/545898259 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc02c04d030 con 0x7fc034106ed0 2024-09-10T20:55:08.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.973+0000 7fc03c7aa740 1 -- start start 2024-09-10T20:55:08.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 0x558b25a168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a22840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a22d80 0x558b25a25170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558b2598cea0 con 0x558b25a164d0 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558b2597c2d0 con 0x558b25a22d80 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558b259800e0 con 0x558b25a16df0 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 0x558b25a168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 0x558b25a168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43692/0 (socket says 172.21.15.67:43692) 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc02bfff640 1 -- 172.21.15.67:0/746143780 learned_addr learned my addr 172.21.15.67:0/746143780 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a22840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc02bfff640 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a22d80 0x558b25a25170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 -- 172.21.15.67:0/746143780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a22d80 msgr2=0x558b25a25170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a22d80 0x558b25a25170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 -- 172.21.15.67:0/746143780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 msgr2=0x558b25a168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 0x558b25a168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc031ffb640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 0x7fc0200b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.974+0000 7fc033fff640 1 -- 172.21.15.67:0/746143780 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b256da650 con 0x558b25a16df0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc031ffb640 1 -- 172.21.15.67:0/545898259 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc02c106950 con 0x7fc034106ed0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc02bfff640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 0x7fc0200b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc033fff640 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a22840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc024009c20 tx=0x7fc024011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d566e5235aab15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc02a7fc640 1 -- 172.21.15.67:0/746143780 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024004050 con 0x558b25a16df0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc02a7fc640 1 -- 172.21.15.67:0/746143780 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0240054d0 con 0x558b25a16df0 2024-09-10T20:55:08.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.975+0000 7fc02a7fc640 1 -- 172.21.15.67:0/746143780 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024004d30 con 0x558b25a16df0 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.976+0000 7fc03c7aa740 1 -- 172.21.15.67:0/746143780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 msgr2=0x558b25a22840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.976+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a22840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc024009c20 tx=0x7fc024011810 comp rx=0 tx=0).stop 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.976+0000 7fc02bfff640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 0x7fc0200b78a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009fd0 tx=0x7fc01c0095a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 -- 172.21.15.67:0/746143780 shutdown_connections 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a22d80 0x558b25a25170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a22840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/746143780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a164d0 0x558b25a168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 -- 172.21.15.67:0/746143780 >> 172.21.15.67:0/746143780 conn(0x558b25a14300 msgr2=0x558b25a154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 -- 172.21.15.67:0/746143780 shutdown_connections 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 -- 172.21.15.67:0/746143780 wait complete. 2024-09-10T20:55:08.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 -- start start 2024-09-10T20:55:08.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.977+0000 7fc03c7aa740 1 Processor -- start 2024-09-10T20:55:08.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a22620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a22d80 0x558b25a20030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558b257dd700 con 0x558b25a16df0 2024-09-10T20:55:08.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558b25917160 con 0x558b25a164d0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43706/0 (socket says 172.21.15.67:43706) 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc02bfff640 1 -- 172.21.15.67:0/1984558450 learned_addr learned my addr 172.21.15.67:0/1984558450 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558b25a25a00 con 0x558b25a22d80 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc03c7aa740 10 client.0 _ll_register_callbacks cb 0x558b259309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc038972640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a22d80 0x558b25a20030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc02bfff640 1 -- 172.21.15.67:0/1984558450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a22d80 msgr2=0x558b25a20030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.978+0000 7fc02bfff640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a22d80 0x558b25a20030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc02bfff640 1 -- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 msgr2=0x558b25a22620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc02bfff640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a22620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc02bfff640 1 -- 172.21.15.67:0/1984558450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b25944c90 con 0x558b25a16df0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc02bfff640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0129f0 tx=0x7fc01c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e1e2da8062afea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:08.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc0137fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c026070 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc01c005020 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0240054d0 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc01c01c070 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc03c7aa740 10 client.15801 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.979+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b25a313b0 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc01c0047a0 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fc01c02a410 con 0x558b25a16df0 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 10 client.15801 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 20 client.15801 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25a328c0 0x558b25a34cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 4 client.15801 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:08.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc0240054d0 con 0x558b25a328c0 2024-09-10T20:55:08.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.980+0000 7fc033fff640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25a328c0 0x558b25a34cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:08.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.981+0000 7fc033fff640 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25a328c0 0x558b25a34cd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2255256bfec3bbbc server_cookie=70316d073915d459 in_seq=0 out_seq=0 2024-09-10T20:55:08.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.981+0000 7fc0137fe640 10 client.15801 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:08.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.982+0000 7fc0137fe640 1 -- 172.21.15.67:0/1984558450 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc0240054d0 con 0x558b25a328c0 2024-09-10T20:55:08.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.982+0000 7fc0137fe640 10 client.15801 handle_command_reply: tid=0 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.982+0000 7fc03c7aa740 1 client.15801 shutdown 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 msgr2=0x558b25a1fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0129f0 tx=0x7fc01c0093e0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 shutdown_connections 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25a328c0 0x558b25a34cd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a22d80 0x558b25a20030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a16df0 0x558b25a1fa70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/1984558450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a22620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 >> 172.21.15.67:0/1984558450 conn(0x558b25a14300 msgr2=0x558b25a19e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc0137fe640 0 client.15801 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 shutdown_connections 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 1 -- 172.21.15.67:0/1984558450 wait complete. 2024-09-10T20:55:08.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:08.983+0000 7fc03c7aa740 20 client.15801 trim_cache size 0 max 16384 2024-09-10T20:55:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.006+0000 7fc03c7aa740 1 Processor -- start 2024-09-10T20:55:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.006+0000 7fc03c7aa740 1 -- start start 2024-09-10T20:55:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a24170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a246b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341bf930 con 0x558b25a22d80 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341bd1a0 con 0x558b25a164d0 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341baff0 con 0x558b25a16df0 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc038972640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc038972640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a246b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43712/0 (socket says 172.21.15.67:43712) 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46914/0 (socket says 172.21.15.67:46914) 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc038972640 1 -- 172.21.15.67:0/3110954830 learned_addr learned my addr 172.21.15.67:0/3110954830 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc02bfff640 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a24170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 -- 172.21.15.67:0/3110954830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 msgr2=0x558b25a24170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a24170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 -- 172.21.15.67:0/3110954830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 msgr2=0x558b25a246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a246b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.007+0000 7fc033fff640 1 -- 172.21.15.67:0/3110954830 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b25a20d40 con 0x558b25a164d0 2024-09-10T20:55:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc033fff640 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc024004a70 tx=0x7fc024005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad1d1cce702abdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc029ffb640 1 -- 172.21.15.67:0/3110954830 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02401e040 con 0x558b25a164d0 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc029ffb640 1 -- 172.21.15.67:0/3110954830 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02401f040 con 0x558b25a164d0 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc029ffb640 1 -- 172.21.15.67:0/3110954830 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024003bc0 con 0x558b25a164d0 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3110954830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 msgr2=0x558b25a2ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc024004a70 tx=0x7fc024005da0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3110954830 shutdown_connections 2024-09-10T20:55:09.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a246b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a24170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3110954830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2ec90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.008+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3110954830 >> 172.21.15.67:0/3110954830 conn(0x558b25a14300 msgr2=0x558b25a1e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3110954830 shutdown_connections 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3110954830 wait complete. 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- start start 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 Processor -- start 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a2b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a25e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341bb660 con 0x558b25a22d80 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341bcad0 con 0x558b25a164d0 2024-09-10T20:55:09.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.009+0000 7fc03c7aa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341bbd30 con 0x558b25a16df0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc038972640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a25e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc038972640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a25e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43714/0 (socket says 172.21.15.67:43714) 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc038972640 1 -- 172.21.15.67:0/3787675570 learned_addr learned my addr 172.21.15.67:0/3787675570 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc03c7aa740 10 client.0 _ll_register_callbacks cb 0x7fc01c009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc02bfff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a2b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 -- 172.21.15.67:0/3787675570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 msgr2=0x558b25a2b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a2b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 -- 172.21.15.67:0/3787675570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 msgr2=0x558b25a25e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a25e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.010+0000 7fc033fff640 1 -- 172.21.15.67:0/3787675570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b25a26670 con 0x558b25a164d0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.011+0000 7fc033fff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2b0b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc024011850 tx=0x7fc024009970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22206902f31b4886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.011+0000 7fc0137fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:09.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.011+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02401e040 con 0x558b25a164d0 2024-09-10T20:55:09.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.011+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc024025870 con 0x558b25a164d0 2024-09-10T20:55:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.012+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc02401f040 con 0x558b25a164d0 2024-09-10T20:55:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc024025a70 con 0x558b25a164d0 2024-09-10T20:55:09.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 10 client.25466 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558b25aa0430 con 0x558b25a164d0 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02401f040 con 0x558b25a164d0 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fc02402b030 con 0x558b25a164d0 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 10 client.25466 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 10 client.25466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 20 client.25466 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25aa0900 0x558b25aa2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 4 client.25466 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b2598edf0 con 0x558b25aa0900 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.013+0000 7fc02bfff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25aa0900 0x558b25aa2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc0137fe640 10 client.25466 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc02bfff640 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25aa0900 0x558b25aa2cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a1a5d32495086ff server_cookie=a5b85efabfe85b16 in_seq=0 out_seq=0 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc0137fe640 1 -- 172.21.15.67:0/3787675570 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b2598edf0 con 0x558b25aa0900 2024-09-10T20:55:09.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc0137fe640 10 client.25466 handle_command_reply: tid=0 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 client.25466 shutdown 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 msgr2=0x558b25a2b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2b0b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc024011850 tx=0x7fc024009970 comp rx=0 tx=0).stop 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 shutdown_connections 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558b25aa0900 0x558b25aa2cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc0137fe640 0 client.25466 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b25a22d80 0x558b25a25e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b25a16df0 0x558b25a2b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 --2- 172.21.15.67:0/3787675570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b25a164d0 0x558b25a2b0b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.014+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 >> 172.21.15.67:0/3787675570 conn(0x558b25a14300 msgr2=0x558b25a12c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.016+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 shutdown_connections 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.016+0000 7fc03c7aa740 1 -- 172.21.15.67:0/3787675570 wait complete. 2024-09-10T20:55:09.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.016+0000 7fc03c7aa740 20 client.25466 trim_cache size 0 max 16384 2024-09-10T20:55:09.024 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 msgr2=0x7fc0200b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 0x7fc0200b78a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009fd0 tx=0x7fc01c0095a0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 msgr2=0x7fc03406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005cc0 tx=0x7fc02c030d70 comp rx=0 tx=0).stop 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 shutdown_connections 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc0200b53e0 0x7fc0200b78a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc034106ed0 0x7fc03406db60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0341023b0 0x7fc034074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 --2- 172.21.15.67:0/545898259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc034101a90 0x7fc034074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 >> 172.21.15.67:0/545898259 conn(0x7fc0340fd700 msgr2=0x7fc034104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 shutdown_connections 2024-09-10T20:55:09.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:09.017+0000 7fc03a3d5640 1 -- 172.21.15.67:0/545898259 wait complete. 2024-09-10T20:55:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 215.0 s, 3030.4 tps, lat 33.075 ms stddev 35.421 2024-09-10T20:55:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:10 smithi172 ceph-mon[35265]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-09-10T20:55:10.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:10 smithi067 ceph-mon[30891]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-09-10T20:55:10.851 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:55:10.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:55:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:10 smithi083 ceph-mon[35058]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-09-10T20:55:11.235 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.054+0000 7f39004b4640 1 -- 172.21.15.67:0/3851979984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f811c0a0 msgr2=0x7f38f811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.054+0000 7f39004b4640 1 --2- 172.21.15.67:0/3851979984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f811c0a0 0x7f38f811e490 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009ca0 tx=0x7f38f002a980 comp rx=0 tx=0).stop 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.055+0000 7f39004b4640 1 -- 172.21.15.67:0/3851979984 shutdown_connections 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.055+0000 7f39004b4640 1 --2- 172.21.15.67:0/3851979984 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f811c0a0 0x7f38f811e490 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.055+0000 7f39004b4640 1 --2- 172.21.15.67:0/3851979984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f810a530 0x7f38f810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.055+0000 7f39004b4640 1 --2- 172.21.15.67:0/3851979984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f810a150 0x7f38f81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.055+0000 7f39004b4640 1 -- 172.21.15.67:0/3851979984 >> 172.21.15.67:0/3851979984 conn(0x7f38f806dfc0 msgr2=0x7f38f806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.060+0000 7f39004b4640 1 -- 172.21.15.67:0/3851979984 shutdown_connections 2024-09-10T20:55:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.060+0000 7f39004b4640 1 -- 172.21.15.67:0/3851979984 wait complete. 2024-09-10T20:55:12.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f39004b4640 1 Processor -- start 2024-09-10T20:55:12.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f39004b4640 1 -- start start 2024-09-10T20:55:12.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f39004b4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 0x7f38f81a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f39004b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f39004b4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f81ae250 0x7f38f81ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.062+0000 7f38fe250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 0x7f38f81a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fe250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 0x7f38f81a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46948/0 (socket says 172.21.15.67:46948) 2024-09-10T20:55:12.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52298/0 (socket says 172.21.15.67:52298) 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f39004b4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8121cb0 con 0x7f38f81ae250 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f39004b4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8121b30 con 0x7f38f811c0a0 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f39004b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38f8121e30 con 0x7f38f81a8970 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fe250640 1 -- 172.21.15.67:0/3982071113 learned_addr learned my addr 172.21.15.67:0/3982071113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 -- 172.21.15.67:0/3982071113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 msgr2=0x7f38f81a8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 0x7f38f81a8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 -- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f81ae250 msgr2=0x7f38f81ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f81ae250 0x7f38f81ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.063+0000 7f38fda4f640 1 -- 172.21.15.67:0/3982071113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38f81b4e90 con 0x7f38f81a8970 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.064+0000 7f38fda4f640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f38f806f3c0 tx=0x7f38f400b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.065+0000 7f38ef7fe640 1 -- 172.21.15.67:0/3982071113 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4015020 con 0x7f38f81a8970 2024-09-10T20:55:12.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.065+0000 7f38ef7fe640 1 -- 172.21.15.67:0/3982071113 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f4011ce0 con 0x7f38f81a8970 2024-09-10T20:55:12.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.065+0000 7f38ef7fe640 1 -- 172.21.15.67:0/3982071113 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4010d70 con 0x7f38f81a8970 2024-09-10T20:55:12.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.065+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38f81b5180 con 0x7f38f81a8970 2024-09-10T20:55:12.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.065+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38f81b5640 con 0x7f38f81a8970 2024-09-10T20:55:12.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.069+0000 7f38ef7fe640 1 -- 172.21.15.67:0/3982071113 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f38f4011830 con 0x7f38f81a8970 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.070+0000 7f38ef7fe640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 0x7f38e40b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.071+0000 7f38ef7fe640 1 -- 172.21.15.67:0/3982071113 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38f40e5480 con 0x7f38f81a8970 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.072+0000 7f38fe250640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 0x7f38e40b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.073+0000 7f38fe250640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 0x7f38e40b79a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009980 tx=0x7f38e8009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.073+0000 7f3902889740 1 Processor -- start 2024-09-10T20:55:12.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.073+0000 7f3902889740 1 -- start start 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.073+0000 7f3902889740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.073+0000 7f3902889740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 0x55ee1a6a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f3902889740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f3902889740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a610e60 con 0x55ee1a69a800 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f3902889740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a600290 con 0x55ee1a699ee0 2024-09-10T20:55:12.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f3902889740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a6040a0 con 0x55ee1a6a6790 2024-09-10T20:55:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fe250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fe250640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46954/0 (socket says 172.21.15.67:46954) 2024-09-10T20:55:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 0x55ee1a6a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fe250640 1 -- 172.21.15.67:0/1981366420 learned_addr learned my addr 172.21.15.67:0/1981366420 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:12.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fea51640 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 -- 172.21.15.67:0/1981366420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 msgr2=0x55ee1a6a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 -- 172.21.15.67:0/1981366420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 msgr2=0x55ee1a69a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fda4f640 1 -- 172.21.15.67:0/1981366420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1a35e930 con 0x55ee1a69a800 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.074+0000 7f38fe250640 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.075+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 0x55ee1a6a6250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f38f40e2f20 tx=0x7f38f40a7bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab9b8b36333ed83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.075+0000 7f38ecff9640 1 -- 172.21.15.67:0/1981366420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b0070 con 0x55ee1a69a800 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.075+0000 7f38ecff9640 1 -- 172.21.15.67:0/1981366420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f40ab720 con 0x55ee1a69a800 2024-09-10T20:55:12.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.075+0000 7f38ecff9640 1 -- 172.21.15.67:0/1981366420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b51a0 con 0x55ee1a69a800 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 -- 172.21.15.67:0/1981366420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 msgr2=0x55ee1a6a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 0x55ee1a6a6250 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f38f40e2f20 tx=0x7f38f40a7bb0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 -- 172.21.15.67:0/1981366420 shutdown_connections 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a69a800 0x55ee1a6a6250 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 --2- 172.21.15.67:0/1981366420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a699ee0 0x55ee1a69a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.077+0000 7f3902889740 1 -- 172.21.15.67:0/1981366420 >> 172.21.15.67:0/1981366420 conn(0x55ee1a697d10 msgr2=0x55ee1a698eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.078+0000 7f3902889740 1 -- 172.21.15.67:0/1981366420 shutdown_connections 2024-09-10T20:55:12.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.078+0000 7f3902889740 1 -- 172.21.15.67:0/1981366420 wait complete. 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.078+0000 7f3902889740 1 -- start start 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.078+0000 7f3902889740 1 Processor -- start 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a461890 con 0x55ee1a699ee0 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f38fda4f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43764/0 (socket says 172.21.15.67:43764) 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f38fe250640 1 -- 172.21.15.67:0/1271407006 learned_addr learned my addr 172.21.15.67:0/1271407006 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a59ad40 con 0x55ee1a69a800 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee1a6a9440 con 0x55ee1a6a6790 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f3902889740 10 client.0 _ll_register_callbacks cb 0x55ee1a5fec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:12.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.079+0000 7f38fea51640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.082+0000 7f38fda4f640 1 -- 172.21.15.67:0/1271407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 msgr2=0x55ee1a6a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.082+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.082+0000 7f38fda4f640 1 -- 172.21.15.67:0/1271407006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 msgr2=0x55ee1a6a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.082+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.082+0000 7f38fda4f640 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1a6b2920 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38fda4f640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a3d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38f40a8e80 tx=0x7f38f40ab4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f7ec2443825d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40b0070 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38f40b0410 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38f40ab720 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f38f40a7380 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 10 client.25475 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ee1a6b52b0 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f40ac310 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f38f40a7680 con 0x55ee1a69a800 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 10 client.25475 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:12.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 20 client.25475 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a6b6600 0x55ee1a6b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 4 client.25475 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.083+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f38f40ab720 con 0x55ee1a6b6600 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.084+0000 7f38fe250640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a6b6600 0x55ee1a6b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.084+0000 7f38fe250640 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a6b6600 0x55ee1a6b89f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4dd5958ecf0030 server_cookie=ee411853ae478929 in_seq=0 out_seq=0 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.084+0000 7f38e1ffb640 10 client.25475 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:12.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.085+0000 7f38e1ffb640 1 -- 172.21.15.67:0/1271407006 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f38f40ab720 con 0x55ee1a6b6600 2024-09-10T20:55:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.085+0000 7f38e1ffb640 10 client.25475 handle_command_reply: tid=0 2024-09-10T20:55:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.085+0000 7f3902889740 1 client.25475 shutdown 2024-09-10T20:55:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 msgr2=0x55ee1a6a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a3d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38f40a8e80 tx=0x7f38f40ab4b0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 shutdown_connections 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a6b6600 0x55ee1a6b89f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a3d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 --2- 172.21.15.67:0/1271407006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f38e1ffb640 0 client.25475 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 >> 172.21.15.67:0/1271407006 conn(0x55ee1a697d10 msgr2=0x55ee1a696f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 shutdown_connections 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 1 -- 172.21.15.67:0/1271407006 wait complete. 2024-09-10T20:55:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.087+0000 7f3902889740 20 client.25475 trim_cache size 0 max 16384 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 Processor -- start 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 -- start start 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81c05f0 con 0x55ee1a699ee0 2024-09-10T20:55:12.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81bde60 con 0x55ee1a69a800 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f3902889740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81bbcb0 con 0x55ee1a6a6790 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.115+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43780/0 (socket says 172.21.15.67:43780) 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 -- 172.21.15.67:0/475858106 learned_addr learned my addr 172.21.15.67:0/475858106 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fda4f640 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fea51640 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 -- 172.21.15.67:0/475858106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 msgr2=0x55ee1a6a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 -- 172.21.15.67:0/475858106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 msgr2=0x55ee1a6a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 -- 172.21.15.67:0/475858106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1a6a1d40 con 0x55ee1a699ee0 2024-09-10T20:55:12.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38fe250640 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ec40 tx=0x7f38e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda471eb77d846e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38e3fff640 1 -- 172.21.15.67:0/475858106 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e802f070 con 0x55ee1a699ee0 2024-09-10T20:55:12.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38e3fff640 1 -- 172.21.15.67:0/475858106 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e8016df0 con 0x55ee1a699ee0 2024-09-10T20:55:12.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f38e3fff640 1 -- 172.21.15.67:0/475858106 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e801b040 con 0x55ee1a699ee0 2024-09-10T20:55:12.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f3902889740 1 -- 172.21.15.67:0/475858106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 msgr2=0x55ee1a6a3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.117+0000 7f3902889740 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f38e800ec40 tx=0x7f38e8015000 comp rx=0 tx=0).stop 2024-09-10T20:55:12.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 -- 172.21.15.67:0/475858106 shutdown_connections 2024-09-10T20:55:12.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 --2- 172.21.15.67:0/475858106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6a3ec0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 -- 172.21.15.67:0/475858106 >> 172.21.15.67:0/475858106 conn(0x55ee1a697d10 msgr2=0x55ee1a6a37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 -- 172.21.15.67:0/475858106 shutdown_connections 2024-09-10T20:55:12.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 -- 172.21.15.67:0/475858106 wait complete. 2024-09-10T20:55:12.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 -- start start 2024-09-10T20:55:12.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 Processor -- start 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.119+0000 7f3902889740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6bb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81bc320 con 0x55ee1a699ee0 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81bd790 con 0x55ee1a69a800 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38f81bc9f0 con 0x55ee1a6a6790 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f3902889740 10 client.0 _ll_register_callbacks cb 0x7f38e8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43784/0 (socket says 172.21.15.67:43784) 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 -- 172.21.15.67:0/2082235242 learned_addr learned my addr 172.21.15.67:0/2082235242 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fea51640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6bb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fda4f640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 -- 172.21.15.67:0/2082235242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 msgr2=0x55ee1a6bb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6bb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 -- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 msgr2=0x55ee1a6baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 -- 172.21.15.67:0/2082235242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1a723200 con 0x55ee1a699ee0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fda4f640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38fe250640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f38e800eb00 tx=0x7f38e800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfefdea83a496847 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.120+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e802f030 con 0x55ee1a699ee0 2024-09-10T20:55:12.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38e8028040 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38e8016df0 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f38e80225b0 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 10 client.15822 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ee1a724540 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e8016df0 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f38e80364d0 con 0x55ee1a699ee0 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 10 client.15822 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 20 client.15822 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a724c40 0x55ee1a727060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 4 client.15822 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.121+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee1a612db0 con 0x55ee1a724c40 2024-09-10T20:55:12.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.122+0000 7f38fda4f640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a724c40 0x55ee1a727060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.122+0000 7f38fda4f640 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a724c40 0x55ee1a727060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9adfef2d5c21d60f server_cookie=6d2f247e2f4ebea9 in_seq=0 out_seq=0 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.122+0000 7f38e1ffb640 10 client.15822 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f38e1ffb640 1 -- 172.21.15.67:0/2082235242 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee1a612db0 con 0x55ee1a724c40 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f38e1ffb640 10 client.15822 handle_command_reply: tid=0 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 client.15822 shutdown 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 msgr2=0x55ee1a6ba9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f38e800eb00 tx=0x7f38e800eb30 comp rx=0 tx=0).stop 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 shutdown_connections 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ee1a724c40 0x55ee1a727060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee1a6a6790 0x55ee1a6bb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee1a69a800 0x55ee1a6baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 --2- 172.21.15.67:0/2082235242 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee1a699ee0 0x55ee1a6ba9e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 >> 172.21.15.67:0/2082235242 conn(0x55ee1a697d10 msgr2=0x55ee1a6a5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f38e1ffb640 0 client.15822 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 shutdown_connections 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 1 -- 172.21.15.67:0/2082235242 wait complete. 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.124+0000 7f3902889740 20 client.15822 trim_cache size 0 max 16384 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "65baa163-fbe0-42fc-aa2f-bacdb8686051", 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:55:12.132 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:55:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 msgr2=0x7f38e40b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 0x7f38e40b79a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009980 tx=0x7f38e8009190 comp rx=0 tx=0).stop 2024-09-10T20:55:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 msgr2=0x7f38f81add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:12.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f38f806f3c0 tx=0x7f38f400b820 comp rx=0 tx=0).stop 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 shutdown_connections 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f38f81ae250 0x7f38f81ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f38e40b54e0 0x7f38e40b79a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38f81a8970 0x7f38f81add10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 --2- 172.21.15.67:0/3982071113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38f811c0a0 0x7f38f81a8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 >> 172.21.15.67:0/3982071113 conn(0x7f38f806dfc0 msgr2=0x7f38f811c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.125+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 shutdown_connections 2024-09-10T20:55:12.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:12.126+0000 7f39004b4640 1 -- 172.21.15.67:0/3982071113 wait complete. 2024-09-10T20:55:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:12 smithi172 ceph-mon[35265]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.2 MiB/s wr, 672 op/s 2024-09-10T20:55:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:12 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:55:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:12 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:12.712 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:12 smithi067 ceph-mon[30891]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.2 MiB/s wr, 672 op/s 2024-09-10T20:55:12.712 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:12 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:12.712 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:12 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:12 smithi083 ceph-mon[35058]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.2 MiB/s wr, 672 op/s 2024-09-10T20:55:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:12 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:12 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:55:13.592 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:13 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:55:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:13 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:55:13.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:13 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:55:13.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:13 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:55:13.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:13 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:13.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:13 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:13.721 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:13 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:55:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:13 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:13 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:13.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 220.0 s, 2683.4 tps, lat 37.178 ms stddev 43.190 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 -- 172.21.15.67:0/2713287193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 msgr2=0x7efc9010ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 --2- 172.21.15.67:0/2713287193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc9010ef00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efc78009900 tx=0x7efc7802a4a0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 -- 172.21.15.67:0/2713287193 shutdown_connections 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 --2- 172.21.15.67:0/2713287193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc9010f440 0x7efc90111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 --2- 172.21.15.67:0/2713287193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc9010ef00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 --2- 172.21.15.67:0/2713287193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc90101890 0x7efc90101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 -- 172.21.15.67:0/2713287193 >> 172.21.15.67:0/2713287193 conn(0x7efc900fd700 msgr2=0x7efc900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 -- 172.21.15.67:0/2713287193 shutdown_connections 2024-09-10T20:55:14.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.309+0000 7efc957af640 1 -- 172.21.15.67:0/2713287193 wait complete. 2024-09-10T20:55:14.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.311+0000 7efc957af640 1 Processor -- start 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.311+0000 7efc957af640 1 -- start start 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 0x7efc90103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 0x7efc90104640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc90114fe0 con 0x7efc901021b0 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc90114e60 con 0x7efc9010f440 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc957af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc90115160 con 0x7efc90101890 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc87fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc87fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37852/0 (socket says 172.21.15.67:37852) 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc87fff640 1 -- 172.21.15.67:0/2449828667 learned_addr learned my addr 172.21.15.67:0/2449828667 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:14.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 0x7efc90104640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.312+0000 7efc8effd640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 0x7efc90103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 -- 172.21.15.67:0/2449828667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 msgr2=0x7efc90103bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 0x7efc90103bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 -- 172.21.15.67:0/2449828667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 msgr2=0x7efc90104640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 0x7efc90104640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 -- 172.21.15.67:0/2449828667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc901ab920 con 0x7efc901021b0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 0x7efc90104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc8effd640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 0x7efc90103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc87fff640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efc78030680 tx=0x7efc780306b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc8cff9640 1 -- 172.21.15.67:0/2449828667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7803f070 con 0x7efc901021b0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc8cff9640 1 -- 172.21.15.67:0/2449828667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc78004460 con 0x7efc901021b0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc8cff9640 1 -- 172.21.15.67:0/2449828667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78035030 con 0x7efc901021b0 2024-09-10T20:55:14.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc901abbb0 con 0x7efc901021b0 2024-09-10T20:55:14.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.313+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc901ac040 con 0x7efc901021b0 2024-09-10T20:55:14.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.317+0000 7efc97b84740 1 Processor -- start 2024-09-10T20:55:14.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.317+0000 7efc97b84740 1 -- start start 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f894fd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f895097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f8950c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558f89473e50 con 0x558f894fdda0 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558f89463280 con 0x558f89509d30 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc97b84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558f89467090 con 0x558f894fd480 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f895097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f895097f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37860/0 (socket says 172.21.15.67:37860) 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc8effd640 1 -- 172.21.15.67:0/321483072 learned_addr learned my addr 172.21.15.67:0/321483072 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.318+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f894fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 -- 172.21.15.67:0/321483072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 msgr2=0x558f8950c120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:55:14.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f8950c120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 -- 172.21.15.67:0/321483072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 msgr2=0x558f895097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f895097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 -- 172.21.15.67:0/321483072 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f891c1650 con 0x558f894fd480 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f894fd860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc8800a750 tx=0x7efc88009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc33466143fb36a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.319+0000 7efc8cff9640 1 -- 172.21.15.67:0/2449828667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efc780308d0 con 0x7efc901021b0 2024-09-10T20:55:14.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.320+0000 7efc857fa640 1 -- 172.21.15.67:0/321483072 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88018020 con 0x558f894fd480 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.320+0000 7efc857fa640 1 -- 172.21.15.67:0/321483072 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc8800ed50 con 0x558f894fd480 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.320+0000 7efc857fa640 1 -- 172.21.15.67:0/321483072 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88013360 con 0x558f894fd480 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.321+0000 7efc8cff9640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 0x7efc700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.321+0000 7efc97b84740 1 -- 172.21.15.67:0/321483072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 msgr2=0x558f894fd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.321+0000 7efc97b84740 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f894fd860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc8800a750 tx=0x7efc88009650 comp rx=0 tx=0).stop 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.321+0000 7efc8effd640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 0x7efc700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.321+0000 7efc8cff9640 1 -- 172.21.15.67:0/2449828667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efc78106910 con 0x7efc901021b0 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc97b84740 1 -- 172.21.15.67:0/321483072 shutdown_connections 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc97b84740 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f8950c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc97b84740 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f895097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc97b84740 1 --2- 172.21.15.67:0/321483072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f894fd860 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc97b84740 1 -- 172.21.15.67:0/321483072 >> 172.21.15.67:0/321483072 conn(0x558f894fb2b0 msgr2=0x558f894fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.322+0000 7efc8effd640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 0x7efc700b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x558f894fc190 tx=0x7efc80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.323+0000 7efc97b84740 1 -- 172.21.15.67:0/321483072 shutdown_connections 2024-09-10T20:55:14.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.323+0000 7efc97b84740 1 -- 172.21.15.67:0/321483072 wait complete. 2024-09-10T20:55:14.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.323+0000 7efc97b84740 1 -- start start 2024-09-10T20:55:14.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.324+0000 7efc97b84740 1 Processor -- start 2024-09-10T20:55:14.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.324+0000 7efc97b84740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 0x558f89509780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.324+0000 7efc97b84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 0x558f89506bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.324+0000 7efc8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 0x558f89509780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc8effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 0x558f89509780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37864/0 (socket says 172.21.15.67:37864) 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc8effd640 1 -- 172.21.15.67:0/4148923589 learned_addr learned my addr 172.21.15.67:0/4148923589 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc87fff640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 0x558f89506bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f89507360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558f892c4700 con 0x558f894fd480 2024-09-10T20:55:14.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558f893fe110 con 0x558f89509d30 2024-09-10T20:55:14.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f89507360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558f8950c9b0 con 0x558f894fdda0 2024-09-10T20:55:14.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.325+0000 7efc97b84740 10 client.0 _ll_register_callbacks cb 0x558f89417990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:14.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.326+0000 7efc87fff640 1 -- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 msgr2=0x558f89507360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.326+0000 7efc87fff640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f89507360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.326+0000 7efc87fff640 1 -- 172.21.15.67:0/4148923589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 msgr2=0x558f89509780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.326+0000 7efc87fff640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 0x558f89509780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.326+0000 7efc87fff640 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f8942bc40 con 0x558f894fdda0 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.327+0000 7efc87fff640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 0x558f89506bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc78030650 tx=0x7efc78031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa990536be1e88c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.327+0000 7efc7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:55:14.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.327+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780035f0 con 0x558f894fdda0 2024-09-10T20:55:14.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.327+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efc780c9310 con 0x558f894fdda0 2024-09-10T20:55:14.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.327+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8800ed50 con 0x558f894fdda0 2024-09-10T20:55:14.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.328+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efc780ccbb0 con 0x558f894fdda0 2024-09-10T20:55:14.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.329+0000 7efc97b84740 10 client.25474 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:14.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.329+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f89518420 con 0x558f894fdda0 2024-09-10T20:55:14.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.330+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc8800ed50 con 0x558f894fdda0 2024-09-10T20:55:14.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.330+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7efc78030bf0 con 0x558f894fdda0 2024-09-10T20:55:14.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.332+0000 7efc97b84740 10 client.25474 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:14.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.332+0000 7efc97b84740 10 client.25474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:14.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.332+0000 7efc97b84740 20 client.25474 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:14.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.332+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89519810 0x558f8951bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.333+0000 7efc8effd640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89519810 0x558f8951bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.334+0000 7efc97b84740 4 client.25474 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:14.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.334+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f89475da0 con 0x558f89519810 2024-09-10T20:55:14.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.334+0000 7efc8effd640 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89519810 0x558f8951bc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34bc360f8e3d1bb server_cookie=53d7cf21ab6160c8 in_seq=0 out_seq=0 2024-09-10T20:55:14.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.334+0000 7efc7e7fc640 10 client.25474 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:14.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.336+0000 7efc7e7fc640 1 -- 172.21.15.67:0/4148923589 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f89475da0 con 0x558f89519810 2024-09-10T20:55:14.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.336+0000 7efc7e7fc640 10 client.25474 handle_command_reply: tid=0 2024-09-10T20:55:14.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.336+0000 7efc97b84740 1 client.25474 shutdown 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 msgr2=0x558f89506bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 0x558f89506bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc78030650 tx=0x7efc78031a20 comp rx=0 tx=0).stop 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 shutdown_connections 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89519810 0x558f8951bc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f89509d30 0x558f89507360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fdda0 0x558f89506bd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 --2- 172.21.15.67:0/4148923589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fd480 0x558f89509780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 >> 172.21.15.67:0/4148923589 conn(0x558f894fb2b0 msgr2=0x558f89500e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.339+0000 7efc7e7fc640 0 client.25474 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.340+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 shutdown_connections 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.340+0000 7efc97b84740 1 -- 172.21.15.67:0/4148923589 wait complete. 2024-09-10T20:55:14.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.340+0000 7efc97b84740 20 client.25474 trim_cache size 0 max 16384 2024-09-10T20:55:14.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.377+0000 7efc97b84740 1 Processor -- start 2024-09-10T20:55:14.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.377+0000 7efc97b84740 1 -- start start 2024-09-10T20:55:14.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 0x558f894fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f89508910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 0x558f895214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b7280 con 0x558f894fdda0 2024-09-10T20:55:14.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b4af0 con 0x558f894fd480 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc97b84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b2940 con 0x558f89509d30 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc8f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 0x558f895214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc8effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 0x558f894fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc8effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 0x558f894fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40936/0 (socket says 172.21.15.67:40936) 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.378+0000 7efc8effd640 1 -- 172.21.15.67:0/1319936331 learned_addr learned my addr 172.21.15.67:0/1319936331 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1319936331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 msgr2=0x558f894fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 0x558f894fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1319936331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 msgr2=0x558f89508910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f89508910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1319936331 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f89505b30 con 0x558f89509d30 2024-09-10T20:55:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.379+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 0x558f895214d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88014b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19060402cfcb0d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.380+0000 7efc84ff9640 1 -- 172.21.15.67:0/1319936331 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88018040 con 0x558f89509d30 2024-09-10T20:55:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.381+0000 7efc84ff9640 1 -- 172.21.15.67:0/1319936331 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc8800e6a0 con 0x558f89509d30 2024-09-10T20:55:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.381+0000 7efc84ff9640 1 -- 172.21.15.67:0/1319936331 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc880042c0 con 0x558f89509d30 2024-09-10T20:55:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.381+0000 7efc97b84740 1 -- 172.21.15.67:0/1319936331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 msgr2=0x558f895214d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.381+0000 7efc97b84740 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 0x558f895214d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88014b50 comp rx=0 tx=0).stop 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 -- 172.21.15.67:0/1319936331 shutdown_connections 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f89509d30 0x558f895214d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f894fdda0 0x558f89508910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 --2- 172.21.15.67:0/1319936331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fd480 0x558f894fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 -- 172.21.15.67:0/1319936331 >> 172.21.15.67:0/1319936331 conn(0x558f894fb2b0 msgr2=0x558f89508200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 -- 172.21.15.67:0/1319936331 shutdown_connections 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.382+0000 7efc97b84740 1 -- 172.21.15.67:0/1319936331 wait complete. 2024-09-10T20:55:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.383+0000 7efc97b84740 1 -- start start 2024-09-10T20:55:14.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.383+0000 7efc97b84740 1 Processor -- start 2024-09-10T20:55:14.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc97b84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f89512490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc97b84740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 0x558f8950cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc97b84740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 0x558f8950d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f89512490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc8effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f89512490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56608/0 (socket says 172.21.15.67:56608) 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 0x558f8950cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc87fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 0x558f8950cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40940/0 (socket says 172.21.15.67:40940) 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc8effd640 1 -- 172.21.15.67:0/1802417035 learned_addr learned my addr 172.21.15.67:0/1802417035 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 0x558f8950d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b2fb0 con 0x558f89509d30 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.384+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b4420 con 0x558f894fdda0 2024-09-10T20:55:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc901b3680 con 0x558f894fd480 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc97b84740 10 client.0 _ll_register_callbacks cb 0x7efc78005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1802417035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 msgr2=0x558f89512490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f89512490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 msgr2=0x558f8950cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 0x558f8950cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.385+0000 7efc8f7fe640 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f894fc990 con 0x558f89509d30 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.386+0000 7efc8f7fe640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 0x558f8950d1e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88014630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2badc5a90c614df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.386+0000 7efc7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.386+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88018070 con 0x558f89509d30 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.386+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8800e6a0 con 0x558f89509d30 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.387+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efc8800ea50 con 0x558f89509d30 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.387+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efc880149b0 con 0x558f89509d30 2024-09-10T20:55:14.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.387+0000 7efc97b84740 10 client.15837 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.387+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f895875d0 con 0x558f89509d30 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc8802e070 con 0x558f89509d30 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7efc88024020 con 0x558f89509d30 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 10 client.15837 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 20 client.15837 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89587980 0x558f89589da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 4 client.15837 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7efc8800e6a0 con 0x558f89587980 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.388+0000 7efc8effd640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89587980 0x558f89589da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.389+0000 7efc8effd640 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89587980 0x558f89589da0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7fd3d41c5abfda server_cookie=1920476247dc6566 in_seq=0 out_seq=0 2024-09-10T20:55:14.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.389+0000 7efc7e7fc640 10 client.15837 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:14.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc7e7fc640 1 -- 172.21.15.67:0/1802417035 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x7efc8800e6a0 con 0x558f89587980 2024-09-10T20:55:14.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc7e7fc640 10 client.15837 handle_command_reply: tid=0 2024-09-10T20:55:14.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 client.15837 shutdown 2024-09-10T20:55:14.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 msgr2=0x558f8950d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 0x558f8950d1e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efc88009fd0 tx=0x7efc88014630 comp rx=0 tx=0).stop 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 shutdown_connections 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558f89587980 0x558f89589da0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f89509d30 0x558f8950d1e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558f894fdda0 0x558f8950cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 --2- 172.21.15.67:0/1802417035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f894fd480 0x558f89512490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 >> 172.21.15.67:0/1802417035 conn(0x558f894fb2b0 msgr2=0x558f89508a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.390+0000 7efc7e7fc640 0 client.15837 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.391+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 shutdown_connections 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.391+0000 7efc97b84740 1 -- 172.21.15.67:0/1802417035 wait complete. 2024-09-10T20:55:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.391+0000 7efc97b84740 20 client.15837 trim_cache size 0 max 16384 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "65baa163-fbe0-42fc-aa2f-bacdb8686051", 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:55:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.399 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:55:14.400 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.401 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:14.402 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 msgr2=0x7efc700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 0x7efc700b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x558f894fc190 tx=0x7efc80005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 msgr2=0x7efc90104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efc78030680 tx=0x7efc780306b0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 shutdown_connections 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc9010f440 0x7efc90104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc901021b0 0x7efc90104100 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc700b5360 0x7efc700b7820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 --2- 172.21.15.67:0/2449828667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc90101890 0x7efc90103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 >> 172.21.15.67:0/2449828667 conn(0x7efc900fd700 msgr2=0x7efc9010ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 shutdown_connections 2024-09-10T20:55:14.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:14.393+0000 7efc957af640 1 -- 172.21.15.67:0/2449828667 wait complete. 2024-09-10T20:55:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:14 smithi067 ceph-mon[30891]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 841 op/s 2024-09-10T20:55:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:14 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:14 smithi172 ceph-mon[35265]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 841 op/s 2024-09-10T20:55:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:14 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:14 smithi083 ceph-mon[35058]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 841 op/s 2024-09-10T20:55:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:14 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:15.109 INFO:tasks.cephfs.filesystem:scrub status for tag:65baa163-fbe0-42fc-aa2f-bacdb8686051 - {'path': '/', 'tag': '65baa163-fbe0-42fc-aa2f-bacdb8686051', 'options': 'recursive,force'} 2024-09-10T20:55:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:16 smithi172 ceph-mon[35265]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:55:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:16 smithi067 ceph-mon[30891]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:55:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:16 smithi083 ceph-mon[35058]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:55:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:18 smithi172 ceph-mon[35265]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 775 op/s 2024-09-10T20:55:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:18 smithi067 ceph-mon[30891]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 775 op/s 2024-09-10T20:55:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:18 smithi083 ceph-mon[35058]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 775 op/s 2024-09-10T20:55:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 225.0 s, 4212.8 tps, lat 23.706 ms stddev 29.039 2024-09-10T20:55:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:20 smithi172 ceph-mon[35265]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 772 op/s 2024-09-10T20:55:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:20 smithi067 ceph-mon[30891]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 772 op/s 2024-09-10T20:55:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:20 smithi083 ceph-mon[35058]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 772 op/s 2024-09-10T20:55:22.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:22 smithi067 ceph-mon[30891]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-09-10T20:55:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:22 smithi083 ceph-mon[35058]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-09-10T20:55:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:22 smithi172 ceph-mon[35265]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-09-10T20:55:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 230.0 s, 3863.0 tps, lat 26.053 ms stddev 28.695 2024-09-10T20:55:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:24 smithi067 ceph-mon[30891]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 863 op/s 2024-09-10T20:55:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:24 smithi083 ceph-mon[35058]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 863 op/s 2024-09-10T20:55:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:24 smithi172 ceph-mon[35265]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 863 op/s 2024-09-10T20:55:26.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:26 smithi172 ceph-mon[35265]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 765 op/s 2024-09-10T20:55:26.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:55:26.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:55:26.750 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:55:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:26 smithi067 ceph-mon[30891]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 765 op/s 2024-09-10T20:55:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:55:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:55:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:55:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:26 smithi083 ceph-mon[35058]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 765 op/s 2024-09-10T20:55:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:55:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:55:26.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:55:28.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:28 smithi067 ceph-mon[30891]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-09-10T20:55:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:28 smithi083 ceph-mon[35058]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-09-10T20:55:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:28 smithi172 ceph-mon[35265]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 879 op/s 2024-09-10T20:55:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 235.0 s, 5640.0 tps, lat 17.684 ms stddev 20.710 2024-09-10T20:55:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:30 smithi067 ceph-mon[30891]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 MiB/s wr, 817 op/s 2024-09-10T20:55:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:30 smithi083 ceph-mon[35058]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 MiB/s wr, 817 op/s 2024-09-10T20:55:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:30 smithi172 ceph-mon[35265]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.9 MiB/s wr, 817 op/s 2024-09-10T20:55:32.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:32 smithi067 ceph-mon[30891]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-10T20:55:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:32 smithi083 ceph-mon[35058]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-10T20:55:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:32 smithi172 ceph-mon[35265]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7.7 MiB/s wr, 730 op/s 2024-09-10T20:55:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 240.0 s, 3633.0 tps, lat 27.169 ms stddev 36.990 2024-09-10T20:55:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:34 smithi067 ceph-mon[30891]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-09-10T20:55:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:34 smithi083 ceph-mon[35058]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-09-10T20:55:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:34 smithi172 ceph-mon[35265]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 923 op/s 2024-09-10T20:55:36.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:36 smithi067 ceph-mon[30891]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 836 op/s 2024-09-10T20:55:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:36 smithi083 ceph-mon[35058]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 836 op/s 2024-09-10T20:55:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:36 smithi172 ceph-mon[35265]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 836 op/s 2024-09-10T20:55:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:38 smithi067 ceph-mon[30891]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-10T20:55:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:38 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:55:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:38 smithi083 ceph-mon[35058]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-10T20:55:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:38 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:55:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:38 smithi172 ceph-mon[35265]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-10T20:55:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:38 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:55:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 245.0 s, 2836.8 tps, lat 35.728 ms stddev 40.906 2024-09-10T20:55:39.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:55:39.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:55:39.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:39 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:55:39.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:55:39.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:55:39.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:39 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:55:39.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:55:39.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:55:39.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:39 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:55:40.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:40 smithi067 ceph-mon[30891]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-10T20:55:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:40 smithi083 ceph-mon[35058]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-10T20:55:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:40 smithi172 ceph-mon[35265]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 838 op/s 2024-09-10T20:55:42.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:42 smithi067 ceph-mon[30891]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 858 op/s 2024-09-10T20:55:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:42 smithi083 ceph-mon[35058]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 858 op/s 2024-09-10T20:55:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:42 smithi172 ceph-mon[35265]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 858 op/s 2024-09-10T20:55:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 250.0 s, 3162.8 tps, lat 31.456 ms stddev 39.884 2024-09-10T20:55:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:44 smithi067 ceph-mon[30891]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 968 op/s 2024-09-10T20:55:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:44 smithi083 ceph-mon[35058]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 968 op/s 2024-09-10T20:55:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:44 smithi172 ceph-mon[35265]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 968 op/s 2024-09-10T20:55:45.110 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:55:45.571 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:46.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 -- 172.21.15.67:0/207504757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48101220 msgr2=0x7fdd48101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 --2- 172.21.15.67:0/207504757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48101220 0x7fdd48101600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001acb0 tx=0x7fdd4003b8e0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 -- 172.21.15.67:0/207504757 shutdown_connections 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 --2- 172.21.15.67:0/207504757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48113830 0x7fdd48115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 --2- 172.21.15.67:0/207504757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48110f00 0x7fdd481132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 --2- 172.21.15.67:0/207504757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48101220 0x7fdd48101600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.159+0000 7fdd4de08640 1 -- 172.21.15.67:0/207504757 >> 172.21.15.67:0/207504757 conn(0x7fdd48078100 msgr2=0x7fdd480ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.164+0000 7fdd4de08640 1 -- 172.21.15.67:0/207504757 shutdown_connections 2024-09-10T20:55:46.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.164+0000 7fdd4de08640 1 -- 172.21.15.67:0/207504757 wait complete. 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.164+0000 7fdd4de08640 1 Processor -- start 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 -- start start 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48101220 0x7fdd48103fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48110f00 0x7fdd481044f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4810afe0 con 0x7fdd48101220 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4810ae60 con 0x7fdd48110f00 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.165+0000 7fdd4de08640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4810b160 con 0x7fdd48113830 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50496/0 (socket says 172.21.15.67:50496) 2024-09-10T20:55:46.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 -- 172.21.15.67:0/2606903115 learned_addr learned my addr 172.21.15.67:0/2606903115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:46.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48110f00 0x7fdd481044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 -- 172.21.15.67:0/2606903115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48110f00 msgr2=0x7fdd481044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48110f00 0x7fdd481044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 -- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48101220 msgr2=0x7fdd48103fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48101220 0x7fdd48103fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.166+0000 7fdd47fff640 1 -- 172.21.15.67:0/2606903115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4819d1d0 con 0x7fdd48113830 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd47fff640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800c410 tx=0x7fdd38001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd44ff9640 1 -- 172.21.15.67:0/2606903115 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38004020 con 0x7fdd48113830 2024-09-10T20:55:46.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4819d4c0 con 0x7fdd48113830 2024-09-10T20:55:46.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481c5c10 con 0x7fdd48113830 2024-09-10T20:55:46.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd44ff9640 1 -- 172.21.15.67:0/2606903115 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd380041c0 con 0x7fdd48113830 2024-09-10T20:55:46.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.167+0000 7fdd44ff9640 1 -- 172.21.15.67:0/2606903115 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011990 con 0x7fdd48113830 2024-09-10T20:55:46.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.181+0000 7fdd501dd740 1 Processor -- start 2024-09-10T20:55:46.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd44ff9640 1 -- 172.21.15.67:0/2606903115 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdd38011b30 con 0x7fdd48113830 2024-09-10T20:55:46.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 -- start start 2024-09-10T20:55:46.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219340a0 0x55bc21934480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219349c0 0x55bc21940410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bc218aae50 con 0x55bc219340a0 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bc2189a280 con 0x55bc219349c0 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.184+0000 7fdd501dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc2189e090 con 0x55bc21940950 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50510/0 (socket says 172.21.15.67:50510) 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 -- 172.21.15.67:0/3078714454 learned_addr learned my addr 172.21.15.67:0/3078714454 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:46.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219340a0 0x55bc21934480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 -- 172.21.15.67:0/3078714454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219349c0 msgr2=0x55bc21940410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:55:46.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219349c0 0x55bc21940410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 -- 172.21.15.67:0/3078714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219340a0 msgr2=0x55bc21934480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219340a0 0x55bc21934480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.185+0000 7fdd46ffd640 1 -- 172.21.15.67:0/3078714454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc215f8650 con 0x55bc21940950 2024-09-10T20:55:46.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.186+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009fc0 tx=0x7fdd3c009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25298825fead7667 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.187+0000 7fdd2dffb640 1 -- 172.21.15.67:0/3078714454 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c004030 con 0x55bc21940950 2024-09-10T20:55:46.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.187+0000 7fdd2dffb640 1 -- 172.21.15.67:0/3078714454 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c0035f0 con 0x55bc21940950 2024-09-10T20:55:46.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.187+0000 7fdd2dffb640 1 -- 172.21.15.67:0/3078714454 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c01d620 con 0x55bc21940950 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd44ff9640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 0x7fdd300b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 -- 172.21.15.67:0/3078714454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 msgr2=0x55bc21942d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009fc0 tx=0x7fdd3c009570 comp rx=0 tx=0).stop 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 -- 172.21.15.67:0/3078714454 shutdown_connections 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc21942d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219349c0 0x55bc21940410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3078714454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219340a0 0x55bc21934480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd501dd740 1 -- 172.21.15.67:0/3078714454 >> 172.21.15.67:0/3078714454 conn(0x55bc21931ed0 msgr2=0x55bc21933070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.188+0000 7fdd44ff9640 1 -- 172.21.15.67:0/2606903115 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdd380e4d00 con 0x7fdd48113830 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.189+0000 7fdd501dd740 1 -- 172.21.15.67:0/3078714454 shutdown_connections 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.189+0000 7fdd477fe640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 0x7fdd300b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.189+0000 7fdd501dd740 1 -- 172.21.15.67:0/3078714454 wait complete. 2024-09-10T20:55:46.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.190+0000 7fdd501dd740 1 -- start start 2024-09-10T20:55:46.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.190+0000 7fdd501dd740 1 Processor -- start 2024-09-10T20:55:46.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc21940260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc2193dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55bc216fb700 con 0x55bc219349c0 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55bc21835110 con 0x55bc21940950 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc21943620 con 0x55bc219340a0 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.191+0000 7fdd501dd740 10 client.0 _ll_register_callbacks cb 0x55bc2184e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58786/0 (socket says 172.21.15.67:58786) 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd46ffd640 1 -- 172.21.15.67:0/3590460703 learned_addr learned my addr 172.21.15.67:0/3590460703 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:46.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc2193dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd477fe640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc21940260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 -- 172.21.15.67:0/3590460703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 msgr2=0x55bc21940260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc21940260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 -- 172.21.15.67:0/3590460703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 msgr2=0x55bc2193d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.192+0000 7fdd47fff640 1 -- 172.21.15.67:0/3590460703 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc21862c40 con 0x55bc21940950 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.193+0000 7fdd47fff640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc2193dce0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd380e27d0 tx=0x7fdd380aac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da18b00bad41156 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.193+0000 7fdd26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:46.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.193+0000 7fdd477fe640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 0x7fdd300b78e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdd40006010 tx=0x7fdd4001a8d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.193+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd380ab490 con 0x55bc21940950 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.193+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdd380a7700 con 0x55bc21940950 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.194+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd3c0035f0 con 0x55bc21940950 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.194+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd380aff70 con 0x55bc21940950 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.195+0000 7fdd501dd740 10 client.25499 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.195+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bc2194f060 con 0x55bc21940950 2024-09-10T20:55:46.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.195+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c0035f0 con 0x55bc21940950 2024-09-10T20:55:46.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.195+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fdd380a6de0 con 0x55bc21940950 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 10 client.25499 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 20 client.25499 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21950520 0x55bc21952910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 4 client.25499 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc218acda0 con 0x55bc21950520 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.196+0000 7fdd477fe640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21950520 0x55bc21952910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.197+0000 7fdd477fe640 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21950520 0x55bc21952910 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8147aaa88b0dde5c server_cookie=77144a85ce01df20 in_seq=0 out_seq=0 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.197+0000 7fdd26ffd640 10 client.25499 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.197+0000 7fdd26ffd640 1 -- 172.21.15.67:0/3590460703 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc218acda0 con 0x55bc21950520 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd26ffd640 10 client.25499 handle_command_reply: tid=0 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 client.25499 shutdown 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 msgr2=0x55bc2193dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc2193dce0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd380e27d0 tx=0x7fdd380aac00 comp rx=0 tx=0).stop 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 shutdown_connections 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21950520 0x55bc21952910 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc2193dce0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 --2- 172.21.15.67:0/3590460703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc21940260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 >> 172.21.15.67:0/3590460703 conn(0x55bc21931ed0 msgr2=0x55bc21937a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd26ffd640 0 client.25499 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 shutdown_connections 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 1 -- 172.21.15.67:0/3590460703 wait complete. 2024-09-10T20:55:46.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.198+0000 7fdd501dd740 20 client.25499 trim_cache size 0 max 16384 2024-09-10T20:55:46.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.222+0000 7fdd501dd740 1 Processor -- start 2024-09-10T20:55:46.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.222+0000 7fdd501dd740 1 -- start start 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc21933000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc2193bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34010d90 con 0x55bc219349c0 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400e600 con 0x55bc219340a0 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.223+0000 7fdd501dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400c450 con 0x55bc21940950 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.224+0000 7fdd477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.224+0000 7fdd47fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc2193bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:38890/0 (socket says 172.21.15.67:38890) 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 -- 172.21.15.67:0/2687912175 learned_addr learned my addr 172.21.15.67:0/2687912175 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:46.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 -- 172.21.15.67:0/2687912175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 msgr2=0x55bc2193bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc2193bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 -- 172.21.15.67:0/2687912175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 msgr2=0x55bc21933000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc21933000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 -- 172.21.15.67:0/2687912175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc21932950 con 0x55bc219340a0 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd47fff640 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc2193bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd477fe640 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001acb0 tx=0x7fdd40012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33aa6808a27f2440 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd2d7fa640 1 -- 172.21.15.67:0/2687912175 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40017040 con 0x55bc219340a0 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd2d7fa640 1 -- 172.21.15.67:0/2687912175 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd40047040 con 0x55bc219340a0 2024-09-10T20:55:46.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.225+0000 7fdd2d7fa640 1 -- 172.21.15.67:0/2687912175 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40041900 con 0x55bc219340a0 2024-09-10T20:55:46.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 -- 172.21.15.67:0/2687912175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 msgr2=0x55bc2194c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdd4001acb0 tx=0x7fdd40012000 comp rx=0 tx=0).stop 2024-09-10T20:55:46.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 -- 172.21.15.67:0/2687912175 shutdown_connections 2024-09-10T20:55:46.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc21940950 0x55bc2193bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc21933000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 --2- 172.21.15.67:0/2687912175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc219340a0 0x55bc2194c930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 -- 172.21.15.67:0/2687912175 >> 172.21.15.67:0/2687912175 conn(0x55bc21931ed0 msgr2=0x55bc21938960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 -- 172.21.15.67:0/2687912175 shutdown_connections 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.226+0000 7fdd501dd740 1 -- 172.21.15.67:0/2687912175 wait complete. 2024-09-10T20:55:46.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 -- start start 2024-09-10T20:55:46.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 Processor -- start 2024-09-10T20:55:46.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc2193add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc21948be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400cac0 con 0x55bc219349c0 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400df30 con 0x55bc21940950 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400d190 con 0x55bc219340a0 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.227+0000 7fdd501dd740 10 client.0 _ll_register_callbacks cb 0x7fdd38003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58808/0 (socket says 172.21.15.67:58808) 2024-09-10T20:55:46.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 -- 172.21.15.67:0/954240862 learned_addr learned my addr 172.21.15.67:0/954240862 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:46.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd477fe640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc2193add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd47fff640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc21948be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 -- 172.21.15.67:0/954240862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 msgr2=0x55bc2193add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc2193add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 -- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 msgr2=0x55bc21948be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:46.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc21948be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd46ffd640 1 -- 172.21.15.67:0/954240862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc21949410 con 0x55bc219349c0 2024-09-10T20:55:46.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.228+0000 7fdd47fff640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc21948be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.229+0000 7fdd46ffd640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c012fd0 tx=0x7fdd3c01ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6370a7b4e46385eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.229+0000 7fdd26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c02c060 con 0x55bc219349c0 2024-09-10T20:55:46.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdd3c01ed00 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd40047040 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fdd3c005070 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd501dd740 10 client.15849 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55bc219bb200 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd40047040 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fdd3c003b70 con 0x55bc219349c0 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd501dd740 10 client.15849 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.230+0000 7fdd501dd740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd501dd740 20 client.15849 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21939c20 0x55bc2193a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd501dd740 4 client.15849 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc218a8850 con 0x55bc21939c20 2024-09-10T20:55:46.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd477fe640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21939c20 0x55bc2193a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd26ffd640 10 client.15849 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.231+0000 7fdd477fe640 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21939c20 0x55bc2193a030 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f426976452bea89 server_cookie=63d47b68169392b5 in_seq=0 out_seq=0 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd26ffd640 1 -- 172.21.15.67:0/954240862 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55bc218a8850 con 0x55bc21939c20 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd26ffd640 10 client.15849 handle_command_reply: tid=0 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 client.15849 shutdown 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 msgr2=0x55bc2193b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c012fd0 tx=0x7fdd3c01ec60 comp rx=0 tx=0).stop 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 shutdown_connections 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55bc21939c20 0x55bc2193a030 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc21940950 0x55bc21948be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd26ffd640 0 client.15849 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55bc219349c0 0x55bc2193b350 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 --2- 172.21.15.67:0/954240862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc219340a0 0x55bc2193add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 >> 172.21.15.67:0/954240862 conn(0x55bc21931ed0 msgr2=0x55bc2193bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 shutdown_connections 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 1 -- 172.21.15.67:0/954240862 wait complete. 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.232+0000 7fdd501dd740 20 client.15849 trim_cache size 0 max 16384 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:55:46.243 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:46.244 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.245 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:55:46.246 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:55:46.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 msgr2=0x7fdd300b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 0x7fdd300b78e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdd40006010 tx=0x7fdd4001a8d0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 msgr2=0x7fdd4819ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800c410 tx=0x7fdd38001e70 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 shutdown_connections 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdd300b5420 0x7fdd300b78e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd48113830 0x7fdd4819ca00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd48110f00 0x7fdd481044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 --2- 172.21.15.67:0/2606903115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd48101220 0x7fdd48103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 >> 172.21.15.67:0/2606903115 conn(0x7fdd48078100 msgr2=0x7fdd48114030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 shutdown_connections 2024-09-10T20:55:46.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:46.233+0000 7fdd4de08640 1 -- 172.21.15.67:0/2606903115 wait complete. 2024-09-10T20:55:46.758 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:46 smithi067 ceph-mon[30891]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 849 op/s 2024-09-10T20:55:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:46 smithi083 ceph-mon[35058]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 849 op/s 2024-09-10T20:55:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:46 smithi172 ceph-mon[35265]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 849 op/s 2024-09-10T20:55:47.183 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:55:47.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:55:47.617 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2643316096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810bb80 msgr2=0x7ff7c81142d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2643316096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810bb80 0x7ff7c81142d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009ca0 tx=0x7ff7c002a950 comp rx=0 tx=0).stop 2024-09-10T20:55:48.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2643316096 shutdown_connections 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2643316096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c8116c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2643316096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810bb80 0x7ff7c81142d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2643316096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810b260 0x7ff7c810b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.224+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2643316096 >> 172.21.15.67:0/2643316096 conn(0x7ff7c806e2e0 msgr2=0x7ff7c806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.225+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2643316096 shutdown_connections 2024-09-10T20:55:48.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.225+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2643316096 wait complete. 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.225+0000 7ff7cd6d6640 1 Processor -- start 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 -- start start 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 0x7ff7c81a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c81a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c811a450 con 0x7ff7c810b260 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c811a2d0 con 0x7ff7c810bb80 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7cd6d6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c811a5d0 con 0x7ff7c8114810 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58826/0 (socket says 172.21.15.67:58826) 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 -- 172.21.15.67:0/2345396023 learned_addr learned my addr 172.21.15.67:0/2345396023 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c67fc640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 0x7ff7c81a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c77fe640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c81a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 -- 172.21.15.67:0/2345396023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 msgr2=0x7ff7c81a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c81a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 -- 172.21.15.67:0/2345396023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 msgr2=0x7ff7c81a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 0x7ff7c81a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c6ffd640 1 -- 172.21.15.67:0/2345396023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c81a7bd0 con 0x7ff7c810b260 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c77fe640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c81a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.226+0000 7ff7c67fc640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 0x7ff7c81a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.227+0000 7ff7c6ffd640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e9f0 tx=0x7ff7bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.227+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00cd80 con 0x7ff7c810b260 2024-09-10T20:55:48.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.227+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7bc0108e0 con 0x7ff7c810b260 2024-09-10T20:55:48.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.227+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc018980 con 0x7ff7c810b260 2024-09-10T20:55:48.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.229+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c81a7ec0 con 0x7ff7c810b260 2024-09-10T20:55:48.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.229+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81ae580 con 0x7ff7c810b260 2024-09-10T20:55:48.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.231+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c810b640 con 0x7ff7c810b260 2024-09-10T20:55:48.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.233+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff7bc010430 con 0x7ff7c810b260 2024-09-10T20:55:48.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.234+0000 7ff7affff640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 0x7ff7b00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:48.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.234+0000 7ff7c67fc640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 0x7ff7b00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:48.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.235+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff7bc0e6110 con 0x7ff7c810b260 2024-09-10T20:55:48.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.235+0000 7ff7c67fc640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 0x7ff7b00b7970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8116570 tx=0x7ff7c002fc20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:48.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.241+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff7bc0acfa0 con 0x7ff7c810b260 2024-09-10T20:55:48.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.575+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7c802e5c0 con 0x7ff7c810b260 2024-09-10T20:55:48.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.576+0000 7ff7affff640 1 -- 172.21.15.67:0/2345396023 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11907 (secure 0 0 0) 0x7ff7bc0ac8a0 con 0x7ff7c810b260 2024-09-10T20:55:48.580 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:55:48.581 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"btime":"2024-09-10T20:54:26:300672+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:54:25.547459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:55:48.581 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 32 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 msgr2=0x7ff7b00b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 0x7ff7b00b7970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8116570 tx=0x7ff7c002fc20 comp rx=0 tx=0).stop 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 msgr2=0x7ff7c81a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00e9f0 tx=0x7ff7bc00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 shutdown_connections 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff7b00b54b0 0x7ff7b00b7970 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c8114810 0x7ff7c81a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7c810bb80 0x7ff7c81a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 --2- 172.21.15.67:0/2345396023 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7c810b260 0x7ff7c81a1b20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:48.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 >> 172.21.15.67:0/2345396023 conn(0x7ff7c806e2e0 msgr2=0x7ff7c810a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:48.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 shutdown_connections 2024-09-10T20:55:48.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:48.580+0000 7ff7cd6d6640 1 -- 172.21.15.67:0/2345396023 wait complete. 2024-09-10T20:55:48.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:48 smithi067 ceph-mon[30891]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 946 op/s 2024-09-10T20:55:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:48 smithi083 ceph-mon[35058]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 946 op/s 2024-09-10T20:55:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:48 smithi172 ceph-mon[35265]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 29 MiB/s wr, 946 op/s 2024-09-10T20:55:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 255.0 s, 3054.6 tps, lat 32.865 ms stddev 38.894 2024-09-10T20:55:49.392 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:55:49.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:49 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2345396023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:49.802 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:49.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:49 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2345396023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:49.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:49 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2345396023' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 -- 172.21.15.67:0/3449746207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075540 msgr2=0x7f2298075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 --2- 172.21.15.67:0/3449746207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075540 0x7f2298075920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f228c009900 tx=0x7f228c02a410 comp rx=0 tx=0).stop 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 -- 172.21.15.67:0/3449746207 shutdown_connections 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 --2- 172.21.15.67:0/3449746207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298113b20 0x7f2298115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 --2- 172.21.15.67:0/3449746207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298075e60 0x7f22981135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 --2- 172.21.15.67:0/3449746207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075540 0x7f2298075920 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.355+0000 7f229e1d2640 1 -- 172.21.15.67:0/3449746207 >> 172.21.15.67:0/3449746207 conn(0x7f22980fe870 msgr2=0x7f2298100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.356+0000 7f229e1d2640 1 -- 172.21.15.67:0/3449746207 shutdown_connections 2024-09-10T20:55:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.357+0000 7f229e1d2640 1 -- 172.21.15.67:0/3449746207 wait complete. 2024-09-10T20:55:50.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 Processor -- start 2024-09-10T20:55:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 -- start start 2024-09-10T20:55:50.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 0x7f2298113440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 0x7f229810c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2298119400 con 0x7f2298075e60 2024-09-10T20:55:50.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2298119280 con 0x7f2298113b20 2024-09-10T20:55:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.358+0000 7f229e1d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2298119580 con 0x7f2298075540 2024-09-10T20:55:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f22977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f22977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50576/0 (socket says 172.21.15.67:50576) 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f22977fe640 1 -- 172.21.15.67:0/741805953 learned_addr learned my addr 172.21.15.67:0/741805953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2297fff640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 0x7f229810c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 0x7f2298113440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 -- 172.21.15.67:0/741805953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 msgr2=0x7f2298112f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 -- 172.21.15.67:0/741805953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 msgr2=0x7f229810c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 0x7f229810c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.359+0000 7f2296ffd640 1 -- 172.21.15.67:0/741805953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229810cb10 con 0x7f2298075e60 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.360+0000 7f2296ffd640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 0x7f2298113440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f228800e9f0 tx=0x7f228800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.360+0000 7f2294ff9640 1 -- 172.21.15.67:0/741805953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228800ccc0 con 0x7f2298075e60 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.361+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229810ce00 con 0x7f2298075e60 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.361+0000 7f2294ff9640 1 -- 172.21.15.67:0/741805953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22880108e0 con 0x7f2298075e60 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.361+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2298111df0 con 0x7f2298075e60 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.361+0000 7f22977fe640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.361+0000 7f2297fff640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 0x7f229810c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:50.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.362+0000 7f2294ff9640 1 -- 172.21.15.67:0/741805953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880188a0 con 0x7f2298075e60 2024-09-10T20:55:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.365+0000 7f2294ff9640 1 -- 172.21.15.67:0/741805953 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2288010430 con 0x7f2298075e60 2024-09-10T20:55:50.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.366+0000 7f22a05a7740 1 Processor -- start 2024-09-10T20:55:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.366+0000 7f2294ff9640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 0x7f22800b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.366+0000 7f2297fff640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 0x7f22800b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.366+0000 7f2294ff9640 1 -- 172.21.15.67:0/741805953 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f22880e5fe0 con 0x7f2298075e60 2024-09-10T20:55:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 -- start start 2024-09-10T20:55:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fb0a10 0x5600c0fbc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5600c0f26ea0 con 0x5600c0fb0a10 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5600c0f162d0 con 0x5600c0fb00f0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22a05a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600c0f1a0e0 con 0x5600c0fbc9a0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.367+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:38934/0 (socket says 172.21.15.67:38934) 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 -- 172.21.15.67:0/1643352369 learned_addr learned my addr 172.21.15.67:0/1643352369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f2297fff640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 0x7f22800b77d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f229806c430 tx=0x7f2290009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f2297fff640 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f2296ffd640 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fb0a10 0x5600c0fbc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 -- 172.21.15.67:0/1643352369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fbc9a0 msgr2=0x5600c0fbed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 -- 172.21.15.67:0/1643352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fb0a10 msgr2=0x5600c0fbc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fb0a10 0x5600c0fbc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.368+0000 7f22977fe640 1 -- 172.21.15.67:0/1643352369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600c0c74650 con 0x5600c0fb00f0 2024-09-10T20:55:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.369+0000 7f22977fe640 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f228c005ab0 tx=0x7f228c004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b771fa4d5a0acc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.370+0000 7f227dffb640 1 -- 172.21.15.67:0/1643352369 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03f020 con 0x5600c0fb00f0 2024-09-10T20:55:50.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.370+0000 7f227dffb640 1 -- 172.21.15.67:0/1643352369 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0046c0 con 0x5600c0fb00f0 2024-09-10T20:55:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f227dffb640 1 -- 172.21.15.67:0/1643352369 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c035070 con 0x5600c0fb00f0 2024-09-10T20:55:50.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 -- 172.21.15.67:0/1643352369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 msgr2=0x5600c0fb04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f228c005ab0 tx=0x7f228c004320 comp rx=0 tx=0).stop 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 -- 172.21.15.67:0/1643352369 shutdown_connections 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fb0a10 0x5600c0fbc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 --2- 172.21.15.67:0/1643352369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fb04d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 -- 172.21.15.67:0/1643352369 >> 172.21.15.67:0/1643352369 conn(0x5600c0fadf20 msgr2=0x5600c0faf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.371+0000 7f22a05a7740 1 -- 172.21.15.67:0/1643352369 shutdown_connections 2024-09-10T20:55:50.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.372+0000 7f22a05a7740 1 -- 172.21.15.67:0/1643352369 wait complete. 2024-09-10T20:55:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.372+0000 7f22a05a7740 1 -- start start 2024-09-10T20:55:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.372+0000 7f22a05a7740 1 Processor -- start 2024-09-10T20:55:50.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fb9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5600c0d77700 con 0x5600c0fbc9a0 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5600c0eb1160 con 0x5600c0fb00f0 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600c0fbf610 con 0x5600c0fb0a10 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22a05a7740 10 client.0 _ll_register_callbacks cb 0x5600c0eca9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:38948/0 (socket says 172.21.15.67:38948) 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f22977fe640 1 -- 172.21.15.67:0/3492196351 learned_addr learned my addr 172.21.15.67:0/3492196351 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.373+0000 7f2296ffd640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fb9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f2297fff640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 -- 172.21.15.67:0/3492196351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 msgr2=0x5600c0fb9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fb9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 -- 172.21.15.67:0/3492196351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 msgr2=0x5600c0fb9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 -- 172.21.15.67:0/3492196351 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600c0edec90 con 0x5600c0fb00f0 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f22977fe640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f228c009620 tx=0x7f228c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5e976878d5b351 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.374+0000 7f2276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:50.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.375+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03f070 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.375+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f228c005460 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.375+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c0046c0 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.376+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f228c055050 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.376+0000 7f22a05a7740 10 client.25520 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.376+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5600c0fdbf70 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c0046c0 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f228c03b460 con 0x5600c0fb00f0 2024-09-10T20:55:50.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 10 client.25520 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 10 client.25520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:55:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 20 client.25520 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c0fdd420 0x5600c0fdf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 4 client.25520 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:50.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.377+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600c0f28df0 con 0x5600c0fdd420 2024-09-10T20:55:50.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.389+0000 7f2296ffd640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c0fdd420 0x5600c0fdf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.408+0000 7f2276ffd640 10 client.25520 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:50.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.408+0000 7f2296ffd640 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c0fdd420 0x5600c0fdf860 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=447f4eecf231645e server_cookie=a2ae27b7a4ad159a in_seq=0 out_seq=0 2024-09-10T20:55:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.410+0000 7f2276ffd640 1 -- 172.21.15.67:0/3492196351 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600c0f28df0 con 0x5600c0fdd420 2024-09-10T20:55:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.410+0000 7f2276ffd640 10 client.25520 handle_command_reply: tid=0 2024-09-10T20:55:50.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.410+0000 7f22a05a7740 1 client.25520 shutdown 2024-09-10T20:55:50.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 msgr2=0x5600c0fbc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f228c009620 tx=0x7f228c009260 comp rx=0 tx=0).stop 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 shutdown_connections 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c0fdd420 0x5600c0fdf860 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fb9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3492196351 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fbc220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f2276ffd640 0 client.25520 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:50.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.412+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 >> 172.21.15.67:0/3492196351 conn(0x5600c0fadf20 msgr2=0x5600c0fb3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.414+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 shutdown_connections 2024-09-10T20:55:50.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.416+0000 7f22a05a7740 1 -- 172.21.15.67:0/3492196351 wait complete. 2024-09-10T20:55:50.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.416+0000 7f22a05a7740 20 client.25520 trim_cache size 0 max 16384 2024-09-10T20:55:50.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 Processor -- start 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 -- start start 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 0x5600c0faf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f22981b7390 con 0x5600c0fbc9a0 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2298074660 con 0x5600c0fb0a10 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.438+0000 7f22a05a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22980724b0 con 0x5600c0fb00f0 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:50608/0 (socket says 172.21.15.67:50608) 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 -- 172.21.15.67:0/3503822548 learned_addr learned my addr 172.21.15.67:0/3503822548 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f2296ffd640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 0x5600c0faf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f2297fff640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 -- 172.21.15.67:0/3503822548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 msgr2=0x5600c0faf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 0x5600c0faf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 -- 172.21.15.67:0/3503822548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 msgr2=0x5600c0fb6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 -- 172.21.15.67:0/3503822548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600c0fd9c00 con 0x5600c0fb00f0 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f2296ffd640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 0x5600c0faf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f22977fe640 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f228c004ff0 tx=0x7f228c004490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465333e2e79b775a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.439+0000 7f227d7fa640 1 -- 172.21.15.67:0/3503822548 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c03f030 con 0x5600c0fb00f0 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.440+0000 7f227d7fa640 1 -- 172.21.15.67:0/3503822548 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c03b660 con 0x5600c0fb00f0 2024-09-10T20:55:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.440+0000 7f227d7fa640 1 -- 172.21.15.67:0/3503822548 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c035040 con 0x5600c0fb00f0 2024-09-10T20:55:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.440+0000 7f22a05a7740 1 -- 172.21.15.67:0/3503822548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 msgr2=0x5600c0faec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.440+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f228c004ff0 tx=0x7f228c004490 comp rx=0 tx=0).stop 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 -- 172.21.15.67:0/3503822548 shutdown_connections 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fb6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb0a10 0x5600c0faf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 --2- 172.21.15.67:0/3503822548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb00f0 0x5600c0faec00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 -- 172.21.15.67:0/3503822548 >> 172.21.15.67:0/3503822548 conn(0x5600c0fadf20 msgr2=0x5600c0fb4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 -- 172.21.15.67:0/3503822548 shutdown_connections 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 -- 172.21.15.67:0/3503822548 wait complete. 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 -- start start 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.441+0000 7f22a05a7740 1 Processor -- start 2024-09-10T20:55:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fc4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2298072b20 con 0x5600c0fbc9a0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2298073f90 con 0x5600c0fb00f0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22980731f0 con 0x5600c0fb0a10 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22a05a7740 10 client.0 _ll_register_callbacks cb 0x7f22900093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:38970/0 (socket says 172.21.15.67:38970) 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f2297fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 -- 172.21.15.67:0/490696598 learned_addr learned my addr 172.21.15.67:0/490696598 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f2296ffd640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fc4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 -- 172.21.15.67:0/490696598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 msgr2=0x5600c0fc4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fc4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 -- 172.21.15.67:0/490696598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 msgr2=0x5600c0fbf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 -- 172.21.15.67:0/490696598 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600c0fbfe20 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f22977fe640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f228c004650 tx=0x7f228c02aba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df584594bb37559 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f2276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c05d020 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.442+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f228c005460 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c03b660 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f228c035040 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 10 client.25526 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5600c104ab10 con 0x5600c0fb00f0 2024-09-10T20:55:50.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228c03b660 con 0x5600c0fb00f0 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f228c031810 con 0x5600c0fb00f0 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 10 client.25526 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 10 client.25526 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 20 client.25526 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c104af70 0x5600c104d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 4 client.25526 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600c0f248a0 con 0x5600c104af70 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.443+0000 7f2296ffd640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c104af70 0x5600c104d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f2296ffd640 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c104af70 0x5600c104d360 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3946b5063d13656e server_cookie=9a4636630622cb68 in_seq=0 out_seq=0 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f2276ffd640 10 client.25526 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f2276ffd640 1 -- 172.21.15.67:0/490696598 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600c0f248a0 con 0x5600c104af70 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f2276ffd640 10 client.25526 handle_command_reply: tid=0 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 client.25526 shutdown 2024-09-10T20:55:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 msgr2=0x5600c0fc4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f228c004650 tx=0x7f228c02aba0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 shutdown_connections 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5600c104af70 0x5600c104d360 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5600c0fbc9a0 0x5600c0fbf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600c0fb0a10 0x5600c0fc4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 --2- 172.21.15.67:0/490696598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5600c0fb00f0 0x5600c0fc4930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 >> 172.21.15.67:0/490696598 conn(0x5600c0fadf20 msgr2=0x5600c0faec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f2276ffd640 0 client.25526 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:55:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.444+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 shutdown_connections 2024-09-10T20:55:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.446+0000 7f22a05a7740 1 -- 172.21.15.67:0/490696598 wait complete. 2024-09-10T20:55:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.446+0000 7f22a05a7740 20 client.25526 trim_cache size 0 max 16384 2024-09-10T20:55:50.454 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 msgr2=0x7f22800b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 0x7f22800b77d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f229806c430 tx=0x7f2290009500 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 msgr2=0x7f2298113440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 0x7f2298113440 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f228800e9f0 tx=0x7f228800eeb0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 shutdown_connections 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2298113b20 0x7f229810c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298075e60 0x7f2298113440 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f22800b5310 0x7f22800b77d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 --2- 172.21.15.67:0/741805953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2298075540 0x7f2298112f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 >> 172.21.15.67:0/741805953 conn(0x7f22980fe870 msgr2=0x7f22980ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 shutdown_connections 2024-09-10T20:55:50.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:50.447+0000 7f229e1d2640 1 -- 172.21.15.67:0/741805953 wait complete. 2024-09-10T20:55:50.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:50 smithi067 ceph-mon[30891]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 812 op/s 2024-09-10T20:55:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:50 smithi083 ceph-mon[35058]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 812 op/s 2024-09-10T20:55:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:50 smithi172 ceph-mon[35265]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 812 op/s 2024-09-10T20:55:51.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:55:52.061 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 -- 172.21.15.67:0/432674318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10fb90 msgr2=0x7f4ffc116370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 --2- 172.21.15.67:0/432674318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc116370 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009900 tx=0x7f4ff402a580 comp rx=0 tx=0).stop 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 -- 172.21.15.67:0/432674318 shutdown_connections 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 --2- 172.21.15.67:0/432674318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc116370 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 --2- 172.21.15.67:0/432674318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10f210 0x7f4ffc10f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 --2- 172.21.15.67:0/432674318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc10a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.655+0000 7f500364b640 1 -- 172.21.15.67:0/432674318 >> 172.21.15.67:0/432674318 conn(0x7f4ffc06e2e0 msgr2=0x7f4ffc06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.656+0000 7f500364b640 1 -- 172.21.15.67:0/432674318 shutdown_connections 2024-09-10T20:55:52.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.656+0000 7f500364b640 1 -- 172.21.15.67:0/432674318 wait complete. 2024-09-10T20:55:52.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 Processor -- start 2024-09-10T20:55:52.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 -- start start 2024-09-10T20:55:52.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 0x7f4ffc19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f50013e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f50013e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40274/0 (socket says 172.21.15.67:40274) 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc1a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f50013e7640 1 -- 172.21.15.67:0/3365723568 learned_addr learned my addr 172.21.15.67:0/3365723568 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc119340 con 0x7f4ffc10f210 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1191c0 con 0x7f4ffc10fb90 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.657+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1194c0 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f5001be8640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc1a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f5000be6640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 0x7f4ffc19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f50013e7640 1 -- 172.21.15.67:0/3365723568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10fb90 msgr2=0x7f4ffc1a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f50013e7640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc1a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f50013e7640 1 -- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 msgr2=0x7f4ffc19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f50013e7640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 0x7f4ffc19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f50013e7640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc1a5920 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.658+0000 7f5000be6640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 0x7f4ffc19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f50013e7640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8010b80 tx=0x7f4ff800e490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f4ff27fc640 1 -- 172.21.15.67:0/3365723568 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff801a030 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f4ff27fc640 1 -- 172.21.15.67:0/3365723568 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff8004020 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f4ff27fc640 1 -- 172.21.15.67:0/3365723568 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8003bb0 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc1a5c10 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.659+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc1ac2d0 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 Processor -- start 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 -- start start 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea0df0 0x564ae5eac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564ae5e16ea0 con 0x564ae5eacd80 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564ae5e062d0 con 0x564ae5ea0df0 2024-09-10T20:55:52.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.663+0000 7f5005a20740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ae5e0a0e0 con 0x564ae5ea04d0 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40276/0 (socket says 172.21.15.67:40276) 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 -- 172.21.15.67:0/2964966442 learned_addr learned my addr 172.21.15.67:0/2964966442 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5000be6640 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 -- 172.21.15.67:0/2964966442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea0df0 msgr2=0x564ae5eac840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea0df0 0x564ae5eac840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 -- 172.21.15.67:0/2964966442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 msgr2=0x564ae5eaf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.664+0000 7f5001be8640 1 -- 172.21.15.67:0/2964966442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae5b64650 con 0x564ae5ea04d0 2024-09-10T20:55:52.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.665+0000 7f5001be8640 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009900 tx=0x7f4ff4009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d259553e86a454 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.665+0000 7f4fe77fe640 1 -- 172.21.15.67:0/2964966442 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4031e10 con 0x564ae5ea04d0 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.665+0000 7f4fe77fe640 1 -- 172.21.15.67:0/2964966442 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff4003e20 con 0x564ae5ea04d0 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.665+0000 7f4fe77fe640 1 -- 172.21.15.67:0/2964966442 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4004460 con 0x564ae5ea04d0 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 -- 172.21.15.67:0/2964966442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 msgr2=0x564ae5ea08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009900 tx=0x7f4ff4009600 comp rx=0 tx=0).stop 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 -- 172.21.15.67:0/2964966442 shutdown_connections 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea0df0 0x564ae5eac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 --2- 172.21.15.67:0/2964966442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5ea04d0 0x564ae5ea08b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.666+0000 7f5005a20740 1 -- 172.21.15.67:0/2964966442 >> 172.21.15.67:0/2964966442 conn(0x564ae5e9e300 msgr2=0x564ae5e9f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.667+0000 7f4ff27fc640 1 -- 172.21.15.67:0/3365723568 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4ff800eb40 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.667+0000 7f5005a20740 1 -- 172.21.15.67:0/2964966442 shutdown_connections 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.667+0000 7f5005a20740 1 -- 172.21.15.67:0/2964966442 wait complete. 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.668+0000 7f4ff27fc640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 0x7f4fe80b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.668+0000 7f4ff27fc640 1 -- 172.21.15.67:0/3365723568 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4ff80e55e0 con 0x7f4ffc10a3b0 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.668+0000 7f5000be6640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 0x7f4fe80b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.668+0000 7f5005a20740 1 -- start start 2024-09-10T20:55:52.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.669+0000 7f5005a20740 1 Processor -- start 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.669+0000 7f5000be6640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 0x7f4fe80b7770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc06eab0 tx=0x7f4fec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.670+0000 7f5005a20740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5ea9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.670+0000 7f5005a20740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5005a20740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5005a20740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564ae5c67700 con 0x564ae5eacd80 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5000be6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5000be6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47118/0 (socket says 172.21.15.67:47118) 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5000be6640 1 -- 172.21.15.67:0/367733749 learned_addr learned my addr 172.21.15.67:0/367733749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564ae5da1160 con 0x564ae5ea04d0 2024-09-10T20:55:52.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ae5ec09b0 con 0x564ae5eaa780 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5005a20740 10 client.0 _ll_register_callbacks cb 0x564ae5dba9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f5001be8640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.671+0000 7f50013e7640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5ea9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 -- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 msgr2=0x564ae5ec9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 -- 172.21.15.67:0/367733749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 msgr2=0x564ae5eaa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae5dcec90 con 0x564ae5ea04d0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f5001be8640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f50013e7640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5ea9d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564ae5e9f1e0 tx=0x7f4ff80abc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8466b4a4542276c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f4fe4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80ab960 con 0x564ae5ea04d0 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.672+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4ff80970c0 con 0x564ae5ea04d0 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.673+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff4003e20 con 0x564ae5ea04d0 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.673+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4ff80ac550 con 0x564ae5ea04d0 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.673+0000 7f5005a20740 10 client.25535 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.673+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564ae5ecc970 con 0x564ae5ea04d0 2024-09-10T20:55:52.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff4003e20 con 0x564ae5ea04d0 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f4ff8057ce0 con 0x564ae5ea04d0 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 10 client.25535 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 10 client.25535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 20 client.25535 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5ed0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 4 client.25535 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ae5e18df0 con 0x564ae5ecdd80 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.674+0000 7f5000be6640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5ed0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.675+0000 7f4fe4ff9640 10 client.25535 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.675+0000 7f5000be6640 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5ed0170 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ecae56a3a0e3eb6 server_cookie=9986da4be2b266fe in_seq=0 out_seq=0 2024-09-10T20:55:52.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/367733749 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ae5e18df0 con 0x564ae5ecdd80 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f4fe4ff9640 10 client.25535 handle_command_reply: tid=0 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 client.25535 shutdown 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 msgr2=0x564ae5ea9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5ea9d00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564ae5e9f1e0 tx=0x7f4ff80abc20 comp rx=0 tx=0).stop 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 shutdown_connections 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5ed0170 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f4fe4ff9640 0 client.25535 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eaa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 --2- 172.21.15.67:0/367733749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5ea9d00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 >> 172.21.15.67:0/367733749 conn(0x564ae5e9e300 msgr2=0x564ae5ea3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 shutdown_connections 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.676+0000 7f5005a20740 1 -- 172.21.15.67:0/367733749 wait complete. 2024-09-10T20:55:52.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.677+0000 7f5005a20740 20 client.25535 trim_cache size 0 max 16384 2024-09-10T20:55:52.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.695+0000 7f5005a20740 1 Processor -- start 2024-09-10T20:55:52.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 -- start start 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b7360 con 0x564ae5eacd80 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b4bd0 con 0x564ae5ea04d0 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.696+0000 7f5005a20740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b2a20 con 0x564ae5eaa780 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f5000be6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56326/0 (socket says 172.21.15.67:56326) 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f5000be6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40284/0 (socket says 172.21.15.67:40284) 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 -- 172.21.15.67:0/2827501460 learned_addr learned my addr 172.21.15.67:0/2827501460 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f5001be8640 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 -- 172.21.15.67:0/2827501460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 msgr2=0x564ae5ec9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 -- 172.21.15.67:0/2827501460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 msgr2=0x564ae5eca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 -- 172.21.15.67:0/2827501460 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ae5e9f010 con 0x564ae5ea04d0 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.697+0000 7f50013e7640 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80a90c0 tx=0x7f4ff80abd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8146185c3cbc6ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.698+0000 7f4fe6ffd640 1 -- 172.21.15.67:0/2827501460 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a84a0 con 0x564ae5ea04d0 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.698+0000 7f4fe6ffd640 1 -- 172.21.15.67:0/2827501460 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ff80ae070 con 0x564ae5ea04d0 2024-09-10T20:55:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.698+0000 7f4fe6ffd640 1 -- 172.21.15.67:0/2827501460 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80b0930 con 0x564ae5ea04d0 2024-09-10T20:55:52.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- 172.21.15.67:0/2827501460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 msgr2=0x564ae5eaba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80a90c0 tx=0x7f4ff80abd50 comp rx=0 tx=0).stop 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- 172.21.15.67:0/2827501460 shutdown_connections 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5eacd80 0x564ae5eca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eaa780 0x564ae5ec9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 --2- 172.21.15.67:0/2827501460 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5ea04d0 0x564ae5eaba40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- 172.21.15.67:0/2827501460 >> 172.21.15.67:0/2827501460 conn(0x564ae5e9e300 msgr2=0x564ae5eab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- 172.21.15.67:0/2827501460 shutdown_connections 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- 172.21.15.67:0/2827501460 wait complete. 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 -- start start 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.699+0000 7f5005a20740 1 Processor -- start 2024-09-10T20:55:52.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5ea04d0 0x564ae5ec5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eacd80 0x564ae5ea5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b3090 con 0x564ae5ea04d0 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b4500 con 0x564ae5eaa780 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc1b3760 con 0x564ae5eacd80 2024-09-10T20:55:52.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.700+0000 7f5005a20740 10 client.0 _ll_register_callbacks cb 0x7f4ff80044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.702+0000 7f5000be6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.702+0000 7f5000be6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56330/0 (socket says 172.21.15.67:56330) 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.702+0000 7f5000be6640 1 -- 172.21.15.67:0/861118616 learned_addr learned my addr 172.21.15.67:0/861118616 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f50013e7640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5ea04d0 0x564ae5ec5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 -- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eacd80 msgr2=0x564ae5ea5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eacd80 0x564ae5ea5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 -- 172.21.15.67:0/861118616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5ea04d0 msgr2=0x564ae5ec5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5ea04d0 0x564ae5ec5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 -- 172.21.15.67:0/861118616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ae5ec6960 con 0x564ae5eaa780 2024-09-10T20:55:52.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f5000be6640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564ae5ed0980 tx=0x7f4fec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16e6b3392c669444 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.703+0000 7f4fe4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.704+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec01cd40 con 0x564ae5eaa780 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.704+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fec0293b0 con 0x564ae5eaa780 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.704+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ff80ae070 con 0x564ae5eaa780 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.704+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4fec01de20 con 0x564ae5eaa780 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.706+0000 7f5005a20740 10 client.25541 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:52.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.706+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564ae5ea7590 con 0x564ae5eaa780 2024-09-10T20:55:52.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fec029a60 con 0x564ae5eaa780 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f4fec01a040 con 0x564ae5eaa780 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f5005a20740 10 client.25541 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f5005a20740 10 client.25541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f5005a20740 20 client.25541 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.707+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5f3dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.708+0000 7f5005a20740 4 client.25541 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:52.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.708+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4ff80ae070 con 0x564ae5ecdd80 2024-09-10T20:55:52.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.709+0000 7f50013e7640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5f3dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.711+0000 7f50013e7640 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5f3dc00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e2b981a6770ddf1 server_cookie=90d2693908acf592 in_seq=0 out_seq=0 2024-09-10T20:55:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.711+0000 7f4fe4ff9640 10 client.25541 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.711+0000 7f4fe4ff9640 1 -- 172.21.15.67:0/861118616 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4ff80ae070 con 0x564ae5ecdd80 2024-09-10T20:55:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.711+0000 7f4fe4ff9640 10 client.25541 handle_command_reply: tid=0 2024-09-10T20:55:52.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.711+0000 7f5005a20740 1 client.25541 shutdown 2024-09-10T20:55:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.717+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 msgr2=0x564ae5ec6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.717+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564ae5ed0980 tx=0x7f4fec0046c0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 shutdown_connections 2024-09-10T20:55:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564ae5ecdd80 0x564ae5f3dc00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ae5eacd80 0x564ae5ea5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f4fe4ff9640 0 client.25541 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:55:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564ae5eaa780 0x564ae5ec6180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 --2- 172.21.15.67:0/861118616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564ae5ea04d0 0x564ae5ec5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.719+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 >> 172.21.15.67:0/861118616 conn(0x564ae5e9e300 msgr2=0x564ae5eabb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.724+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 shutdown_connections 2024-09-10T20:55:52.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.725+0000 7f5005a20740 1 -- 172.21.15.67:0/861118616 wait complete. 2024-09-10T20:55:52.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.726+0000 7f5005a20740 20 client.25541 trim_cache size 0 max 16384 2024-09-10T20:55:52.734 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 msgr2=0x7f4fe80b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 0x7f4fe80b7770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc06eab0 tx=0x7f4fec005f90 comp rx=0 tx=0).stop 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 msgr2=0x7f4ffc19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8010b80 tx=0x7f4ff800e490 comp rx=0 tx=0).stop 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 shutdown_connections 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ffc10fb90 0x7f4ffc1a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ffc10f210 0x7f4ffc19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f4fe80b52b0 0x7f4fe80b7770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 --2- 172.21.15.67:0/3365723568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ffc10a3b0 0x7f4ffc19f870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:52.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.731+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 >> 172.21.15.67:0/3365723568 conn(0x7f4ffc06e2e0 msgr2=0x7f4ffc0734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:52.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.735+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 shutdown_connections 2024-09-10T20:55:52.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:52.735+0000 7f500364b640 1 -- 172.21.15.67:0/3365723568 wait complete. 2024-09-10T20:55:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:52 smithi067 ceph-mon[30891]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 768 op/s 2024-09-10T20:55:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:52 smithi083 ceph-mon[35058]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 768 op/s 2024-09-10T20:55:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:52 smithi172 ceph-mon[35265]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 768 op/s 2024-09-10T20:55:53.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:55:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 260.0 s, 2871.0 tps, lat 34.670 ms stddev 38.340 2024-09-10T20:55:54.089 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:54.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 -- 172.21.15.67:0/2053444535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0940108020 msgr2=0x7f094010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 --2- 172.21.15.67:0/2053444535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0940108020 0x7f094010e820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0938009be0 tx=0x7f093802a6c0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 -- 172.21.15.67:0/2053444535 shutdown_connections 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 --2- 172.21.15.67:0/2053444535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0940108020 0x7f094010e820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 --2- 172.21.15.67:0/2053444535 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09401076a0 0x7f0940107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 --2- 172.21.15.67:0/2053444535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f0940102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 -- 172.21.15.67:0/2053444535 >> 172.21.15.67:0/2053444535 conn(0x7f09400fd700 msgr2=0x7f09400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 -- 172.21.15.67:0/2053444535 shutdown_connections 2024-09-10T20:55:54.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.654+0000 7f0944ddf640 1 -- 172.21.15.67:0/2053444535 wait complete. 2024-09-10T20:55:54.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 Processor -- start 2024-09-10T20:55:54.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 -- start start 2024-09-10T20:55:54.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f09400ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09401076a0 0x7f09400fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 0x7f09400fe230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0940111ce0 con 0x7f0940108020 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0940111b60 con 0x7f0940101c90 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f0944ddf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0940111e60 con 0x7f09401076a0 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f093ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 0x7f09400fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f093ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 0x7f09400fe230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47170/0 (socket says 172.21.15.67:47170) 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.655+0000 7f093ed9d640 1 -- 172.21.15.67:0/1980521014 learned_addr learned my addr 172.21.15.67:0/1980521014 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:54.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f09400ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 -- 172.21.15.67:0/1980521014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09401076a0 msgr2=0x7f09400fdc00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09401076a0 0x7f09400fdc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 -- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 msgr2=0x7f09400fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 0x7f09400fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.656+0000 7f093e59c640 1 -- 172.21.15.67:0/1980521014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09401abbc0 con 0x7f0940101c90 2024-09-10T20:55:54.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.657+0000 7f093e59c640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f09400ff6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f093000e9f0 tx=0x7f093000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.657+0000 7f09377fe640 1 -- 172.21.15.67:0/1980521014 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093000ccc0 con 0x7f0940101c90 2024-09-10T20:55:54.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.657+0000 7f09377fe640 1 -- 172.21.15.67:0/1980521014 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0930005020 con 0x7f0940101c90 2024-09-10T20:55:54.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.657+0000 7f09377fe640 1 -- 172.21.15.67:0/1980521014 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930004a00 con 0x7f0940101c90 2024-09-10T20:55:54.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.657+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09401abd90 con 0x7f0940101c90 2024-09-10T20:55:54.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.658+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401ac1f0 con 0x7f0940101c90 2024-09-10T20:55:54.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.660+0000 7f09377fe640 1 -- 172.21.15.67:0/1980521014 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0930004ba0 con 0x7f0940101c90 2024-09-10T20:55:54.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.660+0000 7f09471b4740 1 Processor -- start 2024-09-10T20:55:54.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 -- start start 2024-09-10T20:55:54.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f093ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f093ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56366/0 (socket says 172.21.15.67:56366) 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c52840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f093ed9d640 1 -- 172.21.15.67:0/1838400483 learned_addr learned my addr 172.21.15.67:0/1838400483 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c55170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ce23bbcea0 con 0x55ce23c52d80 2024-09-10T20:55:54.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ce23bac2d0 con 0x55ce23c464d0 2024-09-10T20:55:54.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce23bb00e0 con 0x55ce23c46df0 2024-09-10T20:55:54.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.661+0000 7f09377fe640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 0x7f092c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.662+0000 7f093ed9d640 1 -- 172.21.15.67:0/1838400483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 msgr2=0x55ce23c52840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.662+0000 7f09377fe640 1 -- 172.21.15.67:0/1980521014 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f09300e5ca0 con 0x7f0940101c90 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.662+0000 7f093e59c640 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c52840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c52840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 -- 172.21.15.67:0/1838400483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 msgr2=0x55ce23c55170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c55170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 -- 172.21.15.67:0/1838400483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2390a650 con 0x55ce23c464d0 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 0x7f092c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093e59c640 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f093ed9d640 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0938005f00 tx=0x7f0938030640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a7f348680c1f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.663+0000 7f0934ff9640 1 -- 172.21.15.67:0/1838400483 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938036040 con 0x55ce23c464d0 2024-09-10T20:55:54.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.664+0000 7f0934ff9640 1 -- 172.21.15.67:0/1838400483 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0938030e20 con 0x55ce23c464d0 2024-09-10T20:55:54.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.664+0000 7f0934ff9640 1 -- 172.21.15.67:0/1838400483 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938031440 con 0x55ce23c464d0 2024-09-10T20:55:54.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.664+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 msgr2=0x55ce23c468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.664+0000 7f09471b4740 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0938005f00 tx=0x7f0938030640 comp rx=0 tx=0).stop 2024-09-10T20:55:54.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.664+0000 7f093ed9d640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 0x7f092c0b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f093804a000 tx=0x7f0938004990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 shutdown_connections 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c55170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 --2- 172.21.15.67:0/1838400483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c464d0 0x55ce23c468b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 >> 172.21.15.67:0/1838400483 conn(0x55ce23c44300 msgr2=0x55ce23c454a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 shutdown_connections 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 -- 172.21.15.67:0/1838400483 wait complete. 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 -- start start 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.665+0000 7f09471b4740 1 Processor -- start 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c52d80 0x55ce23c50180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ce23a0d700 con 0x55ce23c464d0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ce23b47160 con 0x55ce23c46df0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce23c55a00 con 0x55ce23c52d80 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f09471b4740 10 client.0 _ll_register_callbacks cb 0x55ce23b609e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56382/0 (socket says 172.21.15.67:56382) 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 -- 172.21.15.67:0/2032893655 learned_addr learned my addr 172.21.15.67:0/2032893655 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f093e59c640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f093ed9d640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c52d80 0x55ce23c50180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 -- 172.21.15.67:0/2032893655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c52d80 msgr2=0x55ce23c50180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c52d80 0x55ce23c50180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 -- 172.21.15.67:0/2032893655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 msgr2=0x55ce23c526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 -- 172.21.15.67:0/2032893655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce23b74c90 con 0x55ce23c46df0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0937fff640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f092800e5d0 tx=0x7f092800ea90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b21712a7494d9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.666+0000 7f0925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928010900 con 0x55ce23c46df0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0938030e20 con 0x55ce23c46df0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0928010aa0 con 0x55ce23c46df0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0928010ca0 con 0x55ce23c46df0 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f09471b4740 10 client.25553 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:54.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.667+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ce23c61390 con 0x55ce23c46df0 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0938030e20 con 0x55ce23c46df0 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f0928018530 con 0x55ce23c46df0 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 10 client.25553 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 20 client.25553 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23c627f0 0x55ce23c64c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 4 client.25553 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce23bbedf0 con 0x55ce23c627f0 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.669+0000 7f093e59c640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23c627f0 0x55ce23c64c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f0925ffb640 10 client.25553 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f093e59c640 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23c627f0 0x55ce23c64c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2066af4be990d9f server_cookie=f4b1f594cc200934 in_seq=0 out_seq=0 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f0925ffb640 1 -- 172.21.15.67:0/2032893655 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce23bbedf0 con 0x55ce23c627f0 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f0925ffb640 10 client.25553 handle_command_reply: tid=0 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f09471b4740 1 client.25553 shutdown 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 msgr2=0x55ce23c4fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.670+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f092800e5d0 tx=0x7f092800ea90 comp rx=0 tx=0).stop 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 shutdown_connections 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23c627f0 0x55ce23c64c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c52d80 0x55ce23c50180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c4fb20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f0925ffb640 0 client.25553 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 --2- 172.21.15.67:0/2032893655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 >> 172.21.15.67:0/2032893655 conn(0x55ce23c44300 msgr2=0x55ce23c49e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 shutdown_connections 2024-09-10T20:55:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 1 -- 172.21.15.67:0/2032893655 wait complete. 2024-09-10T20:55:54.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.671+0000 7f09471b4740 20 client.25553 trim_cache size 0 max 16384 2024-09-10T20:55:54.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.689+0000 7f09471b4740 1 Processor -- start 2024-09-10T20:55:54.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.689+0000 7f09471b4740 1 -- start start 2024-09-10T20:55:54.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 0x55ce23c5ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c3f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c43310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b7250 con 0x55ce23c52d80 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b4ac0 con 0x55ce23c46df0 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f09471b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b2910 con 0x55ce23c464d0 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f0937fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c3f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f0937fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c3f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56396/0 (socket says 172.21.15.67:56396) 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 0x55ce23c5ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f0937fff640 1 -- 172.21.15.67:0/3475617457 learned_addr learned my addr 172.21.15.67:0/3475617457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093ed9d640 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c43310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 -- 172.21.15.67:0/3475617457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 msgr2=0x55ce23c3f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c3f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 -- 172.21.15.67:0/3475617457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 msgr2=0x55ce23c43310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c43310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.690+0000 7f093e59c640 1 -- 172.21.15.67:0/3475617457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce23c652c0 con 0x55ce23c464d0 2024-09-10T20:55:54.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.691+0000 7f093e59c640 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 0x55ce23c5ec60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55ce23c451e0 tx=0x7f09300e5040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d284268779ede218 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.692+0000 7f0927fff640 1 -- 172.21.15.67:0/3475617457 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093001c040 con 0x55ce23c464d0 2024-09-10T20:55:54.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.692+0000 7f0927fff640 1 -- 172.21.15.67:0/3475617457 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09300acb30 con 0x55ce23c464d0 2024-09-10T20:55:54.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.692+0000 7f0927fff640 1 -- 172.21.15.67:0/3475617457 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09300a86a0 con 0x55ce23c464d0 2024-09-10T20:55:54.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- 172.21.15.67:0/3475617457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 msgr2=0x55ce23c5ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 0x55ce23c5ec60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55ce23c451e0 tx=0x7f09300e5040 comp rx=0 tx=0).stop 2024-09-10T20:55:54.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- 172.21.15.67:0/3475617457 shutdown_connections 2024-09-10T20:55:54.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c52d80 0x55ce23c43310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c46df0 0x55ce23c3f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 --2- 172.21.15.67:0/3475617457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c464d0 0x55ce23c5ec60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- 172.21.15.67:0/3475617457 >> 172.21.15.67:0/3475617457 conn(0x55ce23c44300 msgr2=0x55ce23c42c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- 172.21.15.67:0/3475617457 shutdown_connections 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- 172.21.15.67:0/3475617457 wait complete. 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.693+0000 7f09471b4740 1 -- start start 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 Processor -- start 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c5b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 0x55ce23c55ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b2f80 con 0x55ce23c464d0 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f093e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b43f0 con 0x55ce23c52d80 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09401b3650 con 0x55ce23c46df0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f09471b4740 10 client.0 _ll_register_callbacks cb 0x7f0928009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f093e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47200/0 (socket says 172.21.15.67:47200) 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f093e59c640 1 -- 172.21.15.67:0/860594968 learned_addr learned my addr 172.21.15.67:0/860594968 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f093ed9d640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 0x55ce23c55ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.694+0000 7f0937fff640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c5b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 -- 172.21.15.67:0/860594968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 msgr2=0x55ce23c5b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c5b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 -- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 msgr2=0x55ce23c55ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 0x55ce23c55ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 -- 172.21.15.67:0/860594968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce23c56510 con 0x55ce23c464d0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093ed9d640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 0x55ce23c55ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f093e59c640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09300e5010 tx=0x7f0930005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2112aaa61cb96e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:54.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f0925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093001c070 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f09300ac690 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09300acb30 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f09300b0f10 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f09471b4740 10 client.15900 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.695+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ce23cd0290 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.696+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09300acb30 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.696+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f09300b5530 con 0x55ce23c464d0 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.696+0000 7f09471b4740 10 client.15900 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.696+0000 7f09471b4740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:54.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.696+0000 7f09471b4740 20 client.15900 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.697+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23cd0910 0x55ce23cd2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.697+0000 7f09471b4740 4 client.15900 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.697+0000 7f0937fff640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23cd0910 0x55ce23cd2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.697+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce23bba8a0 con 0x55ce23cd0910 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f0937fff640 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23cd0910 0x55ce23cd2d30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bace551f9539dbe server_cookie=363317054f8d32fc in_seq=0 out_seq=0 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f0925ffb640 10 client.15900 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f0925ffb640 1 -- 172.21.15.67:0/860594968 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce23bba8a0 con 0x55ce23cd0910 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f0925ffb640 10 client.15900 handle_command_reply: tid=0 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f09471b4740 1 client.15900 shutdown 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 msgr2=0x55ce23c5af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.698+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f09300e5010 tx=0x7f0930005bd0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 shutdown_connections 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55ce23cd0910 0x55ce23cd2d30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f0925ffb640 0 client.15900 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ce23c52d80 0x55ce23c55ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce23c46df0 0x55ce23c5b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 --2- 172.21.15.67:0/860594968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ce23c464d0 0x55ce23c5af60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 >> 172.21.15.67:0/860594968 conn(0x55ce23c44300 msgr2=0x55ce23c51970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 shutdown_connections 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 1 -- 172.21.15.67:0/860594968 wait complete. 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.699+0000 7f09471b4740 20 client.15900 trim_cache size 0 max 16384 2024-09-10T20:55:54.707 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 msgr2=0x7f092c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 0x7f092c0b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f093804a000 tx=0x7f0938004990 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 msgr2=0x7f09400ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f09400ff6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f093000e9f0 tx=0x7f093000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 shutdown_connections 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0940108020 0x7f09400fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f092c0b52e0 0x7f092c0b77a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09401076a0 0x7f09400fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 --2- 172.21.15.67:0/1980521014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0940101c90 0x7f09400ff6b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 >> 172.21.15.67:0/1980521014 conn(0x7f09400fd700 msgr2=0x7f094006aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:54.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 shutdown_connections 2024-09-10T20:55:54.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:54.700+0000 7f0944ddf640 1 -- 172.21.15.67:0/1980521014 wait complete. 2024-09-10T20:55:54.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:54 smithi067 ceph-mon[30891]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 871 op/s 2024-09-10T20:55:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:54 smithi083 ceph-mon[35058]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 871 op/s 2024-09-10T20:55:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:54 smithi172 ceph-mon[35265]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 871 op/s 2024-09-10T20:55:56.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:56 smithi067 ceph-mon[30891]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 804 op/s 2024-09-10T20:55:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:56 smithi083 ceph-mon[35058]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 804 op/s 2024-09-10T20:55:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:56 smithi172 ceph-mon[35265]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 21 MiB/s wr, 804 op/s 2024-09-10T20:55:57.142 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:55:57.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:55:57.403 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 -- 172.21.15.67:0/1320457529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8101c90 msgr2=0x7fbef8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/1320457529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8101c90 0x7fbef8102070 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009900 tx=0x7fbee802a410 comp rx=0 tx=0).stop 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 -- 172.21.15.67:0/1320457529 shutdown_connections 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/1320457529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef8108020 0x7fbef810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/1320457529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef81076a0 0x7fbef8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/1320457529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8101c90 0x7fbef8102070 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.924+0000 7fbefcf7a640 1 -- 172.21.15.67:0/1320457529 >> 172.21.15.67:0/1320457529 conn(0x7fbef80fd700 msgr2=0x7fbef80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.925+0000 7fbefcf7a640 1 -- 172.21.15.67:0/1320457529 shutdown_connections 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.925+0000 7fbefcf7a640 1 -- 172.21.15.67:0/1320457529 wait complete. 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.925+0000 7fbefcf7a640 1 Processor -- start 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.925+0000 7fbefcf7a640 1 -- start start 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 0x7fbef8199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 0x7fbef819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8111ce0 con 0x7fbef8108020 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8111b60 con 0x7fbef8101c90 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbef8111e60 con 0x7fbef81076a0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 0x7fbef819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56418/0 (socket says 172.21.15.67:56418) 2024-09-10T20:55:57.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 0x7fbef8199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef659c640 1 -- 172.21.15.67:0/2434584576 learned_addr learned my addr 172.21.15.67:0/2434584576 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 -- 172.21.15.67:0/2434584576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 msgr2=0x7fbef8199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 0x7fbef8199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 -- 172.21.15.67:0/2434584576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 msgr2=0x7fbef81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 -- 172.21.15.67:0/2434584576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef819f3a0 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef659c640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 0x7fbef8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 0x7fbef819ebd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009fd0 tx=0x7fbef000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbee77fe640 1 -- 172.21.15.67:0/2434584576 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000ce20 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.926+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef819f690 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.927+0000 7fbee77fe640 1 -- 172.21.15.67:0/2434584576 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef0005020 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.927+0000 7fbee77fe640 1 -- 172.21.15.67:0/2434584576 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0010690 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.927+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a5f20 con 0x7fbef8108020 2024-09-10T20:55:57.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.929+0000 7fbeff34f740 1 Processor -- start 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.929+0000 7fbee77fe640 1 -- 172.21.15.67:0/2434584576 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbef00054d0 con 0x7fbef8108020 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.929+0000 7fbeff34f740 1 -- start start 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95be4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95be6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db95b4ee60 con 0x55db95bd8800 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55db95b3e290 con 0x55db95bd7ee0 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbeff34f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db95b420a0 con 0x55db95be4790 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95be4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56432/0 (socket says 172.21.15.67:56432) 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 -- 172.21.15.67:0/955063821 learned_addr learned my addr 172.21.15.67:0/955063821 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95be6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 -- 172.21.15.67:0/955063821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 msgr2=0x55db95be6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95be6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 -- 172.21.15.67:0/955063821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 msgr2=0x55db95be4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95be4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 -- 172.21.15.67:0/955063821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db9589c930 con 0x55db95bd7ee0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef659c640 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95be4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbee77fe640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 0x7fbee00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.930+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbeec011be0 tx=0x7fbeec009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c766c8063c1440c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.931+0000 7fbef659c640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 0x7fbee00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.931+0000 7fbee77fe640 1 -- 172.21.15.67:0/2434584576 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbef00e61c0 con 0x7fbef8108020 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.931+0000 7fbee4ff9640 1 -- 172.21.15.67:0/955063821 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00fc50 con 0x55db95bd7ee0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.931+0000 7fbee4ff9640 1 -- 172.21.15.67:0/955063821 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeec00fdf0 con 0x55db95bd7ee0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.931+0000 7fbee4ff9640 1 -- 172.21.15.67:0/955063821 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00e680 con 0x55db95bd7ee0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- 172.21.15.67:0/955063821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 msgr2=0x55db95bd82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbef659c640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 0x7fbee00b77a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbee8031440 tx=0x7fbee80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbeec011be0 tx=0x7fbeec009ba0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- 172.21.15.67:0/955063821 shutdown_connections 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95be6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95be4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 --2- 172.21.15.67:0/955063821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bd82c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- 172.21.15.67:0/955063821 >> 172.21.15.67:0/955063821 conn(0x55db95bd5d10 msgr2=0x55db95bd6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- 172.21.15.67:0/955063821 shutdown_connections 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- 172.21.15.67:0/955063821 wait complete. 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 -- start start 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.932+0000 7fbeff34f740 1 Processor -- start 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55db9599f890 con 0x55db95bd7ee0 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55db95ad8d40 con 0x55db95be4790 2024-09-10T20:55:57.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db95be7440 con 0x55db95bd8800 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeff34f740 10 client.0 _ll_register_callbacks cb 0x55db95b3cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47246/0 (socket says 172.21.15.67:47246) 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 -- 172.21.15.67:0/3494968059 learned_addr learned my addr 172.21.15.67:0/3494968059 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 -- 172.21.15.67:0/3494968059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 msgr2=0x55db95be1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 -- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 msgr2=0x55db95be2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 -- 172.21.15.67:0/3494968059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db95bf08a0 con 0x55db95bd7ee0 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbef659c640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009a20 tx=0x7fbee8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59ead3eb2891f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.933+0000 7fbeddffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee804d070 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbee8005220 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbeec00fdf0 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbee8058070 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 10 client.15912 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db95bf3250 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbeec00fdf0 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fbee8003710 con 0x55db95bd7ee0 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 10 client.15912 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:57.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 20 client.15912 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95bf47b0 0x55db95bf6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 4 client.15912 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.934+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db95b50db0 con 0x55db95bf47b0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.935+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95bf47b0 0x55db95bf6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.935+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95bf47b0 0x55db95bf6ba0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e90cff9f04b7a75 server_cookie=13607a027852e1c0 in_seq=0 out_seq=0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.935+0000 7fbeddffb640 10 client.15912 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeddffb640 1 -- 172.21.15.67:0/3494968059 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db95b50db0 con 0x55db95bf47b0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeddffb640 10 client.15912 handle_command_reply: tid=0 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 client.15912 shutdown 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 msgr2=0x55db95be17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009a20 tx=0x7fbee8009260 comp rx=0 tx=0).stop 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 shutdown_connections 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95bf47b0 0x55db95bf6ba0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 --2- 172.21.15.67:0/3494968059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95be17e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 >> 172.21.15.67:0/3494968059 conn(0x55db95bd5d10 msgr2=0x55db95bd4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeddffb640 0 client.15912 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 shutdown_connections 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 1 -- 172.21.15.67:0/3494968059 wait complete. 2024-09-10T20:55:57.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.936+0000 7fbeff34f740 20 client.15912 trim_cache size 0 max 16384 2024-09-10T20:55:57.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 Processor -- start 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 -- start start 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95bd4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95bd53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81b0b70 con 0x55db95bd8800 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ae3e0 con 0x55db95bd7ee0 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbeff34f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ac230 con 0x55db95be4790 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95bd4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56448/0 (socket says 172.21.15.67:56448) 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef659c640 1 -- 172.21.15.67:0/1386614492 learned_addr learned my addr 172.21.15.67:0/1386614492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:57.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95bd53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef659c640 1 -- 172.21.15.67:0/1386614492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 msgr2=0x55db95bd53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.954+0000 7fbef659c640 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95bd53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbef659c640 1 -- 172.21.15.67:0/1386614492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 msgr2=0x55db95bd4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbef659c640 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95bd4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbef659c640 1 -- 172.21.15.67:0/1386614492 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db95bd73f0 con 0x55db95bd7ee0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbef659c640 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbee802a450 tx=0x7fbee8005940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e68facfa2b57bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbedffff640 1 -- 172.21.15.67:0/1386614492 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee804d070 con 0x55db95bd7ee0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbedffff640 1 -- 172.21.15.67:0/1386614492 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee8005030 con 0x55db95bd7ee0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.955+0000 7fbedffff640 1 -- 172.21.15.67:0/1386614492 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8043070 con 0x55db95bd7ee0 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- 172.21.15.67:0/1386614492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 msgr2=0x55db95bdbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbee802a450 tx=0x7fbee8005940 comp rx=0 tx=0).stop 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- 172.21.15.67:0/1386614492 shutdown_connections 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95be4790 0x55db95bd53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd8800 0x55db95bd4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1386614492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95bd7ee0 0x55db95bdbf50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- 172.21.15.67:0/1386614492 >> 172.21.15.67:0/1386614492 conn(0x55db95bd5d10 msgr2=0x55db95bd4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- 172.21.15.67:0/1386614492 shutdown_connections 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- 172.21.15.67:0/1386614492 wait complete. 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- start start 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 Processor -- start 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81ac8a0 con 0x55db95bd7ee0 2024-09-10T20:55:57.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81add10 con 0x55db95be4790 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbef81acf70 con 0x55db95bd8800 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.956+0000 7fbeff34f740 10 client.0 _ll_register_callbacks cb 0x7fbee8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47266/0 (socket says 172.21.15.67:47266) 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef659c640 1 -- 172.21.15.67:0/1404201970 learned_addr learned my addr 172.21.15.67:0/1404201970 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 -- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 msgr2=0x55db95be8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 -- 172.21.15.67:0/1404201970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 msgr2=0x55db95bed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 -- 172.21.15.67:0/1404201970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db95c606b0 con 0x55db95bd8800 2024-09-10T20:55:57.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef659c640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef6d9d640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbef5d9b640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be8550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55db95bf7450 tx=0x7fbeec00ffa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586d070bda208ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbeddffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec005360 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee8005030 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.957+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbeec005500 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbeec03a070 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 10 client.25561 fetch_fsmap learned FSMap version 32 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db95c61950 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee8005030 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7fbeec01d020 con 0x55db95bd8800 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 10 client.25561 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:55:57.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 20 client.25561 populate_metadata read hostname 'smithi067' 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95c61e60 0x55db95c64280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 4 client.25561 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55db95b4c860 con 0x55db95c61e60 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.958+0000 7fbef659c640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95c61e60 0x55db95c64280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.959+0000 7fbef659c640 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95c61e60 0x55db95c64280 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40dcc8d5bacf368 server_cookie=258a9a2546f22780 in_seq=0 out_seq=0 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.959+0000 7fbeddffb640 10 client.25561 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeddffb640 1 -- 172.21.15.67:0/1404201970 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55db95b4c860 con 0x55db95c61e60 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeddffb640 10 client.25561 handle_command_reply: tid=0 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 client.25561 shutdown 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 msgr2=0x55db95be8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be8550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55db95bf7450 tx=0x7fbeec00ffa0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 shutdown_connections 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55db95c61e60 0x55db95c64280 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55db95be4790 0x55db95be8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db95bd8800 0x55db95be8550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 --2- 172.21.15.67:0/1404201970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55db95bd7ee0 0x55db95bed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 >> 172.21.15.67:0/1404201970 conn(0x55db95bd5d10 msgr2=0x55db95bd4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeddffb640 0 client.25561 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 shutdown_connections 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 1 -- 172.21.15.67:0/1404201970 wait complete. 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.960+0000 7fbeff34f740 20 client.25561 trim_cache size 0 max 16384 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:55:57.972 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "5df62bf1-149c-47de-b39c-8e2017c0c4a6", 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 msgr2=0x7fbee00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 0x7fbee00b77a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbee8031440 tx=0x7fbee80058d0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 msgr2=0x7fbef819ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 0x7fbef819ebd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009fd0 tx=0x7fbef000ef10 comp rx=0 tx=0).stop 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 shutdown_connections 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbef8108020 0x7fbef819ebd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbee00b52e0 0x7fbee00b77a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbef81076a0 0x7fbef8199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 --2- 172.21.15.67:0/2434584576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbef8101c90 0x7fbef81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:55:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 >> 172.21.15.67:0/2434584576 conn(0x7fbef80fd700 msgr2=0x7fbef806ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:55:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 shutdown_connections 2024-09-10T20:55:57.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:55:57.961+0000 7fbefcf7a640 1 -- 172.21.15.67:0/2434584576 wait complete. 2024-09-10T20:55:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:58 smithi067 ceph-mon[30891]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 1.04k op/s 2024-09-10T20:55:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:58 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:58.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:58 smithi083 ceph-mon[35058]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 1.04k op/s 2024-09-10T20:55:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:58 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:58 smithi172 ceph-mon[35265]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 29 MiB/s wr, 1.04k op/s 2024-09-10T20:55:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:58 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:55:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 265.0 s, 79.2 tps, lat 202.972 ms stddev 259.791 2024-09-10T20:55:59.186 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:55:59.451 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:55:59.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:59 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:55:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:59 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:59 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:59.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:55:59 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:55:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:59 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:55:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:59 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:59 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:55:59 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:55:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:59 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:55:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:59 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:55:59.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:59 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:55:59.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:55:59 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:56:00.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 -- 172.21.15.67:0/2770259277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c81087f0 msgr2=0x7f75c8108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 --2- 172.21.15.67:0/2770259277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c81087f0 0x7f75c8108c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009900 tx=0x7f75bc02a410 comp rx=0 tx=0).stop 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 -- 172.21.15.67:0/2770259277 shutdown_connections 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 --2- 172.21.15.67:0/2770259277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8109170 0x7f75c810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 --2- 172.21.15.67:0/2770259277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c81087f0 0x7f75c8108c30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 --2- 172.21.15.67:0/2770259277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c8102de0 0x7f75c81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 -- 172.21.15.67:0/2770259277 >> 172.21.15.67:0/2770259277 conn(0x7f75c80fe830 msgr2=0x7f75c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 -- 172.21.15.67:0/2770259277 shutdown_connections 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.105+0000 7f75cce23640 1 -- 172.21.15.67:0/2770259277 wait complete. 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 Processor -- start 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 -- start start 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 0x7f75c81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c8109170 0x7f75c819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8112e30 con 0x7f75c8109170 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8112cb0 con 0x7f75c8102de0 2024-09-10T20:56:00.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.106+0000 7f75cce23640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75c8112fb0 con 0x7f75c81087f0 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c8109170 0x7f75c819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56476/0 (socket says 172.21.15.67:56476) 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 0x7f75c81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c659c640 1 -- 172.21.15.67:0/2158890182 learned_addr learned my addr 172.21.15.67:0/2158890182 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2158890182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 msgr2=0x7f75c81992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c8109170 msgr2=0x7f75c819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c8109170 0x7f75c819eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2158890182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c819f350 con 0x7f75c81087f0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c659c640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 0x7f75c81997e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f75bc02a930 tx=0x7f75bc031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75b77fe640 1 -- 172.21.15.67:0/2158890182 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc03f030 con 0x7f75c81087f0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75b77fe640 1 -- 172.21.15.67:0/2158890182 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75bc0043d0 con 0x7f75c81087f0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c819f5e0 con 0x7f75c81087f0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75b77fe640 1 -- 172.21.15.67:0/2158890182 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc035070 con 0x7f75c81087f0 2024-09-10T20:56:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.107+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c81a5d00 con 0x7f75c81087f0 2024-09-10T20:56:00.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.110+0000 7f75cf1f8740 1 Processor -- start 2024-09-10T20:56:00.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.110+0000 7f75cf1f8740 1 -- start start 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.110+0000 7f75b77fe640 1 -- 172.21.15.67:0/2158890182 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f75bc003c30 con 0x7f75c81087f0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd75480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd85820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd88150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563daccebe50 con 0x563dacd750a0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563daccdb280 con 0x563dacd759c0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563daccdf090 con 0x563dacd85d60 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd75480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd85820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c6d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd75480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47290/0 (socket says 172.21.15.67:47290) 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c6d9d640 1 -- 172.21.15.67:0/3620264923 learned_addr learned my addr 172.21.15.67:0/3620264923 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd88150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 -- 172.21.15.67:0/3620264923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 msgr2=0x563dacd88150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd88150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 -- 172.21.15.67:0/3620264923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 msgr2=0x563dacd75480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd75480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 -- 172.21.15.67:0/3620264923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563daca39650 con 0x563dacd759c0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75c659c640 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd85820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75b8011510 tx=0x7f75b80119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7485d5c22b159b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.111+0000 7f75b77fe640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 0x7f75b00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75b4ff9640 1 -- 172.21.15.67:0/3620264923 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8005020 con 0x563dacd759c0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75b4ff9640 1 -- 172.21.15.67:0/3620264923 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b80047a0 con 0x563dacd759c0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75b4ff9640 1 -- 172.21.15.67:0/3620264923 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b800f8e0 con 0x563dacd759c0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75c6d9d640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 0x7f75b00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75b77fe640 1 -- 172.21.15.67:0/2158890182 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f75bc1060e0 con 0x7f75c81087f0 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 -- 172.21.15.67:0/3620264923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 msgr2=0x563dacd85820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75c6d9d640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 0x7f75b00b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75c0012680 tx=0x7f75c0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd85820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75b8011510 tx=0x7f75b80119d0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 -- 172.21.15.67:0/3620264923 shutdown_connections 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd88150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd85820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/3620264923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd75480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.112+0000 7f75cf1f8740 1 -- 172.21.15.67:0/3620264923 >> 172.21.15.67:0/3620264923 conn(0x563dacd72ed0 msgr2=0x563dacd74070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- 172.21.15.67:0/3620264923 shutdown_connections 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- 172.21.15.67:0/3620264923 wait complete. 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- start start 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 Processor -- start 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 0x563dacd85660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd85d60 0x563dacd830c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563dacb3c700 con 0x563dacd85d60 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563dacc76110 con 0x563dacd759c0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.113+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563dacd88a10 con 0x563dacd750a0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75cf1f8740 10 client.0 _ll_register_callbacks cb 0x563dacc8f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56494/0 (socket says 172.21.15.67:56494) 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 0x563dacd85660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2582593316 learned_addr learned my addr 172.21.15.67:0/2582593316 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c6d9d640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd85d60 0x563dacd830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2582593316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 msgr2=0x563dacd85660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 0x563dacd85660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2582593316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd85d60 msgr2=0x563dacd830c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd85d60 0x563dacd830c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 -- 172.21.15.67:0/2582593316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dacca3c40 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c659c640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 0x563dacd85660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0c8e40 tx=0x7f75bc0c8110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b8f5651b0b49a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75adffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc049050 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f75bc0ccad0 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.114+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b80047a0 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f75bc0cc640 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 10 client.25589 fetch_fsmap learned FSMap version 32 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563dacd94390 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b80047a0 con 0x563dacd759c0 2024-09-10T20:56:00.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f75bc0d5970 con 0x563dacd759c0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 10 client.25589 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 10 client.25589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 20 client.25589 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd957d0 0x563dacd97c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 4 client.25589 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563daccedda0 con 0x563dacd957d0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.115+0000 7f75c659c640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd957d0 0x563dacd97c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75c659c640 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd957d0 0x563dacd97c00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fcced820ec8deaf server_cookie=51d9a80f09eb9be4 in_seq=0 out_seq=0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75adffb640 10 client.25589 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75adffb640 1 -- 172.21.15.67:0/2582593316 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563daccedda0 con 0x563dacd957d0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75adffb640 10 client.25589 handle_command_reply: tid=0 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 client.25589 shutdown 2024-09-10T20:56:00.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 msgr2=0x563dacd82ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0c8e40 tx=0x7f75bc0c8110 comp rx=0 tx=0).stop 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 shutdown_connections 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd957d0 0x563dacd97c00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd85d60 0x563dacd830c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd759c0 0x563dacd82ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/2582593316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd750a0 0x563dacd85660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75adffb640 0 client.25589 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 >> 172.21.15.67:0/2582593316 conn(0x563dacd72ed0 msgr2=0x563dacd78a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 shutdown_connections 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.116+0000 7f75cf1f8740 1 -- 172.21.15.67:0/2582593316 wait complete. 2024-09-10T20:56:00.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.117+0000 7f75cf1f8740 20 client.25589 trim_cache size 0 max 16384 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 Processor -- start 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 -- start start 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 0x563dacd91c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd81870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81ae9b0 con 0x563dacd759c0 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81ac220 con 0x563dacd750a0 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81aa070 con 0x563dacd85d60 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47306/0 (socket says 172.21.15.67:47306) 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 -- 172.21.15.67:0/169363543 learned_addr learned my addr 172.21.15.67:0/169363543 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c659c640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 0x563dacd91c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c6d9d640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd81870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 -- 172.21.15.67:0/169363543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 msgr2=0x563dacd81870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd81870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 -- 172.21.15.67:0/169363543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 msgr2=0x563dacd91c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 0x563dacd91c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c5d9b640 1 -- 172.21.15.67:0/169363543 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dacd6e790 con 0x563dacd759c0 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.135+0000 7f75c659c640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 0x563dacd91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f75bc03d040 tx=0x7f75bc0d1470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c462f780e945a693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75affff640 1 -- 172.21.15.67:0/169363543 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc049070 con 0x563dacd759c0 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75affff640 1 -- 172.21.15.67:0/169363543 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75bc0ccf70 con 0x563dacd759c0 2024-09-10T20:56:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75affff640 1 -- 172.21.15.67:0/169363543 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0cbfe0 con 0x563dacd759c0 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 -- 172.21.15.67:0/169363543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 msgr2=0x563dacd81330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f75bc03d040 tx=0x7f75bc0d1470 comp rx=0 tx=0).stop 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 -- 172.21.15.67:0/169363543 shutdown_connections 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd85d60 0x563dacd81870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd759c0 0x563dacd81330 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/169363543 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd750a0 0x563dacd91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.136+0000 7f75cf1f8740 1 -- 172.21.15.67:0/169363543 >> 172.21.15.67:0/169363543 conn(0x563dacd72ed0 msgr2=0x563dacd87b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- 172.21.15.67:0/169363543 shutdown_connections 2024-09-10T20:56:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- 172.21.15.67:0/169363543 wait complete. 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- start start 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 Processor -- start 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd85d60 0x563dacd88e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81aa6e0 con 0x563dacd750a0 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81abb50 con 0x563dacd85d60 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75c81aadb0 con 0x563dacd759c0 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75cf1f8740 10 client.0 _ll_register_callbacks cb 0x7f75bc005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.137+0000 7f75c659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40466/0 (socket says 172.21.15.67:40466) 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 -- 172.21.15.67:0/1928725626 learned_addr learned my addr 172.21.15.67:0/1928725626 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c6d9d640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd85d60 0x563dacd88e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 -- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd85d60 msgr2=0x563dacd88e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd85d60 0x563dacd88e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 -- 172.21.15.67:0/1928725626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 msgr2=0x563dacd8e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd8e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 -- 172.21.15.67:0/1928725626 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dacd896c0 con 0x563dacd759c0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c659c640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd8e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75c5d9b640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75bc103c90 tx=0x7f75bc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da2aea450660fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75adffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc049070 con 0x563dacd759c0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f75bc0efdc0 con 0x563dacd759c0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75bc0ccf70 con 0x563dacd759c0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.138+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f75bc0cc1c0 con 0x563dacd759c0 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 10 client.25579 fetch_fsmap learned FSMap version 32 2024-09-10T20:56:00.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563dacd896c0 con 0x563dacd759c0 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75bc0ccf70 con 0x563dacd759c0 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f75bc07c0c0 con 0x563dacd759c0 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 10 client.25579 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 20 client.25579 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd7b730 0x563dacd7db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 4 client.25579 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563dacce9850 con 0x563dacd7b730 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.139+0000 7f75c659c640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd7b730 0x563dacd7db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75c659c640 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd7b730 0x563dacd7db50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fd0dadb7296d5d server_cookie=fd0dfe094f0e20f4 in_seq=0 out_seq=0 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75adffb640 10 client.25579 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75adffb640 1 -- 172.21.15.67:0/1928725626 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2280 (crc 0 0 0) 0x563dacce9850 con 0x563dacd7b730 2024-09-10T20:56:00.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75adffb640 10 client.25579 handle_command_reply: tid=0 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 client.25579 shutdown 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 msgr2=0x563dacd8e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75bc103c90 tx=0x7f75bc000bc0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 shutdown_connections 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563dacd7b730 0x563dacd7db50 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563dacd85d60 0x563dacd88e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dacd759c0 0x563dacd8e6c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 --2- 172.21.15.67:0/1928725626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563dacd750a0 0x563dacd8e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 >> 172.21.15.67:0/1928725626 conn(0x563dacd72ed0 msgr2=0x563dacd80f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75adffb640 0 client.25579 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 shutdown_connections 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 1 -- 172.21.15.67:0/1928725626 wait complete. 2024-09-10T20:56:00.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.140+0000 7f75cf1f8740 20 client.25579 trim_cache size 0 max 16384 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "scrub active (0 inodes in the stack)", 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "5df62bf1-149c-47de-b39c-8e2017c0c4a6", 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:56:00.151 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.153 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.154 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:00.155 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 msgr2=0x7f75b00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 0x7f75b00b7820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f75c0012680 tx=0x7f75c0009500 comp rx=0 tx=0).stop 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 msgr2=0x7f75c81997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 0x7f75c81997e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f75bc02a930 tx=0x7f75bc031a20 comp rx=0 tx=0).stop 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 shutdown_connections 2024-09-10T20:56:00.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c8109170 0x7f75c819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f75b00b5360 0x7f75b00b7820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75c81087f0 0x7f75c81997e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 --2- 172.21.15.67:0/2158890182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c8102de0 0x7f75c81992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 >> 172.21.15.67:0/2158890182 conn(0x7f75c80fe830 msgr2=0x7f75c8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 shutdown_connections 2024-09-10T20:56:00.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:00.141+0000 7f75cce23640 1 -- 172.21.15.67:0/2158890182 wait complete. 2024-09-10T20:56:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:00 smithi067 ceph-mon[30891]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 MiB/s wr, 1.11k op/s 2024-09-10T20:56:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:00 smithi083 ceph-mon[35058]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 MiB/s wr, 1.11k op/s 2024-09-10T20:56:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:00 smithi172 ceph-mon[35265]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 34 MiB/s wr, 1.11k op/s 2024-09-10T20:56:00.950 INFO:tasks.cephfs.filesystem:scrub status for tag:5df62bf1-149c-47de-b39c-8e2017c0c4a6 - {'path': '/', 'tag': '5df62bf1-149c-47de-b39c-8e2017c0c4a6', 'options': 'recursive,force'} 2024-09-10T20:56:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:02 smithi067 ceph-mon[30891]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 36 MiB/s wr, 1.13k op/s 2024-09-10T20:56:02.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:02 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:02.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:02 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:02 smithi083 ceph-mon[35058]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 36 MiB/s wr, 1.13k op/s 2024-09-10T20:56:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:02 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:02 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:02 smithi172 ceph-mon[35265]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 36 MiB/s wr, 1.13k op/s 2024-09-10T20:56:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:02 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:02 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:03.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:03 smithi083 ceph-mon[35058]: Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:03.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:03 smithi172 ceph-mon[35265]: Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 270.0 s, 1448.5 tps, lat 123.427 ms stddev 768.495 2024-09-10T20:56:04.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:03 smithi067 ceph-mon[30891]: Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:04 smithi083 ceph-mon[35058]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 41 MiB/s wr, 1.21k op/s 2024-09-10T20:56:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:04 smithi172 ceph-mon[35265]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 41 MiB/s wr, 1.21k op/s 2024-09-10T20:56:05.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:04 smithi067 ceph-mon[30891]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 41 MiB/s wr, 1.21k op/s 2024-09-10T20:56:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:06 smithi083 ceph-mon[35058]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 39 MiB/s wr, 1.12k op/s 2024-09-10T20:56:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:06 smithi172 ceph-mon[35265]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 39 MiB/s wr, 1.12k op/s 2024-09-10T20:56:07.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:06 smithi067 ceph-mon[30891]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 39 MiB/s wr, 1.12k op/s 2024-09-10T20:56:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:08 smithi083 ceph-mon[35058]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T20:56:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:08 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:08 smithi172 ceph-mon[35265]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T20:56:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:08 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 275.0 s, 3739.3 tps, lat 28.133 ms stddev 45.401 2024-09-10T20:56:09.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:08 smithi067 ceph-mon[30891]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T20:56:09.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:08 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:10 smithi083 ceph-mon[35058]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 30 MiB/s wr, 999 op/s 2024-09-10T20:56:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:10 smithi083 ceph-mon[35058]: Health check update: 11 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:10 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:10 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:10 smithi172 ceph-mon[35265]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 30 MiB/s wr, 999 op/s 2024-09-10T20:56:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:10 smithi172 ceph-mon[35265]: Health check update: 11 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:10 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:10 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:11.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:10 smithi067 ceph-mon[30891]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 30 MiB/s wr, 999 op/s 2024-09-10T20:56:11.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:10 smithi067 ceph-mon[30891]: Health check update: 11 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T20:56:11.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:10 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:11.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:10 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:11.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:11.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:12.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:12 smithi067 ceph-mon[30891]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 791 op/s 2024-09-10T20:56:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:12 smithi083 ceph-mon[35058]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 791 op/s 2024-09-10T20:56:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:12 smithi172 ceph-mon[35265]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 791 op/s 2024-09-10T20:56:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 280.0 s, 2502.4 tps, lat 39.399 ms stddev 44.618 2024-09-10T20:56:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:14 smithi083 ceph-mon[35058]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 890 op/s 2024-09-10T20:56:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:14 smithi172 ceph-mon[35265]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 890 op/s 2024-09-10T20:56:15.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:14 smithi067 ceph-mon[30891]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 890 op/s 2024-09-10T20:56:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:16 smithi083 ceph-mon[35058]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-09-10T20:56:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:16 smithi172 ceph-mon[35265]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-09-10T20:56:17.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:16 smithi067 ceph-mon[30891]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-09-10T20:56:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:18 smithi172 ceph-mon[35265]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 907 op/s 2024-09-10T20:56:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 285.0 s, 2748.0 tps, lat 36.887 ms stddev 45.893 2024-09-10T20:56:19.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:18 smithi067 ceph-mon[30891]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 907 op/s 2024-09-10T20:56:19.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:18 smithi083 ceph-mon[35058]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 907 op/s 2024-09-10T20:56:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:20 smithi172 ceph-mon[35265]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 767 op/s 2024-09-10T20:56:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:20 smithi172 ceph-mon[35265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:21.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:20 smithi067 ceph-mon[30891]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 767 op/s 2024-09-10T20:56:21.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:20 smithi067 ceph-mon[30891]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:21.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:20 smithi083 ceph-mon[35058]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 767 op/s 2024-09-10T20:56:21.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:20 smithi083 ceph-mon[35058]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T20:56:22.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:21 smithi067 ceph-mon[30891]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 699 op/s 2024-09-10T20:56:22.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:21 smithi083 ceph-mon[35058]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 699 op/s 2024-09-10T20:56:22.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:21 smithi172 ceph-mon[35265]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 10 MiB/s wr, 699 op/s 2024-09-10T20:56:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 290.0 s, 3128.4 tps, lat 32.022 ms stddev 36.565 2024-09-10T20:56:24.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:23 smithi067 ceph-mon[30891]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-10T20:56:24.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:23 smithi083 ceph-mon[35058]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-10T20:56:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:23 smithi172 ceph-mon[35265]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 12 MiB/s wr, 845 op/s 2024-09-10T20:56:26.251 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:25 smithi172 ceph-mon[35265]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-10T20:56:26.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:25 smithi067 ceph-mon[30891]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-10T20:56:26.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:25 smithi083 ceph-mon[35058]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 MiB/s wr, 731 op/s 2024-09-10T20:56:28.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:27 smithi067 ceph-mon[30891]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-09-10T20:56:28.393 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:27 smithi083 ceph-mon[35058]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-09-10T20:56:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:27 smithi172 ceph-mon[35265]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 9.8 MiB/s wr, 745 op/s 2024-09-10T20:56:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 295.0 s, 3356.2 tps, lat 29.592 ms stddev 35.624 2024-09-10T20:56:30.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:29 smithi067 ceph-mon[30891]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.6 MiB/s wr, 702 op/s 2024-09-10T20:56:30.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:29 smithi083 ceph-mon[35058]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.6 MiB/s wr, 702 op/s 2024-09-10T20:56:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:29 smithi172 ceph-mon[35265]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9.6 MiB/s wr, 702 op/s 2024-09-10T20:56:30.952 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:56:31.343 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:32.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:31 smithi067 ceph-mon[30891]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-09-10T20:56:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.957+0000 7f088c90d640 1 -- 172.21.15.67:0/3132424672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888113b20 msgr2=0x7f0888115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.957+0000 7f088c90d640 1 --2- 172.21.15.67:0/3132424672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888113b20 0x7f0888115f10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0880009ca0 tx=0x7f088002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 -- 172.21.15.67:0/3132424672 shutdown_connections 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 --2- 172.21.15.67:0/3132424672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888113b20 0x7f0888115f10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 --2- 172.21.15.67:0/3132424672 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075e60 0x7f08881135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 --2- 172.21.15.67:0/3132424672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888075540 0x7f0888075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 -- 172.21.15.67:0/3132424672 >> 172.21.15.67:0/3132424672 conn(0x7f08880fe850 msgr2=0x7f0888100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 -- 172.21.15.67:0/3132424672 shutdown_connections 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.958+0000 7f088c90d640 1 -- 172.21.15.67:0/3132424672 wait complete. 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.959+0000 7f088c90d640 1 Processor -- start 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 -- start start 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 0x7f088819fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888113b20 0x7f08881a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f0885d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 0x7f088819fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08881193f0 con 0x7f0888113b20 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0888119270 con 0x7f0888075540 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088c90d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0888119570 con 0x7f0888075e60 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:42178/0 (socket says 172.21.15.67:42178) 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f088659c640 1 -- 172.21.15.67:0/438411900 learned_addr learned my addr 172.21.15.67:0/438411900 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.960+0000 7f0886d9d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888113b20 0x7f08881a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 -- 172.21.15.67:0/438411900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 msgr2=0x7f088819fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 0x7f088819fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 -- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888113b20 msgr2=0x7f08881a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888113b20 0x7f08881a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 -- 172.21.15.67:0/438411900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08881a5a10 con 0x7f0888075540 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f0885d9b640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 0x7f088819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.961+0000 7f088659c640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f087800b4a0 tx=0x7f087800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.962+0000 7f08777fe640 1 -- 172.21.15.67:0/438411900 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878014070 con 0x7f0888075540 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.962+0000 7f08777fe640 1 -- 172.21.15.67:0/438411900 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0878010ac0 con 0x7f0888075540 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.962+0000 7f08777fe640 1 -- 172.21.15.67:0/438411900 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878017b60 con 0x7f0888075540 2024-09-10T20:56:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.962+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08881a5d00 con 0x7f0888075540 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.963+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08881ac3c0 con 0x7f0888075540 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.966+0000 7f088ece2740 1 Processor -- start 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 -- start start 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db9c0 0x5566c04f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 0x5566c04fad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566c0451e50 con 0x5566c04db9c0 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5566c0441280 con 0x5566c04f8960 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f088ece2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5566c0445090 con 0x5566c04db0a0 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.967+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52348/0 (socket says 172.21.15.67:52348) 2024-09-10T20:56:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0885d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 0x5566c04fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 -- 172.21.15.67:0/1631111958 learned_addr learned my addr 172.21.15.67:0/1631111958 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 -- 172.21.15.67:0/1631111958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 msgr2=0x5566c04fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 0x5566c04fad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 -- 172.21.15.67:0/1631111958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db9c0 msgr2=0x5566c04f8420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db9c0 0x5566c04f8420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 -- 172.21.15.67:0/1631111958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c019f650 con 0x5566c04db0a0 2024-09-10T20:56:32.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0885d9b640 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 0x5566c04fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f08777fe640 1 -- 172.21.15.67:0/438411900 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0878010610 con 0x7f0888075540 2024-09-10T20:56:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.968+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0880009ca0 tx=0x7f0880030450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3f8b3d8ca168d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.969+0000 7f0874ff9640 1 -- 172.21.15.67:0/1631111958 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880030800 con 0x5566c04db0a0 2024-09-10T20:56:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.969+0000 7f0874ff9640 1 -- 172.21.15.67:0/1631111958 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0880036070 con 0x5566c04db0a0 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.969+0000 7f0874ff9640 1 -- 172.21.15.67:0/1631111958 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880004500 con 0x5566c04db0a0 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.969+0000 7f08777fe640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 0x7f08700b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 -- 172.21.15.67:0/1631111958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 msgr2=0x5566c04db480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f08777fe640 1 -- 172.21.15.67:0/438411900 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f08780e4f20 con 0x7f0888075540 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0880009ca0 tx=0x7f0880030450 comp rx=0 tx=0).stop 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 -- 172.21.15.67:0/1631111958 shutdown_connections 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04f8960 0x5566c04fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db9c0 0x5566c04f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 --2- 172.21.15.67:0/1631111958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db0a0 0x5566c04db480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.970+0000 7f088ece2740 1 -- 172.21.15.67:0/1631111958 >> 172.21.15.67:0/1631111958 conn(0x5566c04d8ed0 msgr2=0x5566c04da070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.972+0000 7f088659c640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 0x7f08700b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.972+0000 7f088ece2740 1 -- 172.21.15.67:0/1631111958 shutdown_connections 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.972+0000 7f088ece2740 1 -- 172.21.15.67:0/1631111958 wait complete. 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.972+0000 7f088659c640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 0x7f08700b7930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f08780a7d30 tx=0x7f087800bf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.972+0000 7f088ece2740 1 -- start start 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 Processor -- start 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04e5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5566c02a2700 con 0x5566c04f8960 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5566c03dc110 con 0x5566c04db0a0 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5566c04e15b0 con 0x5566c04db9c0 2024-09-10T20:56:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.973+0000 7f088ece2740 10 client.0 _ll_register_callbacks cb 0x5566c03f5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.974+0000 7f0885d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.974+0000 7f0885d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:52358/0 (socket says 172.21.15.67:52358) 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.974+0000 7f0885d9b640 1 -- 172.21.15.67:0/4256928920 learned_addr learned my addr 172.21.15.67:0/4256928920 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.974+0000 7f0886d9d640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.974+0000 7f0886d9d640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 -- 172.21.15.67:0/4256928920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 msgr2=0x5566c04e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 -- 172.21.15.67:0/4256928920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 msgr2=0x5566c04ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 -- 172.21.15.67:0/4256928920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c0409c40 con 0x5566c04db0a0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f0886d9d640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04e4e80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0880009a60 tx=0x7f088002a8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869d02f3c1e7ca82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f086dffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880003c40 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0880030800 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.975+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0880036070 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.980+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0880030a00 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 10 client.25607 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5566c04f35c0 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0880036070 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0880065020 con 0x5566c04db0a0 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 10 client.25607 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 10 client.25607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 20 client.25607 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c04f4a80 0x5566c04f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 4 client.25607 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.981+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566c0453da0 con 0x5566c04f4a80 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.982+0000 7f0885d9b640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c04f4a80 0x5566c04f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.983+0000 7f086dffb640 10 client.25607 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.983+0000 7f0885d9b640 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c04f4a80 0x5566c04f6e70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbbcf23ef4981791 server_cookie=637d0cf9bfcb1aea in_seq=0 out_seq=0 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f086dffb640 1 -- 172.21.15.67:0/4256928920 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566c0453da0 con 0x5566c04f4a80 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f086dffb640 10 client.25607 handle_command_reply: tid=0 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 client.25607 shutdown 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 msgr2=0x5566c04e4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04e4e80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0880009a60 tx=0x7f088002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 shutdown_connections 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c04f4a80 0x5566c04f6e70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 --2- 172.21.15.67:0/4256928920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04e4e80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 >> 172.21.15.67:0/4256928920 conn(0x5566c04d8ed0 msgr2=0x5566c04dea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f086dffb640 0 client.25607 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 shutdown_connections 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.984+0000 7f088ece2740 1 -- 172.21.15.67:0/4256928920 wait complete. 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:31.985+0000 7f088ece2740 20 client.25607 trim_cache size 0 max 16384 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.018+0000 7f088ece2740 1 Processor -- start 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.018+0000 7f088ece2740 1 -- start start 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.018+0000 7f088ece2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f088ece2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f088ece2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:42212/0 (socket says 172.21.15.67:42212) 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 -- 172.21.15.67:0/1161859648 learned_addr learned my addr 172.21.15.67:0/1161859648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0885d9b640 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f08881ae370 con 0x5566c04f8960 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08881aea40 con 0x5566c04db0a0 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0888075030 con 0x5566c04db9c0 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 -- 172.21.15.67:0/1161859648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 msgr2=0x5566c04f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 -- 172.21.15.67:0/1161859648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 msgr2=0x5566c04f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.019+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.020+0000 7f0886d9d640 1 -- 172.21.15.67:0/1161859648 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c04d3e20 con 0x5566c04db0a0 2024-09-10T20:56:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.023+0000 7f0886d9d640 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08800046b0 tx=0x7f08800095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74895d67fa82f7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.037+0000 7f086ffff640 1 -- 172.21.15.67:0/1161859648 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088007f040 con 0x5566c04db0a0 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.037+0000 7f086ffff640 1 -- 172.21.15.67:0/1161859648 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0880036070 con 0x5566c04db0a0 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 msgr2=0x5566c04d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08800046b0 tx=0x7f08800095c0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 shutdown_connections 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04f8960 0x5566c04f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04db9c0 0x5566c04f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 --2- 172.21.15.67:0/1161859648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db0a0 0x5566c04d8710 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 >> 172.21.15.67:0/1161859648 conn(0x5566c04d8ed0 msgr2=0x5566c04d9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 shutdown_connections 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.038+0000 7f088ece2740 1 -- 172.21.15.67:0/1161859648 wait complete. 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 -- start start 2024-09-10T20:56:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 Processor -- start 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 0x5566c0500940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db9c0 0x5566c04fee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 0x5566c04ff380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0888073510 con 0x5566c04db0a0 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0888074960 con 0x5566c04db9c0 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0888073bc0 con 0x5566c04f8960 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.039+0000 7f088ece2740 10 client.0 _ll_register_callbacks cb 0x7f087c00bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.042+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 0x5566c04ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.042+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 0x5566c0500940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.042+0000 7f0886d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 0x5566c0500940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35254/0 (socket says 172.21.15.67:35254) 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.042+0000 7f0886d9d640 1 -- 172.21.15.67:0/2349289963 learned_addr learned my addr 172.21.15.67:0/2349289963 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.042+0000 7f0885d9b640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db9c0 0x5566c04fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.048+0000 7f0886d9d640 1 -- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db9c0 msgr2=0x5566c04fee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.048+0000 7f0886d9d640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db9c0 0x5566c04fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.048+0000 7f0886d9d640 1 -- 172.21.15.67:0/2349289963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 msgr2=0x5566c0500940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.048+0000 7f0886d9d640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 0x5566c0500940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.048+0000 7f0886d9d640 1 -- 172.21.15.67:0/2349289963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c04ff970 con 0x5566c04f8960 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.049+0000 7f0886d9d640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 0x5566c04ff380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0880002230 tx=0x7f0880030ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba5b32ed096ecbda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.049+0000 7f086dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.049+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088008c070 con 0x5566c04f8960 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.049+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0880036070 con 0x5566c04f8960 2024-09-10T20:56:32.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.049+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0880030800 con 0x5566c04f8960 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.051+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f088007f070 con 0x5566c04f8960 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.053+0000 7f088ece2740 10 client.25597 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.053+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5566c0575450 con 0x5566c04f8960 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0880036070 con 0x5566c04f8960 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f088008f020 con 0x5566c04f8960 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 10 client.25597 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 10 client.25597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 20 client.25597 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c0575b90 0x5566c0577fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 4 client.25597 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5566c044f850 con 0x5566c0575b90 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.056+0000 7f0885d9b640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c0575b90 0x5566c0577fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.061+0000 7f0885d9b640 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c0575b90 0x5566c0577fb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f28aeec3346ac03 server_cookie=ad09de7591b32d26 in_seq=0 out_seq=0 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.061+0000 7f086dffb640 10 client.25597 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.061+0000 7f086dffb640 1 -- 172.21.15.67:0/2349289963 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x5566c044f850 con 0x5566c0575b90 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.061+0000 7f086dffb640 10 client.25597 handle_command_reply: tid=0 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.061+0000 7f088ece2740 1 client.25597 shutdown 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.062+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 msgr2=0x5566c04ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.062+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 0x5566c04ff380 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0880002230 tx=0x7f0880030ba0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.062+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 shutdown_connections 2024-09-10T20:56:32.212 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.213 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.214 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.215 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.216 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:32.217 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.062+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5566c0575b90 0x5566c0577fb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.063+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566c04f8960 0x5566c04ff380 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.063+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5566c04db9c0 0x5566c04fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.063+0000 7f088ece2740 1 --2- 172.21.15.67:0/2349289963 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5566c04db0a0 0x5566c0500940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.063+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 >> 172.21.15.67:0/2349289963 conn(0x5566c04d8ed0 msgr2=0x5566c04de1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.063+0000 7f086dffb640 0 client.25597 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.064+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 shutdown_connections 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.064+0000 7f088ece2740 1 -- 172.21.15.67:0/2349289963 wait complete. 2024-09-10T20:56:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.064+0000 7f088ece2740 20 client.25597 trim_cache size 0 max 16384 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 msgr2=0x7f08700b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 0x7f08700b7930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f08780a7d30 tx=0x7f087800bf90 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 msgr2=0x7f088819f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f087800b4a0 tx=0x7f087800b960 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 shutdown_connections 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0888113b20 0x7f08881a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f08700b5470 0x7f08700b7930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0888075e60 0x7f088819fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.065+0000 7f088c90d640 1 --2- 172.21.15.67:0/438411900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0888075540 0x7f088819f960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.066+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 >> 172.21.15.67:0/438411900 conn(0x7f08880fe850 msgr2=0x7f08880ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.066+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 shutdown_connections 2024-09-10T20:56:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:32.066+0000 7f088c90d640 1 -- 172.21.15.67:0/438411900 wait complete. 2024-09-10T20:56:32.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:31 smithi083 ceph-mon[35058]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-09-10T20:56:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:31 smithi172 ceph-mon[35265]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-09-10T20:56:33.102 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:56:33.102 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:56:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 300.0 s, 3838.2 tps, lat 26.184 ms stddev 30.623 2024-09-10T20:56:34.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.178+0000 7f809c88d640 1 -- 172.21.15.67:0/1971428819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900abb80 msgr2=0x7f80900b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.178+0000 7f809c88d640 1 --2- 172.21.15.67:0/1971428819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900abb80 0x7f80900b22d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8098068c00 tx=0x7f809808f230 comp rx=0 tx=0).stop 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 -- 172.21.15.67:0/1971428819 shutdown_connections 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 --2- 172.21.15.67:0/1971428819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900abb80 0x7f80900b22d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 --2- 172.21.15.67:0/1971428819 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 0x7f80900ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 --2- 172.21.15.67:0/1971428819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900a63a0 0x7f80900a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 -- 172.21.15.67:0/1971428819 >> 172.21.15.67:0/1971428819 conn(0x7f809001c870 msgr2=0x7f809001cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 -- 172.21.15.67:0/1971428819 shutdown_connections 2024-09-10T20:56:34.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.179+0000 7f809c88d640 1 -- 172.21.15.67:0/1971428819 wait complete. 2024-09-10T20:56:34.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 Processor -- start 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 -- start start 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 0x7f809013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 0x7f809013f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 0x7f8090144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f80900b4600 con 0x7f80900ab200 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f80900b4480 con 0x7f80900abb80 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f809c88d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80900b4780 con 0x7f80900a63a0 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f8097fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 0x7f8090144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f8097fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 0x7f8090144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47568/0 (socket says 172.21.15.67:47568) 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.180+0000 7f8097fff640 1 -- 172.21.15.67:0/3073987363 learned_addr learned my addr 172.21.15.67:0/3073987363 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f8096ffd640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 0x7f809013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 0x7f809013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 -- 172.21.15.67:0/3073987363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 msgr2=0x7f8090144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 0x7f8090144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 -- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 msgr2=0x7f809013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 0x7f809013f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 -- 172.21.15.67:0/3073987363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8090144ff0 con 0x7f80900a63a0 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.181+0000 7f80977fe640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 0x7f809013ef40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f808c009fd0 tx=0x7f808c00b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.182+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c015020 con 0x7f80900a63a0 2024-09-10T20:56:34.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.182+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c011ce0 con 0x7f80900a63a0 2024-09-10T20:56:34.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.182+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80901452e0 con 0x7f80900a63a0 2024-09-10T20:56:34.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.182+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809014b9a0 con 0x7f80900a63a0 2024-09-10T20:56:34.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.182+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c010de0 con 0x7f80900a63a0 2024-09-10T20:56:34.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.183+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c0052c0 con 0x7f80900a63a0 2024-09-10T20:56:34.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.185+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f808c011830 con 0x7f80900a63a0 2024-09-10T20:56:34.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.186+0000 7f8094ff9640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 0x7f80880b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:34.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.187+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f808c0e5380 con 0x7f80900a63a0 2024-09-10T20:56:34.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.187+0000 7f8096ffd640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 0x7f80880b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:34.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.188+0000 7f8096ffd640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 0x7f80880b7970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80900a2800 tx=0x7f8084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:34.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.191+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f808c01f020 con 0x7f80900a63a0 2024-09-10T20:56:34.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:33 smithi067 ceph-mon[30891]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-10T20:56:34.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:33 smithi083 ceph-mon[35058]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-10T20:56:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:33 smithi172 ceph-mon[35265]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-10T20:56:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.543+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f807c0055b0 con 0x7f80900a63a0 2024-09-10T20:56:34.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.544+0000 7f8094ff9640 1 -- 172.21.15.67:0/3073987363 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f808c0ac210 con 0x7f80900a63a0 2024-09-10T20:56:34.549 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:56:34.549 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:56:34.549 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.546+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 msgr2=0x7f80880b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.546+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 0x7f80880b7970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f80900a2800 tx=0x7f8084005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.546+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 msgr2=0x7f809013ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.546+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 0x7f809013ef40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f808c009fd0 tx=0x7f808c00b870 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 shutdown_connections 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80900abb80 0x7f8090144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f80900ab200 0x7f809013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f80880b54b0 0x7f80880b7970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 --2- 172.21.15.67:0/3073987363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80900a63a0 0x7f809013ef40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 >> 172.21.15.67:0/3073987363 conn(0x7f809001c870 msgr2=0x7f80900a34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:34.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 shutdown_connections 2024-09-10T20:56:34.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:34.547+0000 7f809c88d640 1 -- 172.21.15.67:0/3073987363 wait complete. 2024-09-10T20:56:35.243 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3073987363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:56:35.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:56:35.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:34 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3073987363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:56:35.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:34 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3073987363' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:56:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:36.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:35 smithi067 ceph-mon[30891]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 703 op/s 2024-09-10T20:56:36.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:35 smithi083 ceph-mon[35058]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 703 op/s 2024-09-10T20:56:36.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.433+0000 7f8e2f995640 1 -- 172.21.15.67:0/1514702077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 msgr2=0x7f8e2810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.433+0000 7f8e2f995640 1 --2- 172.21.15.67:0/1514702077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810caf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009ca0 tx=0x7f8e2002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 -- 172.21.15.67:0/1514702077 shutdown_connections 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 --2- 172.21.15.67:0/1514702077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e2810d140 0x7f8e2810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 --2- 172.21.15.67:0/1514702077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810caf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 --2- 172.21.15.67:0/1514702077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e28103ce0 0x7f8e281040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 -- 172.21.15.67:0/1514702077 >> 172.21.15.67:0/1514702077 conn(0x7f8e280fd740 msgr2=0x7f8e280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 -- 172.21.15.67:0/1514702077 shutdown_connections 2024-09-10T20:56:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.434+0000 7f8e2f995640 1 -- 172.21.15.67:0/1514702077 wait complete. 2024-09-10T20:56:36.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 Processor -- start 2024-09-10T20:56:36.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 -- start start 2024-09-10T20:56:36.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28103ce0 0x7f8e2810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e2810d140 0x7f8e2819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28112e00 con 0x7f8e2810d140 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2cf30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28112c80 con 0x7f8e28104600 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2f995640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28112f80 con 0x7f8e28103ce0 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2df32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e2810d140 0x7f8e2819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2cf30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47584/0 (socket says 172.21.15.67:47584) 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.435+0000 7f8e2cf30640 1 -- 172.21.15.67:0/783869772 learned_addr learned my addr 172.21.15.67:0/783869772 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2d731640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28103ce0 0x7f8e2810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 -- 172.21.15.67:0/783869772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28103ce0 msgr2=0x7f8e2810bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28103ce0 0x7f8e2810bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 -- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e2810d140 msgr2=0x7f8e2819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e2810d140 0x7f8e2819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 -- 172.21.15.67:0/783869772 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e281a02e0 con 0x7f8e28104600 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e20000f80 tx=0x7f8e20031750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e1e7fc640 1 -- 172.21.15.67:0/783869772 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20003b70 con 0x7f8e28104600 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e1e7fc640 1 -- 172.21.15.67:0/783869772 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20003d10 con 0x7f8e28104600 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e1e7fc640 1 -- 172.21.15.67:0/783869772 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2002fa10 con 0x7f8e28104600 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.436+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e281a0570 con 0x7f8e28104600 2024-09-10T20:56:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.437+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e2819c9e0 con 0x7f8e28104600 2024-09-10T20:56:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.440+0000 7f8e31d6a740 1 Processor -- start 2024-09-10T20:56:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.440+0000 7f8e31d6a740 1 -- start start 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x55695966a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569595d1ea0 con 0x55695965b4d0 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5569595c12d0 con 0x55695965bdf0 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569595c50e0 con 0x556959667d80 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2d731640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2d731640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47596/0 (socket says 172.21.15.67:47596) 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44968/0 (socket says 172.21.15.67:44968) 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2d731640 1 -- 172.21.15.67:0/2405434239 learned_addr learned my addr 172.21.15.67:0/2405434239 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e1e7fc640 1 -- 172.21.15.67:0/783869772 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8e2002fbb0 con 0x7f8e28104600 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 -- 172.21.15.67:0/2405434239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 msgr2=0x55695966a170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x55695966a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 -- 172.21.15.67:0/2405434239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 msgr2=0x556959667840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.441+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e2df32640 1 -- 172.21.15.67:0/2405434239 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695931f650 con 0x55695965b4d0 2024-09-10T20:56:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8e24004640 tx=0x7f8e2400ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f221994daf2cc367 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e137fe640 1 -- 172.21.15.67:0/2405434239 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24003bb0 con 0x55695965b4d0 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e137fe640 1 -- 172.21.15.67:0/2405434239 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e24015070 con 0x55695965b4d0 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e137fe640 1 -- 172.21.15.67:0/2405434239 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e240106a0 con 0x55695965b4d0 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.442+0000 7f8e1e7fc640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 0x7f8e140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e2d731640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 0x7f8e140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e1e7fc640 1 -- 172.21.15.67:0/783869772 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8e20106ca0 con 0x7f8e28104600 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2405434239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 msgr2=0x55695965b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8e24004640 tx=0x7f8e2400ba90 comp rx=0 tx=0).stop 2024-09-10T20:56:36.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2405434239 shutdown_connections 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x55695966a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965bdf0 0x556959667840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2405434239 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x55695965b8b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2405434239 >> 172.21.15.67:0/2405434239 conn(0x556959659300 msgr2=0x55695965a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2405434239 shutdown_connections 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.443+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2405434239 wait complete. 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e2d731640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 0x7f8e140b7820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55695965a1e0 tx=0x7f8e18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e31d6a740 1 -- start start 2024-09-10T20:56:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e31d6a740 1 Processor -- start 2024-09-10T20:56:36.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:35 smithi172 ceph-mon[35265]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 703 op/s 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x556959667680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x556959664ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.444+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556959422700 con 0x55695965bdf0 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55695955c160 con 0x55695965b4d0 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55695966aa00 con 0x556959667d80 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2cf30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x556959664ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42688/0 (socket says 172.21.15.67:42688) 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 -- 172.21.15.67:0/1957954472 learned_addr learned my addr 172.21.15.67:0/1957954472 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2d731640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x556959667680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e31d6a740 10 client.0 _ll_register_callbacks cb 0x5569595759e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 -- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 msgr2=0x556959667680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x556959667680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 -- 172.21.15.67:0/1957954472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 msgr2=0x556959664ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x556959664ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 -- 172.21.15.67:0/1957954472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556959589c90 con 0x556959667d80 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e2df32640 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e24004610 tx=0x7f8e24003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7c6c7cc37b5de41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.445+0000 7f8e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.446+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24027030 con 0x556959667d80 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.446+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8e24005020 con 0x556959667d80 2024-09-10T20:56:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.446+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e24015070 con 0x556959667d80 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.447+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e24005220 con 0x556959667d80 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.447+0000 7f8e31d6a740 10 client.25612 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.447+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556959676360 con 0x556959667d80 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.447+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e240053c0 con 0x556959667d80 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8e240049b0 con 0x556959667d80 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 10 client.25612 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 10 client.25612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 20 client.25612 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x556959677760 0x556959679b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 4 client.25612 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8e24015070 con 0x556959677760 2024-09-10T20:56:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e2d731640 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x556959677760 0x556959679b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e2d731640 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x556959677760 0x556959679b50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9baced277d5a2f25 server_cookie=b9e8846038f67148 in_seq=0 out_seq=0 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.448+0000 7f8e10ff9640 10 client.25612 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e10ff9640 1 -- 172.21.15.67:0/1957954472 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8e24015070 con 0x556959677760 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e10ff9640 10 client.25612 handle_command_reply: tid=0 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 client.25612 shutdown 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 msgr2=0x5569596650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e24004610 tx=0x7f8e24003c60 comp rx=0 tx=0).stop 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 shutdown_connections 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x556959677760 0x556959679b50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x5569596650e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x556959664ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/1957954472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x556959667680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e10ff9640 0 client.25612 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:56:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.449+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 >> 172.21.15.67:0/1957954472 conn(0x556959659300 msgr2=0x55695965ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.450+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 shutdown_connections 2024-09-10T20:56:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.450+0000 7f8e31d6a740 1 -- 172.21.15.67:0/1957954472 wait complete. 2024-09-10T20:56:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.450+0000 7f8e31d6a740 20 client.25612 trim_cache size 0 max 16384 2024-09-10T20:56:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 Processor -- start 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 -- start start 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55695965bdf0 0x55695965ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 0x556959658c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bfaf0 con 0x55695965b4d0 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bd3c0 con 0x556959667d80 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.472+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bb210 con 0x55695965bdf0 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44986/0 (socket says 172.21.15.67:44986) 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 -- 172.21.15.67:0/2319908669 learned_addr learned my addr 172.21.15.67:0/2319908669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 0x556959658c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55695965bdf0 0x55695965ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 -- 172.21.15.67:0/2319908669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55695965bdf0 msgr2=0x55695965ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55695965bdf0 0x55695965ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 -- 172.21.15.67:0/2319908669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 msgr2=0x556959658c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 0x556959658c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 -- 172.21.15.67:0/2319908669 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556959659d80 con 0x55695965b4d0 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 0x556959658c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8e18013000 tx=0x7f8e1801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462811a8489f611f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e12ffd640 1 -- 172.21.15.67:0/2319908669 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1802e070 con 0x55695965b4d0 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e12ffd640 1 -- 172.21.15.67:0/2319908669 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e18003b70 con 0x55695965b4d0 2024-09-10T20:56:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.473+0000 7f8e12ffd640 1 -- 172.21.15.67:0/2319908669 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18011440 con 0x55695965b4d0 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2319908669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 msgr2=0x556959673cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8e18013000 tx=0x7f8e1801a000 comp rx=0 tx=0).stop 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2319908669 shutdown_connections 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556959667d80 0x556959658c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55695965bdf0 0x55695965ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2319908669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965b4d0 0x556959673cd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.474+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2319908669 >> 172.21.15.67:0/2319908669 conn(0x556959659300 msgr2=0x55695965a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.475+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2319908669 shutdown_connections 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.475+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2319908669 wait complete. 2024-09-10T20:56:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.475+0000 7f8e31d6a740 1 -- start start 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.475+0000 7f8e31d6a740 1 Processor -- start 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x55695967cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x5569596783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x556959678930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bb880 con 0x55695965bdf0 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bccf0 con 0x55695965b4d0 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281bbf50 con 0x556959667d80 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e31d6a740 10 client.0 _ll_register_callbacks cb 0x7f8e180096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.476+0000 7f8e2cf30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x5569596783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2cf30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x5569596783f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:44994/0 (socket says 172.21.15.67:44994) 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2cf30640 1 -- 172.21.15.67:0/2128450824 learned_addr learned my addr 172.21.15.67:0/2128450824 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x55695967cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2df32640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x556959678930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 -- 172.21.15.67:0/2128450824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 msgr2=0x556959678930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x556959678930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 -- 172.21.15.67:0/2128450824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 msgr2=0x5569596783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x5569596783f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 -- 172.21.15.67:0/2128450824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556959679130 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e2d731640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x55695967cf20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005d00 tx=0x7f8e18004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d12f5b31b363fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1802e030 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8e18021410 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.477+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e18003b70 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8e18043070 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 10 client.25631 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5569596e42f0 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1803c440 con 0x55695965b4d0 2024-09-10T20:56:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8e1803a020 con 0x55695965b4d0 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 10 client.25631 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 10 client.25631 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 20 client.25631 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5569596e4a10 0x5569596e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 4 client.25631 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8e18003b70 con 0x5569596e4a10 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.478+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5569596e4a10 0x5569596e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e2cf30640 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5569596e4a10 0x5569596e6e30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8668a313e5b4738c server_cookie=8aff4e64d2ec70ab in_seq=0 out_seq=0 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e10ff9640 10 client.25631 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e10ff9640 1 -- 172.21.15.67:0/2128450824 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8e18003b70 con 0x5569596e4a10 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e10ff9640 10 client.25631 handle_command_reply: tid=0 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e31d6a740 1 client.25631 shutdown 2024-09-10T20:56:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 msgr2=0x55695967cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.479+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x55695967cf20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005d00 tx=0x7f8e18004510 comp rx=0 tx=0).stop 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 shutdown_connections 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5569596e4a10 0x5569596e6e30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556959667d80 0x556959678930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e10ff9640 0 client.25631 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55695965bdf0 0x5569596783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 --2- 172.21.15.67:0/2128450824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55695965b4d0 0x55695967cf20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.480+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 >> 172.21.15.67:0/2128450824 conn(0x556959659300 msgr2=0x556959666100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.481+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 shutdown_connections 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.481+0000 7f8e31d6a740 1 -- 172.21.15.67:0/2128450824 wait complete. 2024-09-10T20:56:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.481+0000 7f8e31d6a740 20 client.25631 trim_cache size 0 max 16384 2024-09-10T20:56:36.490 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.482+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 msgr2=0x7f8e140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.482+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 0x7f8e140b7820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55695965a1e0 tx=0x7f8e18005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.482+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 msgr2=0x7f8e2810c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.482+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e20000f80 tx=0x7f8e20031750 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 shutdown_connections 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e2810d140 0x7f8e2819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e28104600 0x7f8e2810c3e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8e140b5360 0x7f8e140b7820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 --2- 172.21.15.67:0/783869772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28103ce0 0x7f8e2810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 >> 172.21.15.67:0/783869772 conn(0x7f8e280fd740 msgr2=0x7f8e280ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 shutdown_connections 2024-09-10T20:56:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:36.483+0000 7f8e2f995640 1 -- 172.21.15.67:0/783869772 wait complete. 2024-09-10T20:56:37.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:56:37.705 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:38.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:37 smithi067 ceph-mon[30891]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-10T20:56:38.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:37 smithi083 ceph-mon[35058]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-10T20:56:38.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:37 smithi172 ceph-mon[35265]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 -- 172.21.15.67:0/1023547794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8102430 msgr2=0x7f54d8106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 --2- 172.21.15.67:0/1023547794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8102430 0x7f54d8106900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc02a3f0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 -- 172.21.15.67:0/1023547794 shutdown_connections 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 --2- 172.21.15.67:0/1023547794 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8106f50 0x7f54d81073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 --2- 172.21.15.67:0/1023547794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8102430 0x7f54d8106900 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 --2- 172.21.15.67:0/1023547794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8101b10 0x7f54d8101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.548+0000 7f54de7d4640 1 -- 172.21.15.67:0/1023547794 >> 172.21.15.67:0/1023547794 conn(0x7f54d80fd7c0 msgr2=0x7f54d80ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.551+0000 7f54de7d4640 1 -- 172.21.15.67:0/1023547794 shutdown_connections 2024-09-10T20:56:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.551+0000 7f54de7d4640 1 -- 172.21.15.67:0/1023547794 wait complete. 2024-09-10T20:56:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.551+0000 7f54de7d4640 1 Processor -- start 2024-09-10T20:56:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.551+0000 7f54de7d4640 1 -- start start 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 0x7f54d819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8102430 0x7f54d819fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 0x7f54d81a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8119430 con 0x7f54d8101b10 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54d81192b0 con 0x7f54d8102430 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54de7d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54d81195b0 con 0x7f54d8106f50 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 0x7f54d819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 0x7f54d819f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45008/0 (socket says 172.21.15.67:45008) 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54d7fff640 1 -- 172.21.15.67:0/335382945 learned_addr learned my addr 172.21.15.67:0/335382945 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54dcd71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 0x7f54d81a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.552+0000 7f54d77fe640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8102430 0x7f54d819fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 -- 172.21.15.67:0/335382945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8102430 msgr2=0x7f54d819fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8102430 0x7f54d819fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 -- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 msgr2=0x7f54d819f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 0x7f54d819f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 -- 172.21.15.67:0/335382945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d81a5a30 con 0x7f54d8106f50 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54dcd71640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 0x7f54d81a5260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54c800e970 tx=0x7f54c800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54d57fa640 1 -- 172.21.15.67:0/335382945 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800ccc0 con 0x7f54d8106f50 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.553+0000 7f54d57fa640 1 -- 172.21.15.67:0/335382945 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c8005020 con 0x7f54d8106f50 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.554+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d81a5d20 con 0x7f54d8106f50 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.554+0000 7f54d57fa640 1 -- 172.21.15.67:0/335382945 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8004a00 con 0x7f54d8106f50 2024-09-10T20:56:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.554+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d81ac3e0 con 0x7f54d8106f50 2024-09-10T20:56:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.558+0000 7f54d57fa640 1 -- 172.21.15.67:0/335382945 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f54c8004ba0 con 0x7f54d8106f50 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.560+0000 7f54d57fa640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 0x7f54c00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.560+0000 7f54d57fa640 1 -- 172.21.15.67:0/335382945 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54c80e5a10 con 0x7f54d8106f50 2024-09-10T20:56:38.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.560+0000 7f54d7fff640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 0x7f54c00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.560+0000 7f54e0ba9740 1 Processor -- start 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.560+0000 7f54e0ba9740 1 -- start start 2024-09-10T20:56:38.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e068170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56196dfcfea0 con 0x56196e065d80 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56196dfbf2d0 con 0x56196e059df0 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56196dfc30e0 con 0x56196e0594d0 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47654/0 (socket says 172.21.15.67:47654) 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 -- 172.21.15.67:0/1043052815 learned_addr learned my addr 172.21.15.67:0/1043052815 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54dcd71640 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e068170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 -- 172.21.15.67:0/1043052815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 msgr2=0x56196e0598b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0598b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 -- 172.21.15.67:0/1043052815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 msgr2=0x56196e068170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e068170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.561+0000 7f54d77fe640 1 -- 172.21.15.67:0/1043052815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196dd1d650 con 0x56196e059df0 2024-09-10T20:56:38.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.562+0000 7f54d7fff640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 0x7f54c00b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e250 tx=0x7f54d000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.563+0000 7f54d77fe640 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13cc2e3734ac189 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.563+0000 7f54be7fc640 1 -- 172.21.15.67:0/1043052815 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc03f070 con 0x56196e059df0 2024-09-10T20:56:38.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.563+0000 7f54be7fc640 1 -- 172.21.15.67:0/1043052815 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54cc032c20 con 0x56196e059df0 2024-09-10T20:56:38.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.564+0000 7f54be7fc640 1 -- 172.21.15.67:0/1043052815 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc035070 con 0x56196e059df0 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.564+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1043052815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 msgr2=0x56196e065840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.564+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc005dd0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.565+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1043052815 shutdown_connections 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.565+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e068170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.565+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e059df0 0x56196e065840 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc005dd0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.565+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1043052815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.565+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1043052815 >> 172.21.15.67:0/1043052815 conn(0x56196e057300 msgr2=0x56196e0584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.566+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1043052815 shutdown_connections 2024-09-10T20:56:38.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.566+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1043052815 wait complete. 2024-09-10T20:56:38.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.566+0000 7f54e0ba9740 1 -- start start 2024-09-10T20:56:38.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.567+0000 7f54e0ba9740 1 Processor -- start 2024-09-10T20:56:38.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56196de20700 con 0x56196e065d80 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56196df5a160 con 0x56196e0632e0 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56196e068a40 con 0x56196e0594d0 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54e0ba9740 10 client.0 _ll_register_callbacks cb 0x56196df739e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42754/0 (socket says 172.21.15.67:42754) 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.568+0000 7f54d7fff640 1 -- 172.21.15.67:0/1851338802 learned_addr learned my addr 172.21.15.67:0/1851338802 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 -- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 msgr2=0x56196e0657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 -- 172.21.15.67:0/1851338802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 msgr2=0x56196e062bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e062bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 -- 172.21.15.67:0/1851338802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196df87c90 con 0x56196e0632e0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54d77fe640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.569+0000 7f54dcd71640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54c80e34e0 tx=0x7f54c80ac760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f4292d17a62038d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.570+0000 7f54b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.570+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c801c040 con 0x56196e0632e0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.570+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54c80d30c0 con 0x56196e0632e0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.570+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54cc032c20 con 0x56196e0632e0 2024-09-10T20:56:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.570+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f54c80abcb0 con 0x56196e0632e0 2024-09-10T20:56:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 10 client.25640 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56196e074910 con 0x56196e0632e0 2024-09-10T20:56:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54cc032c20 con 0x56196e0632e0 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f54c80a7af0 con 0x56196e0632e0 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 10 client.25640 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 10 client.25640 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 20 client.25640 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e075dc0 0x56196e0781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 4 client.25640 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.571+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56196dfd1df0 con 0x56196e075dc0 2024-09-10T20:56:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.572+0000 7f54d7fff640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e075dc0 0x56196e0781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.573+0000 7f54d7fff640 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e075dc0 0x56196e0781b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=debce70e0cdaaaa8 server_cookie=78bcf9961a59ab73 in_seq=0 out_seq=0 2024-09-10T20:56:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.573+0000 7f54b77fe640 10 client.25640 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:56:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54b77fe640 1 -- 172.21.15.67:0/1851338802 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56196dfd1df0 con 0x56196e075dc0 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54b77fe640 10 client.25640 handle_command_reply: tid=0 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 client.25640 shutdown 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 msgr2=0x56196e071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071e00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54c80e34e0 tx=0x7f54c80ac760 comp rx=0 tx=0).stop 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 shutdown_connections 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e075dc0 0x56196e0781b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071e00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e065d80 0x56196e062bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/1851338802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e0594d0 0x56196e0657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 >> 172.21.15.67:0/1851338802 conn(0x56196e057300 msgr2=0x56196e05ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54b77fe640 0 client.25640 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:56:38.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 shutdown_connections 2024-09-10T20:56:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 1 -- 172.21.15.67:0/1851338802 wait complete. 2024-09-10T20:56:38.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.575+0000 7f54e0ba9740 20 client.25640 trim_cache size 0 max 16384 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.601+0000 7f54e0ba9740 1 Processor -- start 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.601+0000 7f54e0ba9740 1 -- start start 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0594d0 0x56196e064930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4010c70 con 0x56196e0594d0 2024-09-10T20:56:38.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54c400e540 con 0x56196e0632e0 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c400c390 con 0x56196e065d80 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54d7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0594d0 0x56196e064930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42756/0 (socket says 172.21.15.67:42756) 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 -- 172.21.15.67:0/3148567907 learned_addr learned my addr 172.21.15.67:0/3148567907 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54d77fe640 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 -- 172.21.15.67:0/3148567907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 msgr2=0x56196e071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 -- 172.21.15.67:0/3148567907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0594d0 msgr2=0x56196e064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0594d0 0x56196e064930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.602+0000 7f54dcd71640 1 -- 172.21.15.67:0/3148567907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56196e058010 con 0x56196e065d80 2024-09-10T20:56:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.603+0000 7f54dcd71640 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54c80a8770 tx=0x7f54c80ac0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7968547f7b677022 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.604+0000 7f54bdffb640 1 -- 172.21.15.67:0/3148567907 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c80abaf0 con 0x56196e065d80 2024-09-10T20:56:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.604+0000 7f54bdffb640 1 -- 172.21.15.67:0/3148567907 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c80b0c80 con 0x56196e065d80 2024-09-10T20:56:38.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.604+0000 7f54bdffb640 1 -- 172.21.15.67:0/3148567907 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c80ab1a0 con 0x56196e065d80 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 -- 172.21.15.67:0/3148567907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 msgr2=0x56196e072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f54c80a8770 tx=0x7f54c80ac0a0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 -- 172.21.15.67:0/3148567907 shutdown_connections 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e072240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0632e0 0x56196e071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/3148567907 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0594d0 0x56196e064930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.605+0000 7f54e0ba9740 1 -- 172.21.15.67:0/3148567907 >> 172.21.15.67:0/3148567907 conn(0x56196e057300 msgr2=0x56196e064220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.606+0000 7f54e0ba9740 1 -- 172.21.15.67:0/3148567907 shutdown_connections 2024-09-10T20:56:38.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.606+0000 7f54e0ba9740 1 -- 172.21.15.67:0/3148567907 wait complete. 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.607+0000 7f54e0ba9740 1 -- start start 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.607+0000 7f54e0ba9740 1 Processor -- start 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.607+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 0x56196e06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.607+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 0x56196e06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.607+0000 7f54e0ba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f54c400ca00 con 0x56196e0632e0 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f54c400de70 con 0x56196e0594d0 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54e0ba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54c400d0d0 con 0x56196e065d80 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 0x56196e06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54d77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 0x56196e06e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45052/0 (socket says 172.21.15.67:45052) 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54d77fe640 1 -- 172.21.15.67:0/729321273 learned_addr learned my addr 172.21.15.67:0/729321273 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54e0ba9740 10 client.0 _ll_register_callbacks cb 0x7f54c8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54d7fff640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 0x56196e06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 -- 172.21.15.67:0/729321273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 msgr2=0x56196e06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 0x56196e06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 -- 172.21.15.67:0/729321273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 msgr2=0x56196e06e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 0x56196e06e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54dcd71640 1 -- 172.21.15.67:0/729321273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56196e0694b0 con 0x56196e065d80 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.608+0000 7f54d7fff640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 0x56196e06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.609+0000 7f54dcd71640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e068d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54c80a8720 tx=0x7f54c80a8920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff1a0c6c11e6f4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:38.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.609+0000 7f54b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.609+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c801c070 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54c80971f0 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c80b0c80 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f54c80ac1a0 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54e0ba9740 10 client.25633 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56196e0f46f0 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.610+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c80b0c80 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f54c80e39a0 con 0x56196e065d80 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 10 client.25633 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:38.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 10 client.25633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:56:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 20 client.25633 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e0f4bf0 0x56196e0f7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 4 client.25633 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:56:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56196dfcd8a0 con 0x56196e0f4bf0 2024-09-10T20:56:38.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.611+0000 7f54d7fff640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e0f4bf0 0x56196e0f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.612+0000 7f54d7fff640 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e0f4bf0 0x56196e0f7010 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4482a6cca920297c server_cookie=eee68cf388c92013 in_seq=0 out_seq=0 2024-09-10T20:56:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.612+0000 7f54b77fe640 10 client.25633 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:56:38.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.612+0000 7f54b77fe640 1 -- 172.21.15.67:0/729321273 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56196dfcd8a0 con 0x56196e0f4bf0 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.612+0000 7f54b77fe640 10 client.25633 handle_command_reply: tid=0 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.612+0000 7f54e0ba9740 1 client.25633 shutdown 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 msgr2=0x56196e068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e068d20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54c80a8720 tx=0x7f54c80a8920 comp rx=0 tx=0).stop 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 shutdown_connections 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56196e0f4bf0 0x56196e0f7010 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196e065d80 0x56196e068d20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56196e0632e0 0x56196e06e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 --2- 172.21.15.67:0/729321273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56196e0594d0 0x56196e06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.613+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 >> 172.21.15.67:0/729321273 conn(0x56196e057300 msgr2=0x56196e064a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.614+0000 7f54b77fe640 0 client.25633 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.614+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 shutdown_connections 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.614+0000 7f54e0ba9740 1 -- 172.21.15.67:0/729321273 wait complete. 2024-09-10T20:56:38.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.614+0000 7f54e0ba9740 20 client.25633 trim_cache size 0 max 16384 2024-09-10T20:56:38.620 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 msgr2=0x7f54c00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 0x7f54c00b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e250 tx=0x7f54d000b040 comp rx=0 tx=0).stop 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 msgr2=0x7f54d81a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 0x7f54d81a5260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54c800e970 tx=0x7f54c800ee30 comp rx=0 tx=0).stop 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 shutdown_connections 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f54c00b5360 0x7f54c00b7820 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54d8106f50 0x7f54d81a5260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54d8102430 0x7f54d819fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 --2- 172.21.15.67:0/335382945 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d8101b10 0x7f54d819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:38.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 >> 172.21.15.67:0/335382945 conn(0x7f54d80fd7c0 msgr2=0x7f54d81048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:38.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.616+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 shutdown_connections 2024-09-10T20:56:38.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:38.617+0000 7f54de7d4640 1 -- 172.21.15.67:0/335382945 wait complete. 2024-09-10T20:56:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 305.0 s, 3271.0 tps, lat 30.742 ms stddev 41.111 2024-09-10T20:56:39.341 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:56:39.761 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:40.218 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:40 smithi067 ceph-mon[30891]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-10T20:56:40.218 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:56:40.218 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:56:40.218 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:56:40.219 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:56:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 -- 172.21.15.67:0/3778078070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 msgr2=0x7f60f8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/3778078070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f8108c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009be0 tx=0x7f60ec02a6c0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 -- 172.21.15.67:0/3778078070 shutdown_connections 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/3778078070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/3778078070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f8108c10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/3778078070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 0x7f60f81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 -- 172.21.15.67:0/3778078070 >> 172.21.15.67:0/3778078070 conn(0x7f60f80fe830 msgr2=0x7f60f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.338+0000 7f60ff8d4640 1 -- 172.21.15.67:0/3778078070 shutdown_connections 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.339+0000 7f60ff8d4640 1 -- 172.21.15.67:0/3778078070 wait complete. 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.339+0000 7f60ff8d4640 1 Processor -- start 2024-09-10T20:56:40.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.339+0000 7f60ff8d4640 1 -- start start 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 0x7f60f810f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8076dd0 con 0x7f60f8109150 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8076c50 con 0x7f60f81087d0 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60ff8d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8076f50 con 0x7f60f8102dc0 2024-09-10T20:56:40.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47696/0 (socket says 172.21.15.67:47696) 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 -- 172.21.15.67:0/581225349 learned_addr learned my addr 172.21.15.67:0/581225349 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fde71640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fd670640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 0x7f60f810f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 -- 172.21.15.67:0/581225349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 msgr2=0x7f60f810f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 0x7f60f810f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 -- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 msgr2=0x7f60f810cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fce6f640 1 -- 172.21.15.67:0/581225349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f810d5e0 con 0x7f60f81087d0 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.340+0000 7f60fde71640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:40.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.341+0000 7f60fce6f640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60ec004af0 tx=0x7f60ec003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.343+0000 7f60ea7fc640 1 -- 172.21.15.67:0/581225349 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec040020 con 0x7f60f81087d0 2024-09-10T20:56:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.343+0000 7f60ea7fc640 1 -- 172.21.15.67:0/581225349 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60ec030970 con 0x7f60f81087d0 2024-09-10T20:56:40.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.343+0000 7f60ea7fc640 1 -- 172.21.15.67:0/581225349 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec036040 con 0x7f60f81087d0 2024-09-10T20:56:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.343+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f81abd50 con 0x7f60f81087d0 2024-09-10T20:56:40.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.343+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f81ac180 con 0x7f60f81087d0 2024-09-10T20:56:40.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.347+0000 7f6101ca9740 1 Processor -- start 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.347+0000 7f6101ca9740 1 -- start start 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc0204d0 0x5650cc0208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5650cbf96ea0 con 0x5650cc020df0 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5650cbf862d0 con 0x5650cc0204d0 2024-09-10T20:56:40.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f6101ca9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5650cbf8a0e0 con 0x5650cc02cd80 2024-09-10T20:56:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f60fde71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc0204d0 0x5650cc0208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f60fd670640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f60fd670640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45086/0 (socket says 172.21.15.67:45086) 2024-09-10T20:56:40.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.348+0000 7f60fd670640 1 -- 172.21.15.67:0/300027339 learned_addr learned my addr 172.21.15.67:0/300027339 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.349+0000 7f60fd670640 1 -- 172.21.15.67:0/300027339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 msgr2=0x5650cc02f170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:56:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.349+0000 7f60fd670640 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02f170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.349+0000 7f60fd670640 1 -- 172.21.15.67:0/300027339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc0204d0 msgr2=0x5650cc0208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.349+0000 7f60fd670640 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc0204d0 0x5650cc0208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.349+0000 7f60fd670640 1 -- 172.21.15.67:0/300027339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650cbce4650 con 0x5650cc020df0 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.354+0000 7f60ea7fc640 1 -- 172.21.15.67:0/581225349 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f60ec004510 con 0x7f60f81087d0 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.355+0000 7f60ea7fc640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 0x7f60e40b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.356+0000 7f60ea7fc640 1 -- 172.21.15.67:0/581225349 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f60ec106a00 con 0x7f60f81087d0 2024-09-10T20:56:40.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.356+0000 7f60fd670640 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009c50 tx=0x7f60f40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8576ca5e5e113da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.359+0000 7f60e37fe640 1 -- 172.21.15.67:0/300027339 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4012450 con 0x5650cc020df0 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.359+0000 7f60e37fe640 1 -- 172.21.15.67:0/300027339 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f4012aa0 con 0x5650cc020df0 2024-09-10T20:56:40.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.359+0000 7f60fde71640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 0x7f60e40b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 -- 172.21.15.67:0/300027339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 msgr2=0x5650cc02c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009c50 tx=0x7f60f40117b0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 -- 172.21.15.67:0/300027339 shutdown_connections 2024-09-10T20:56:40.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc020df0 0x5650cc02c840 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 --2- 172.21.15.67:0/300027339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc0204d0 0x5650cc0208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.360+0000 7f6101ca9740 1 -- 172.21.15.67:0/300027339 >> 172.21.15.67:0/300027339 conn(0x5650cc01e300 msgr2=0x5650cc01f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.362+0000 7f60fde71640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 0x7f60e40b7970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009d30 tx=0x7f60f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.364+0000 7f6101ca9740 1 -- 172.21.15.67:0/300027339 shutdown_connections 2024-09-10T20:56:40.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.364+0000 7f6101ca9740 1 -- 172.21.15.67:0/300027339 wait complete. 2024-09-10T20:56:40.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.364+0000 7f6101ca9740 1 -- start start 2024-09-10T20:56:40.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.364+0000 7f6101ca9740 1 Processor -- start 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.367+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc02c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc020df0 0x5650cc029a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 0x5650cc02a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5650cbde7700 con 0x5650cc0204d0 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5650cbf21160 con 0x5650cc02cd80 2024-09-10T20:56:40.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5650cc040a60 con 0x5650cc020df0 2024-09-10T20:56:40.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f6101ca9740 10 client.0 _ll_register_callbacks cb 0x5650cbf3a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:40.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f60fde71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 0x5650cc02a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f60fde71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 0x5650cc02a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:47708/0 (socket says 172.21.15.67:47708) 2024-09-10T20:56:40.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.368+0000 7f60fde71640 1 -- 172.21.15.67:0/1376972564 learned_addr learned my addr 172.21.15.67:0/1376972564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:40.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.369+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc020df0 0x5650cc029a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.369+0000 7f60fd670640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc02c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 -- 172.21.15.67:0/1376972564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc020df0 msgr2=0x5650cc029a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc020df0 0x5650cc029a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 -- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 msgr2=0x5650cc02a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 0x5650cc02a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 -- 172.21.15.67:0/1376972564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650cbf4ec90 con 0x5650cc0204d0 2024-09-10T20:56:40.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60fd670640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc02c620 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009850 tx=0x7f60f4009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fadcc68d7d795f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.370+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4028070 con 0x5650cc0204d0 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.371+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f4012aa0 con 0x5650cc0204d0 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.371+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f60f4005070 con 0x5650cc0204d0 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.371+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f60f4005290 con 0x5650cc0204d0 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.371+0000 7f6101ca9740 10 client.15996 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:40.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.371+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5650cc04c3d0 con 0x5650cc0204d0 2024-09-10T20:56:40.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.372+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f4012aa0 con 0x5650cc0204d0 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f60f402b030 con 0x5650cc0204d0 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 10 client.15996 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 20 client.15996 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc04dc10 0x5650cc050030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 4 client.15996 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650cbf98df0 con 0x5650cc04dc10 2024-09-10T20:56:40.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.373+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc04dc10 0x5650cc050030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.374+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc04dc10 0x5650cc050030 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae8f0519a4fdb5f server_cookie=2a716b9f4edc27cb in_seq=0 out_seq=0 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.374+0000 7f60e0ff9640 10 client.15996 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1376972564 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650cbf98df0 con 0x5650cc04dc10 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f60e0ff9640 10 client.15996 handle_command_reply: tid=0 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 client.15996 shutdown 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 msgr2=0x5650cc02c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc02c620 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009850 tx=0x7f60f4009460 comp rx=0 tx=0).stop 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 shutdown_connections 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc04dc10 0x5650cc050030 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc02cd80 0x5650cc02a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc020df0 0x5650cc029a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1376972564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc02c620 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 >> 172.21.15.67:0/1376972564 conn(0x5650cc01e300 msgr2=0x5650cc023ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.375+0000 7f60e0ff9640 0 client.15996 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:40.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.376+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 shutdown_connections 2024-09-10T20:56:40.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.379+0000 7f6101ca9740 1 -- 172.21.15.67:0/1376972564 wait complete. 2024-09-10T20:56:40.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.379+0000 7f6101ca9740 20 client.15996 trim_cache size 0 max 16384 2024-09-10T20:56:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:40 smithi083 ceph-mon[35058]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-10T20:56:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:56:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:56:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:56:40.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:56:40.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.412+0000 7f6101ca9740 1 Processor -- start 2024-09-10T20:56:40.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.412+0000 7f6101ca9740 1 -- start start 2024-09-10T20:56:40.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.413+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc01f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.413+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc01dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.413+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f6101ca9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60f806f2a0 con 0x5650cc0204d0 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f6101ca9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60f806cb70 con 0x5650cc020df0 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f6101ca9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60f811bd10 con 0x5650cc02cd80 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fd670640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc01f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fd670640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc01f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45112/0 (socket says 172.21.15.67:45112) 2024-09-10T20:56:40.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fd670640 1 -- 172.21.15.67:0/3405272890 learned_addr learned my addr 172.21.15.67:0/3405272890 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fce6f640 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc01dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 -- 172.21.15.67:0/3405272890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 msgr2=0x5650cc01dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc01dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 -- 172.21.15.67:0/3405272890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 msgr2=0x5650cc01f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc01f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.414+0000 7f60fde71640 1 -- 172.21.15.67:0/3405272890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650cc02c250 con 0x5650cc02cd80 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f60fde71640 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60f0012cb0 tx=0x7f60f001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14994222e1255de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f60e2ffd640 1 -- 172.21.15.67:0/3405272890 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0005020 con 0x5650cc02cd80 2024-09-10T20:56:40.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f60e2ffd640 1 -- 172.21.15.67:0/3405272890 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f00047a0 con 0x5650cc02cd80 2024-09-10T20:56:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f60e2ffd640 1 -- 172.21.15.67:0/3405272890 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011820 con 0x5650cc02cd80 2024-09-10T20:56:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f6101ca9740 1 -- 172.21.15.67:0/3405272890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 msgr2=0x5650cc02e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.416+0000 7f6101ca9740 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60f0012cb0 tx=0x7f60f001a000 comp rx=0 tx=0).stop 2024-09-10T20:56:40.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 -- 172.21.15.67:0/3405272890 shutdown_connections 2024-09-10T20:56:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc02cd80 0x5650cc02e170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc01dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 --2- 172.21.15.67:0/3405272890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc0204d0 0x5650cc01f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 -- 172.21.15.67:0/3405272890 >> 172.21.15.67:0/3405272890 conn(0x5650cc01e300 msgr2=0x5650cc0282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.417+0000 7f6101ca9740 1 -- 172.21.15.67:0/3405272890 shutdown_connections 2024-09-10T20:56:40.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.419+0000 7f6101ca9740 1 -- 172.21.15.67:0/3405272890 wait complete. 2024-09-10T20:56:40.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.420+0000 7f6101ca9740 1 -- start start 2024-09-10T20:56:40.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.420+0000 7f6101ca9740 1 Processor -- start 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc0555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc02cd80 0x5650cc055bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f60f811c380 con 0x5650cc02cd80 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60f811d7f0 con 0x5650cc020df0 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60f811ca50 con 0x5650cc0204d0 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f6101ca9740 10 client.0 _ll_register_callbacks cb 0x7f60f00095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:42798/0 (socket says 172.21.15.67:42798) 2024-09-10T20:56:40.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 -- 172.21.15.67:0/1453481381 learned_addr learned my addr 172.21.15.67:0/1453481381 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fde71640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc02cd80 0x5650cc055bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc0555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 -- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 msgr2=0x5650cc0555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc0555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 -- 172.21.15.67:0/1453481381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc02cd80 msgr2=0x5650cc055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc02cd80 0x5650cc055bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.421+0000 7f60fd670640 1 -- 172.21.15.67:0/1453481381 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650cc0563f0 con 0x5650cc0204d0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f60fd670640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009850 tx=0x7f60f4009690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741814f661b1f215 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f60e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f403d060 con 0x5650cc0204d0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f60f4003a40 con 0x5650cc0204d0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f00047a0 con 0x5650cc0204d0 2024-09-10T20:56:40.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f60f4028040 con 0x5650cc0204d0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f6101ca9740 10 client.25648 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.422+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5650cc0bac30 con 0x5650cc0204d0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f00047a0 con 0x5650cc0204d0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f60f402b040 con 0x5650cc0204d0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 10 client.25648 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 10 client.25648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 20 client.25648 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc0bb300 0x5650cc0bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 4 client.25648 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5650cbf948a0 con 0x5650cc0bb300 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.423+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc0bb300 0x5650cc0bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f60e0ff9640 10 client.25648 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f60fce6f640 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc0bb300 0x5650cc0bd720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ebbedbcecfccd96 server_cookie=bde5b2caeee65fa8 in_seq=0 out_seq=0 2024-09-10T20:56:40.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f60e0ff9640 1 -- 172.21.15.67:0/1453481381 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5650cbf948a0 con 0x5650cc0bb300 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f60e0ff9640 10 client.25648 handle_command_reply: tid=0 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 client.25648 shutdown 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 msgr2=0x5650cc0465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009850 tx=0x7f60f4009690 comp rx=0 tx=0).stop 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 shutdown_connections 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5650cc0bb300 0x5650cc0bd720 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5650cc02cd80 0x5650cc055bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5650cc020df0 0x5650cc0555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 --2- 172.21.15.67:0/1453481381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5650cc0204d0 0x5650cc0465a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 >> 172.21.15.67:0/1453481381 conn(0x5650cc01e300 msgr2=0x5650cc02b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f60e0ff9640 0 client.25648 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:40.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 shutdown_connections 2024-09-10T20:56:40.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.424+0000 7f6101ca9740 1 -- 172.21.15.67:0/1453481381 wait complete. 2024-09-10T20:56:40.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f6101ca9740 20 client.25648 trim_cache size 0 max 16384 2024-09-10T20:56:40.433 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 msgr2=0x7f60e40b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 0x7f60e40b7970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009d30 tx=0x7f60f0005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 msgr2=0x7f60f810c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60ec004af0 tx=0x7f60ec003c20 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 shutdown_connections 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60f8109150 0x7f60f810cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60f81087d0 0x7f60f810c880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60e40b54b0 0x7f60e40b7970 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 --2- 172.21.15.67:0/581225349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f8102dc0 0x7f60f810f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 >> 172.21.15.67:0/581225349 conn(0x7f60f80fe830 msgr2=0x7f60f8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:40.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 shutdown_connections 2024-09-10T20:56:40.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:40.425+0000 7f60ff8d4640 1 -- 172.21.15.67:0/581225349 wait complete. 2024-09-10T20:56:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:40 smithi172 ceph-mon[35265]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-09-10T20:56:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:56:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:56:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:56:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:56:42.280 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:56:42.281 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:56:42.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:42 smithi067 ceph-mon[30891]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 760 op/s 2024-09-10T20:56:42.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:42 smithi083 ceph-mon[35058]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 760 op/s 2024-09-10T20:56:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:42 smithi172 ceph-mon[35265]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.7 MiB/s wr, 760 op/s 2024-09-10T20:56:42.695 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:43.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 -- 172.21.15.67:0/1073747437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb0105f40 msgr2=0x7effb010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 --2- 172.21.15.67:0/1073747437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb0105f40 0x7effb010f960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7effa8009ca0 tx=0x7effa802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 -- 172.21.15.67:0/1073747437 shutdown_connections 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 --2- 172.21.15.67:0/1073747437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb0105f40 0x7effb010f960 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 --2- 172.21.15.67:0/1073747437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb01055a0 0x7effb0105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 --2- 172.21.15.67:0/1073747437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0101250 0x7effb0101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 -- 172.21.15.67:0/1073747437 >> 172.21.15.67:0/1073747437 conn(0x7effb0078140 msgr2=0x7effb00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 -- 172.21.15.67:0/1073747437 shutdown_connections 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.393+0000 7effb7b8c640 1 -- 172.21.15.67:0/1073747437 wait complete. 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.394+0000 7effb7b8c640 1 Processor -- start 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.394+0000 7effb7b8c640 1 -- start start 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.394+0000 7effb7b8c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb0101250 0x7effb019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.394+0000 7effb7b8c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.394+0000 7effb7b8c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0105f40 0x7effb01a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb7b8c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effb0112db0 con 0x7effb01055a0 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb7b8c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7effb0112c30 con 0x7effb0101250 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb7b8c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb0112f30 con 0x7effb0105f40 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50710/0 (socket says 172.21.15.67:50710) 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 -- 172.21.15.67:0/670980264 learned_addr learned my addr 172.21.15.67:0/670980264 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5928640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb0101250 0x7effb019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb6129640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0105f40 0x7effb01a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 -- 172.21.15.67:0/670980264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0105f40 msgr2=0x7effb01a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0105f40 0x7effb01a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 -- 172.21.15.67:0/670980264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb0101250 msgr2=0x7effb019b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb0101250 0x7effb019b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 -- 172.21.15.67:0/670980264 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb01a1520 con 0x7effb01055a0 2024-09-10T20:56:43.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb5127640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7effa000d950 tx=0x7effa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effa6ffd640 1 -- 172.21.15.67:0/670980264 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0017030 con 0x7effb01055a0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb01a1810 con 0x7effb01055a0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effa6ffd640 1 -- 172.21.15.67:0/670980264 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effa0004020 con 0x7effb01055a0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.395+0000 7effa6ffd640 1 -- 172.21.15.67:0/670980264 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00047a0 con 0x7effb01055a0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.396+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb01a7ed0 con 0x7effb01055a0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.399+0000 7effb9f61740 1 Processor -- start 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 -- start start 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55edce718e60 con 0x55edce7b6fa0 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55edce708290 con 0x55edce7a2800 2024-09-10T20:56:43.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb9f61740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edce70c0a0 con 0x55edce7a1ee0 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34028/0 (socket says 172.21.15.67:34028) 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 -- 172.21.15.67:0/1260008509 learned_addr learned my addr 172.21.15.67:0/1260008509 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 -- 172.21.15.67:0/1260008509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 msgr2=0x55edce7a22c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7a22c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.400+0000 7effb5928640 1 -- 172.21.15.67:0/1260008509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 msgr2=0x55edce7b9390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7effb5928640 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b9390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7effb5928640 1 -- 172.21.15.67:0/1260008509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edce466930 con 0x55edce7a2800 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7effb5928640 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effac009d20 tx=0x7effac011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569bc7de40500141 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7effa6ffd640 1 -- 172.21.15.67:0/670980264 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7effa0009a30 con 0x7effb01055a0 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7eff9bfff640 1 -- 172.21.15.67:0/1260008509 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac01e070 con 0x55edce7a2800 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7eff9bfff640 1 -- 172.21.15.67:0/1260008509 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effac019ae0 con 0x55edce7a2800 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.401+0000 7eff9bfff640 1 -- 172.21.15.67:0/1260008509 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac00ea80 con 0x55edce7a2800 2024-09-10T20:56:43.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.402+0000 7effb9f61740 1 -- 172.21.15.67:0/1260008509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 msgr2=0x55edce7b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.402+0000 7effb9f61740 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effac009d20 tx=0x7effac011810 comp rx=0 tx=0).stop 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.402+0000 7effa6ffd640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 0x7eff9c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.402+0000 7effa6ffd640 1 -- 172.21.15.67:0/670980264 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7effa00e5590 con 0x7effb01055a0 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 -- 172.21.15.67:0/1260008509 shutdown_connections 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b6a60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 --2- 172.21.15.67:0/1260008509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 -- 172.21.15.67:0/1260008509 >> 172.21.15.67:0/1260008509 conn(0x55edce79fd10 msgr2=0x55edce7a0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb6129640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 0x7eff9c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 -- 172.21.15.67:0/1260008509 shutdown_connections 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 -- 172.21.15.67:0/1260008509 wait complete. 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb6129640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 0x7eff9c0b7820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7effa8009430 tx=0x7effa80093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 -- start start 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.403+0000 7effb9f61740 1 Processor -- start 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55edce569890 con 0x55edce7b6fa0 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55edce6a2d40 con 0x55edce7a2800 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edce7b9c20 con 0x55edce7a1ee0 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb9f61740 10 client.0 _ll_register_callbacks cb 0x55edce706c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb5127640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb5127640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34040/0 (socket says 172.21.15.67:34040) 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb5127640 1 -- 172.21.15.67:0/1192686260 learned_addr learned my addr 172.21.15.67:0/1192686260 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:43.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb5928640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.404+0000 7effb6129640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 -- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 msgr2=0x55edce7b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 -- 172.21.15.67:0/1192686260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 msgr2=0x55edce7b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 -- 172.21.15.67:0/1192686260 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edce7c3100 con 0x55edce7a1ee0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5127640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb5928640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7b4060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effac01c040 tx=0x7effac004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da3558f9dff71695 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7eff997fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac01e050 con 0x55edce7a1ee0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effac019ae0 con 0x55edce7a1ee0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.405+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7effac019430 con 0x55edce7a1ee0 2024-09-10T20:56:43.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.406+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7effac0098f0 con 0x55edce7a1ee0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.406+0000 7effb9f61740 10 client.25657 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.406+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edce7c5ab0 con 0x55edce7a1ee0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.406+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effac019ae0 con 0x55edce7a1ee0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7effac0035f0 con 0x55edce7a1ee0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 10 client.25657 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 10 client.25657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 20 client.25657 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce7c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 4 client.25657 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edce71adb0 con 0x55edce7c71a0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.407+0000 7effb5127640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce7c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.408+0000 7eff997fa640 10 client.25657 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.408+0000 7effb5127640 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce7c9620 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c383afd4e892ef server_cookie=4d4d6a64f5d3c616 in_seq=0 out_seq=0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.409+0000 7eff997fa640 1 -- 172.21.15.67:0/1192686260 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edce71adb0 con 0x55edce7c71a0 2024-09-10T20:56:43.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.409+0000 7eff997fa640 10 client.25657 handle_command_reply: tid=0 2024-09-10T20:56:43.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.409+0000 7effb9f61740 1 client.25657 shutdown 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.409+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 msgr2=0x55edce7b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.409+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7b4060 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7effac01c040 tx=0x7effac004270 comp rx=0 tx=0).stop 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 shutdown_connections 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce7c9620 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7eff997fa640 0 client.25657 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7b6fa0 0x55edce7b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7a2800 0x55edce7b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 --2- 172.21.15.67:0/1192686260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a1ee0 0x55edce7b4060 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 >> 172.21.15.67:0/1192686260 conn(0x55edce79fd10 msgr2=0x55edce79ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 shutdown_connections 2024-09-10T20:56:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 1 -- 172.21.15.67:0/1192686260 wait complete. 2024-09-10T20:56:43.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.410+0000 7effb9f61740 20 client.25657 trim_cache size 0 max 16384 2024-09-10T20:56:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 Processor -- start 2024-09-10T20:56:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 -- start start 2024-09-10T20:56:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effb01aea60 con 0x55edce7a1ee0 2024-09-10T20:56:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7effb01ac330 con 0x55edce7b6fa0 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb9f61740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb01aa120 con 0x55edce7a2800 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.435+0000 7effb6129640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34044/0 (socket says 172.21.15.67:34044) 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 -- 172.21.15.67:0/3528420362 learned_addr learned my addr 172.21.15.67:0/3528420362 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb5928640 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb5127640 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 -- 172.21.15.67:0/3528420362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 msgr2=0x55edce7b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 -- 172.21.15.67:0/3528420362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 msgr2=0x55edce7b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 -- 172.21.15.67:0/3528420362 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edce7b7d40 con 0x55edce7b6fa0 2024-09-10T20:56:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.436+0000 7effb6129640 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7effa8031bf0 tx=0x7effa803b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca998d5923bac708 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.437+0000 7eff9b7fe640 1 -- 172.21.15.67:0/3528420362 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8055070 con 0x55edce7b6fa0 2024-09-10T20:56:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.437+0000 7eff9b7fe640 1 -- 172.21.15.67:0/3528420362 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effa8003e20 con 0x55edce7b6fa0 2024-09-10T20:56:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.437+0000 7eff9b7fe640 1 -- 172.21.15.67:0/3528420362 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa802f660 con 0x55edce7b6fa0 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.438+0000 7effb9f61740 1 -- 172.21.15.67:0/3528420362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 msgr2=0x55edce7cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.438+0000 7effb9f61740 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7effa8031bf0 tx=0x7effa803b000 comp rx=0 tx=0).stop 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 -- 172.21.15.67:0/3528420362 shutdown_connections 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7cef30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 --2- 172.21.15.67:0/3528420362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 -- 172.21.15.67:0/3528420362 >> 172.21.15.67:0/3528420362 conn(0x55edce79fd10 msgr2=0x55edce7b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 -- 172.21.15.67:0/3528420362 shutdown_connections 2024-09-10T20:56:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 -- 172.21.15.67:0/3528420362 wait complete. 2024-09-10T20:56:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.439+0000 7effb9f61740 1 -- start start 2024-09-10T20:56:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 Processor -- start 2024-09-10T20:56:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7bf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7effb01aa7f0 con 0x55edce7a1ee0 2024-09-10T20:56:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7effb01abc60 con 0x55edce7b6fa0 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb01aaec0 con 0x55edce7a2800 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.440+0000 7effb9f61740 10 client.0 _ll_register_callbacks cb 0x7effac01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb5928640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb5127640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb5928640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50752/0 (socket says 172.21.15.67:50752) 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb5928640 1 -- 172.21.15.67:0/2436204114 learned_addr learned my addr 172.21.15.67:0/2436204114 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 -- 172.21.15.67:0/2436204114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 msgr2=0x55edce7bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 -- 172.21.15.67:0/2436204114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 msgr2=0x55edce7beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7beec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 -- 172.21.15.67:0/2436204114 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edce7ba3b0 con 0x55edce7b6fa0 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb5127640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb6129640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7b9e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7effa8005e30 tx=0x7effa8031f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee8edd7010b1cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7eff997fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa805f060 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7effa8003b70 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.441+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa8003e20 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7effa8055070 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 10 client.25679 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edce834880 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effa8003e20 con 0x55edce7b6fa0 2024-09-10T20:56:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7effa8043040 con 0x55edce7b6fa0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 10 client.25679 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 20 client.25679 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce836ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 4 client.25679 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55edce716860 con 0x55edce7c71a0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.442+0000 7effb5928640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce836ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.443+0000 7eff997fa640 10 client.25679 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.443+0000 7effb5928640 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce836ec0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc0f51bcb368d18 server_cookie=3b45d0495bc491d8 in_seq=0 out_seq=0 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.444+0000 7eff997fa640 1 -- 172.21.15.67:0/2436204114 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55edce716860 con 0x55edce7c71a0 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.444+0000 7eff997fa640 10 client.25679 handle_command_reply: tid=0 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.444+0000 7effb9f61740 1 client.25679 shutdown 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.444+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 msgr2=0x55edce7b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.444+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7b9e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7effa8005e30 tx=0x7effa8031f10 comp rx=0 tx=0).stop 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 shutdown_connections 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55edce7c71a0 0x55edce836ec0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edce7b6fa0 0x55edce7b9e70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edce7a2800 0x55edce7bf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7eff997fa640 0 client.25679 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 --2- 172.21.15.67:0/2436204114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55edce7a1ee0 0x55edce7beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 >> 172.21.15.67:0/2436204114 conn(0x55edce79fd10 msgr2=0x55edce7c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 shutdown_connections 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.446+0000 7effb9f61740 1 -- 172.21.15.67:0/2436204114 wait complete. 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.447+0000 7effb9f61740 20 client.25679 trim_cache size 0 max 16384 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "ded77e3f-35e5-4ca0-b02b-666b66695112", 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:56:43.453 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:56:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.447+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 msgr2=0x7eff9c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.447+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 0x7eff9c0b7820 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7effa8009430 tx=0x7effa80093a0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 msgr2=0x7effb019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7effa000d950 tx=0x7effa000de10 comp rx=0 tx=0).stop 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 shutdown_connections 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7eff9c0b5360 0x7eff9c0b7820 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb0105f40 0x7effb01a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effb01055a0 0x7effb019b9b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 --2- 172.21.15.67:0/670980264 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7effb0101250 0x7effb019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 >> 172.21.15.67:0/670980264 conn(0x7effb0078140 msgr2=0x7effb0108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 shutdown_connections 2024-09-10T20:56:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:43.448+0000 7effb7b8c640 1 -- 172.21.15.67:0/670980264 wait complete. 2024-09-10T20:56:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 310.0 s, 2403.6 tps, lat 40.598 ms stddev 44.130 2024-09-10T20:56:44.151 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.3 MiB/s wr, 790 op/s 2024-09-10T20:56:44.151 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:56:44.151 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.152 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:56:44.152 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:56:44.152 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:44 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:56:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.3 MiB/s wr, 790 op/s 2024-09-10T20:56:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:56:44.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:56:44.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:56:44.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:44 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.3 MiB/s wr, 790 op/s 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:56:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:44 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:56:45.131 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:45 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:56:45.131 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:45 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:45.131 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:45 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 -- 172.21.15.67:0/1798420466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a150 msgr2=0x7fbadc1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 --2- 172.21.15.67:0/1798420466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a150 0x7fbadc1111b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009860 tx=0x7fbad802a340 comp rx=0 tx=0).stop 2024-09-10T20:56:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 -- 172.21.15.67:0/1798420466 shutdown_connections 2024-09-10T20:56:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 --2- 172.21.15.67:0/1798420466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 --2- 172.21.15.67:0/1798420466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a530 0x7fbadc10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 --2- 172.21.15.67:0/1798420466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a150 0x7fbadc1111b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.277+0000 7fbae225e640 1 -- 172.21.15.67:0/1798420466 >> 172.21.15.67:0/1798420466 conn(0x7fbadc06cb30 msgr2=0x7fbadc06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.278+0000 7fbae225e640 1 -- 172.21.15.67:0/1798420466 shutdown_connections 2024-09-10T20:56:45.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.278+0000 7fbae225e640 1 -- 172.21.15.67:0/1798420466 wait complete. 2024-09-10T20:56:45.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.278+0000 7fbae225e640 1 Processor -- start 2024-09-10T20:56:45.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 -- start start 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a150 0x7fbadc1a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 0x7fbadc1a8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc121a50 con 0x7fbadc10a530 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1218d0 con 0x7fbadc11c0a0 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae225e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc121bd0 con 0x7fbadc10a150 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 0x7fbadc1a8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae1a5d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae1a5d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34074/0 (socket says 172.21.15.67:34074) 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 0x7fbadc1a8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50782/0 (socket says 172.21.15.67:50782) 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae1a5d640 1 -- 172.21.15.67:0/104482888 learned_addr learned my addr 172.21.15.67:0/104482888 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.279+0000 7fbae125c640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a150 0x7fbadc1a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 -- 172.21.15.67:0/104482888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a150 msgr2=0x7fbadc1a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a150 0x7fbadc1a7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 -- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 msgr2=0x7fbadc1a8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 0x7fbadc1a8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 -- 172.21.15.67:0/104482888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc1adf70 con 0x7fbadc11c0a0 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbae1a5d640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbad400eb10 tx=0x7fbad400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbad27fc640 1 -- 172.21.15.67:0/104482888 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4004b20 con 0x7fbadc11c0a0 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.280+0000 7fbad27fc640 1 -- 172.21.15.67:0/104482888 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad4004cc0 con 0x7fbadc11c0a0 2024-09-10T20:56:45.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.281+0000 7fbad27fc640 1 -- 172.21.15.67:0/104482888 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4010720 con 0x7fbadc11c0a0 2024-09-10T20:56:45.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.281+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc1ae260 con 0x7fbadc11c0a0 2024-09-10T20:56:45.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.281+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc1b4920 con 0x7fbadc11c0a0 2024-09-10T20:56:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.285+0000 7fbae5895740 1 Processor -- start 2024-09-10T20:56:45.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbad27fc640 1 -- 172.21.15.67:0/104482888 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbad4005020 con 0x7fbadc11c0a0 2024-09-10T20:56:45.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 -- start start 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 0x55a5d7b819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a5d7aebe50 con 0x55a5d7b81f00 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a5d7adb280 con 0x55a5d7b75650 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.286+0000 7fbae5895740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5d7adf090 con 0x55a5d7b75f70 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34090/0 (socket says 172.21.15.67:34090) 2024-09-10T20:56:45.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1094923683 learned_addr learned my addr 172.21.15.67:0/1094923683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae125c640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 0x55a5d7b819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1094923683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 msgr2=0x55a5d7b819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 0x55a5d7b819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1094923683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 msgr2=0x55a5d7b842f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b842f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1094923683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d7839650 con 0x55a5d7b75650 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbae125c640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 0x55a5d7b819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.287+0000 7fbad27fc640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 0x7fbac80b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.288+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0058c0 tx=0x7fbacc005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261bce7dbeb4932a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.288+0000 7fbad27fc640 1 -- 172.21.15.67:0/104482888 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbad40e60f0 con 0x7fbadc11c0a0 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.288+0000 7fbae125c640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 0x7fbac80b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.288+0000 7fbac77fe640 1 -- 172.21.15.67:0/1094923683 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004020 con 0x55a5d7b75650 2024-09-10T20:56:45.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.288+0000 7fbac77fe640 1 -- 172.21.15.67:0/1094923683 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbacc0054d0 con 0x55a5d7b75650 2024-09-10T20:56:45.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbac77fe640 1 -- 172.21.15.67:0/1094923683 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004ba0 con 0x55a5d7b75650 2024-09-10T20:56:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 -- 172.21.15.67:0/1094923683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 msgr2=0x55a5d7b75a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0058c0 tx=0x7fbacc005850 comp rx=0 tx=0).stop 2024-09-10T20:56:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 -- 172.21.15.67:0/1094923683 shutdown_connections 2024-09-10T20:56:45.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75f70 0x55a5d7b819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 --2- 172.21.15.67:0/1094923683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b75a30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.289+0000 7fbae5895740 1 -- 172.21.15.67:0/1094923683 >> 172.21.15.67:0/1094923683 conn(0x55a5d7b73480 msgr2=0x55a5d7b74620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.290+0000 7fbae125c640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 0x7fbac80b7a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009830 tx=0x7fbad8030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.290+0000 7fbae5895740 1 -- 172.21.15.67:0/1094923683 shutdown_connections 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.290+0000 7fbae5895740 1 -- 172.21.15.67:0/1094923683 wait complete. 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.290+0000 7fbae5895740 1 -- start start 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.290+0000 7fbae5895740 1 Processor -- start 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b81840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b7f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a5d793c700 con 0x55a5d7b75f70 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a5d7a76110 con 0x55a5d7b75650 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5d7b84bd0 con 0x55a5d7b81f00 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae5895740 10 client.0 _ll_register_callbacks cb 0x55a5d7a8f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae0a5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50800/0 (socket says 172.21.15.67:50800) 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.291+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1109351629 learned_addr learned my addr 172.21.15.67:0/1109351629 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1109351629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 msgr2=0x55a5d7b7f310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b7f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 msgr2=0x55a5d7b81840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b81840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1109351629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d7aa3c40 con 0x55a5d7b75f70 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbacc005490 tx=0x7fbacc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e0b37676cae68b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.292+0000 7fbac4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0046c0 con 0x55a5d7b75f70 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbacc004b30 con 0x55a5d7b75f70 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbacc0054d0 con 0x55a5d7b75f70 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbacc004d30 con 0x55a5d7b75f70 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbae5895740 10 client.16029 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:45.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.293+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a5d7b90510 con 0x55a5d7b75f70 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbacc0054d0 con 0x55a5d7b75f70 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbacc01d030 con 0x55a5d7b75f70 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 10 client.16029 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 20 client.16029 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7b91860 0x55a5d7b93c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 4 client.16029 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d7aedda0 con 0x55a5d7b91860 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.294+0000 7fbae125c640 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7b91860 0x55a5d7b93c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.295+0000 7fbac4ff9640 10 client.16029 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.295+0000 7fbae125c640 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7b91860 0x55a5d7b93c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcce328f977e2314 server_cookie=e82a87315f7d2917 in_seq=0 out_seq=0 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.296+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1109351629 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a5d7aedda0 con 0x55a5d7b91860 2024-09-10T20:56:45.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.296+0000 7fbac4ff9640 10 client.16029 handle_command_reply: tid=0 2024-09-10T20:56:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.296+0000 7fbae5895740 1 client.16029 shutdown 2024-09-10T20:56:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.296+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 msgr2=0x55a5d7b7ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.296+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbacc005490 tx=0x7fbacc009260 comp rx=0 tx=0).stop 2024-09-10T20:56:45.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 shutdown_connections 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7b91860 0x55a5d7b93c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b7f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b7ec90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 --2- 172.21.15.67:0/1109351629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b81840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 >> 172.21.15.67:0/1109351629 conn(0x55a5d7b73480 msgr2=0x55a5d7b78ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbac4ff9640 0 client.16029 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 shutdown_connections 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.297+0000 7fbae5895740 1 -- 172.21.15.67:0/1109351629 wait complete. 2024-09-10T20:56:45.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.298+0000 7fbae5895740 20 client.16029 trim_cache size 0 max 16384 2024-09-10T20:56:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.331+0000 7fbae5895740 1 Processor -- start 2024-09-10T20:56:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.331+0000 7fbae5895740 1 -- start start 2024-09-10T20:56:45.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.331+0000 7fbae5895740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 0x55a5d7b72e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae5895740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 0x55a5d7b809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae5895740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae5895740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1bf6b0 con 0x55a5d7b81f00 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae5895740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1bcf80 con 0x55a5d7b75f70 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae5895740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1badd0 con 0x55a5d7b75650 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae125c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 0x55a5d7b72e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae125c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 0x55a5d7b72e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36124/0 (socket says 172.21.15.67:36124) 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae1a5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae125c640 1 -- 172.21.15.67:0/1078201605 learned_addr learned my addr 172.21.15.67:0/1078201605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 0x55a5d7b809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1078201605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 msgr2=0x55a5d7b72e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 0x55a5d7b72e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1078201605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 msgr2=0x55a5d7b832f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b832f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 -- 172.21.15.67:0/1078201605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d7b7d190 con 0x55a5d7b75f70 2024-09-10T20:56:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.332+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 0x55a5d7b809d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbacc033590 tx=0x7fbacc0116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e1ca8b87eb3e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.333+0000 7fbac6ffd640 1 -- 172.21.15.67:0/1078201605 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004b30 con 0x55a5d7b75f70 2024-09-10T20:56:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.333+0000 7fbac6ffd640 1 -- 172.21.15.67:0/1078201605 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbacc0096e0 con 0x55a5d7b75f70 2024-09-10T20:56:45.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.333+0000 7fbac6ffd640 1 -- 172.21.15.67:0/1078201605 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc009ab0 con 0x55a5d7b75f70 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.334+0000 7fbae5895740 1 -- 172.21.15.67:0/1078201605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 msgr2=0x55a5d7b809d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.334+0000 7fbae5895740 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 0x55a5d7b809d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbacc033590 tx=0x7fbacc0116c0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 -- 172.21.15.67:0/1078201605 shutdown_connections 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b81f00 0x55a5d7b832f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75f70 0x55a5d7b809d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 --2- 172.21.15.67:0/1078201605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b75650 0x55a5d7b72e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 -- 172.21.15.67:0/1078201605 >> 172.21.15.67:0/1078201605 conn(0x55a5d7b73480 msgr2=0x55a5d7b802c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 -- 172.21.15.67:0/1078201605 shutdown_connections 2024-09-10T20:56:45.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.335+0000 7fbae5895740 1 -- 172.21.15.67:0/1078201605 wait complete. 2024-09-10T20:56:45.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.336+0000 7fbae5895740 1 -- start start 2024-09-10T20:56:45.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.336+0000 7fbae5895740 1 Processor -- start 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.336+0000 7fbae5895740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.336+0000 7fbae5895740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae5895740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b99d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:34116/0 (socket says 172.21.15.67:34116) 2024-09-10T20:56:45.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 -- 172.21.15.67:0/1821044002 learned_addr learned my addr 172.21.15.67:0/1821044002 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1bb440 con 0x55a5d7b75f70 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1bc8b0 con 0x55a5d7b75650 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc1bbb10 con 0x55a5d7b81f00 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae5895740 10 client.0 _ll_register_callbacks cb 0x7fbacc009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae1a5d640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b99d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 -- 172.21.15.67:0/1821044002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 msgr2=0x55a5d7b99d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b99d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 -- 172.21.15.67:0/1821044002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 msgr2=0x55a5d7b997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.337+0000 7fbae125c640 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d7b86370 con 0x55a5d7b75650 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbae125c640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbad80095f0 tx=0x7fbad8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b44116ab6af843 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:56:45.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbac4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8059060 con 0x55a5d7b75650 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbad80307d0 con 0x55a5d7b75650 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbacc0096e0 con 0x55a5d7b75650 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbad8037040 con 0x55a5d7b75650 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.338+0000 7fbae5895740 10 client.25694 fetch_fsmap learned FSMap version 34 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a5d7bfe8d0 con 0x55a5d7b75650 2024-09-10T20:56:45.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbacc0096e0 con 0x55a5d7b75650 2024-09-10T20:56:45.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbad8053070 con 0x55a5d7b75650 2024-09-10T20:56:45.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 10 client.25694 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:56:45.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:56:45.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 20 client.25694 populate_metadata read hostname 'smithi067' 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7bff030 0x55a5d7c01450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 4 client.25694 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.339+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5d7ae9850 con 0x55a5d7bff030 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.340+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7bff030 0x55a5d7c01450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.340+0000 7fbac4ff9640 10 client.25694 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.340+0000 7fbae0a5b640 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7bff030 0x55a5d7c01450 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb8ed906d09654d server_cookie=16a39d58c4d05f9a in_seq=0 out_seq=0 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.340+0000 7fbac4ff9640 1 -- 172.21.15.67:0/1821044002 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55a5d7ae9850 con 0x55a5d7bff030 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.340+0000 7fbac4ff9640 10 client.25694 handle_command_reply: tid=0 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.341+0000 7fbae5895740 1 client.25694 shutdown 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.341+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 msgr2=0x55a5d7b992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.341+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbad80095f0 tx=0x7fbad8005f90 comp rx=0 tx=0).stop 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 shutdown_connections 2024-09-10T20:56:45.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a5d7bff030 0x55a5d7c01450 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbac4ff9640 0 client.25694 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5d7b81f00 0x55a5d7b99d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a5d7b75f70 0x55a5d7b997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 --2- 172.21.15.67:0/1821044002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a5d7b75650 0x55a5d7b992b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 >> 172.21.15.67:0/1821044002 conn(0x55a5d7b73480 msgr2=0x55a5d7b80ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 shutdown_connections 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.342+0000 7fbae5895740 1 -- 172.21.15.67:0/1821044002 wait complete. 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.343+0000 7fbae5895740 20 client.25694 trim_cache size 0 max 16384 2024-09-10T20:56:45.350 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "ded77e3f-35e5-4ca0-b02b-666b66695112", 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:56:45.351 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:56:45.352 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.353 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:56:45.355 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.357 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:56:45.359 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 msgr2=0x7fbac80b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 0x7fbac80b7a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009830 tx=0x7fbad8030340 comp rx=0 tx=0).stop 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 msgr2=0x7fbadc1ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbad400eb10 tx=0x7fbad400c2d0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 shutdown_connections 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbadc11c0a0 0x7fbadc1ad7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbadc10a530 0x7fbadc1a8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbac80b5560 0x7fbac80b7a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 --2- 172.21.15.67:0/104482888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbadc10a150 0x7fbadc1a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:56:45.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.344+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 >> 172.21.15.67:0/104482888 conn(0x7fbadc06cb30 msgr2=0x7fbadc11c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:56:45.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.345+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 shutdown_connections 2024-09-10T20:56:45.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:56:45.346+0000 7fbae225e640 1 -- 172.21.15.67:0/104482888 wait complete. 2024-09-10T20:56:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:45 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:56:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:45 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:45.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:45 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:45.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:45 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:56:45.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:45 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:45.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:45 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:56:46.082 INFO:tasks.cephfs.filesystem:scrub status for tag:ded77e3f-35e5-4ca0-b02b-666b66695112 - {'path': '/', 'tag': 'ded77e3f-35e5-4ca0-b02b-666b66695112', 'options': 'recursive,force'} 2024-09-10T20:56:46.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:46 smithi067 ceph-mon[30891]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-10T20:56:46.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:46 smithi083 ceph-mon[35058]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-10T20:56:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:46 smithi172 ceph-mon[35265]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 772 op/s 2024-09-10T20:56:48.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:48 smithi067 ceph-mon[30891]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-09-10T20:56:48.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:48 smithi083 ceph-mon[35058]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-09-10T20:56:48.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:48 smithi172 ceph-mon[35265]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 822 op/s 2024-09-10T20:56:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 315.0 s, 3724.0 tps, lat 27.486 ms stddev 34.180 2024-09-10T20:56:50.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:50 smithi067 ceph-mon[30891]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 664 op/s 2024-09-10T20:56:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:50 smithi083 ceph-mon[35058]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 664 op/s 2024-09-10T20:56:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:50 smithi172 ceph-mon[35265]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 664 op/s 2024-09-10T20:56:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:52 smithi083 ceph-mon[35058]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-09-10T20:56:52.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:52 smithi172 ceph-mon[35265]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-09-10T20:56:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:52 smithi067 ceph-mon[30891]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 666 op/s 2024-09-10T20:56:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 320.0 s, 2573.8 tps, lat 38.447 ms stddev 42.280 2024-09-10T20:56:54.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:54 smithi083 ceph-mon[35058]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 776 op/s 2024-09-10T20:56:54.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:54 smithi172 ceph-mon[35265]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 776 op/s 2024-09-10T20:56:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:54 smithi067 ceph-mon[30891]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 776 op/s 2024-09-10T20:56:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:56 smithi083 ceph-mon[35058]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 752 op/s 2024-09-10T20:56:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:56 smithi172 ceph-mon[35265]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 752 op/s 2024-09-10T20:56:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:56.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:56 smithi067 ceph-mon[30891]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 752 op/s 2024-09-10T20:56:56.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:56.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:57.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:57 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:56:57.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:57 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:56:57.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:57 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:56:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:56:58 smithi083 ceph-mon[35058]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:56:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:56:58 smithi172 ceph-mon[35265]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:56:58.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:56:58 smithi067 ceph-mon[30891]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 749 op/s 2024-09-10T20:56:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 325.0 s, 3063.0 tps, lat 32.703 ms stddev 35.929 2024-09-10T20:57:00.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:00 smithi083 ceph-mon[35058]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 666 op/s 2024-09-10T20:57:00.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:00 smithi172 ceph-mon[35265]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 666 op/s 2024-09-10T20:57:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:00 smithi067 ceph-mon[30891]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 666 op/s 2024-09-10T20:57:02.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:02 smithi083 ceph-mon[35058]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.4 MiB/s wr, 669 op/s 2024-09-10T20:57:02.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:02 smithi172 ceph-mon[35265]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.4 MiB/s wr, 669 op/s 2024-09-10T20:57:02.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:02 smithi067 ceph-mon[30891]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7.4 MiB/s wr, 669 op/s 2024-09-10T20:57:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 330.0 s, 2671.8 tps, lat 37.485 ms stddev 38.419 2024-09-10T20:57:04.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:04 smithi083 ceph-mon[35058]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 8.4 MiB/s wr, 791 op/s 2024-09-10T20:57:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:04 smithi172 ceph-mon[35265]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 8.4 MiB/s wr, 791 op/s 2024-09-10T20:57:04.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:04 smithi067 ceph-mon[30891]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 8.4 MiB/s wr, 791 op/s 2024-09-10T20:57:06.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:06 smithi083 ceph-mon[35058]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-09-10T20:57:06.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:06 smithi172 ceph-mon[35265]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-09-10T20:57:06.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:06 smithi067 ceph-mon[30891]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-09-10T20:57:08.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:08 smithi083 ceph-mon[35058]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.3 MiB/s wr, 717 op/s 2024-09-10T20:57:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:08 smithi172 ceph-mon[35265]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.3 MiB/s wr, 717 op/s 2024-09-10T20:57:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:08 smithi067 ceph-mon[30891]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.3 MiB/s wr, 717 op/s 2024-09-10T20:57:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 335.0 s, 2578.6 tps, lat 38.684 ms stddev 44.282 2024-09-10T20:57:10.347 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:10 smithi067 ceph-mon[30891]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2024-09-10T20:57:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:10 smithi083 ceph-mon[35058]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2024-09-10T20:57:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:10 smithi172 ceph-mon[35265]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 672 op/s 2024-09-10T20:57:12.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:12 smithi083 ceph-mon[35058]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-09-10T20:57:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:12 smithi172 ceph-mon[35265]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-09-10T20:57:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:12 smithi067 ceph-mon[30891]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.4 MiB/s wr, 692 op/s 2024-09-10T20:57:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 340.0 s, 2369.8 tps, lat 42.347 ms stddev 45.353 2024-09-10T20:57:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:14 smithi083 ceph-mon[35058]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 MiB/s wr, 769 op/s 2024-09-10T20:57:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:14 smithi172 ceph-mon[35265]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 MiB/s wr, 769 op/s 2024-09-10T20:57:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:14 smithi067 ceph-mon[30891]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.0 MiB/s wr, 769 op/s 2024-09-10T20:57:16.083 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:57:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:16 smithi083 ceph-mon[35058]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 681 op/s 2024-09-10T20:57:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:16 smithi172 ceph-mon[35265]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 681 op/s 2024-09-10T20:57:16.482 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:16 smithi067 ceph-mon[30891]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.1 MiB/s wr, 681 op/s 2024-09-10T20:57:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.086+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/2705211811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810a9d0 msgr2=0x7f2e6810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.086+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/2705211811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810a9d0 0x7f2e6810ae10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009900 tx=0x7f2e6402a410 comp rx=0 tx=0).stop 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/2705211811 shutdown_connections 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/2705211811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e6810b350 0x7f2e68111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/2705211811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810a9d0 0x7f2e6810ae10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/2705211811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e68104fc0 0x7f2e681053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/2705211811 >> 172.21.15.67:0/2705211811 conn(0x7f2e681009f0 msgr2=0x7f2e68102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/2705211811 shutdown_connections 2024-09-10T20:57:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.087+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/2705211811 wait complete. 2024-09-10T20:57:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 Processor -- start 2024-09-10T20:57:17.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 -- start start 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 0x7f2e6819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 0x7f2e6819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810b350 0x7f2e681a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e68114f50 con 0x7f2e68104fc0 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e68114dd0 con 0x7f2e6810a9d0 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.088+0000 7f2e6ff1e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681150d0 con 0x7f2e6810b350 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6dcba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 0x7f2e6819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6dcba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 0x7f2e6819b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40398/0 (socket says 172.21.15.67:40398) 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6dcba640 1 -- 172.21.15.67:0/1170923388 learned_addr learned my addr 172.21.15.67:0/1170923388 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810b350 0x7f2e681a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 0x7f2e6819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/1170923388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810b350 msgr2=0x7f2e681a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810b350 0x7f2e681a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 msgr2=0x7f2e6819b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.089+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 0x7f2e6819b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.090+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/1170923388 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e681a14b0 con 0x7f2e6810a9d0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.090+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 0x7f2e6819b940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e6402a930 tx=0x7f2e640045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.090+0000 7f2e5effd640 1 -- 172.21.15.67:0/1170923388 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64040070 con 0x7f2e6810a9d0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.090+0000 7f2e5effd640 1 -- 172.21.15.67:0/1170923388 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e640316d0 con 0x7f2e6810a9d0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.090+0000 7f2e5effd640 1 -- 172.21.15.67:0/1170923388 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64035020 con 0x7f2e6810a9d0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.091+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e681a1740 con 0x7f2e6810a9d0 2024-09-10T20:57:17.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.091+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e681a7e60 con 0x7f2e6810a9d0 2024-09-10T20:57:17.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.094+0000 7f2e5effd640 1 -- 172.21.15.67:0/1170923388 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2e6403a040 con 0x7f2e6810a9d0 2024-09-10T20:57:17.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.096+0000 7f2e722f3740 1 Processor -- start 2024-09-10T20:57:17.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 -- start start 2024-09-10T20:57:17.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39def480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39dfb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39dfdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564c39d65e50 con 0x564c39def9c0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c39d55280 con 0x564c39def0a0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e722f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c39d59090 con 0x564c39dfb950 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e5effd640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 0x7f2e540b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6dcba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39dfb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6dcba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39dfb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40412/0 (socket says 172.21.15.67:40412) 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6dcba640 1 -- 172.21.15.67:0/3342872226 learned_addr learned my addr 172.21.15.67:0/3342872226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39def480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39dfdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e5effd640 1 -- 172.21.15.67:0/1170923388 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2e64107410 con 0x7f2e6810a9d0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.097+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 0x7f2e540b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 -- 172.21.15.67:0/3342872226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 msgr2=0x564c39dfdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39dfdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 -- 172.21.15.67:0/3342872226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 msgr2=0x564c39dfb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39dfb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 -- 172.21.15.67:0/3342872226 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c39ab3650 con 0x564c39def0a0 2024-09-10T20:57:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39def480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2e600129b0 tx=0x7f2e60012e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=474f7ab8c8c73293 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.098+0000 7f2e53fff640 1 -- 172.21.15.67:0/3342872226 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60021030 con 0x564c39def0a0 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.099+0000 7f2e53fff640 1 -- 172.21.15.67:0/3342872226 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e60010c10 con 0x564c39def0a0 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.099+0000 7f2e53fff640 1 -- 172.21.15.67:0/3342872226 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000e650 con 0x564c39def0a0 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 -- 172.21.15.67:0/3342872226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 msgr2=0x564c39def480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39def480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2e600129b0 tx=0x7f2e60012e70 comp rx=0 tx=0).stop 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e6e4bb640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 0x7f2e540b78a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e60021000 tx=0x7f2e6000eca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 -- 172.21.15.67:0/3342872226 shutdown_connections 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39dfdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39dfb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3342872226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39def480 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.100+0000 7f2e722f3740 1 -- 172.21.15.67:0/3342872226 >> 172.21.15.67:0/3342872226 conn(0x564c39deced0 msgr2=0x564c39dee070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.101+0000 7f2e722f3740 1 -- 172.21.15.67:0/3342872226 shutdown_connections 2024-09-10T20:57:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.101+0000 7f2e722f3740 1 -- 172.21.15.67:0/3342872226 wait complete. 2024-09-10T20:57:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.102+0000 7f2e722f3740 1 -- start start 2024-09-10T20:57:17.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.102+0000 7f2e722f3740 1 Processor -- start 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 0x564c39dfb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def9c0 0x564c39df85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39df8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564c39bb6700 con 0x564c39def0a0 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564c39cf0110 con 0x564c39def9c0 2024-09-10T20:57:17.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c39dfe670 con 0x564c39dfb950 2024-09-10T20:57:17.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e722f3740 10 client.0 _ll_register_callbacks cb 0x564c39d09990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:17.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e6e4bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39df8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e6e4bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39df8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51650/0 (socket says 172.21.15.67:51650) 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e6e4bb640 1 -- 172.21.15.67:0/3530392763 learned_addr learned my addr 172.21.15.67:0/3530392763 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.103+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 0x564c39dfb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.104+0000 7f2e6dcba640 1 -- 172.21.15.67:0/3530392763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 msgr2=0x564c39df8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.104+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39df8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.104+0000 7f2e6dcba640 1 -- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def9c0 msgr2=0x564c39df85b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.104+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def9c0 0x564c39df85b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.104+0000 7f2e6dcba640 1 -- 172.21.15.67:0/3530392763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c39d1dc40 con 0x564c39def0a0 2024-09-10T20:57:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.105+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 0x564c39dfb160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2e58004650 tx=0x7f2e58012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e641974f9f6729cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.105+0000 7f2e517fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:57:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.109+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800f8c0 con 0x564c39def0a0 2024-09-10T20:57:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.110+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2e5800fa60 con 0x564c39def0a0 2024-09-10T20:57:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.110+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e60010c10 con 0x564c39def0a0 2024-09-10T20:57:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.111+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2e5800fc60 con 0x564c39def0a0 2024-09-10T20:57:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.111+0000 7f2e722f3740 10 client.16047 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.111+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564c39e12780 con 0x564c39def0a0 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.111+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e60010c10 con 0x564c39def0a0 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2e58027420 con 0x564c39def0a0 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 10 client.16047 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 20 client.16047 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e16110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 4 client.16047 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:17.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c39d67da0 con 0x564c39e13ce0 2024-09-10T20:57:17.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e16110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e517fa640 10 client.16047 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:17.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.112+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e16110 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a791a08f7544910e server_cookie=3a7e355c7dca8189 in_seq=0 out_seq=0 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.113+0000 7f2e517fa640 1 -- 172.21.15.67:0/3530392763 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c39d67da0 con 0x564c39e13ce0 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.113+0000 7f2e517fa640 10 client.16047 handle_command_reply: tid=0 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.113+0000 7f2e722f3740 1 client.16047 shutdown 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.113+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 msgr2=0x564c39dfb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.113+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 0x564c39dfb160 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2e58004650 tx=0x7f2e58012ca0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 shutdown_connections 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e16110 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39df8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e517fa640 0 client.16047 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def9c0 0x564c39df85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 --2- 172.21.15.67:0/3530392763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def0a0 0x564c39dfb160 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.114+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 >> 172.21.15.67:0/3530392763 conn(0x564c39deced0 msgr2=0x564c39df2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.115+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 shutdown_connections 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.115+0000 7f2e722f3740 1 -- 172.21.15.67:0/3530392763 wait complete. 2024-09-10T20:57:17.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.115+0000 7f2e722f3740 20 client.16047 trim_cache size 0 max 16384 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.146+0000 7f2e722f3740 1 Processor -- start 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 -- start start 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39df8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39dfb950 0x564c39df5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681ae8e0 con 0x564c39dfb950 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681ac1b0 con 0x564c39def0a0 2024-09-10T20:57:17.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e722f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681aa060 con 0x564c39def9c0 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e6dcba640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39df8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e6d4b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e6d4b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51666/0 (socket says 172.21.15.67:51666) 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.147+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/154497334 learned_addr learned my addr 172.21.15.67:0/154497334 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/154497334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 msgr2=0x564c39df8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39df8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/154497334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39dfb950 msgr2=0x564c39df5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39dfb950 0x564c39df5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 -- 172.21.15.67:0/154497334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c39def7f0 con 0x564c39def9c0 2024-09-10T20:57:17.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e640cdb30 tx=0x7f2e640419c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5b15a7586d93f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e537fe640 1 -- 172.21.15.67:0/154497334 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6404a040 con 0x564c39def9c0 2024-09-10T20:57:17.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e537fe640 1 -- 172.21.15.67:0/154497334 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e640d2070 con 0x564c39def9c0 2024-09-10T20:57:17.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.148+0000 7f2e537fe640 1 -- 172.21.15.67:0/154497334 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e640d2680 con 0x564c39def9c0 2024-09-10T20:57:17.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 -- 172.21.15.67:0/154497334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 msgr2=0x564c39dec710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e640cdb30 tx=0x7f2e640419c0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 -- 172.21.15.67:0/154497334 shutdown_connections 2024-09-10T20:57:17.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39dfb950 0x564c39df5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39def9c0 0x564c39dec710 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 --2- 172.21.15.67:0/154497334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39df8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 -- 172.21.15.67:0/154497334 >> 172.21.15.67:0/154497334 conn(0x564c39deced0 msgr2=0x564c39df8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 -- 172.21.15.67:0/154497334 shutdown_connections 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.149+0000 7f2e722f3740 1 -- 172.21.15.67:0/154497334 wait complete. 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.150+0000 7f2e722f3740 1 -- start start 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.150+0000 7f2e722f3740 1 Processor -- start 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.150+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39e0c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.150+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39e0c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.150+0000 7f2e722f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39e091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e722f3740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681aa6b0 con 0x564c39def9c0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e722f3740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681abae0 con 0x564c39def0a0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e722f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e681aad40 con 0x564c39dfb950 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e722f3740 10 client.0 _ll_register_callbacks cb 0x7f2e58009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6e4bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39e091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6e4bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39e091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51676/0 (socket says 172.21.15.67:51676) 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6e4bb640 1 -- 172.21.15.67:0/1077872697 learned_addr learned my addr 172.21.15.67:0/1077872697 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39e0c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39e0c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 -- 172.21.15.67:0/1077872697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 msgr2=0x564c39e091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39e091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 -- 172.21.15.67:0/1077872697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 msgr2=0x564c39e0c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39e0c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6dcba640 1 -- 172.21.15.67:0/1077872697 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c39e096f0 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.151+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39e0c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e6dcba640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39e0c1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e5800f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0bbd763158c83a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e517fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58027d10 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2e58005030 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e640d2070 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.152+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2e58005230 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 10 client.25709 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564c39e812b0 con 0x564c39def0a0 2024-09-10T20:57:17.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e640d2070 con 0x564c39def0a0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2e58004c50 con 0x564c39def0a0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 10 client.25709 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 10 client.25709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 20 client.25709 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e83a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 4 client.25709 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c39d63850 con 0x564c39e13ce0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.153+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e83a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.154+0000 7f2e517fa640 10 client.25709 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.154+0000 7f2e6d4b9640 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e83a50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c220b4d6dd7e0c server_cookie=82df25b084cc884e in_seq=0 out_seq=0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.154+0000 7f2e517fa640 1 -- 172.21.15.67:0/1077872697 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x564c39d63850 con 0x564c39e13ce0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.154+0000 7f2e517fa640 10 client.25709 handle_command_reply: tid=0 2024-09-10T20:57:17.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.154+0000 7f2e722f3740 1 client.25709 shutdown 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 msgr2=0x564c39e0c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39e0c1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e58000c00 tx=0x7f2e5800f9c0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 shutdown_connections 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564c39e13ce0 0x564c39e83a50 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c39dfb950 0x564c39e091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564c39def9c0 0x564c39e0c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 --2- 172.21.15.67:0/1077872697 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c39def0a0 0x564c39e0c1e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 >> 172.21.15.67:0/1077872697 conn(0x564c39deced0 msgr2=0x564c39df9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e517fa640 0 client.25709 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 shutdown_connections 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.155+0000 7f2e722f3740 1 -- 172.21.15.67:0/1077872697 wait complete. 2024-09-10T20:57:17.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.156+0000 7f2e722f3740 20 client.25709 trim_cache size 0 max 16384 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:57:17.169 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.170 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.171 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:17.172 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:57:17.173 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 msgr2=0x7f2e540b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 0x7f2e540b78a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e60021000 tx=0x7f2e6000eca0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 msgr2=0x7f2e6819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 0x7f2e6819b940 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e6402a930 tx=0x7f2e640045f0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 shutdown_connections 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2e540b53e0 0x7f2e540b78a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e6810b350 0x7f2e681a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e6810a9d0 0x7f2e6819b940 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 --2- 172.21.15.67:0/1170923388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2e68104fc0 0x7f2e6819b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:17.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 >> 172.21.15.67:0/1170923388 conn(0x7f2e681009f0 msgr2=0x7f2e681011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:17.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 shutdown_connections 2024-09-10T20:57:17.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:17.157+0000 7f2e6ff1e640 1 -- 172.21.15.67:0/1170923388 wait complete. 2024-09-10T20:57:18.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:57:18.108 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:57:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:18 smithi083 ceph-mon[35058]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-09-10T20:57:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:18 smithi172 ceph-mon[35265]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-09-10T20:57:18.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:18 smithi067 ceph-mon[30891]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-09-10T20:57:18.559 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 345.0 s, 2891.4 tps, lat 34.705 ms stddev 41.166 2024-09-10T20:57:19.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.150+0000 7efc85b75640 1 -- 172.21.15.67:0/317617396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc801076e0 msgr2=0x7efc80107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.150+0000 7efc85b75640 1 --2- 172.21.15.67:0/317617396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc801076e0 0x7efc80107b20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efc70009900 tx=0x7efc7002a410 comp rx=0 tx=0).stop 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.153+0000 7efc85b75640 1 -- 172.21.15.67:0/317617396 shutdown_connections 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.153+0000 7efc85b75640 1 --2- 172.21.15.67:0/317617396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc80108060 0x7efc8010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.153+0000 7efc85b75640 1 --2- 172.21.15.67:0/317617396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc801076e0 0x7efc80107b20 secure :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efc70009900 tx=0x7efc7002a410 comp rx=0 tx=0).stop 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.153+0000 7efc85b75640 1 --2- 172.21.15.67:0/317617396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80101cd0 0x7efc801020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.153+0000 7efc85b75640 1 -- 172.21.15.67:0/317617396 >> 172.21.15.67:0/317617396 conn(0x7efc800fd740 msgr2=0x7efc800ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.159+0000 7efc85b75640 1 -- 172.21.15.67:0/317617396 shutdown_connections 2024-09-10T20:57:19.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.159+0000 7efc85b75640 1 -- 172.21.15.67:0/317617396 wait complete. 2024-09-10T20:57:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.160+0000 7efc85b75640 1 Processor -- start 2024-09-10T20:57:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 -- start start 2024-09-10T20:57:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc80101cd0 0x7efc8010aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc8010b550 0x7efc801abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110c80 con 0x7efc80101cd0 2024-09-10T20:57:19.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110b00 con 0x7efc8010b550 2024-09-10T20:57:19.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.161+0000 7efc85b75640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110e00 con 0x7efc80108060 2024-09-10T20:57:19.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51688/0 (socket says 172.21.15.67:51688) 2024-09-10T20:57:19.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 -- 172.21.15.67:0/35343865 learned_addr learned my addr 172.21.15.67:0/35343865 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:19.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7f7fe640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc80101cd0 0x7efc8010aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 -- 172.21.15.67:0/35343865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc8010b550 msgr2=0x7efc801abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc8010b550 0x7efc801abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 -- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc80101cd0 msgr2=0x7efc8010aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc80101cd0 0x7efc8010aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 -- 172.21.15.67:0/35343865 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80116650 con 0x7efc80108060 2024-09-10T20:57:19.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.166+0000 7efc7effd640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc70006010 tx=0x7efc70030940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.169+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70035070 con 0x7efc80108060 2024-09-10T20:57:19.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.170+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc70041070 con 0x7efc80108060 2024-09-10T20:57:19.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.170+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70003d10 con 0x7efc80108060 2024-09-10T20:57:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.170+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc801168e0 con 0x7efc80108060 2024-09-10T20:57:19.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.171+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc80116d70 con 0x7efc80108060 2024-09-10T20:57:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.175+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efc7003a040 con 0x7efc80108060 2024-09-10T20:57:19.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.176+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc80107b20 con 0x7efc80108060 2024-09-10T20:57:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.178+0000 7efc7cff9640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 0x7efc680b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:19.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.179+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efc70105e30 con 0x7efc80108060 2024-09-10T20:57:19.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.180+0000 7efc7f7fe640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 0x7efc680b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:19.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.187+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efc70109030 con 0x7efc80108060 2024-09-10T20:57:19.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.187+0000 7efc7f7fe640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 0x7efc680b79a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efc78005fd0 tx=0x7efc78009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:19.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.601+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc80112af0 con 0x7efc80108060 2024-09-10T20:57:19.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.603+0000 7efc7cff9640 1 -- 172.21.15.67:0/35343865 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7efc700cccc0 con 0x7efc80108060 2024-09-10T20:57:19.609 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:57:19.609 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:57:19.609 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T20:57:19.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 msgr2=0x7efc680b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 0x7efc680b79a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efc78005fd0 tx=0x7efc78009500 comp rx=0 tx=0).stop 2024-09-10T20:57:19.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 msgr2=0x7efc8010b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:19.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc70006010 tx=0x7efc70030940 comp rx=0 tx=0).stop 2024-09-10T20:57:19.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 shutdown_connections 2024-09-10T20:57:19.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc8010b550 0x7efc801abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efc680b54e0 0x7efc680b79a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc80108060 0x7efc8010b010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 --2- 172.21.15.67:0/35343865 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc80101cd0 0x7efc8010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:19.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.607+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 >> 172.21.15.67:0/35343865 conn(0x7efc800fd740 msgr2=0x7efc800ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:19.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.608+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 shutdown_connections 2024-09-10T20:57:19.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:19.609+0000 7efc85b75640 1 -- 172.21.15.67:0/35343865 wait complete. 2024-09-10T20:57:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:20 smithi083 ceph-mon[35058]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-09-10T20:57:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:20 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/35343865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:57:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:20 smithi172 ceph-mon[35265]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-09-10T20:57:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:20 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/35343865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:57:20.500 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:20 smithi067 ceph-mon[30891]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-09-10T20:57:20.500 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:20 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/35343865' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:57:20.554 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:57:20.994 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:21.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 -- 172.21.15.67:0/2306484079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f284010f460 msgr2=0x7f2840111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 --2- 172.21.15.67:0/2306484079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f284010f460 0x7f2840111850 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2838009ca0 tx=0x7f283802a950 comp rx=0 tx=0).stop 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 -- 172.21.15.67:0/2306484079 shutdown_connections 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 --2- 172.21.15.67:0/2306484079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f284010f460 0x7f2840111850 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 --2- 172.21.15.67:0/2306484079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28401021d0 0x7f284010ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 --2- 172.21.15.67:0/2306484079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 0x7f2840101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.544+0000 7f28479be640 1 -- 172.21.15.67:0/2306484079 >> 172.21.15.67:0/2306484079 conn(0x7f28400fd700 msgr2=0x7f28400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.545+0000 7f28479be640 1 -- 172.21.15.67:0/2306484079 shutdown_connections 2024-09-10T20:57:21.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.545+0000 7f28479be640 1 -- 172.21.15.67:0/2306484079 wait complete. 2024-09-10T20:57:21.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.546+0000 7f28479be640 1 Processor -- start 2024-09-10T20:57:21.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.546+0000 7f28479be640 1 -- start start 2024-09-10T20:57:21.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 0x7f284019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28401021d0 0x7f284019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2840114f60 con 0x7f284010f460 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2840114de0 con 0x7f28401021d0 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f28479be640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28401150e0 con 0x7f28401018b0 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40488/0 (socket says 172.21.15.67:40488) 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 -- 172.21.15.67:0/154693914 learned_addr learned my addr 172.21.15.67:0/154693914 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2844f59640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28401021d0 0x7f284019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f284575a640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 0x7f284019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 -- 172.21.15.67:0/154693914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 msgr2=0x7f284019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 0x7f284019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 -- 172.21.15.67:0/154693914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28401021d0 msgr2=0x7f284019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28401021d0 0x7f284019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.547+0000 7f2845f5b640 1 -- 172.21.15.67:0/154693914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28401a14e0 con 0x7f284010f460 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f2845f5b640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2838004af0 tx=0x7f2838031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f28367fc640 1 -- 172.21.15.67:0/154693914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838034040 con 0x7f284010f460 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f28367fc640 1 -- 172.21.15.67:0/154693914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28380308f0 con 0x7f284010f460 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28401a1770 con 0x7f284010f460 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f28367fc640 1 -- 172.21.15.67:0/154693914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380045d0 con 0x7f284010f460 2024-09-10T20:57:21.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.548+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28401a7e90 con 0x7f284010f460 2024-09-10T20:57:21.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.551+0000 7f2849d93740 1 Processor -- start 2024-09-10T20:57:21.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f28367fc640 1 -- 172.21.15.67:0/154693914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f283804d030 con 0x7f284010f460 2024-09-10T20:57:21.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 -- start start 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e9508a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 0x557e95096460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e95098d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e95000ea0 con 0x557e9508aa10 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f284575a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 0x557e95096460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2844f59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e9508a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f284575a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 0x557e95096460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40494/0 (socket says 172.21.15.67:40494) 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f284575a640 1 -- 172.21.15.67:0/909824451 learned_addr learned my addr 172.21.15.67:0/909824451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557e94ff02d0 con 0x557e950969a0 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.552+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e94ff40e0 con 0x557e9508a0f0 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f28367fc640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 0x7f282c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e95098d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 -- 172.21.15.67:0/909824451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 msgr2=0x557e95098d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e95098d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 -- 172.21.15.67:0/909824451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 msgr2=0x557e95096460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 0x557e95096460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f28367fc640 1 -- 172.21.15.67:0/154693914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2838106680 con 0x7f284010f460 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2845f5b640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 0x7f282c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 -- 172.21.15.67:0/909824451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e94d4e650 con 0x557e9508a0f0 2024-09-10T20:57:21.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.553+0000 7f2844f59640 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e9508a4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28400fffa0 tx=0x7f28300096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07190a67ddc7a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.554+0000 7f282b7fe640 1 -- 172.21.15.67:0/909824451 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830013c90 con 0x557e9508a0f0 2024-09-10T20:57:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.554+0000 7f282b7fe640 1 -- 172.21.15.67:0/909824451 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2830013e30 con 0x557e9508a0f0 2024-09-10T20:57:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.554+0000 7f2845f5b640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 0x7f282c0b7820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f283802fd10 tx=0x7f2838004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.554+0000 7f282b7fe640 1 -- 172.21.15.67:0/909824451 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830004a00 con 0x557e9508a0f0 2024-09-10T20:57:21.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 msgr2=0x557e9508a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e9508a4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28400fffa0 tx=0x7f28300096c0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 shutdown_connections 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e95098d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508aa10 0x557e95096460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 --2- 172.21.15.67:0/909824451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e9508a4d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.555+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 >> 172.21.15.67:0/909824451 conn(0x557e95087f20 msgr2=0x557e950890c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.556+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 shutdown_connections 2024-09-10T20:57:21.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.556+0000 7f2849d93740 1 -- 172.21.15.67:0/909824451 wait complete. 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.556+0000 7f2849d93740 1 -- start start 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 Processor -- start 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e95096310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 0x557e95093de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e94e51700 con 0x557e9508a0f0 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557e94f8b160 con 0x557e9508aa10 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e95099620 con 0x557e950969a0 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2849d93740 10 client.0 _ll_register_callbacks cb 0x557e94fa49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f284575a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2844f59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 0x557e95093de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.557+0000 7f2844f59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e95096310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f2844f59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 0x557e95093de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51726/0 (socket says 172.21.15.67:51726) 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50788/0 (socket says 172.21.15.67:50788) 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 -- 172.21.15.67:0/639531286 learned_addr learned my addr 172.21.15.67:0/639531286 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 -- 172.21.15.67:0/639531286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 msgr2=0x557e95093de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 0x557e95093de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 -- 172.21.15.67:0/639531286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 msgr2=0x557e95096310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e95096310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 -- 172.21.15.67:0/639531286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e94fb8c90 con 0x557e9508aa10 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f2844f59640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e95096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f284575a640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f283c012840 tx=0x7f283c012d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a866685b156986 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.558+0000 7f2828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c004050 con 0x557e9508aa10 2024-09-10T20:57:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2830013e30 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f283c0041f0 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f283c023070 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 10 client.25724 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557e950a5080 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2830013e30 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f283c003970 con 0x557e9508aa10 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 10 client.25724 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 10 client.25724 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 20 client.25724 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e950a6880 0x557e950a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 4 client.25724 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.559+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e95002df0 con 0x557e950a6880 2024-09-10T20:57:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.560+0000 7f2844f59640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e950a6880 0x557e950a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.560+0000 7f2828ff9640 10 client.25724 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.560+0000 7f2844f59640 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e950a6880 0x557e950a8d20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31a699521a9dfdee server_cookie=507645a8c7d6f6fc in_seq=0 out_seq=0 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.561+0000 7f2828ff9640 1 -- 172.21.15.67:0/639531286 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e95002df0 con 0x557e950a6880 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.561+0000 7f2828ff9640 10 client.25724 handle_command_reply: tid=0 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.561+0000 7f2849d93740 1 client.25724 shutdown 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.561+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 msgr2=0x557e95093760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.561+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f283c012840 tx=0x7f283c012d00 comp rx=0 tx=0).stop 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 shutdown_connections 2024-09-10T20:57:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e950a6880 0x557e950a8d20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e950969a0 0x557e95093de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e95093760 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 --2- 172.21.15.67:0/639531286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e95096310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 >> 172.21.15.67:0/639531286 conn(0x557e95087f20 msgr2=0x557e9508dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.562+0000 7f2828ff9640 0 client.25724 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.563+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 shutdown_connections 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.563+0000 7f2849d93740 1 -- 172.21.15.67:0/639531286 wait complete. 2024-09-10T20:57:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.563+0000 7f2849d93740 20 client.25724 trim_cache size 0 max 16384 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 Processor -- start 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 -- start start 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e95087760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 0x557e95090ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28401b2d30 con 0x557e950969a0 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f28401b0600 con 0x557e9508aa10 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f2849d93740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28401ae450 con 0x557e9508a0f0 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.581+0000 7f284575a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50802/0 (socket says 172.21.15.67:50802) 2024-09-10T20:57:21.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 -- 172.21.15.67:0/2458907385 learned_addr learned my addr 172.21.15.67:0/2458907385 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f2844f59640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e95087760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f2844f59640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 0x557e95090ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 -- 172.21.15.67:0/2458907385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 msgr2=0x557e95087760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e95087760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 -- 172.21.15.67:0/2458907385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 msgr2=0x557e95090ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 0x557e95090ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 -- 172.21.15.67:0/2458907385 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9508a840 con 0x557e9508aa10 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f2844f59640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 0x557e95090ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.582+0000 7f284575a640 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f283c000c00 tx=0x7f283c0057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9894fe845978c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.583+0000 7f282affd640 1 -- 172.21.15.67:0/2458907385 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c0035f0 con 0x557e9508aa10 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.583+0000 7f282affd640 1 -- 172.21.15.67:0/2458907385 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c02c030 con 0x557e9508aa10 2024-09-10T20:57:21.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.583+0000 7f282affd640 1 -- 172.21.15.67:0/2458907385 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00fde0 con 0x557e9508aa10 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 -- 172.21.15.67:0/2458907385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 msgr2=0x557e950909b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f283c000c00 tx=0x7f283c0057d0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 -- 172.21.15.67:0/2458907385 shutdown_connections 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e950969a0 0x557e95090ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e9508aa10 0x557e950909b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 --2- 172.21.15.67:0/2458907385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508a0f0 0x557e95087760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.584+0000 7f2849d93740 1 -- 172.21.15.67:0/2458907385 >> 172.21.15.67:0/2458907385 conn(0x557e95087f20 msgr2=0x557e9508ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.585+0000 7f2849d93740 1 -- 172.21.15.67:0/2458907385 shutdown_connections 2024-09-10T20:57:21.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.585+0000 7f2849d93740 1 -- 172.21.15.67:0/2458907385 wait complete. 2024-09-10T20:57:21.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.586+0000 7f2849d93740 1 -- start start 2024-09-10T20:57:21.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.586+0000 7f2849d93740 1 Processor -- start 2024-09-10T20:57:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e9509ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508aa10 0x557e9509f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28401aeac0 con 0x557e9508a0f0 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f28401aff30 con 0x557e950969a0 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28401af190 con 0x557e9508aa10 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2849d93740 10 client.0 _ll_register_callbacks cb 0x7f283c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e9509ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50812/0 (socket says 172.21.15.67:50812) 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 -- 172.21.15.67:0/2914220534 learned_addr learned my addr 172.21.15.67:0/2914220534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 -- 172.21.15.67:0/2914220534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508aa10 msgr2=0x557e9509f010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508aa10 0x557e9509f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 -- 172.21.15.67:0/2914220534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 msgr2=0x557e9509ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.587+0000 7f2844f59640 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e9509ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2844f59640 1 -- 172.21.15.67:0/2914220534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e950901d0 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2844f59640 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2830006010 tx=0x7f2830022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2243a158031d51e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2828ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283003a060 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f28300117b0 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f283c02c030 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28300119b0 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2849d93740 10 client.25730 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.588+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557e950913b0 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f283c02c030 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2830004b10 con 0x557e950969a0 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 10 client.25730 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:21.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 10 client.25730 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:57:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 20 client.25730 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e95114840 0x557e95116c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 4 client.25730 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:57:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e94ffe8a0 con 0x557e95114840 2024-09-10T20:57:21.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.589+0000 7f284575a640 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e95114840 0x557e95116c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.590+0000 7f284575a640 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e95114840 0x557e95116c30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98e592392c321980 server_cookie=15191bf1f28f413f in_seq=0 out_seq=0 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.590+0000 7f2828ff9640 10 client.25730 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.590+0000 7f2828ff9640 1 -- 172.21.15.67:0/2914220534 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e94ffe8a0 con 0x557e95114840 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.590+0000 7f2828ff9640 10 client.25730 handle_command_reply: tid=0 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 client.25730 shutdown 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 msgr2=0x557e9508f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2830006010 tx=0x7f2830022040 comp rx=0 tx=0).stop 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 shutdown_connections 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557e95114840 0x557e95116c30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e950969a0 0x557e9508f9a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.591+0000 7f2828ff9640 0 client.25730 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e9508aa10 0x557e9509f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 1 --2- 172.21.15.67:0/2914220534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e9508a0f0 0x557e9509ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 >> 172.21.15.67:0/2914220534 conn(0x557e95087f20 msgr2=0x557e95094d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 shutdown_connections 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 1 -- 172.21.15.67:0/2914220534 wait complete. 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.592+0000 7f2849d93740 20 client.25730 trim_cache size 0 max 16384 2024-09-10T20:57:21.599 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 msgr2=0x7f282c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 0x7f282c0b7820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f283802fd10 tx=0x7f2838004040 comp rx=0 tx=0).stop 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 msgr2=0x7f28401a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2838004af0 tx=0x7f2838031f50 comp rx=0 tx=0).stop 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 shutdown_connections 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f284010f460 0x7f28401a0d10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28401021d0 0x7f284019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f282c0b5360 0x7f282c0b7820 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 --2- 172.21.15.67:0/154693914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28401018b0 0x7f284019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:21.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 >> 172.21.15.67:0/154693914 conn(0x7f28400fd700 msgr2=0x7f2840111720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:21.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 shutdown_connections 2024-09-10T20:57:21.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:21.594+0000 7f28479be640 1 -- 172.21.15.67:0/154693914 wait complete. 2024-09-10T20:57:22.336 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:57:22.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:22 smithi083 ceph-mon[35058]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-10T20:57:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:22 smithi172 ceph-mon[35265]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-10T20:57:22.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:22 smithi067 ceph-mon[30891]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 7.3 MiB/s wr, 708 op/s 2024-09-10T20:57:22.730 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.308+0000 7f61587d4640 1 -- 172.21.15.67:0/3691397180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 msgr2=0x7f6150107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.308+0000 7f61587d4640 1 --2- 172.21.15.67:0/3691397180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150107ae0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6140009900 tx=0x7f614002a440 comp rx=0 tx=0).stop 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 -- 172.21.15.67:0/3691397180 shutdown_connections 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 --2- 172.21.15.67:0/3691397180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150108020 0x7f615010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 --2- 172.21.15.67:0/3691397180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150107ae0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 --2- 172.21.15.67:0/3691397180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150101c90 0x7f6150102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 -- 172.21.15.67:0/3691397180 >> 172.21.15.67:0/3691397180 conn(0x7f61500fd700 msgr2=0x7f61500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 -- 172.21.15.67:0/3691397180 shutdown_connections 2024-09-10T20:57:23.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.309+0000 7f61587d4640 1 -- 172.21.15.67:0/3691397180 wait complete. 2024-09-10T20:57:23.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 Processor -- start 2024-09-10T20:57:23.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 -- start start 2024-09-10T20:57:23.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 0x7f61501991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 0x7f615019eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6150111cc0 con 0x7f61501076a0 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6150111b40 con 0x7f6150108020 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f61587d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6150111e40 con 0x7f6150101c90 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f6155d6f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f6155d6f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35028/0 (socket says 172.21.15.67:35028) 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f6156d71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 0x7f615019eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f6155d6f640 1 -- 172.21.15.67:0/546534181 learned_addr learned my addr 172.21.15.67:0/546534181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.310+0000 7f6156570640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 0x7f61501991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 -- 172.21.15.67:0/546534181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 msgr2=0x7f61501991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 0x7f61501991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 -- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 msgr2=0x7f6150199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 -- 172.21.15.67:0/546534181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615019f270 con 0x7f6150108020 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156570640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 0x7f61501991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f6156d71640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 0x7f615019eaa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6148009fd0 tx=0x7f614800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f61477fe640 1 -- 172.21.15.67:0/546534181 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800ce20 con 0x7f6150108020 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f61477fe640 1 -- 172.21.15.67:0/546534181 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6148005020 con 0x7f6150108020 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f61477fe640 1 -- 172.21.15.67:0/546534181 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148010690 con 0x7f6150108020 2024-09-10T20:57:23.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615019f560 con 0x7f6150108020 2024-09-10T20:57:23.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.311+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61500fdae0 con 0x7f6150108020 2024-09-10T20:57:23.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.315+0000 7f61477fe640 1 -- 172.21.15.67:0/546534181 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f61480054d0 con 0x7f6150108020 2024-09-10T20:57:23.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.317+0000 7f615aba9740 1 Processor -- start 2024-09-10T20:57:23.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.317+0000 7f61477fe640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 0x7f613c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.317+0000 7f6155d6f640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 0x7f613c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 -- start start 2024-09-10T20:57:23.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f61477fe640 1 -- 172.21.15.67:0/546534181 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61480e6210 con 0x7f6150108020 2024-09-10T20:57:23.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f6155d6f640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 0x7f613c0b7860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f61400096c0 tx=0x7f6140000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413544460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413546d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644134aeea0 con 0x5644135380f0 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56441349e2d0 con 0x5644135449a0 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f615aba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644134a20e0 con 0x564413538a10 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.318+0000 7f6156570640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35034/0 (socket says 172.21.15.67:35034) 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 -- 172.21.15.67:0/2306359621 learned_addr learned my addr 172.21.15.67:0/2306359621 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6155d6f640 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413544460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156d71640 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413546d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 -- 172.21.15.67:0/2306359621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 msgr2=0x564413544460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413544460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 -- 172.21.15.67:0/2306359621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 msgr2=0x564413546d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413546d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 -- 172.21.15.67:0/2306359621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644131fc650 con 0x5644135380f0 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6156570640 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f614c0104d0 tx=0x7f614c0108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c983a8aaa14aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6144ff9640 1 -- 172.21.15.67:0/2306359621 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c004220 con 0x5644135380f0 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6144ff9640 1 -- 172.21.15.67:0/2306359621 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614c0043c0 con 0x5644135380f0 2024-09-10T20:57:23.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.319+0000 7f6144ff9640 1 -- 172.21.15.67:0/2306359621 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c011a70 con 0x5644135380f0 2024-09-10T20:57:23.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 -- 172.21.15.67:0/2306359621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 msgr2=0x5644135384d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f614c0104d0 tx=0x7f614c0108d0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 -- 172.21.15.67:0/2306359621 shutdown_connections 2024-09-10T20:57:23.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413546d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413544460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.320+0000 7f615aba9740 1 --2- 172.21.15.67:0/2306359621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135380f0 0x5644135384d0 secure :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f614c0104d0 tx=0x7f614c0108d0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.321+0000 7f615aba9740 1 -- 172.21.15.67:0/2306359621 >> 172.21.15.67:0/2306359621 conn(0x564413535f20 msgr2=0x5644135370c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.321+0000 7f615aba9740 1 -- 172.21.15.67:0/2306359621 shutdown_connections 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.322+0000 7f615aba9740 1 -- 172.21.15.67:0/2306359621 wait complete. 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.322+0000 7f615aba9740 1 -- start start 2024-09-10T20:57:23.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.322+0000 7f615aba9740 1 Processor -- start 2024-09-10T20:57:23.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 0x5644135418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x564413541e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413550950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644132ff700 con 0x5644135449a0 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564413439160 con 0x564413538a10 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564413547620 con 0x564413542340 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f615aba9740 10 client.0 _ll_register_callbacks cb 0x5644134529e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6156570640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 0x5644135418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6155d6f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x564413541e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6156570640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 0x5644135418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49044/0 (socket says 172.21.15.67:49044) 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6156570640 1 -- 172.21.15.67:0/1208054476 learned_addr learned my addr 172.21.15.67:0/1208054476 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6156d71640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413550950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.323+0000 7f6156d71640 1 -- 172.21.15.67:0/1208054476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 msgr2=0x5644135418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6156d71640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 0x5644135418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6156d71640 1 -- 172.21.15.67:0/1208054476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 msgr2=0x564413541e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6156d71640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x564413541e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6156d71640 1 -- 172.21.15.67:0/1208054476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564413466c90 con 0x564413542340 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6156d71640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413550950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61480a9c10 tx=0x7f61480ac5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8acefeec0c8273e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480d3070 con 0x564413542340 2024-09-10T20:57:23.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.324+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61480b5ca0 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f614c0043c0 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f61480b1480 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f615aba9740 10 client.25726 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564413553570 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614c0043c0 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.325+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f61480ab670 con 0x564413542340 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 10 client.25726 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 10 client.25726 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 20 client.25726 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x564413556e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 4 client.25726 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644134b0df0 con 0x564413554a30 2024-09-10T20:57:23.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f6156570640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x564413556e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f6139ffb640 10 client.25726 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.326+0000 7f6156570640 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x564413556e90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=915e4c8a466f6031 server_cookie=c2a784fefd7e46de in_seq=0 out_seq=0 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f6139ffb640 1 -- 172.21.15.67:0/1208054476 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644134b0df0 con 0x564413554a30 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f6139ffb640 10 client.25726 handle_command_reply: tid=0 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 client.25726 shutdown 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 msgr2=0x564413550950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413550950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f61480a9c10 tx=0x7f61480ac5e0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 shutdown_connections 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x564413556e90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f6139ffb640 0 client.25726 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413550950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x564413541e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 --2- 172.21.15.67:0/1208054476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413538a10 0x5644135418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.327+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 >> 172.21.15.67:0/1208054476 conn(0x564413535f20 msgr2=0x56441353ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.328+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 shutdown_connections 2024-09-10T20:57:23.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.328+0000 7f615aba9740 1 -- 172.21.15.67:0/1208054476 wait complete. 2024-09-10T20:57:23.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.328+0000 7f615aba9740 20 client.25726 trim_cache size 0 max 16384 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.343+0000 7f615aba9740 1 Processor -- start 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.343+0000 7f615aba9740 1 -- start start 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.343+0000 7f615aba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413534e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.343+0000 7f615aba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 0x564413545d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f615aba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f615aba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b7050 con 0x5644135449a0 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f615aba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b4920 con 0x564413542340 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f615aba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b2770 con 0x564413538a10 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35038/0 (socket says 172.21.15.67:35038) 2024-09-10T20:57:23.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 -- 172.21.15.67:0/3490352985 learned_addr learned my addr 172.21.15.67:0/3490352985 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6155d6f640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 0x564413545d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156570640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413534e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 -- 172.21.15.67:0/3490352985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 msgr2=0x564413534e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413534e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 -- 172.21.15.67:0/3490352985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 msgr2=0x564413545d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 0x564413545d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 -- 172.21.15.67:0/3490352985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564413538840 con 0x5644135449a0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6155d6f640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 0x564413545d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f6156d71640 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6148005c40 tx=0x7f61480b1340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b88eaab05e368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.344+0000 7f613bfff640 1 -- 172.21.15.67:0/3490352985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480d3070 con 0x5644135449a0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f613bfff640 1 -- 172.21.15.67:0/3490352985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6148096030 con 0x5644135449a0 2024-09-10T20:57:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f613bfff640 1 -- 172.21.15.67:0/3490352985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61480b5aa0 con 0x5644135449a0 2024-09-10T20:57:23.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 -- 172.21.15.67:0/3490352985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 msgr2=0x5644135462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6148005c40 tx=0x7f61480b1340 comp rx=0 tx=0).stop 2024-09-10T20:57:23.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 -- 172.21.15.67:0/3490352985 shutdown_connections 2024-09-10T20:57:23.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644135449a0 0x5644135462d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564413542340 0x564413545d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 --2- 172.21.15.67:0/3490352985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413538a10 0x564413534e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 -- 172.21.15.67:0/3490352985 >> 172.21.15.67:0/3490352985 conn(0x564413535f20 msgr2=0x564413534750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 -- 172.21.15.67:0/3490352985 shutdown_connections 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.345+0000 7f615aba9740 1 -- 172.21.15.67:0/3490352985 wait complete. 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 -- start start 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 Processor -- start 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413547870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413548000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b2de0 con 0x564413538a10 2024-09-10T20:57:23.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b4250 con 0x5644135449a0 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61501b34b0 con 0x564413542340 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f615aba9740 10 client.0 _ll_register_callbacks cb 0x7f6148005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f6156570640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f6156570640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35054/0 (socket says 172.21.15.67:35054) 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f6156570640 1 -- 172.21.15.67:0/3732449226 learned_addr learned my addr 172.21.15.67:0/3732449226 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f6156d71640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413548000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.346+0000 7f6155d6f640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413547870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 -- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 msgr2=0x564413547870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413547870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 -- 172.21.15.67:0/3732449226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 msgr2=0x564413548000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413548000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 -- 172.21.15.67:0/3732449226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644135c1960 con 0x564413538a10 2024-09-10T20:57:23.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6156570640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f614c010dd0 tx=0x7f614c0115f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d205248bd7339c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c005450 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6148096030 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f614c0055f0 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f614c011700 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f615aba9740 10 client.16086 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5644135c2be0 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.347+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6148096030 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f614c004910 con 0x564413538a10 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 10 client.16086 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 10 client.16086 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 20 client.16086 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x5644135c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:23.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 4 client.16086 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644134ac8a0 con 0x564413554a30 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f6155d6f640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x5644135c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f6155d6f640 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x5644135c5380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa23e546acb76e3e server_cookie=46a001e2cb38c203 in_seq=0 out_seq=0 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.348+0000 7f6139ffb640 10 client.16086 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f6139ffb640 1 -- 172.21.15.67:0/3732449226 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644134ac8a0 con 0x564413554a30 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f6139ffb640 10 client.16086 handle_command_reply: tid=0 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 client.16086 shutdown 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 msgr2=0x56441354d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f614c010dd0 tx=0x7f614c0115f0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 shutdown_connections 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x564413554a30 0x5644135c5380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644135449a0 0x564413548000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564413542340 0x564413547870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 --2- 172.21.15.67:0/3732449226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564413538a10 0x56441354d220 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 >> 172.21.15.67:0/3732449226 conn(0x564413535f20 msgr2=0x564413534f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f6139ffb640 0 client.16086 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 shutdown_connections 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 1 -- 172.21.15.67:0/3732449226 wait complete. 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.349+0000 7f615aba9740 20 client.16086 trim_cache size 0 max 16384 2024-09-10T20:57:23.359 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 msgr2=0x7f613c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 0x7f613c0b7860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f61400096c0 tx=0x7f6140000bc0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 msgr2=0x7f615019eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 0x7f615019eaa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6148009fd0 tx=0x7f614800ef10 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 shutdown_connections 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6150108020 0x7f615019eaa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f61501076a0 0x7f6150199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f613c0b53a0 0x7f613c0b7860 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 --2- 172.21.15.67:0/546534181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6150101c90 0x7f61501991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:23.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 >> 172.21.15.67:0/546534181 conn(0x7f61500fd700 msgr2=0x7f615006acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:23.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 shutdown_connections 2024-09-10T20:57:23.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:23.350+0000 7f61587d4640 1 -- 172.21.15.67:0/546534181 wait complete. 2024-09-10T20:57:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 350.0 s, 3161.0 tps, lat 31.600 ms stddev 36.654 2024-09-10T20:57:24.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:57:24.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:24 smithi067 ceph-mon[30891]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 760 op/s 2024-09-10T20:57:24.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:24 smithi083 ceph-mon[35058]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 760 op/s 2024-09-10T20:57:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:24 smithi172 ceph-mon[35265]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.7 MiB/s wr, 760 op/s 2024-09-10T20:57:24.529 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:25.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.093+0000 7f6c1727e640 1 -- 172.21.15.67:0/3392516998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c101087f0 msgr2=0x7f6c10108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.093+0000 7f6c1727e640 1 --2- 172.21.15.67:0/3392516998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c101087f0 0x7f6c10108c30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009900 tx=0x7f6c0002a3f0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.094+0000 7f6c1727e640 1 -- 172.21.15.67:0/3392516998 shutdown_connections 2024-09-10T20:57:25.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.094+0000 7f6c1727e640 1 --2- 172.21.15.67:0/3392516998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c10109170 0x7f6c1010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.094+0000 7f6c1727e640 1 --2- 172.21.15.67:0/3392516998 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c101087f0 0x7f6c10108c30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.094+0000 7f6c1727e640 1 --2- 172.21.15.67:0/3392516998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c101031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.094+0000 7f6c1727e640 1 -- 172.21.15.67:0/3392516998 >> 172.21.15.67:0/3392516998 conn(0x7f6c100fe830 msgr2=0x7f6c10100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.101+0000 7f6c1727e640 1 -- 172.21.15.67:0/3392516998 shutdown_connections 2024-09-10T20:57:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.104+0000 7f6c1727e640 1 -- 172.21.15.67:0/3392516998 wait complete. 2024-09-10T20:57:25.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.104+0000 7f6c1727e640 1 Processor -- start 2024-09-10T20:57:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 -- start start 2024-09-10T20:57:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c101087f0 0x7f6c1010c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c10109170 0x7f6c1010cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10076e10 con 0x7f6c10109170 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10076c90 con 0x7f6c10102de0 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1727e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10076f90 con 0x7f6c101087f0 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49072/0 (socket says 172.21.15.67:49072) 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.105+0000 7f6c1501a640 1 -- 172.21.15.67:0/2274401934 learned_addr learned my addr 172.21.15.67:0/2274401934 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.106+0000 7f6c1501a640 1 -- 172.21.15.67:0/2274401934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c101087f0 msgr2=0x7f6c1010c890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.106+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c101087f0 0x7f6c1010c890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.106+0000 7f6c1501a640 1 -- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c10109170 msgr2=0x7f6c1010cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.106+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c10109170 0x7f6c1010cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.106+0000 7f6c1501a640 1 -- 172.21.15.67:0/2274401934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1010d5f0 con 0x7f6c10102de0 2024-09-10T20:57:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.108+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b4a0 tx=0x7f6c0c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.108+0000 7f6c067fc640 1 -- 172.21.15.67:0/2274401934 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c014070 con 0x7f6c10102de0 2024-09-10T20:57:25.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.109+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c10073c20 con 0x7f6c10102de0 2024-09-10T20:57:25.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.109+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c10074230 con 0x7f6c10102de0 2024-09-10T20:57:25.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.109+0000 7f6c067fc640 1 -- 172.21.15.67:0/2274401934 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0c010ac0 con 0x7f6c10102de0 2024-09-10T20:57:25.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.109+0000 7f6c067fc640 1 -- 172.21.15.67:0/2274401934 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c017c30 con 0x7f6c10102de0 2024-09-10T20:57:25.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.113+0000 7f6c19653740 1 Processor -- start 2024-09-10T20:57:25.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.113+0000 7f6c19653740 1 -- start start 2024-09-10T20:57:25.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c4a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2bb4ea0 con 0x55b3a2c3ea10 2024-09-10T20:57:25.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2ba42d0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.114+0000 7f6c19653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2ba80e0 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.116+0000 7f6c067fc640 1 -- 172.21.15.67:0/2274401934 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6c0c019450 con 0x7f6c10102de0 2024-09-10T20:57:25.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.117+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.117+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49076/0 (socket says 172.21.15.67:49076) 2024-09-10T20:57:25.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.117+0000 7f6c1581b640 1 -- 172.21.15.67:0/2053403028 learned_addr learned my addr 172.21.15.67:0/2053403028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:25.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c14819640 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c067fc640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 0x7f6bfc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c067fc640 1 -- 172.21.15.67:0/2274401934 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6c0c0e5360 con 0x7f6c10102de0 2024-09-10T20:57:25.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c1581b640 1 -- 172.21.15.67:0/2053403028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c4a9a0 msgr2=0x55b3a2c4cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c1581b640 1 -- 172.21.15.67:0/2053403028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 msgr2=0x55b3a2c4a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c4a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.118+0000 7f6c1581b640 1 -- 172.21.15.67:0/2053403028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a2902650 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.119+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 0x7f6bfc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.119+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009c50 tx=0x7f6c0800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327ea7f7e8912cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.120+0000 7f6bfb7fe640 1 -- 172.21.15.67:0/2053403028 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801e4e0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.122+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 0x7f6bfc0b78d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801b000 tx=0x7f6c0801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.124+0000 7f6bfb7fe640 1 -- 172.21.15.67:0/2053403028 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0801eb30 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.125+0000 7f6c19653740 1 -- 172.21.15.67:0/2053403028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 msgr2=0x55b3a2c3e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.125+0000 7f6c19653740 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009c50 tx=0x7f6c0800b420 comp rx=0 tx=0).stop 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 -- 172.21.15.67:0/2053403028 shutdown_connections 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c4a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 --2- 172.21.15.67:0/2053403028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c3e4d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 -- 172.21.15.67:0/2053403028 >> 172.21.15.67:0/2053403028 conn(0x55b3a2c3bf20 msgr2=0x55b3a2c3d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 -- 172.21.15.67:0/2053403028 shutdown_connections 2024-09-10T20:57:25.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 -- 172.21.15.67:0/2053403028 wait complete. 2024-09-10T20:57:25.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.128+0000 7f6c19653740 1 -- start start 2024-09-10T20:57:25.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 Processor -- start 2024-09-10T20:57:25.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c476b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c47c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2a05700 con 0x55b3a2c3ea10 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2b3f160 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b3a2c4d6c0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.129+0000 7f6c19653740 10 client.0 _ll_register_callbacks cb 0x55b3a2b589e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.130+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.130+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47102/0 (socket says 172.21.15.67:47102) 2024-09-10T20:57:25.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.130+0000 7f6c1501a640 1 -- 172.21.15.67:0/2173561861 learned_addr learned my addr 172.21.15.67:0/2173561861 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:25.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.131+0000 7f6c14819640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c47c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1501a640 1 -- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 msgr2=0x55b3a2c47c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c47c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1501a640 1 -- 172.21.15.67:0/2173561861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 msgr2=0x55b3a2c476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.134+0000 7f6c1501a640 1 -- 172.21.15.67:0/2173561861 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a2b6cc90 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.135+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000c00 tx=0x7f6c0c0b51b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfca9016584ca00c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.136+0000 7f6bf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:57:25.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.138+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c01e040 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.138+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c0801eb30 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.138+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6c0c0ab2c0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.148+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c0c0940d0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.148+0000 7f6c19653740 10 client.25735 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:25.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.148+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b3a2c590a0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.150+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0801eb30 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6c0c0e4040 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 10 client.25735 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 10 client.25735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 20 client.25735 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2c5a880 0x55b3a2c5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 4 client.25735 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:25.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.151+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3a2bb6df0 con 0x55b3a2c5a880 2024-09-10T20:57:25.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.153+0000 7f6c14819640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2c5a880 0x55b3a2c5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.159+0000 7f6bf8ff9640 10 client.25735 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:25.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.159+0000 7f6c14819640 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2c5a880 0x55b3a2c5cca0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be221ee26bae6a3 server_cookie=730b0d99e9297ac4 in_seq=0 out_seq=0 2024-09-10T20:57:25.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.159+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/2173561861 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3a2bb6df0 con 0x55b3a2c5a880 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.159+0000 7f6bf8ff9640 10 client.25735 handle_command_reply: tid=0 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.159+0000 7f6c19653740 1 client.25735 shutdown 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 msgr2=0x55b3a2c4a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000c00 tx=0x7f6c0c0b51b0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 shutdown_connections 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2c5a880 0x55b3a2c5cca0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c47c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 --2- 172.21.15.67:0/2173561861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c4a260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 >> 172.21.15.67:0/2173561861 conn(0x55b3a2c3bf20 msgr2=0x55b3a2c41ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.160+0000 7f6bf8ff9640 0 client.25735 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:25.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.162+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 shutdown_connections 2024-09-10T20:57:25.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.162+0000 7f6c19653740 1 -- 172.21.15.67:0/2173561861 wait complete. 2024-09-10T20:57:25.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.162+0000 7f6c19653740 20 client.25735 trim_cache size 0 max 16384 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 Processor -- start 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 -- start start 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c3cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4010b70 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf400e440 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c19653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf400c340 con 0x55b3a2c3ea10 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49086/0 (socket says 172.21.15.67:49086) 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c1581b640 1 -- 172.21.15.67:0/2201009812 learned_addr learned my addr 172.21.15.67:0/2201009812 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c1501a640 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.192+0000 7f6c14819640 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c3cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 -- 172.21.15.67:0/2201009812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 msgr2=0x55b3a2c3cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c3cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 -- 172.21.15.67:0/2201009812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3e0f0 msgr2=0x55b3a2c569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 -- 172.21.15.67:0/2201009812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a2c45bb0 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6c1581b640 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c08011490 tx=0x7f6c080114c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46ede00e3aa7c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6bfaffd640 1 -- 172.21.15.67:0/2201009812 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08023040 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6bfaffd640 1 -- 172.21.15.67:0/2201009812 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c08009650 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.193+0000 7f6bfaffd640 1 -- 172.21.15.67:0/2201009812 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c080276a0 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.194+0000 7f6c19653740 1 -- 172.21.15.67:0/2201009812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 msgr2=0x55b3a2c42910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.194+0000 7f6c19653740 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c08011490 tx=0x7f6c080114c0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.194+0000 7f6c19653740 1 -- 172.21.15.67:0/2201009812 shutdown_connections 2024-09-10T20:57:25.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.194+0000 7f6c19653740 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c42910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.194+0000 7f6c19653740 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c3cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.195+0000 7f6c19653740 1 --2- 172.21.15.67:0/2201009812 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.195+0000 7f6c19653740 1 -- 172.21.15.67:0/2201009812 >> 172.21.15.67:0/2201009812 conn(0x55b3a2c3bf20 msgr2=0x55b3a2c5c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.195+0000 7f6c19653740 1 -- 172.21.15.67:0/2201009812 shutdown_connections 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.195+0000 7f6c19653740 1 -- 172.21.15.67:0/2201009812 wait complete. 2024-09-10T20:57:25.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.196+0000 7f6c19653740 1 -- start start 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.196+0000 7f6c19653740 1 Processor -- start 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf400c900 con 0x55b3a2c4a9a0 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf400dd70 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf400cfd0 con 0x55b3a2c3ea10 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1501a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49088/0 (socket says 172.21.15.67:49088) 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1581b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35102/0 (socket says 172.21.15.67:35102) 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1501a640 1 -- 172.21.15.67:0/3997438289 learned_addr learned my addr 172.21.15.67:0/3997438289 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c19653740 10 client.0 _ll_register_callbacks cb 0x7f6c0c0abcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c14819640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.197+0000 7f6c1501a640 1 -- 172.21.15.67:0/3997438289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 msgr2=0x55b3a2c52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c1501a640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c1501a640 1 -- 172.21.15.67:0/3997438289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 msgr2=0x55b3a2c4d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c1501a640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c1501a640 1 -- 172.21.15.67:0/3997438289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a2c53570 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c14819640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:25.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c1501a640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c017670 tx=0x7f6c0c0b03f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289d4c02bb5ded2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:25.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c08009650 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6bf8ff9640 10 client.25763 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/3997438289 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c01e070 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.198+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/3997438289 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6c0c0ab2c0 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/3997438289 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c0c0c6b80 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 10 client.25763 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55b3a2cc7b00 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c1581b640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/3997438289 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6c0c0e4030 con 0x55b3a2c3e0f0 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 10 client.25763 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:25.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 20 client.25763 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.199+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2cc7f90 0x55b3a2cca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.200+0000 7f6c19653740 4 client.25763 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.200+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6c08009650 con 0x55b3a2cc7f90 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.200+0000 7f6c14819640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2cc7f90 0x55b3a2cca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.200+0000 7f6c14819640 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2cc7f90 0x55b3a2cca3b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dc0b5a5f6aa3d38 server_cookie=33508f048e795cbc in_seq=0 out_seq=0 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.200+0000 7f6bf8ff9640 10 client.25763 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.201+0000 7f6bf8ff9640 1 -- 172.21.15.67:0/3997438289 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6c08009650 con 0x55b3a2cc7f90 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.201+0000 7f6bf8ff9640 10 client.25763 handle_command_reply: tid=0 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.201+0000 7f6c19653740 1 client.25763 shutdown 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.201+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 msgr2=0x55b3a2c52a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.201+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c017670 tx=0x7f6c0c0b03f0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 shutdown_connections 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b3a2cc7f90 0x55b3a2cca3b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b3a2c4a9a0 0x55b3a2c4d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b3a2c3ea10 0x55b3a2c52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 --2- 172.21.15.67:0/3997438289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b3a2c3e0f0 0x55b3a2c52a40 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c017670 tx=0x7f6c0c0b03f0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 >> 172.21.15.67:0/3997438289 conn(0x55b3a2c3bf20 msgr2=0x55b3a2c3cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6bf8ff9640 0 client.25763 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:25.209 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 shutdown_connections 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 1 -- 172.21.15.67:0/3997438289 wait complete. 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.202+0000 7f6c19653740 20 client.25763 trim_cache size 0 max 16384 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.203+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 msgr2=0x7f6bfc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.203+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 0x7f6bfc0b78d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c0801b000 tx=0x7f6c0801e000 comp rx=0 tx=0).stop 2024-09-10T20:57:25.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 msgr2=0x7f6c1010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b4a0 tx=0x7f6c0c00b960 comp rx=0 tx=0).stop 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 shutdown_connections 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6c10109170 0x7f6c1010cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6bfc0b5410 0x7f6bfc0b78d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c101087f0 0x7f6c1010c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 --2- 172.21.15.67:0/2274401934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c10102de0 0x7f6c1010f640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 >> 172.21.15.67:0/2274401934 conn(0x7f6c100fe830 msgr2=0x7f6c10100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 shutdown_connections 2024-09-10T20:57:25.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:25.204+0000 7f6c1727e640 1 -- 172.21.15.67:0/2274401934 wait complete. 2024-09-10T20:57:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:26 smithi172 ceph-mon[35265]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-09-10T20:57:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:26 smithi067 ceph-mon[30891]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-09-10T20:57:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:26 smithi083 ceph-mon[35058]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-09-10T20:57:27.241 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:57:27.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:57:27.640 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 -- 172.21.15.67:0/3795613444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 msgr2=0x7fe9e0107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/3795613444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e0107b20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009900 tx=0x7fe9d402c650 comp rx=0 tx=0).stop 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 -- 172.21.15.67:0/3795613444 shutdown_connections 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/3795613444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0108060 0x7fe9e010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/3795613444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e0107b20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/3795613444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 -- 172.21.15.67:0/3795613444 >> 172.21.15.67:0/3795613444 conn(0x7fe9e00fd740 msgr2=0x7fe9e00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 -- 172.21.15.67:0/3795613444 shutdown_connections 2024-09-10T20:57:28.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.240+0000 7fe9e60a3640 1 -- 172.21.15.67:0/3795613444 wait complete. 2024-09-10T20:57:28.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 Processor -- start 2024-09-10T20:57:28.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 -- start start 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e01975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 0x7fe9e019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110c30 con 0x7fe9e01076e0 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110ab0 con 0x7fe9e0101cd0 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9e60a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110db0 con 0x7fe9e0108060 2024-09-10T20:57:28.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.241+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49102/0 (socket says 172.21.15.67:49102) 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9df7fe640 1 -- 172.21.15.67:0/2130695604 learned_addr learned my addr 172.21.15.67:0/2130695604 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 0x7fe9e019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9deffd640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e01975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 -- 172.21.15.67:0/2130695604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 msgr2=0x7fe9e01970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 -- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 msgr2=0x7fe9e01975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e01975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 -- 172.21.15.67:0/2130695604 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e019d150 con 0x7fe9e0108060 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.242+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 0x7fe9e019c980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800ec50 tx=0x7fe9d800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.243+0000 7fe9dcff9640 1 -- 172.21.15.67:0/2130695604 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8003b70 con 0x7fe9e0108060 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.243+0000 7fe9dcff9640 1 -- 172.21.15.67:0/2130695604 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d8003d10 con 0x7fe9e0108060 2024-09-10T20:57:28.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.243+0000 7fe9dcff9640 1 -- 172.21.15.67:0/2130695604 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8010830 con 0x7fe9e0108060 2024-09-10T20:57:28.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.243+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e019d440 con 0x7fe9e0108060 2024-09-10T20:57:28.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.243+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e01a3b00 con 0x7fe9e0108060 2024-09-10T20:57:28.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.246+0000 7fe9e8478740 1 Processor -- start 2024-09-10T20:57:28.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.246+0000 7fe9dcff9640 1 -- 172.21.15.67:0/2130695604 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe9d8003ec0 con 0x7fe9e0108060 2024-09-10T20:57:28.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 -- start start 2024-09-10T20:57:28.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f41b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41b800 0x56110f427250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f429b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56110f391e60 con 0x56110f41aee0 2024-09-10T20:57:28.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56110f381290 con 0x56110f427790 2024-09-10T20:57:28.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9e8478740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56110f3850a0 con 0x56110f41b800 2024-09-10T20:57:28.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f41b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f41b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35140/0 (socket says 172.21.15.67:35140) 2024-09-10T20:57:28.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9deffd640 1 -- 172.21.15.67:0/3368742143 learned_addr learned my addr 172.21.15.67:0/3368742143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:28.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41b800 0x56110f427250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.247+0000 7fe9deffd640 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f429b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.248+0000 7fe9deffd640 1 -- 172.21.15.67:0/3368742143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41b800 msgr2=0x56110f427250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9deffd640 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41b800 0x56110f427250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9deffd640 1 -- 172.21.15.67:0/3368742143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 msgr2=0x56110f41b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9deffd640 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f41b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9deffd640 1 -- 172.21.15.67:0/3368742143 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110f0df930 con 0x56110f427790 2024-09-10T20:57:28.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9deffd640 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f429b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009900 tx=0x7fe9d402c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60c5bac727e8d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9c5ffb640 1 -- 172.21.15.67:0/3368742143 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d403f450 con 0x56110f427790 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9c5ffb640 1 -- 172.21.15.67:0/3368742143 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d403faa0 con 0x56110f427790 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.250+0000 7fe9c5ffb640 1 -- 172.21.15.67:0/3368742143 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4033900 con 0x56110f427790 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9dcff9640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 0x7fe9c80b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 0x7fe9c80b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9dcff9640 1 -- 172.21.15.67:0/2130695604 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9d80e6090 con 0x7fe9e0108060 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 -- 172.21.15.67:0/3368742143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 msgr2=0x56110f429b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f429b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009900 tx=0x7fe9d402c650 comp rx=0 tx=0).stop 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 -- 172.21.15.67:0/3368742143 shutdown_connections 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f429b80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41b800 0x56110f427250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 --2- 172.21.15.67:0/3368742143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f41b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.251+0000 7fe9e8478740 1 -- 172.21.15.67:0/3368742143 >> 172.21.15.67:0/3368742143 conn(0x56110f418d10 msgr2=0x56110f419eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.252+0000 7fe9e8478740 1 -- 172.21.15.67:0/3368742143 shutdown_connections 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.252+0000 7fe9e8478740 1 -- 172.21.15.67:0/3368742143 wait complete. 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.252+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 0x7fe9c80b78f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56110f41e060 tx=0x7fe9d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.252+0000 7fe9e8478740 1 -- start start 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.252+0000 7fe9e8478740 1 Processor -- start 2024-09-10T20:57:28.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41aee0 0x56110f420850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f420d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56110f1e2890 con 0x56110f41b800 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56110f31bd40 con 0x56110f427790 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56110f42a320 con 0x56110f41aee0 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9e8478740 10 client.0 _ll_register_callbacks cb 0x56110f37fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49110/0 (socket says 172.21.15.67:49110) 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 -- 172.21.15.67:0/2762174715 learned_addr learned my addr 172.21.15.67:0/2762174715 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 -- 172.21.15.67:0/2762174715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41aee0 msgr2=0x56110f420850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41aee0 0x56110f420850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 -- 172.21.15.67:0/2762174715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 msgr2=0x56110f420d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f420d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.253+0000 7fe9dffff640 1 -- 172.21.15.67:0/2762174715 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110f426280 con 0x56110f427790 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8004af0 tx=0x7fe9d80ac1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4be22586a8cb234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9beffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8004660 con 0x56110f427790 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9d80cfbd0 con 0x56110f427790 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d403faa0 con 0x56110f427790 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe9d80ac390 con 0x56110f427790 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9e8478740 10 client.25775 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:28.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56110f4361d0 con 0x56110f427790 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.254+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d403faa0 con 0x56110f427790 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d80adbb0 con 0x56110f427790 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 10 client.25775 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 10 client.25775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 20 client.25775 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f437690 0x56110f439ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 4 client.25775 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56110f393db0 con 0x56110f437690 2024-09-10T20:57:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f437690 0x56110f439ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.255+0000 7fe9beffd640 10 client.25775 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.256+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f437690 0x56110f439ae0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dd1d38a1dea486 server_cookie=d689c9a786086d78 in_seq=0 out_seq=0 2024-09-10T20:57:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.256+0000 7fe9beffd640 1 -- 172.21.15.67:0/2762174715 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56110f393db0 con 0x56110f437690 2024-09-10T20:57:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.256+0000 7fe9beffd640 10 client.25775 handle_command_reply: tid=0 2024-09-10T20:57:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.256+0000 7fe9e8478740 1 client.25775 shutdown 2024-09-10T20:57:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.258+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 msgr2=0x56110f4212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.258+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8004af0 tx=0x7fe9d80ac1d0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 shutdown_connections 2024-09-10T20:57:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f437690 0x56110f439ae0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f427790 0x56110f4212d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f420d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 --2- 172.21.15.67:0/2762174715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f41aee0 0x56110f420850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9beffd640 0 client.25775 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 >> 172.21.15.67:0/2762174715 conn(0x56110f418d10 msgr2=0x56110f417f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 shutdown_connections 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.259+0000 7fe9e8478740 1 -- 172.21.15.67:0/2762174715 wait complete. 2024-09-10T20:57:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.260+0000 7fe9e8478740 20 client.25775 trim_cache size 0 max 16384 2024-09-10T20:57:28.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.289+0000 7fe9e8478740 1 Processor -- start 2024-09-10T20:57:28.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 -- start start 2024-09-10T20:57:28.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41b800 0x56110f42d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f43f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aea60 con 0x56110f41aee0 2024-09-10T20:57:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01ac330 con 0x56110f41b800 2024-09-10T20:57:28.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.293+0000 7fe9e8478740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aa180 con 0x56110f427790 2024-09-10T20:57:28.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.296+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.296+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35150/0 (socket says 172.21.15.67:35150) 2024-09-10T20:57:28.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.296+0000 7fe9df7fe640 1 -- 172.21.15.67:0/4193857638 learned_addr learned my addr 172.21.15.67:0/4193857638 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:28.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9dffff640 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f43f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9deffd640 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41b800 0x56110f42d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9df7fe640 1 -- 172.21.15.67:0/4193857638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 msgr2=0x56110f43f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f43f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9df7fe640 1 -- 172.21.15.67:0/4193857638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41b800 msgr2=0x56110f42d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41b800 0x56110f42d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.297+0000 7fe9df7fe640 1 -- 172.21.15.67:0/4193857638 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56110f414640 con 0x56110f41aee0 2024-09-10T20:57:28.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.298+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56110f43a350 tx=0x7fe9d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14781b04608b7373 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.299+0000 7fe9c57fa640 1 -- 172.21.15.67:0/4193857638 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0034070 con 0x56110f41aee0 2024-09-10T20:57:28.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.299+0000 7fe9c57fa640 1 -- 172.21.15.67:0/4193857638 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d00298d0 con 0x56110f41aee0 2024-09-10T20:57:28.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.299+0000 7fe9c57fa640 1 -- 172.21.15.67:0/4193857638 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d002f6b0 con 0x56110f41aee0 2024-09-10T20:57:28.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.300+0000 7fe9e8478740 1 -- 172.21.15.67:0/4193857638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 msgr2=0x56110f42cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.300+0000 7fe9e8478740 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56110f43a350 tx=0x7fe9d00046c0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.302+0000 7fe9e8478740 1 -- 172.21.15.67:0/4193857638 shutdown_connections 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.302+0000 7fe9e8478740 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f43f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.302+0000 7fe9e8478740 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41b800 0x56110f42d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.302+0000 7fe9e8478740 1 --2- 172.21.15.67:0/4193857638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41aee0 0x56110f42cef0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.303+0000 7fe9e8478740 1 -- 172.21.15.67:0/4193857638 >> 172.21.15.67:0/4193857638 conn(0x56110f418d10 msgr2=0x56110f425770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.303+0000 7fe9e8478740 1 -- 172.21.15.67:0/4193857638 shutdown_connections 2024-09-10T20:57:28.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.303+0000 7fe9e8478740 1 -- 172.21.15.67:0/4193857638 wait complete. 2024-09-10T20:57:28.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.304+0000 7fe9e8478740 1 -- start start 2024-09-10T20:57:28.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.305+0000 7fe9e8478740 1 Processor -- start 2024-09-10T20:57:28.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.305+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.305+0000 7fe9e8478740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f4322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49126/0 (socket says 172.21.15.67:49126) 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9df7fe640 1 -- 172.21.15.67:0/787349393 learned_addr learned my addr 172.21.15.67:0/787349393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f432810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aa7f0 con 0x56110f41b800 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01abc60 con 0x56110f41aee0 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9dffff640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f432810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.306+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aaec0 con 0x56110f427790 2024-09-10T20:57:28.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9deffd640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f4322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9df7fe640 1 -- 172.21.15.67:0/787349393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 msgr2=0x56110f432810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f432810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9df7fe640 1 -- 172.21.15.67:0/787349393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 msgr2=0x56110f4322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f4322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9df7fe640 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56110f432f00 con 0x56110f41aee0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9e8478740 10 client.0 _ll_register_callbacks cb 0x7fe9d8004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.307+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d00298d0 con 0x56110f41aee0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9df7fe640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0019040 tx=0x7fe9d000fed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3770bc6d37033c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9beffd640 10 client.25781 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9beffd640 1 -- 172.21.15.67:0/787349393 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0034070 con 0x56110f41aee0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9beffd640 1 -- 172.21.15.67:0/787349393 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9d0029a80 con 0x56110f41aee0 2024-09-10T20:57:28.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9beffd640 1 -- 172.21.15.67:0/787349393 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe9d0029c80 con 0x56110f41aee0 2024-09-10T20:57:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9e8478740 10 client.25781 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.308+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x56110f4a5370 con 0x56110f41aee0 2024-09-10T20:57:28.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9beffd640 1 -- 172.21.15.67:0/787349393 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d0005040 con 0x56110f41aee0 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 10 client.25781 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 10 client.25781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 20 client.25781 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f4a57f0 0x56110f4a7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 4 client.25781 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56110f38f860 con 0x56110f4a57f0 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.309+0000 7fe9deffd640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f4a57f0 0x56110f4a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.310+0000 7fe9deffd640 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f4a57f0 0x56110f4a7c10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf4bb8606b737d1 server_cookie=eab68b2741fcf12a in_seq=0 out_seq=0 2024-09-10T20:57:28.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.310+0000 7fe9beffd640 10 client.25781 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.311+0000 7fe9beffd640 1 -- 172.21.15.67:0/787349393 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56110f38f860 con 0x56110f4a57f0 2024-09-10T20:57:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.311+0000 7fe9beffd640 10 client.25781 handle_command_reply: tid=0 2024-09-10T20:57:28.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.311+0000 7fe9e8478740 1 client.25781 shutdown 2024-09-10T20:57:28.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.312+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 msgr2=0x56110f433d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0019040 tx=0x7fe9d000fed0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 shutdown_connections 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56110f4a57f0 0x56110f4a7c10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9beffd640 0 client.25781 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56110f427790 0x56110f432810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56110f41b800 0x56110f4322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 --2- 172.21.15.67:0/787349393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56110f41aee0 0x56110f433d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.313+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 >> 172.21.15.67:0/787349393 conn(0x56110f418d10 msgr2=0x56110f423e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.314+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 shutdown_connections 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.314+0000 7fe9e8478740 1 -- 172.21.15.67:0/787349393 wait complete. 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.314+0000 7fe9e8478740 20 client.25781 trim_cache size 0 max 16384 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "00387259-d45d-4cdd-860d-55aed9326a82", 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:57:28.319 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 msgr2=0x7fe9c80b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 0x7fe9c80b78f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56110f41e060 tx=0x7fe9d0005f90 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 msgr2=0x7fe9e019c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 0x7fe9e019c980 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800ec50 tx=0x7fe9d800c6a0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 shutdown_connections 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9c80b5430 0x7fe9c80b78f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108060 0x7fe9e019c980 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076e0 0x7fe9e01975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 --2- 172.21.15.67:0/2130695604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101cd0 0x7fe9e01970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 >> 172.21.15.67:0/2130695604 conn(0x7fe9e00fd740 msgr2=0x7fe9e00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 shutdown_connections 2024-09-10T20:57:28.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:28.315+0000 7fe9e60a3640 1 -- 172.21.15.67:0/2130695604 wait complete. 2024-09-10T20:57:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:28 smithi172 ceph-mon[35265]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.0 MiB/s wr, 772 op/s 2024-09-10T20:57:28.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:28 smithi067 ceph-mon[30891]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.0 MiB/s wr, 772 op/s 2024-09-10T20:57:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:28 smithi083 ceph-mon[35058]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 8.0 MiB/s wr, 772 op/s 2024-09-10T20:57:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 355.0 s, 2933.0 tps, lat 33.934 ms stddev 42.338 2024-09-10T20:57:29.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:57:29.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:29 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:57:29.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:29 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:57:29.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:57:29.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:57:29.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:57:29.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:29 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:29.773 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:57:30.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.358+0000 7f7de0fb6640 1 -- 172.21.15.67:0/3991693831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc100fd0 msgr2=0x7f7ddc1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.358+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/3991693831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc1013b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009860 tx=0x7f7dcc02a340 comp rx=0 tx=0).stop 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.359+0000 7f7de0fb6640 1 -- 172.21.15.67:0/3991693831 shutdown_connections 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.359+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/3991693831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc107360 0x7f7ddc10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.359+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/3991693831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.359+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/3991693831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc1013b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.359+0000 7f7de0fb6640 1 -- 172.21.15.67:0/3991693831 >> 172.21.15.67:0/3991693831 conn(0x7f7ddc0fca20 msgr2=0x7f7ddc0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.360+0000 7f7de0fb6640 1 -- 172.21.15.67:0/3991693831 shutdown_connections 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.360+0000 7f7de0fb6640 1 -- 172.21.15.67:0/3991693831 wait complete. 2024-09-10T20:57:30.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 Processor -- start 2024-09-10T20:57:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 -- start start 2024-09-10T20:57:30.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 0x7f7ddc073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc06d430 con 0x7f7ddc1069e0 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc06d2b0 con 0x7f7ddc107360 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.361+0000 7f7de0fb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc06d5b0 con 0x7f7ddc100fd0 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 0x7f7ddc073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 0x7f7ddc073490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49152/0 (socket says 172.21.15.67:49152) 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7ddad9d640 1 -- 172.21.15.67:0/4268004047 learned_addr learned my addr 172.21.15.67:0/4268004047 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:30.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dda59c640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/4268004047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 msgr2=0x7f7ddc074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/4268004047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 msgr2=0x7f7ddc073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 0x7f7ddc073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/4268004047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1b00a0 con 0x7f7ddc1069e0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.362+0000 7f7dda59c640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc072eb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000e9f0 tx=0x7f7dd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7dcb7fe640 1 -- 172.21.15.67:0/4268004047 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000ccc0 con 0x7f7ddc1069e0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7dcb7fe640 1 -- 172.21.15.67:0/4268004047 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd00108e0 con 0x7f7ddc1069e0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7dcb7fe640 1 -- 172.21.15.67:0/4268004047 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0018880 con 0x7f7ddc1069e0 2024-09-10T20:57:30.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc1b0270 con 0x7f7ddc1069e0 2024-09-10T20:57:30.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.363+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc1b0730 con 0x7f7ddc1069e0 2024-09-10T20:57:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.367+0000 7f7de338b740 1 Processor -- start 2024-09-10T20:57:30.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.367+0000 7f7dcb7fe640 1 -- 172.21.15.67:0/4268004047 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7dd0010430 con 0x7f7ddc1069e0 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 -- start start 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c4f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c51930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5653e9bb0e50 con 0x5653e9c3ada0 2024-09-10T20:57:30.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5653e9ba0280 con 0x5653e9c4f540 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7de338b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5653e9ba4090 con 0x5653e9c3a480 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c4f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c4f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35190/0 (socket says 172.21.15.67:35190) 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.368+0000 7f7dda59c640 1 -- 172.21.15.67:0/3608714508 learned_addr learned my addr 172.21.15.67:0/3608714508 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 -- 172.21.15.67:0/3608714508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 msgr2=0x5653e9c51930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c51930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 -- 172.21.15.67:0/3608714508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 msgr2=0x5653e9c4f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c4f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 -- 172.21.15.67:0/3608714508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e98fe650 con 0x5653e9c3a480 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.369+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c3a860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003cc0 tx=0x7f7dd400aec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6156237f374ca55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.370+0000 7f7dc8ff9640 1 -- 172.21.15.67:0/3608714508 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4004820 con 0x5653e9c3a480 2024-09-10T20:57:30.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.370+0000 7f7dc8ff9640 1 -- 172.21.15.67:0/3608714508 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd4016070 con 0x5653e9c3a480 2024-09-10T20:57:30.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.370+0000 7f7dc8ff9640 1 -- 172.21.15.67:0/3608714508 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4005980 con 0x5653e9c3a480 2024-09-10T20:57:30.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 -- 172.21.15.67:0/3608714508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 msgr2=0x5653e9c3a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c3a860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003cc0 tx=0x7f7dd400aec0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7dcb7fe640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 0x7f7dc40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 -- 172.21.15.67:0/3608714508 shutdown_connections 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c51930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c4f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 --2- 172.21.15.67:0/3608714508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c3a860 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 -- 172.21.15.67:0/3608714508 >> 172.21.15.67:0/3608714508 conn(0x5653e9c382b0 msgr2=0x5653e9c39450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 -- 172.21.15.67:0/3608714508 shutdown_connections 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 0x7f7dc40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7dcb7fe640 1 -- 172.21.15.67:0/4268004047 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7dd00e5f50 con 0x7f7ddc1069e0 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.371+0000 7f7de338b740 1 -- 172.21.15.67:0/3608714508 wait complete. 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 -- start start 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 0x7f7dc40b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003ad0 tx=0x7f7dd4008800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 Processor -- start 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c46db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c4f540 0x5653e9c4be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5653e9a01700 con 0x5653e9c4f540 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5653e9b3b110 con 0x5653e9c3ada0 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5653e9c40a70 con 0x5653e9c3a480 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.372+0000 7f7de338b740 10 client.0 _ll_register_callbacks cb 0x5653e9b54990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47208/0 (socket says 172.21.15.67:47208) 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 -- 172.21.15.67:0/2706720284 learned_addr learned my addr 172.21.15.67:0/2706720284 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c46db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 -- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 msgr2=0x5653e9c46db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c46db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 -- 172.21.15.67:0/2706720284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c4f540 msgr2=0x5653e9c4be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c4f540 0x5653e9c4be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 -- 172.21.15.67:0/2706720284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e9b68c40 con 0x5653e9c3a480 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dda59c640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc035040 tx=0x7f7dcc030fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723145e5b904a3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.373+0000 7f7dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc041070 con 0x5653e9c3a480 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7dcc030450 con 0x5653e9c3a480 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd4016070 con 0x5653e9c3a480 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc04b050 con 0x5653e9c3a480 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7de338b740 10 client.25768 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:30.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.374+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5653e9c55380 con 0x5653e9c3a480 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd4016070 con 0x5653e9c3a480 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7dcc0046c0 con 0x5653e9c3a480 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 10 client.25768 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 10 client.25768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 20 client.25768 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9c56890 0x5653e9c58c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 4 client.25768 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653e9bb2da0 con 0x5653e9c56890 2024-09-10T20:57:30.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.375+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9c56890 0x5653e9c58c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.377+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9c56890 0x5653e9c58c80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75c052757402150 server_cookie=786715060d8fe97b in_seq=0 out_seq=0 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.377+0000 7f7dc1ffb640 10 client.25768 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.378+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2706720284 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653e9bb2da0 con 0x5653e9c56890 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.378+0000 7f7dc1ffb640 10 client.25768 handle_command_reply: tid=0 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.378+0000 7f7de338b740 1 client.25768 shutdown 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.378+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 msgr2=0x5653e9c46870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.378+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc035040 tx=0x7f7dcc030fc0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 shutdown_connections 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9c56890 0x5653e9c58c80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c4f540 0x5653e9c4be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7dc1ffb640 0 client.25768 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:30.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c46db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 --2- 172.21.15.67:0/2706720284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c46870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.379+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 >> 172.21.15.67:0/2706720284 conn(0x5653e9c382b0 msgr2=0x5653e9c3de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.380+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 shutdown_connections 2024-09-10T20:57:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.380+0000 7f7de338b740 1 -- 172.21.15.67:0/2706720284 wait complete. 2024-09-10T20:57:30.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.380+0000 7f7de338b740 20 client.25768 trim_cache size 0 max 16384 2024-09-10T20:57:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.408+0000 7f7de338b740 1 Processor -- start 2024-09-10T20:57:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.408+0000 7f7de338b740 1 -- start start 2024-09-10T20:57:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c44f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b73d0 con 0x5653e9c3ada0 2024-09-10T20:57:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b4ca0 con 0x5653e9c4f540 2024-09-10T20:57:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.409+0000 7f7de338b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b2af0 con 0x5653e9c3a480 2024-09-10T20:57:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.414+0000 7f7dd9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.414+0000 7f7dd9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35204/0 (socket says 172.21.15.67:35204) 2024-09-10T20:57:30.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.414+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/1514356793 learned_addr learned my addr 172.21.15.67:0/1514356793 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.416+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c44f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.416+0000 7f7dda59c640 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.420+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/1514356793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 msgr2=0x5653e9c418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.420+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.420+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/1514356793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 msgr2=0x5653e9c44f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.420+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c44f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.420+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/1514356793 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e9c3abd0 con 0x5653e9c3ada0 2024-09-10T20:57:30.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.427+0000 7f7dd9d9b640 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00ac3e0 tx=0x7f7dd000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87e99493d0c083f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.432+0000 7f7dc3fff640 1 -- 172.21.15.67:0/1514356793 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00ac6e0 con 0x5653e9c3ada0 2024-09-10T20:57:30.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.432+0000 7f7dc3fff640 1 -- 172.21.15.67:0/1514356793 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd00b11c0 con 0x5653e9c3ada0 2024-09-10T20:57:30.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.432+0000 7f7dc3fff640 1 -- 172.21.15.67:0/1514356793 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00a8030 con 0x5653e9c3ada0 2024-09-10T20:57:30.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 -- 172.21.15.67:0/1514356793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 msgr2=0x5653e9c41e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00ac3e0 tx=0x7f7dd000ce60 comp rx=0 tx=0).stop 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 -- 172.21.15.67:0/1514356793 shutdown_connections 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c4f540 0x5653e9c44f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3ada0 0x5653e9c41e20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 --2- 172.21.15.67:0/1514356793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c3a480 0x5653e9c418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 -- 172.21.15.67:0/1514356793 >> 172.21.15.67:0/1514356793 conn(0x5653e9c382b0 msgr2=0x5653e9c4bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 -- 172.21.15.67:0/1514356793 shutdown_connections 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.435+0000 7f7de338b740 1 -- 172.21.15.67:0/1514356793 wait complete. 2024-09-10T20:57:30.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.436+0000 7f7de338b740 1 -- start start 2024-09-10T20:57:30.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.436+0000 7f7de338b740 1 Processor -- start 2024-09-10T20:57:30.441 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:30 smithi067 ceph-mon[30891]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-09-10T20:57:30.441 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:30 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.437+0000 7f7de338b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3a480 0x5653e9c687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.437+0000 7f7de338b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c68cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.437+0000 7f7de338b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 0x5653e9cc26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.437+0000 7f7dd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c68cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7dd9d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c68cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49192/0 (socket says 172.21.15.67:49192) 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7dd9d9b640 1 -- 172.21.15.67:0/2012082705 learned_addr learned my addr 172.21.15.67:0/2012082705 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 0x5653e9cc26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b3160 con 0x5653e9c3a480 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b45d0 con 0x5653e9c3ada0 2024-09-10T20:57:30.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b3830 con 0x5653e9c4f540 2024-09-10T20:57:30.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.438+0000 7f7de338b740 10 client.0 _ll_register_callbacks cb 0x7f7dd400ad60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:57:30.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 -- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 msgr2=0x5653e9c68cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c68cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 -- 172.21.15.67:0/2012082705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3a480 msgr2=0x5653e9c687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:57:30.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3a480 0x5653e9c687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e9cc2be0 con 0x5653e9c4f540 2024-09-10T20:57:30.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.441+0000 7f7ddad9d640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 0x5653e9cc26a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c010 tx=0x7f7dd4005600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de0ca610a8a6282c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:57:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:30 smithi172 ceph-mon[35265]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-09-10T20:57:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:30 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:30.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.445+0000 7f7dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:57:30.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.445+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4058060 con 0x5653e9c4f540 2024-09-10T20:57:30.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.445+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7dd4053680 con 0x5653e9c4f540 2024-09-10T20:57:30.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.447+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd00b11c0 con 0x5653e9c4f540 2024-09-10T20:57:30.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.449+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7dd4047e20 con 0x5653e9c4f540 2024-09-10T20:57:30.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.449+0000 7f7de338b740 10 client.25774 fetch_fsmap learned FSMap version 34 2024-09-10T20:57:30.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.449+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5653e9cc3df0 con 0x5653e9c4f540 2024-09-10T20:57:30.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.449+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd00b11c0 con 0x5653e9c4f540 2024-09-10T20:57:30.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.450+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7dd4004d10 con 0x5653e9c4f540 2024-09-10T20:57:30.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 10 client.25774 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:57:30.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 10 client.25774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 20 client.25774 populate_metadata read hostname 'smithi067' 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9cc4140 0x5653e9cc6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 4 client.25774 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653e9bae850 con 0x5653e9cc4140 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.451+0000 7f7dda59c640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9cc4140 0x5653e9cc6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:57:30.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.452+0000 7f7dc1ffb640 10 client.25774 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:30.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.452+0000 7f7dda59c640 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9cc4140 0x5653e9cc6530 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e638c9221b5a481d server_cookie=a5901fed1c023886 in_seq=0 out_seq=0 2024-09-10T20:57:30.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.452+0000 7f7dc1ffb640 1 -- 172.21.15.67:0/2012082705 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x5653e9bae850 con 0x5653e9cc4140 2024-09-10T20:57:30.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.452+0000 7f7dc1ffb640 10 client.25774 handle_command_reply: tid=0 2024-09-10T20:57:30.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.452+0000 7f7de338b740 1 client.25774 shutdown 2024-09-10T20:57:30.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 msgr2=0x5653e9cc26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 0x5653e9cc26a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c010 tx=0x7f7dd4005600 comp rx=0 tx=0).stop 2024-09-10T20:57:30.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 shutdown_connections 2024-09-10T20:57:30.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5653e9cc4140 0x5653e9cc6530 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653e9c4f540 0x5653e9cc26a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7dc1ffb640 0 client.25774 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.453+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5653e9c3ada0 0x5653e9c68cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.454+0000 7f7de338b740 1 --2- 172.21.15.67:0/2012082705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5653e9c3a480 0x5653e9c687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.454+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 >> 172.21.15.67:0/2012082705 conn(0x5653e9c382b0 msgr2=0x5653e9c4bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.454+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 shutdown_connections 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.454+0000 7f7de338b740 1 -- 172.21.15.67:0/2012082705 wait complete. 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.454+0000 7f7de338b740 20 client.25774 trim_cache size 0 max 16384 2024-09-10T20:57:30.459 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "00387259-d45d-4cdd-860d-55aed9326a82", 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.460 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:57:30.461 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.462 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.463 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.464 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:57:30.465 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:57:30.466 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:57:30.467 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:57:30.467 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:57:30.467 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.456+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 msgr2=0x7f7dc40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.456+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 0x7f7dc40b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4003ad0 tx=0x7f7dd4008800 comp rx=0 tx=0).stop 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.456+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 msgr2=0x7f7ddc072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.456+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc072eb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000e9f0 tx=0x7f7dd000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 shutdown_connections 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ddc107360 0x7f7ddc073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ddc1069e0 0x7f7ddc072eb0 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000e9f0 tx=0x7f7dd000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7dc40b5360 0x7f7dc40b7820 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 --2- 172.21.15.67:0/4268004047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ddc100fd0 0x7f7ddc074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:57:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.457+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 >> 172.21.15.67:0/4268004047 conn(0x7f7ddc0fca20 msgr2=0x7f7ddc10d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:57:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.458+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 shutdown_connections 2024-09-10T20:57:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:57:30.458+0000 7f7de0fb6640 1 -- 172.21.15.67:0/4268004047 wait complete. 2024-09-10T20:57:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:30 smithi083 ceph-mon[35058]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-09-10T20:57:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:30 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:57:31.368 INFO:tasks.cephfs.filesystem:scrub status for tag:00387259-d45d-4cdd-860d-55aed9326a82 - {'path': '/', 'tag': '00387259-d45d-4cdd-860d-55aed9326a82', 'options': 'recursive,force'} 2024-09-10T20:57:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:32 smithi172 ceph-mon[35265]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-10T20:57:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:32 smithi067 ceph-mon[30891]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-10T20:57:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:32 smithi083 ceph-mon[35058]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-09-10T20:57:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 360.0 s, 3615.8 tps, lat 27.758 ms stddev 31.607 2024-09-10T20:57:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:34 smithi172 ceph-mon[35265]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 751 op/s 2024-09-10T20:57:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:34 smithi067 ceph-mon[30891]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 751 op/s 2024-09-10T20:57:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:34 smithi083 ceph-mon[35058]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 751 op/s 2024-09-10T20:57:36.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:36 smithi172 ceph-mon[35265]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2024-09-10T20:57:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:36 smithi067 ceph-mon[30891]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2024-09-10T20:57:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:36 smithi083 ceph-mon[35058]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 715 op/s 2024-09-10T20:57:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:38 smithi067 ceph-mon[30891]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 814 op/s 2024-09-10T20:57:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:38 smithi083 ceph-mon[35058]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 814 op/s 2024-09-10T20:57:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:38 smithi172 ceph-mon[35265]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 814 op/s 2024-09-10T20:57:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 365.0 s, 4480.0 tps, lat 22.288 ms stddev 26.845 2024-09-10T20:57:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:40 smithi067 ceph-mon[30891]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-09-10T20:57:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:57:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:40 smithi083 ceph-mon[35058]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-09-10T20:57:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:57:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:40 smithi172 ceph-mon[35265]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 670 op/s 2024-09-10T20:57:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:57:41.445 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:57:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:57:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:57:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:57:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:57:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:57:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:57:41.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:57:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:42 smithi067 ceph-mon[30891]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-09-10T20:57:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:42 smithi083 ceph-mon[35058]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-09-10T20:57:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:42 smithi172 ceph-mon[35265]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 651 op/s 2024-09-10T20:57:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 370.0 s, 3077.8 tps, lat 32.628 ms stddev 36.531 2024-09-10T20:57:44.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:44 smithi067 ceph-mon[30891]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-09-10T20:57:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:44 smithi083 ceph-mon[35058]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-09-10T20:57:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:44 smithi172 ceph-mon[35265]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-09-10T20:57:46.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:46 smithi067 ceph-mon[30891]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.7 MiB/s wr, 795 op/s 2024-09-10T20:57:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:46 smithi083 ceph-mon[35058]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.7 MiB/s wr, 795 op/s 2024-09-10T20:57:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:46 smithi172 ceph-mon[35265]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.7 MiB/s wr, 795 op/s 2024-09-10T20:57:48.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:48 smithi067 ceph-mon[30891]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.3 MiB/s wr, 855 op/s 2024-09-10T20:57:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:48 smithi083 ceph-mon[35058]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.3 MiB/s wr, 855 op/s 2024-09-10T20:57:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:48 smithi172 ceph-mon[35265]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.3 MiB/s wr, 855 op/s 2024-09-10T20:57:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 375.0 s, 2946.2 tps, lat 33.649 ms stddev 36.415 2024-09-10T20:57:50.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:50 smithi067 ceph-mon[30891]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.4 MiB/s wr, 729 op/s 2024-09-10T20:57:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:50 smithi083 ceph-mon[35058]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.4 MiB/s wr, 729 op/s 2024-09-10T20:57:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:50 smithi172 ceph-mon[35265]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.4 MiB/s wr, 729 op/s 2024-09-10T20:57:52.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:52 smithi067 ceph-mon[30891]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-09-10T20:57:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:52 smithi083 ceph-mon[35058]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-09-10T20:57:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:52 smithi172 ceph-mon[35265]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-09-10T20:57:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 380.0 s, 2843.8 tps, lat 35.414 ms stddev 38.196 2024-09-10T20:57:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:54 smithi067 ceph-mon[30891]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.8 MiB/s wr, 856 op/s 2024-09-10T20:57:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:54 smithi083 ceph-mon[35058]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.8 MiB/s wr, 856 op/s 2024-09-10T20:57:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:54 smithi172 ceph-mon[35265]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.8 MiB/s wr, 856 op/s 2024-09-10T20:57:56.501 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:56 smithi172 ceph-mon[35265]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.6 MiB/s wr, 725 op/s 2024-09-10T20:57:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:56 smithi067 ceph-mon[30891]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.6 MiB/s wr, 725 op/s 2024-09-10T20:57:56.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:56 smithi083 ceph-mon[35058]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.6 MiB/s wr, 725 op/s 2024-09-10T20:57:58.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:57:58 smithi067 ceph-mon[30891]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 763 op/s 2024-09-10T20:57:58.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:57:58 smithi083 ceph-mon[35058]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 763 op/s 2024-09-10T20:57:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:57:58 smithi172 ceph-mon[35265]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.9 MiB/s wr, 763 op/s 2024-09-10T20:57:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 385.0 s, 2776.8 tps, lat 36.009 ms stddev 38.029 2024-09-10T20:58:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:00 smithi067 ceph-mon[30891]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 666 op/s 2024-09-10T20:58:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:00 smithi083 ceph-mon[35058]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 666 op/s 2024-09-10T20:58:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:00 smithi172 ceph-mon[35265]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 666 op/s 2024-09-10T20:58:01.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:58:01.726 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:02.462 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:02 smithi067 ceph-mon[30891]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-10T20:58:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 -- 172.21.15.67:0/3190561279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa910103cd0 msgr2=0x7fa9101040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 --2- 172.21.15.67:0/3190561279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa910103cd0 0x7fa9101040b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa900009860 tx=0x7fa90002a340 comp rx=0 tx=0).stop 2024-09-10T20:58:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 -- 172.21.15.67:0/3190561279 shutdown_connections 2024-09-10T20:58:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 --2- 172.21.15.67:0/3190561279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa91010d130 0x7fa91010f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 --2- 172.21.15.67:0/3190561279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9101045f0 0x7fa91010cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 --2- 172.21.15.67:0/3190561279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa910103cd0 0x7fa9101040b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.473+0000 7fa915c48640 1 -- 172.21.15.67:0/3190561279 >> 172.21.15.67:0/3190561279 conn(0x7fa9100fd770 msgr2=0x7fa9100ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.474+0000 7fa915c48640 1 -- 172.21.15.67:0/3190561279 shutdown_connections 2024-09-10T20:58:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.474+0000 7fa915c48640 1 -- 172.21.15.67:0/3190561279 wait complete. 2024-09-10T20:58:02.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.474+0000 7fa915c48640 1 Processor -- start 2024-09-10T20:58:02.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 -- start start 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa910103cd0 0x7fa910199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 0x7fa91019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa910112da0 con 0x7fa9101045f0 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa910112c20 con 0x7fa91010d130 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa915c48640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa910112f20 con 0x7fa910103cd0 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54982/0 (socket says 172.21.15.67:54982) 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 0x7fa91019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90effd640 1 -- 172.21.15.67:0/3321357634 learned_addr learned my addr 172.21.15.67:0/3321357634 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:02.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa910103cd0 0x7fa910199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 -- 172.21.15.67:0/3321357634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa910103cd0 msgr2=0x7fa910199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa910103cd0 0x7fa910199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 -- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 msgr2=0x7fa9101997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90ffff640 1 -- 172.21.15.67:0/3321357634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91019f340 con 0x7fa91010d130 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.475+0000 7fa90effd640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa90ffff640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 0x7fa91019eb70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa90800ef00 tx=0x7fa90800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa90cff9640 1 -- 172.21.15.67:0/3321357634 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908004b20 con 0x7fa91010d130 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa90cff9640 1 -- 172.21.15.67:0/3321357634 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa908003e20 con 0x7fa91010d130 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91019f630 con 0x7fa91010d130 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa90cff9640 1 -- 172.21.15.67:0/3321357634 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90800b570 con 0x7fa91010d130 2024-09-10T20:58:02.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.476+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101a5cf0 con 0x7fa91010d130 2024-09-10T20:58:02.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.478+0000 7fa90cff9640 1 -- 172.21.15.67:0/3321357634 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa90800b040 con 0x7fa91010d130 2024-09-10T20:58:02.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 Processor -- start 2024-09-10T20:58:02.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 -- start start 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b0380820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b0383150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5595b02e6e50 con 0x5595b03709c0 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5595b02d6280 con 0x5595b03700a0 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa91801d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595b02da090 con 0x5595b0380d60 2024-09-10T20:58:02.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.479+0000 7fa90cff9640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 0x7fa8f80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43714/0 (socket says 172.21.15.67:43714) 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90ffff640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 0x7fa8f80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 -- 172.21.15.67:0/1350257473 learned_addr learned my addr 172.21.15.67:0/1350257473 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b0383150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90cff9640 1 -- 172.21.15.67:0/3321357634 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa9080e59e0 con 0x7fa91010d130 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b0380820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 -- 172.21.15.67:0/1350257473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 msgr2=0x5595b0383150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b0383150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 -- 172.21.15.67:0/1350257473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 msgr2=0x5595b0380820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b0380820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 -- 172.21.15.67:0/1350257473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b0034650 con 0x5595b03700a0 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90ffff640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 0x7fa8f80b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9080b3fd0 tx=0x7fa9080708e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b0380820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.480+0000 7fa90effd640 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa904011c50 tx=0x7fa904004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab280402f3b8830 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.481+0000 7fa8f5ffb640 1 -- 172.21.15.67:0/1350257473 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400fc50 con 0x5595b03700a0 2024-09-10T20:58:02.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.481+0000 7fa8f5ffb640 1 -- 172.21.15.67:0/1350257473 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90400fdf0 con 0x5595b03700a0 2024-09-10T20:58:02.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.482+0000 7fa8f5ffb640 1 -- 172.21.15.67:0/1350257473 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904004db0 con 0x5595b03700a0 2024-09-10T20:58:02.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.482+0000 7fa91801d740 1 -- 172.21.15.67:0/1350257473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 msgr2=0x5595b0370480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.482+0000 7fa91801d740 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa904011c50 tx=0x7fa904004730 comp rx=0 tx=0).stop 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.483+0000 7fa91801d740 1 -- 172.21.15.67:0/1350257473 shutdown_connections 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.483+0000 7fa91801d740 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b0383150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.483+0000 7fa91801d740 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b0380820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.483+0000 7fa91801d740 1 --2- 172.21.15.67:0/1350257473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0370480 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.483+0000 7fa91801d740 1 -- 172.21.15.67:0/1350257473 >> 172.21.15.67:0/1350257473 conn(0x5595b036ded0 msgr2=0x5595b036f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.484+0000 7fa91801d740 1 -- 172.21.15.67:0/1350257473 shutdown_connections 2024-09-10T20:58:02.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.484+0000 7fa91801d740 1 -- 172.21.15.67:0/1350257473 wait complete. 2024-09-10T20:58:02.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.484+0000 7fa91801d740 1 -- start start 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.484+0000 7fa91801d740 1 Processor -- start 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa91801d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0380610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa91801d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa91801d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b037e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa91801d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5595b0137700 con 0x5595b03709c0 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55006/0 (socket says 172.21.15.67:55006) 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa90f7fe640 1 -- 172.21.15.67:0/904532432 learned_addr learned my addr 172.21.15.67:0/904532432 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:02.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.485+0000 7fa90effd640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0380610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5595b0271110 con 0x5595b03700a0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595b0383a60 con 0x5595b0380d60 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa91801d740 10 client.0 _ll_register_callbacks cb 0x5595b028a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90effd640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b037e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90f7fe640 1 -- 172.21.15.67:0/904532432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 msgr2=0x5595b037e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b037e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90f7fe640 1 -- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 msgr2=0x5595b0380610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0380610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.486+0000 7fa90f7fe640 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b029ec40 con 0x5595b03709c0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa90002a930 tx=0x7fa900030570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832c7bc72e34ee9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa8eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:58:02.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900041070 con 0x5595b03709c0 2024-09-10T20:58:02.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa90400fdf0 con 0x5595b03709c0 2024-09-10T20:58:02.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa900005250 con 0x5595b03709c0 2024-09-10T20:58:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa90004b050 con 0x5595b03709c0 2024-09-10T20:58:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa91801d740 10 client.16128 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.487+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595b038f360 con 0x5595b03709c0 2024-09-10T20:58:02.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa90400fdf0 con 0x5595b03709c0 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa9000046c0 con 0x5595b03709c0 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 10 client.16128 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 20 client.16128 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b0390b90 0x5595b0392fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 4 client.16128 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595b02e8da0 con 0x5595b0390b90 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.488+0000 7fa90effd640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b0390b90 0x5595b0392fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.489+0000 7fa8eeffd640 10 client.16128 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.489+0000 7fa90effd640 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b0390b90 0x5595b0392fc0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f45ce7302d45109 server_cookie=9f01aad9d0eb5fa9 in_seq=0 out_seq=0 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.489+0000 7fa8eeffd640 1 -- 172.21.15.67:0/904532432 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595b02e8da0 con 0x5595b0390b90 2024-09-10T20:58:02.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.489+0000 7fa8eeffd640 10 client.16128 handle_command_reply: tid=0 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.489+0000 7fa91801d740 1 client.16128 shutdown 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 msgr2=0x5595b037dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa90002a930 tx=0x7fa900030570 comp rx=0 tx=0).stop 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 shutdown_connections 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b0390b90 0x5595b0392fc0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b0380d60 0x5595b037e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037dab0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 --2- 172.21.15.67:0/904532432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b03700a0 0x5595b0380610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.490+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 >> 172.21.15.67:0/904532432 conn(0x5595b036ded0 msgr2=0x5595b0373a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.491+0000 7fa8eeffd640 0 client.16128 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.491+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 shutdown_connections 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.491+0000 7fa91801d740 1 -- 172.21.15.67:0/904532432 wait complete. 2024-09-10T20:58:02.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.491+0000 7fa91801d740 20 client.16128 trim_cache size 0 max 16384 2024-09-10T20:58:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.518+0000 7fa91801d740 1 Processor -- start 2024-09-10T20:58:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.518+0000 7fa91801d740 1 -- start start 2024-09-10T20:58:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b037c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101aea20 con 0x5595b03709c0 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101ac2f0 con 0x5595b0380d60 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa91801d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101aa160 con 0x5595b03700a0 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:58982/0 (socket says 172.21.15.67:58982) 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 -- 172.21.15.67:0/394245895 learned_addr learned my addr 172.21.15.67:0/394245895 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b037c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 -- 172.21.15.67:0/394245895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 msgr2=0x5595b037c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b037c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 -- 172.21.15.67:0/394245895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 msgr2=0x5595b037c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.519+0000 7fa90effd640 1 -- 172.21.15.67:0/394245895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b037ba00 con 0x5595b03700a0 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa90effd640 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9040058c0 tx=0x7fa904023040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d423055e3de252e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa8f57fa640 1 -- 172.21.15.67:0/394245895 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904004030 con 0x5595b03700a0 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa8f57fa640 1 -- 172.21.15.67:0/394245895 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9040035f0 con 0x5595b03700a0 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa8f57fa640 1 -- 172.21.15.67:0/394245895 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90402f350 con 0x5595b03700a0 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 -- 172.21.15.67:0/394245895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 msgr2=0x5595b038cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9040058c0 tx=0x7fa904023040 comp rx=0 tx=0).stop 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 -- 172.21.15.67:0/394245895 shutdown_connections 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b037c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b037c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 --2- 172.21.15.67:0/394245895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b038cce0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.520+0000 7fa91801d740 1 -- 172.21.15.67:0/394245895 >> 172.21.15.67:0/394245895 conn(0x5595b036ded0 msgr2=0x5595b0382b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.521+0000 7fa91801d740 1 -- 172.21.15.67:0/394245895 shutdown_connections 2024-09-10T20:58:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.521+0000 7fa91801d740 1 -- 172.21.15.67:0/394245895 wait complete. 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.521+0000 7fa91801d740 1 -- start start 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.522+0000 7fa91801d740 1 Processor -- start 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b0389540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b03985a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b0398b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101aa7b0 con 0x5595b03709c0 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101abc20 con 0x5595b0380d60 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101aae80 con 0x5595b03700a0 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa91801d740 10 client.0 _ll_register_callbacks cb 0x7fa908009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b03985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b03985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55032/0 (socket says 172.21.15.67:55032) 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa90f7fe640 1 -- 172.21.15.67:0/9306334 learned_addr learned my addr 172.21.15.67:0/9306334 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa90effd640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b0398b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.523+0000 7fa90effd640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b0389540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 -- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 msgr2=0x5595b0398b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b0398b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 -- 172.21.15.67:0/9306334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 msgr2=0x5595b03985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b03985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 -- 172.21.15.67:0/9306334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b0399370 con 0x5595b03700a0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa90effd640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b0389540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa904009c80 tx=0x7fa904000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5366220c5ef39942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa8eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:02.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040110f0 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa904011290 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.524+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9040035f0 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa9040037a0 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 10 client.25792 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595b03fdbf0 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9040035f0 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa90401d030 con 0x5595b03700a0 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 10 client.25792 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 10 client.25792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 20 client.25792 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b03fe180 0x5595b04005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 4 client.25792 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.525+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595b02e4850 con 0x5595b03fe180 2024-09-10T20:58:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.526+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b03fe180 0x5595b04005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.526+0000 7fa8eeffd640 10 client.25792 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.526+0000 7fa90f7fe640 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b03fe180 0x5595b04005a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b12d8b1d86f69b server_cookie=53b2930012d8da73 in_seq=0 out_seq=0 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.526+0000 7fa8eeffd640 1 -- 172.21.15.67:0/9306334 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x5595b02e4850 con 0x5595b03fe180 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.526+0000 7fa8eeffd640 10 client.25792 handle_command_reply: tid=0 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 client.25792 shutdown 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 msgr2=0x5595b0389540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b0389540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa904009c80 tx=0x7fa904000bc0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 shutdown_connections 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5595b03fe180 0x5595b04005a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa8eeffd640 0 client.25792 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5595b0380d60 0x5595b0398b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5595b03709c0 0x5595b03985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 --2- 172.21.15.67:0/9306334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595b03700a0 0x5595b0389540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 >> 172.21.15.67:0/9306334 conn(0x5595b036ded0 msgr2=0x5595b037c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 shutdown_connections 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 1 -- 172.21.15.67:0/9306334 wait complete. 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.527+0000 7fa91801d740 20 client.25792 trim_cache size 0 max 16384 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:58:02.535 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.536 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.537 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.538 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:58:02.539 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:02.540 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 msgr2=0x7fa8f80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 0x7fa8f80b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9080b3fd0 tx=0x7fa9080708e0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 msgr2=0x7fa91019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 0x7fa91019eb70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa90800ef00 tx=0x7fa90800c740 comp rx=0 tx=0).stop 2024-09-10T20:58:02.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 shutdown_connections 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa91010d130 0x7fa91019eb70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa9101045f0 0x7fa9101997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa8f80b5360 0x7fa8f80b7820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 --2- 172.21.15.67:0/3321357634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa910103cd0 0x7fa910199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 >> 172.21.15.67:0/3321357634 conn(0x7fa9100fd770 msgr2=0x7fa91010f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 shutdown_connections 2024-09-10T20:58:02.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:02.528+0000 7fa915c48640 1 -- 172.21.15.67:0/3321357634 wait complete. 2024-09-10T20:58:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:02 smithi083 ceph-mon[35058]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-10T20:58:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:02 smithi172 ceph-mon[35265]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-09-10T20:58:03.652 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:58:03.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:58:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 390.0 s, 2344.6 tps, lat 42.572 ms stddev 46.710 2024-09-10T20:58:04.064 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:04.524 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:04 smithi067 ceph-mon[30891]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.2 MiB/s wr, 791 op/s 2024-09-10T20:58:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:04 smithi083 ceph-mon[35058]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.2 MiB/s wr, 791 op/s 2024-09-10T20:58:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 -- 172.21.15.67:0/805241665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 msgr2=0x7f8da0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 --2- 172.21.15.67:0/805241665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da0107ae0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009900 tx=0x7f8d9c02a410 comp rx=0 tx=0).stop 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 -- 172.21.15.67:0/805241665 shutdown_connections 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 --2- 172.21.15.67:0/805241665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 --2- 172.21.15.67:0/805241665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da0107ae0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 --2- 172.21.15.67:0/805241665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 0x7f8da0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.648+0000 7f8da8247640 1 -- 172.21.15.67:0/805241665 >> 172.21.15.67:0/805241665 conn(0x7f8da00fd700 msgr2=0x7f8da00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.649+0000 7f8da8247640 1 -- 172.21.15.67:0/805241665 shutdown_connections 2024-09-10T20:58:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.649+0000 7f8da8247640 1 -- 172.21.15.67:0/805241665 wait complete. 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 Processor -- start 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 -- start start 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 0x7f8da0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da57e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8da0111d30 con 0x7f8da01076a0 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8da0111bb0 con 0x7f8da0101c90 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da57e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55048/0 (socket says 172.21.15.67:55048) 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da57e2640 1 -- 172.21.15.67:0/319364106 learned_addr learned my addr 172.21.15.67:0/319364106 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.650+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8da0111eb0 con 0x7f8da0108020 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da67e4640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da5fe3640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 0x7f8da0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 -- 172.21.15.67:0/319364106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 msgr2=0x7f8da019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 -- 172.21.15.67:0/319364106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 msgr2=0x7f8da0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 0x7f8da0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da019f330 con 0x7f8da01076a0 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da67e4640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.651+0000 7f8da57e2640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005ab0 tx=0x7f8d9c03ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.652+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035070 con 0x7f8da01076a0 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.652+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d9c003cb0 con 0x7f8da01076a0 2024-09-10T20:58:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.652+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c031c90 con 0x7f8da01076a0 2024-09-10T20:58:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.653+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da019f5c0 con 0x7f8da01076a0 2024-09-10T20:58:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.653+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da00fdae0 con 0x7f8da01076a0 2024-09-10T20:58:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.654+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da0102f40 con 0x7f8da01076a0 2024-09-10T20:58:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.656+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8d9c0315c0 con 0x7f8da01076a0 2024-09-10T20:58:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.657+0000 7f8d96ffd640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 0x7f8d8c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.658+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8d9c109d90 con 0x7f8da01076a0 2024-09-10T20:58:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.658+0000 7f8da5fe3640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 0x7f8d8c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:04.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.659+0000 7f8da5fe3640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 0x7f8d8c0b78a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009b60 tx=0x7f8d90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:04.665+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8d9c0d0c20 con 0x7f8da01076a0 2024-09-10T20:58:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:04 smithi172 ceph-mon[35265]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.2 MiB/s wr, 791 op/s 2024-09-10T20:58:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.016+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da00fdd10 con 0x7f8da01076a0 2024-09-10T20:58:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.018+0000 7f8d96ffd640 1 -- 172.21.15.67:0/319364106 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f8d9c0d0520 con 0x7f8da01076a0 2024-09-10T20:58:05.022 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:58:05.023 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:58:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T20:58:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 msgr2=0x7f8d8c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 0x7f8d8c0b78a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009b60 tx=0x7f8d90005f90 comp rx=0 tx=0).stop 2024-09-10T20:58:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 msgr2=0x7f8da01997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005ab0 tx=0x7f8d9c03ac10 comp rx=0 tx=0).stop 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 shutdown_connections 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8d8c0b53e0 0x7f8d8c0b78a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da0108020 0x7f8da019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8da01076a0 0x7f8da01997c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.023+0000 7f8da8247640 1 --2- 172.21.15.67:0/319364106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8da0101c90 0x7f8da0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.024+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 >> 172.21.15.67:0/319364106 conn(0x7f8da00fd700 msgr2=0x7f8da0104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.024+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 shutdown_connections 2024-09-10T20:58:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:05.024+0000 7f8da8247640 1 -- 172.21.15.67:0/319364106 wait complete. 2024-09-10T20:58:05.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:05 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/319364106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:05.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:05 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/319364106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:05.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:05 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/319364106' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:05.804 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:58:06.273 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:06.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:06 smithi067 ceph-mon[30891]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-09-10T20:58:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:06 smithi083 ceph-mon[35058]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-09-10T20:58:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:06 smithi172 ceph-mon[35265]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.7 MiB/s wr, 657 op/s 2024-09-10T20:58:06.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.890+0000 7f0426ffd640 1 -- 172.21.15.67:0/3330118003 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042002e330 con 0x7f042810a530 2024-09-10T20:58:06.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.891+0000 7f042e4e9640 1 -- 172.21.15.67:0/3330118003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042810a530 msgr2=0x7f042810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.891+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3330118003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042810a530 0x7f042810a930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0420009ca0 tx=0x7f042002a980 comp rx=0 tx=0).stop 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 -- 172.21.15.67:0/3330118003 shutdown_connections 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3330118003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042811c0a0 0x7f042811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3330118003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042810a530 0x7f042810a930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3330118003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042810a150 0x7f04281111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 -- 172.21.15.67:0/3330118003 >> 172.21.15.67:0/3330118003 conn(0x7f042806dfc0 msgr2=0x7f042806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 -- 172.21.15.67:0/3330118003 shutdown_connections 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.900+0000 7f042e4e9640 1 -- 172.21.15.67:0/3330118003 wait complete. 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 Processor -- start 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 -- start start 2024-09-10T20:58:06.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042810a150 0x7f04281155a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 0x7f0428115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 0x7f042811ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0428111d00 con 0x7f042810a150 2024-09-10T20:58:06.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0428111b80 con 0x7f042811c0a0 2024-09-10T20:58:06.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.901+0000 7f042e4e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0428111e80 con 0x7f042810a530 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.902+0000 7f042ca86640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 0x7f042811ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.902+0000 7f042ca86640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 0x7f042811ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43774/0 (socket says 172.21.15.67:43774) 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.902+0000 7f042ca86640 1 -- 172.21.15.67:0/3300750586 learned_addr learned my addr 172.21.15.67:0/3300750586 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.902+0000 7f04277fe640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 0x7f0428115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 -- 172.21.15.67:0/3300750586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 msgr2=0x7f042811ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 0x7f042811ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 -- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042810a150 msgr2=0x7f04281155a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042810a150 0x7f04281155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 -- 172.21.15.67:0/3300750586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042811b540 con 0x7f042810a530 2024-09-10T20:58:06.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04277fe640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 0x7f0428115ae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0420009ca0 tx=0x7f0420003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04257fa640 1 -- 172.21.15.67:0/3300750586 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420034050 con 0x7f042810a530 2024-09-10T20:58:06.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04257fa640 1 -- 172.21.15.67:0/3300750586 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042002f880 con 0x7f042810a530 2024-09-10T20:58:06.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.903+0000 7f04257fa640 1 -- 172.21.15.67:0/3300750586 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04200047c0 con 0x7f042810a530 2024-09-10T20:58:06.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.907+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042811b7d0 con 0x7f042810a530 2024-09-10T20:58:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.907+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042811bb70 con 0x7f042810a530 2024-09-10T20:58:06.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.910+0000 7f04308be740 1 Processor -- start 2024-09-10T20:58:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.911+0000 7f04308be740 1 -- start start 2024-09-10T20:58:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2bfd80 0x55891d2c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55891d229ea0 con 0x55891d2bfd80 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55891d2192d0 con 0x55891d2b3df0 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f04308be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55891d21d0e0 con 0x55891d2b34d0 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59040/0 (socket says 172.21.15.67:59040) 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 -- 172.21.15.67:0/238399095 learned_addr learned my addr 172.21.15.67:0/238399095 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 -- 172.21.15.67:0/238399095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 msgr2=0x55891d2bf840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bf840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 -- 172.21.15.67:0/238399095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2bfd80 msgr2=0x55891d2c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2bfd80 0x55891d2c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.912+0000 7f042ca86640 1 -- 172.21.15.67:0/238399095 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55891cf77650 con 0x55891d2b34d0 2024-09-10T20:58:06.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.913+0000 7f042ca86640 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0418009a90 tx=0x7f0418009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7b2309e889a227 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.913+0000 7f040e7fc640 1 -- 172.21.15.67:0/238399095 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418017070 con 0x55891d2b34d0 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.914+0000 7f040e7fc640 1 -- 172.21.15.67:0/238399095 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f041800eba0 con 0x55891d2b34d0 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.914+0000 7f040e7fc640 1 -- 172.21.15.67:0/238399095 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418012610 con 0x55891d2b34d0 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.914+0000 7f04257fa640 1 -- 172.21.15.67:0/3300750586 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0420041070 con 0x7f042810a530 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.916+0000 7f04257fa640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 0x7f04100c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.916+0000 7f04308be740 1 -- 172.21.15.67:0/238399095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 msgr2=0x55891d2b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.916+0000 7f04308be740 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0418009a90 tx=0x7f0418009f50 comp rx=0 tx=0).stop 2024-09-10T20:58:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.916+0000 7f04257fa640 1 -- 172.21.15.67:0/3300750586 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0420108c90 con 0x7f042810a530 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.918+0000 7f0427fff640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 0x7f04100c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 -- 172.21.15.67:0/238399095 shutdown_connections 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2bfd80 0x55891d2c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 --2- 172.21.15.67:0/238399095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2b34d0 0x55891d2b38b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 -- 172.21.15.67:0/238399095 >> 172.21.15.67:0/238399095 conn(0x55891d2b1300 msgr2=0x55891d2b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 -- 172.21.15.67:0/238399095 shutdown_connections 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.919+0000 7f04308be740 1 -- 172.21.15.67:0/238399095 wait complete. 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.920+0000 7f04308be740 1 -- start start 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.920+0000 7f04308be740 1 Processor -- start 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2bf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bcae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55891d07a700 con 0x55891d2b34d0 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55891d1b4160 con 0x55891d2b3df0 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55891d2c2a00 con 0x55891d2bfd80 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.921+0000 7f04308be740 10 client.0 _ll_register_callbacks cb 0x55891d1cd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.922+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.922+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59044/0 (socket says 172.21.15.67:59044) 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.922+0000 7f042ca86640 1 -- 172.21.15.67:0/1388153999 learned_addr learned my addr 172.21.15.67:0/1388153999 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.922+0000 7f04277fe640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.924+0000 7f0427fff640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2bf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.925+0000 7f0427fff640 1 -- 172.21.15.67:0/1388153999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 msgr2=0x55891d2bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.925+0000 7f0427fff640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2bd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.925+0000 7f0427fff640 1 -- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 msgr2=0x55891d2bcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.925+0000 7f0427fff640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.925+0000 7f0427fff640 1 -- 172.21.15.67:0/1388153999 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55891d1e1c90 con 0x55891d2b34d0 2024-09-10T20:58:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.926+0000 7f0427fff640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 0x7f04100c88b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f041c005fd0 tx=0x7f041c0147e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.927+0000 7f0427fff640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2bf690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f041c005d00 tx=0x7f041c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d818e2e83351fedc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.929+0000 7f04077fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:58:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.929+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c014230 con 0x55891d2b34d0 2024-09-10T20:58:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.929+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f041800eba0 con 0x55891d2b34d0 2024-09-10T20:58:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.929+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f041c01c6f0 con 0x55891d2b34d0 2024-09-10T20:58:06.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.930+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f041c01c8f0 con 0x55891d2b34d0 2024-09-10T20:58:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.931+0000 7f04308be740 10 client.16146 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.931+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55891d2f03a0 con 0x55891d2b34d0 2024-09-10T20:58:06.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.934+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f041800eba0 con 0x55891d2b34d0 2024-09-10T20:58:06.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.934+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f041c01eac0 con 0x55891d2b34d0 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 10 client.16146 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 10 client.16146 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 20 client.16146 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d2f18b0 0x55891d2f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 4 client.16146 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:06.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55891d22bdf0 con 0x55891d2f18b0 2024-09-10T20:58:06.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.936+0000 7f04277fe640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d2f18b0 0x55891d2f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.937+0000 7f04277fe640 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d2f18b0 0x55891d2f3ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3723086e5d71b74c server_cookie=7b5a39e453b67053 in_seq=0 out_seq=0 2024-09-10T20:58:06.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.937+0000 7f04077fe640 10 client.16146 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:06.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.937+0000 7f04077fe640 1 -- 172.21.15.67:0/1388153999 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55891d22bdf0 con 0x55891d2f18b0 2024-09-10T20:58:06.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.937+0000 7f04077fe640 10 client.16146 handle_command_reply: tid=0 2024-09-10T20:58:06.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.937+0000 7f04308be740 1 client.16146 shutdown 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 msgr2=0x55891d2bf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2bf690 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f041c005d00 tx=0x7f041c017000 comp rx=0 tx=0).stop 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 shutdown_connections 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d2f18b0 0x55891d2f3ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2bcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 --2- 172.21.15.67:0/1388153999 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2bf690 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 >> 172.21.15.67:0/1388153999 conn(0x55891d2b1300 msgr2=0x55891d2b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.938+0000 7f04077fe640 0 client.16146 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:06.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.939+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 shutdown_connections 2024-09-10T20:58:06.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.939+0000 7f04308be740 1 -- 172.21.15.67:0/1388153999 wait complete. 2024-09-10T20:58:06.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.939+0000 7f04308be740 20 client.16146 trim_cache size 0 max 16384 2024-09-10T20:58:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 Processor -- start 2024-09-10T20:58:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 -- start start 2024-09-10T20:58:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b34d0 0x55891d2cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2be820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b7320 con 0x55891d2b3df0 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b4bf0 con 0x55891d2b34d0 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.961+0000 7f04308be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b2a40 con 0x55891d2bfd80 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55088/0 (socket says 172.21.15.67:55088) 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f042ca86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2be820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59056/0 (socket says 172.21.15.67:59056) 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 -- 172.21.15.67:0/2345576822 learned_addr learned my addr 172.21.15.67:0/2345576822 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f0427fff640 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b34d0 0x55891d2cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 -- 172.21.15.67:0/2345576822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 msgr2=0x55891d2be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 -- 172.21.15.67:0/2345576822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b34d0 msgr2=0x55891d2cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b34d0 0x55891d2cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.962+0000 7f04277fe640 1 -- 172.21.15.67:0/2345576822 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55891d2b77f0 con 0x55891d2b3df0 2024-09-10T20:58:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.963+0000 7f04277fe640 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04200cb9d0 tx=0x7f04200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993d27d21710616e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.963+0000 7f040dffb640 1 -- 172.21.15.67:0/2345576822 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04200ba020 con 0x55891d2b3df0 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.963+0000 7f040dffb640 1 -- 172.21.15.67:0/2345576822 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04200d82e0 con 0x55891d2b3df0 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.964+0000 7f040dffb640 1 -- 172.21.15.67:0/2345576822 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04200d8990 con 0x55891d2b3df0 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 -- 172.21.15.67:0/2345576822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 msgr2=0x55891d2ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f04200cb9d0 tx=0x7f04200095c0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 -- 172.21.15.67:0/2345576822 shutdown_connections 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b3df0 0x55891d2ac480 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 --2- 172.21.15.67:0/2345576822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b34d0 0x55891d2cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 -- 172.21.15.67:0/2345576822 >> 172.21.15.67:0/2345576822 conn(0x55891d2b1300 msgr2=0x55891d2be110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.965+0000 7f04308be740 1 -- 172.21.15.67:0/2345576822 shutdown_connections 2024-09-10T20:58:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.966+0000 7f04308be740 1 -- 172.21.15.67:0/2345576822 wait complete. 2024-09-10T20:58:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.966+0000 7f04308be740 1 -- start start 2024-09-10T20:58:06.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.967+0000 7f04308be740 1 Processor -- start 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.967+0000 7f04308be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.967+0000 7f04308be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.967+0000 7f0427fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.967+0000 7f0427fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55092/0 (socket says 172.21.15.67:55092) 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f0427fff640 1 -- 172.21.15.67:0/115311574 learned_addr learned my addr 172.21.15.67:0/115311574 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f04277fe640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b30b0 con 0x55891d2b34d0 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b4520 con 0x55891d2b3df0 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f042ca86640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.968+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04281b3780 con 0x55891d2bfd80 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f04308be740 10 client.0 _ll_register_callbacks cb 0x7f041c00b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 -- 172.21.15.67:0/115311574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 msgr2=0x55891d2c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 -- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 msgr2=0x55891d2c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55891d2c3240 con 0x55891d2b34d0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f0427fff640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f041c01ef60 tx=0x7f041c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86a0a2d71dffa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.969+0000 7f04077fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c037020 con 0x55891d2b34d0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f041c01e610 con 0x55891d2b34d0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04200d82e0 con 0x55891d2b34d0 2024-09-10T20:58:06.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f041c011690 con 0x55891d2b34d0 2024-09-10T20:58:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04308be740 10 client.16152 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.970+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55891d35f060 con 0x55891d2b34d0 2024-09-10T20:58:06.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f041c01ecc0 con 0x55891d2b34d0 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f041c012ae0 con 0x55891d2b34d0 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 10 client.16152 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 10 client.16152 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 20 client.16152 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d35f7b0 0x55891d361bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 4 client.16152 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.971+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f04200d82e0 con 0x55891d35f7b0 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.972+0000 7f04277fe640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d35f7b0 0x55891d361bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.972+0000 7f04077fe640 10 client.16152 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.972+0000 7f04277fe640 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d35f7b0 0x55891d361bd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=79027833be3b1f67 server_cookie=f18f92c5cb9f8927 in_seq=0 out_seq=0 2024-09-10T20:58:06.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.972+0000 7f04077fe640 1 -- 172.21.15.67:0/115311574 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f04200d82e0 con 0x55891d35f7b0 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.972+0000 7f04077fe640 10 client.16152 handle_command_reply: tid=0 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.973+0000 7f04308be740 1 client.16152 shutdown 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.973+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 msgr2=0x55891d2c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.973+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f041c01ef60 tx=0x7f041c00b6f0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 shutdown_connections 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55891d35f7b0 0x55891d361bd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55891d2bfd80 0x55891d2c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55891d2b3df0 0x55891d2c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 --2- 172.21.15.67:0/115311574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55891d2b34d0 0x55891d2c7cd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 >> 172.21.15.67:0/115311574 conn(0x55891d2b1300 msgr2=0x55891d2be930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04077fe640 0 client.16152 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 shutdown_connections 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 1 -- 172.21.15.67:0/115311574 wait complete. 2024-09-10T20:58:06.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.974+0000 7f04308be740 20 client.16152 trim_cache size 0 max 16384 2024-09-10T20:58:06.981 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:06.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.975+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 msgr2=0x7f04100c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.975+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 0x7f04100c88b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f041c005fd0 tx=0x7f041c0147e0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.975+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 msgr2=0x7f0428115ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.975+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 0x7f0428115ae0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0420009ca0 tx=0x7f0420003c10 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 shutdown_connections 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f042811c0a0 0x7f042811ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04100c63f0 0x7f04100c88b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f042810a530 0x7f0428115ae0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 --2- 172.21.15.67:0/3300750586 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f042810a150 0x7f04281155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 >> 172.21.15.67:0/3300750586 conn(0x7f042806dfc0 msgr2=0x7f04280718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 shutdown_connections 2024-09-10T20:58:06.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:06.976+0000 7f042e4e9640 1 -- 172.21.15.67:0/3300750586 wait complete. 2024-09-10T20:58:07.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:58:08.288 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:08 smithi067 ceph-mon[30891]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 701 op/s 2024-09-10T20:58:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:08 smithi083 ceph-mon[35058]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 701 op/s 2024-09-10T20:58:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:08 smithi172 ceph-mon[35265]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 701 op/s 2024-09-10T20:58:09.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 395.0 s, 2995.6 tps, lat 33.198 ms stddev 38.083 2024-09-10T20:58:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 -- 172.21.15.67:0/1261961041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54108020 msgr2=0x7fee5410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 --2- 172.21.15.67:0/1261961041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54108020 0x7fee5410e820 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009ca0 tx=0x7fee4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 -- 172.21.15.67:0/1261961041 shutdown_connections 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 --2- 172.21.15.67:0/1261961041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54108020 0x7fee5410e820 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 --2- 172.21.15.67:0/1261961041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee541076a0 0x7fee54107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 --2- 172.21.15.67:0/1261961041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee54101c90 0x7fee54102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.129+0000 7fee5af9c640 1 -- 172.21.15.67:0/1261961041 >> 172.21.15.67:0/1261961041 conn(0x7fee540fd700 msgr2=0x7fee540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.130+0000 7fee5af9c640 1 -- 172.21.15.67:0/1261961041 shutdown_connections 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.130+0000 7fee5af9c640 1 -- 172.21.15.67:0/1261961041 wait complete. 2024-09-10T20:58:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 Processor -- start 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 -- start start 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee541076a0 0x7fee5410b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 0x7fee541a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee54110b40 con 0x7fee54101c90 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fee541109c0 con 0x7fee54108020 2024-09-10T20:58:09.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee5af9c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee54110cc0 con 0x7fee541076a0 2024-09-10T20:58:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55104/0 (socket says 172.21.15.67:55104) 2024-09-10T20:58:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee58d38640 1 -- 172.21.15.67:0/2586338953 learned_addr learned my addr 172.21.15.67:0/2586338953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee59539640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 0x7fee541a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.131+0000 7fee53fff640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee541076a0 0x7fee5410b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 -- 172.21.15.67:0/2586338953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee541076a0 msgr2=0x7fee5410b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee541076a0 0x7fee5410b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 -- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 msgr2=0x7fee5410b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 -- 172.21.15.67:0/2586338953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee541a57d0 con 0x7fee54108020 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee58d38640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.132+0000 7fee59539640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 0x7fee541a5000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02ae30 tx=0x7fee4c0319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.133+0000 7fee51ffb640 1 -- 172.21.15.67:0/2586338953 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c003c70 con 0x7fee54108020 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.133+0000 7fee51ffb640 1 -- 172.21.15.67:0/2586338953 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4c003e10 con 0x7fee54108020 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.133+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee541a5a60 con 0x7fee54108020 2024-09-10T20:58:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.133+0000 7fee51ffb640 1 -- 172.21.15.67:0/2586338953 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c02fbe0 con 0x7fee54108020 2024-09-10T20:58:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.133+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee541ac060 con 0x7fee54108020 2024-09-10T20:58:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.138+0000 7fee51ffb640 1 -- 172.21.15.67:0/2586338953 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fee4c004040 con 0x7fee54108020 2024-09-10T20:58:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.138+0000 7fee5d371740 1 Processor -- start 2024-09-10T20:58:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.138+0000 7fee5d371740 1 -- start start 2024-09-10T20:58:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.138+0000 7fee5d371740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a910f0 0x55b798a914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee5d371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee5d371740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee5d371740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b798a07ea0 con 0x55b798a9d9a0 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee5d371740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b7989f72d0 con 0x55b798a910f0 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee5d371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b7989fb0e0 con 0x55b798a91a10 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55108/0 (socket says 172.21.15.67:55108) 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 -- 172.21.15.67:0/1846183195 learned_addr learned my addr 172.21.15.67:0/1846183195 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a910f0 0x55b798a914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee58d38640 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 -- 172.21.15.67:0/1846183195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 msgr2=0x55b798a9d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 -- 172.21.15.67:0/1846183195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a910f0 msgr2=0x55b798a914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a910f0 0x55b798a914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.139+0000 7fee53fff640 1 -- 172.21.15.67:0/1846183195 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b798755650 con 0x55b798a9d9a0 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee51ffb640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 0x7fee440b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee53fff640 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fee40011780 tx=0x7fee40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4e44497993b849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee51ffb640 1 -- 172.21.15.67:0/2586338953 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee4c106b10 con 0x7fee54108020 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee58d38640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 0x7fee440b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee3effd640 1 -- 172.21.15.67:0/1846183195 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40004050 con 0x55b798a9d9a0 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee3effd640 1 -- 172.21.15.67:0/1846183195 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4000fc70 con 0x55b798a9d9a0 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.140+0000 7fee3effd640 1 -- 172.21.15.67:0/1846183195 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40003920 con 0x55b798a9d9a0 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 -- 172.21.15.67:0/1846183195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 msgr2=0x55b798a9fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fee40011780 tx=0x7fee40004730 comp rx=0 tx=0).stop 2024-09-10T20:58:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 -- 172.21.15.67:0/1846183195 shutdown_connections 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a9d9a0 0x55b798a9fd90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 --2- 172.21.15.67:0/1846183195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a910f0 0x55b798a914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 -- 172.21.15.67:0/1846183195 >> 172.21.15.67:0/1846183195 conn(0x55b798a8ef20 msgr2=0x55b798a900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee58d38640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 0x7fee440b7930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b798a8fe00 tx=0x7fee4800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.141+0000 7fee5d371740 1 -- 172.21.15.67:0/1846183195 shutdown_connections 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 -- 172.21.15.67:0/1846183195 wait complete. 2024-09-10T20:58:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 -- start start 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 Processor -- start 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a9d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.142+0000 7fee5d371740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798a9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee5d371740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b798858700 con 0x55b798a910f0 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee5d371740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b798992160 con 0x55b798a9d9a0 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee5d371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b798aa0620 con 0x55b798a91a10 2024-09-10T20:58:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee5d371740 10 client.0 _ll_register_callbacks cb 0x55b7989ab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee59539640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798a9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a9d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee59539640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798a9ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43836/0 (socket says 172.21.15.67:43836) 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a9d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55120/0 (socket says 172.21.15.67:55120) 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee58d38640 1 -- 172.21.15.67:0/2910697034 learned_addr learned my addr 172.21.15.67:0/2910697034 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 -- 172.21.15.67:0/2910697034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 msgr2=0x55b798a9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798a9ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 -- 172.21.15.67:0/2910697034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 msgr2=0x55b798a9d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a9d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 -- 172.21.15.67:0/2910697034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7989bfc90 con 0x55b798a91a10 2024-09-10T20:58:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee53fff640 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9a760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a010 tx=0x7fee4000fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db9b57a5f8f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.143+0000 7fee33fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40005220 con 0x55b798a91a10 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee4000fc70 con 0x55b798a91a10 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee400053c0 con 0x55b798a91a10 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fee40030050 con 0x55b798a91a10 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee5d371740 10 client.25825 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:09.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.144+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b798aac000 con 0x55b798a91a10 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4000fc70 con 0x55b798a91a10 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fee4001f8d0 con 0x55b798a91a10 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 10 client.25825 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 10 client.25825 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 20 client.25825 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:09.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798aad350 0x55b798aaf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 4 client.25825 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.145+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b798a09df0 con 0x55b798aad350 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.146+0000 7fee58d38640 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798aad350 0x55b798aaf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.146+0000 7fee33fff640 10 client.25825 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.146+0000 7fee58d38640 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798aad350 0x55b798aaf740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56de0cd4bcc21446 server_cookie=9e9bfa38aa23edb7 in_seq=0 out_seq=0 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee33fff640 1 -- 172.21.15.67:0/2910697034 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b798a09df0 con 0x55b798aad350 2024-09-10T20:58:09.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee33fff640 10 client.25825 handle_command_reply: tid=0 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 client.25825 shutdown 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 msgr2=0x55b798a9a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9a760 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee4000a010 tx=0x7fee4000fbd0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 shutdown_connections 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798aad350 0x55b798aaf740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798a9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee33fff640 0 client.25825 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a91a10 0x55b798a9a760 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 --2- 172.21.15.67:0/2910697034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a9d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 >> 172.21.15.67:0/2910697034 conn(0x55b798a8ef20 msgr2=0x55b798a94a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 shutdown_connections 2024-09-10T20:58:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.147+0000 7fee5d371740 1 -- 172.21.15.67:0/2910697034 wait complete. 2024-09-10T20:58:09.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.148+0000 7fee5d371740 20 client.25825 trim_cache size 0 max 16384 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 Processor -- start 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 -- start start 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a91a10 0x55b798a9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 0x55b798a9f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b7080 con 0x55b798a910f0 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b4950 con 0x55b798a91a10 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee5d371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b27a0 con 0x55b798a9d9a0 2024-09-10T20:58:09.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee58d38640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55134/0 (socket says 172.21.15.67:55134) 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee58d38640 1 -- 172.21.15.67:0/1881279519 learned_addr learned my addr 172.21.15.67:0/1881279519 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee53fff640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a91a10 0x55b798a9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.169+0000 7fee59539640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 0x55b798a9f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee58d38640 1 -- 172.21.15.67:0/1881279519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 msgr2=0x55b798a9f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee58d38640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 0x55b798a9f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee58d38640 1 -- 172.21.15.67:0/1881279519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a91a10 msgr2=0x55b798a9ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee58d38640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a91a10 0x55b798a9ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee58d38640 1 -- 172.21.15.67:0/1881279519 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b798a9b150 con 0x55b798a910f0 2024-09-10T20:58:09.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.170+0000 7fee59539640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 0x55b798a9f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:58:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.171+0000 7fee58d38640 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fee48005fd0 tx=0x7fee48019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587857a6a7a52c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.172+0000 7fee3e7fc640 1 -- 172.21.15.67:0/1881279519 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4801cb90 con 0x55b798a910f0 2024-09-10T20:58:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.172+0000 7fee3e7fc640 1 -- 172.21.15.67:0/1881279519 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b798a09df0 con 0x55b798a910f0 2024-09-10T20:58:09.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.172+0000 7fee3e7fc640 1 -- 172.21.15.67:0/1881279519 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4802bdf0 con 0x55b798a910f0 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- 172.21.15.67:0/1881279519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 msgr2=0x55b798a8e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fee48005fd0 tx=0x7fee48019000 comp rx=0 tx=0).stop 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- 172.21.15.67:0/1881279519 shutdown_connections 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a9d9a0 0x55b798a9f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a91a10 0x55b798a9ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 --2- 172.21.15.67:0/1881279519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a910f0 0x55b798a8e760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- 172.21.15.67:0/1881279519 >> 172.21.15.67:0/1881279519 conn(0x55b798a8ef20 msgr2=0x55b798a8ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- 172.21.15.67:0/1881279519 shutdown_connections 2024-09-10T20:58:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- 172.21.15.67:0/1881279519 wait complete. 2024-09-10T20:58:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.173+0000 7fee5d371740 1 -- start start 2024-09-10T20:58:09.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 Processor -- start 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 0x55b798aa5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 0x55b798aa4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798aa4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b2e10 con 0x55b798a91a10 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b4280 con 0x55b798a9d9a0 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee541b34e0 con 0x55b798a910f0 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.174+0000 7fee5d371740 10 client.0 _ll_register_callbacks cb 0x7fee40009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 0x55b798aa4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee53fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 0x55b798aa4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55150/0 (socket says 172.21.15.67:55150) 2024-09-10T20:58:09.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee53fff640 1 -- 172.21.15.67:0/3873362308 learned_addr learned my addr 172.21.15.67:0/3873362308 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:09.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 0x55b798aa5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee59539640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798aa4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 -- 172.21.15.67:0/3873362308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 msgr2=0x55b798aa4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798aa4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 -- 172.21.15.67:0/3873362308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 msgr2=0x55b798aa4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 0x55b798aa4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 -- 172.21.15.67:0/3873362308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b798aa5400 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee58d38640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 0x55b798aa5de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4800bda0 tx=0x7fee4801ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75ff760cd542880a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee33fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.175+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48037070 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee4801cd90 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b798a09df0 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fee48005040 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 10 client.25828 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b798b1ad80 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b798a09df0 con 0x55b798a910f0 2024-09-10T20:58:09.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fee480046c0 con 0x55b798a910f0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 10 client.25828 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 10 client.25828 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 20 client.25828 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798b1b3d0 0x55b798b1d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 4 client.25828 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.176+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b798a058a0 con 0x55b798b1b3d0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee53fff640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798b1b3d0 0x55b798b1d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee53fff640 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798b1b3d0 0x55b798b1d7f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=369dd4a20d6f1826 server_cookie=c76fd81ee1ef7160 in_seq=0 out_seq=0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee33fff640 10 client.25828 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee33fff640 1 -- 172.21.15.67:0/3873362308 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b798a058a0 con 0x55b798b1b3d0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee33fff640 10 client.25828 handle_command_reply: tid=0 2024-09-10T20:58:09.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.177+0000 7fee5d371740 1 client.25828 shutdown 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 msgr2=0x55b798aa5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 0x55b798aa5de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4800bda0 tx=0x7fee4801ca20 comp rx=0 tx=0).stop 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 shutdown_connections 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b798b1b3d0 0x55b798b1d7f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b798a9d9a0 0x55b798aa4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b798a91a10 0x55b798aa4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 --2- 172.21.15.67:0/3873362308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b798a910f0 0x55b798aa5de0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee33fff640 0 client.25828 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 >> 172.21.15.67:0/3873362308 conn(0x55b798a8ef20 msgr2=0x55b798a9bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 shutdown_connections 2024-09-10T20:58:09.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.178+0000 7fee5d371740 1 -- 172.21.15.67:0/3873362308 wait complete. 2024-09-10T20:58:09.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.179+0000 7fee5d371740 20 client.25828 trim_cache size 0 max 16384 2024-09-10T20:58:09.186 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 msgr2=0x7fee440b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 0x7fee440b7930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55b798a8fe00 tx=0x7fee4800b4a0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 msgr2=0x7fee541a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 0x7fee541a5000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee4c02ae30 tx=0x7fee4c0319f0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 shutdown_connections 2024-09-10T20:58:09.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee54108020 0x7fee541a5000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fee440b5470 0x7fee440b7930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee541076a0 0x7fee5410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 --2- 172.21.15.67:0/2586338953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee54101c90 0x7fee5410b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 >> 172.21.15.67:0/2586338953 conn(0x7fee540fd700 msgr2=0x7fee540fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 shutdown_connections 2024-09-10T20:58:09.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:09.180+0000 7fee5af9c640 1 -- 172.21.15.67:0/2586338953 wait complete. 2024-09-10T20:58:09.951 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:58:10.283 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:10 smithi067 ceph-mon[30891]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-09-10T20:58:10.361 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:10 smithi083 ceph-mon[35058]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-09-10T20:58:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:10 smithi172 ceph-mon[35265]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-09-10T20:58:10.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.931+0000 7fae474db640 1 -- 172.21.15.67:0/2169042981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a530 msgr2=0x7fae4010a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.931+0000 7fae474db640 1 --2- 172.21.15.67:0/2169042981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a530 0x7fae4010a930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae38009ca0 tx=0x7fae3802a980 comp rx=0 tx=0).stop 2024-09-10T20:58:10.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 -- 172.21.15.67:0/2169042981 shutdown_connections 2024-09-10T20:58:10.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 --2- 172.21.15.67:0/2169042981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4011c0a0 0x7fae4011e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 --2- 172.21.15.67:0/2169042981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a530 0x7fae4010a930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 --2- 172.21.15.67:0/2169042981 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4010a150 0x7fae401111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 -- 172.21.15.67:0/2169042981 >> 172.21.15.67:0/2169042981 conn(0x7fae4006dfc0 msgr2=0x7fae4006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:10.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 -- 172.21.15.67:0/2169042981 shutdown_connections 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.933+0000 7fae474db640 1 -- 172.21.15.67:0/2169042981 wait complete. 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.934+0000 7fae474db640 1 Processor -- start 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.934+0000 7fae474db640 1 -- start start 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.934+0000 7fae474db640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.934+0000 7fae474db640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4010a530 0x7fae40119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.935+0000 7fae474db640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4011c0a0 0x7fae40112970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.935+0000 7fae474db640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fae40121c90 con 0x7fae4011c0a0 2024-09-10T20:58:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.935+0000 7fae474db640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fae40121b10 con 0x7fae4010a150 2024-09-10T20:58:10.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.935+0000 7fae474db640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae40121e10 con 0x7fae4010a530 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43860/0 (socket says 172.21.15.67:43860) 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 -- 172.21.15.67:0/3917262919 learned_addr learned my addr 172.21.15.67:0/3917262919 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae44a76640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4010a530 0x7fae40119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45a78640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4011c0a0 0x7fae40112970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 -- 172.21.15.67:0/3917262919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4010a530 msgr2=0x7fae40119a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4010a530 0x7fae40119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 -- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4011c0a0 msgr2=0x7fae40112970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4011c0a0 0x7fae40112970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.936+0000 7fae45277640 1 -- 172.21.15.67:0/3917262919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae40113230 con 0x7fae4010a150 2024-09-10T20:58:10.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.937+0000 7fae45277640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae3000b4a0 tx=0x7fae3000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:10.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.938+0000 7fae367fc640 1 -- 172.21.15.67:0/3917262919 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30014070 con 0x7fae4010a150 2024-09-10T20:58:10.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.939+0000 7fae367fc640 1 -- 172.21.15.67:0/3917262919 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae30010ac0 con 0x7fae4010a150 2024-09-10T20:58:10.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.939+0000 7fae474db640 1 -- 172.21.15.67:0/3917262919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae40113520 con 0x7fae4010a150 2024-09-10T20:58:10.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.940+0000 7fae367fc640 1 -- 172.21.15.67:0/3917262919 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae30017c40 con 0x7fae4010a150 2024-09-10T20:58:10.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.940+0000 7fae474db640 1 -- 172.21.15.67:0/3917262919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae40118520 con 0x7fae4010a150 2024-09-10T20:58:10.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.944+0000 7fae498b0740 1 Processor -- start 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 -- start start 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb69d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb69e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb613ea0 con 0x55a2bb6a9b20 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb6032d0 con 0x55a2bb69d270 2024-09-10T20:58:10.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.945+0000 7fae498b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb6070e0 con 0x55a2bb69dcf0 2024-09-10T20:58:10.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.947+0000 7fae45a78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb69d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.947+0000 7fae44a76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.947+0000 7fae44a76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6abf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55160/0 (socket says 172.21.15.67:55160) 2024-09-10T20:58:10.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.947+0000 7fae44a76640 1 -- 172.21.15.67:0/4217941790 learned_addr learned my addr 172.21.15.67:0/4217941790 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:10.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45277640 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb69e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45a78640 1 -- 172.21.15.67:0/4217941790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 msgr2=0x55a2bb69e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45a78640 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb69e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45a78640 1 -- 172.21.15.67:0/4217941790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 msgr2=0x55a2bb6abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45a78640 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae45a78640 1 -- 172.21.15.67:0/4217941790 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bb361650 con 0x55a2bb69d270 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.948+0000 7fae367fc640 1 -- 172.21.15.67:0/3917262919 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fae30010c70 con 0x7fae4010a150 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.950+0000 7fae367fc640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 0x7fae2c0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.950+0000 7fae367fc640 1 -- 172.21.15.67:0/3917262919 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fae300e4a10 con 0x7fae4010a150 2024-09-10T20:58:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.950+0000 7fae45a78640 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb69d7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6d0 tx=0x7fae3c00bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7516ef2e953d898 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.951+0000 7fae474db640 1 -- 172.21.15.67:0/4217941790 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00d740 con 0x55a2bb69d270 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.951+0000 7fae474db640 1 -- 172.21.15.67:0/4217941790 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae3c019070 con 0x55a2bb69d270 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.951+0000 7fae474db640 1 -- 172.21.15.67:0/4217941790 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c014cb0 con 0x55a2bb69d270 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 -- 172.21.15.67:0/4217941790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 msgr2=0x55a2bb69d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb69d7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6d0 tx=0x7fae3c00bb90 comp rx=0 tx=0).stop 2024-09-10T20:58:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 -- 172.21.15.67:0/4217941790 shutdown_connections 2024-09-10T20:58:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb69e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 --2- 172.21.15.67:0/4217941790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb69d7b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.952+0000 7fae498b0740 1 -- 172.21.15.67:0/4217941790 >> 172.21.15.67:0/4217941790 conn(0x55a2bb69b5e0 msgr2=0x55a2bb69c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:10.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.953+0000 7fae45277640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 0x7fae2c0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.954+0000 7fae498b0740 1 -- 172.21.15.67:0/4217941790 shutdown_connections 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.958+0000 7fae498b0740 1 -- 172.21.15.67:0/4217941790 wait complete. 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.958+0000 7fae498b0740 1 -- start start 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.958+0000 7fae498b0740 1 Processor -- start 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb464700 con 0x55a2bb69dcf0 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae45277640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 0x7fae2c0b7840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae30010fb0 tx=0x7fae300047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb59e160 con 0x55a2bb69d270 2024-09-10T20:58:10.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a2bb6aca60 con 0x55a2bb6a9b20 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae498b0740 10 client.0 _ll_register_callbacks cb 0x55a2bb5b79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae44a76640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.959+0000 7fae45a78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43880/0 (socket says 172.21.15.67:43880) 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 -- 172.21.15.67:0/2551216168 learned_addr learned my addr 172.21.15.67:0/2551216168 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 -- 172.21.15.67:0/2551216168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 msgr2=0x55a2bb6a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 -- 172.21.15.67:0/2551216168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 msgr2=0x55a2bb6a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.960+0000 7fae45a78640 1 -- 172.21.15.67:0/2551216168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bb5cbc90 con 0x55a2bb69d270 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.961+0000 7fae45a78640 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6a0 tx=0x7fae3c014810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=855b5d8ccd4a4472 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.961+0000 7fae28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:10.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.961+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00dd80 con 0x55a2bb69d270 2024-09-10T20:58:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.961+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fae3c01e480 con 0x55a2bb69d270 2024-09-10T20:58:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.962+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae3c019070 con 0x55a2bb69d270 2024-09-10T20:58:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.962+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae3c01e680 con 0x55a2bb69d270 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.962+0000 7fae498b0740 10 client.25862 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.962+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a2bb6da3c0 con 0x55a2bb69d270 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.963+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae3c019070 con 0x55a2bb69d270 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fae3c013070 con 0x55a2bb69d270 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 10 client.25862 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 20 client.25862 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb6dbab0 0x55a2bb6ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 4 client.25862 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2bb615df0 con 0x55a2bb6dbab0 2024-09-10T20:58:10.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.964+0000 7fae44a76640 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb6dbab0 0x55a2bb6ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.965+0000 7fae44a76640 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb6dbab0 0x55a2bb6ddf20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfb9779f53ff4de server_cookie=42cffd45bebb11b8 in_seq=0 out_seq=0 2024-09-10T20:58:10.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.965+0000 7fae28ff9640 10 client.25862 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae28ff9640 1 -- 172.21.15.67:0/2551216168 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2bb615df0 con 0x55a2bb6dbab0 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae28ff9640 10 client.25862 handle_command_reply: tid=0 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 client.25862 shutdown 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 msgr2=0x55a2bb6a9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6a0 tx=0x7fae3c014810 comp rx=0 tx=0).stop 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 shutdown_connections 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb6dbab0 0x55a2bb6ddf20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 --2- 172.21.15.67:0/2551216168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6a9400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 >> 172.21.15.67:0/2551216168 conn(0x55a2bb69b5e0 msgr2=0x55a2bb6a1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.967+0000 7fae28ff9640 0 client.25862 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.968+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 shutdown_connections 2024-09-10T20:58:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.969+0000 7fae498b0740 1 -- 172.21.15.67:0/2551216168 wait complete. 2024-09-10T20:58:10.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.969+0000 7fae498b0740 20 client.25862 trim_cache size 0 max 16384 2024-09-10T20:58:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.987+0000 7fae498b0740 1 Processor -- start 2024-09-10T20:58:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.987+0000 7fae498b0740 1 -- start start 2024-09-10T20:58:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69d270 0x55a2bb6a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6e3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007f310 con 0x55a2bb69d270 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007cbe0 con 0x55a2bb6a9b20 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae498b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007aa30 con 0x55a2bb69dcf0 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59168/0 (socket says 172.21.15.67:59168) 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 -- 172.21.15.67:0/1298116720 learned_addr learned my addr 172.21.15.67:0/1298116720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae45a78640 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69d270 0x55a2bb6a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae45a78640 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 -- 172.21.15.67:0/1298116720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb6a9b20 msgr2=0x55a2bb6e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6e3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 -- 172.21.15.67:0/1298116720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69d270 msgr2=0x55a2bb6a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69d270 0x55a2bb6a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.988+0000 7fae44a76640 1 -- 172.21.15.67:0/1298116720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bb6a9770 con 0x55a2bb69dcf0 2024-09-10T20:58:10.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.992+0000 7fae44a76640 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fae3802af40 tx=0x7fae38009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162be5535f0a5d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:10.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.992+0000 7fae2affd640 1 -- 172.21.15.67:0/1298116720 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38034040 con 0x55a2bb69dcf0 2024-09-10T20:58:10.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.992+0000 7fae2affd640 1 -- 172.21.15.67:0/1298116720 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae38030680 con 0x55a2bb69dcf0 2024-09-10T20:58:10.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.992+0000 7fae2affd640 1 -- 172.21.15.67:0/1298116720 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3803a690 con 0x55a2bb69dcf0 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 -- 172.21.15.67:0/1298116720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 msgr2=0x55a2bb6a3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fae3802af40 tx=0x7fae38009360 comp rx=0 tx=0).stop 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 -- 172.21.15.67:0/1298116720 shutdown_connections 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6e3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6a3fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 --2- 172.21.15.67:0/1298116720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69d270 0x55a2bb6a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 -- 172.21.15.67:0/1298116720 >> 172.21.15.67:0/1298116720 conn(0x55a2bb69b5e0 msgr2=0x55a2bb6a50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 -- 172.21.15.67:0/1298116720 shutdown_connections 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.993+0000 7fae498b0740 1 -- 172.21.15.67:0/1298116720 wait complete. 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 -- start start 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 Processor -- start 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007b0a0 con 0x55a2bb69dcf0 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007c510 con 0x55a2bb69d270 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae4007b770 con 0x55a2bb6a9b20 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae45a78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae498b0740 10 client.0 _ll_register_callbacks cb 0x7fae38009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.994+0000 7fae45a78640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43898/0 (socket says 172.21.15.67:43898) 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 -- 172.21.15.67:0/275479002 learned_addr learned my addr 172.21.15.67:0/275479002 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae44a76640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:11.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 -- 172.21.15.67:0/275479002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 msgr2=0x55a2bb6acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 -- 172.21.15.67:0/275479002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 msgr2=0x55a2bb6b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 -- 172.21.15.67:0/275479002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bb6ad220 con 0x55a2bb69d270 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae45a78640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6d0 tx=0x7fae3c00bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5191f8e34a70e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0145c0 con 0x55a2bb69d270 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fae3c014760 con 0x55a2bb69d270 2024-09-10T20:58:11.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.995+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae38030680 con 0x55a2bb69d270 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fae3c02d8a0 con 0x55a2bb69d270 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 10 client.25868 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a2bb749230 con 0x55a2bb69d270 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae38030680 con 0x55a2bb69d270 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fae3c01e940 con 0x55a2bb69d270 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 10 client.25868 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 10 client.25868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 20 client.25868 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb749860 0x55a2bb74bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 4 client.25868 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2bb6118a0 con 0x55a2bb749860 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.996+0000 7fae44a76640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb749860 0x55a2bb74bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:11.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae28ff9640 10 client.25868 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae44a76640 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb749860 0x55a2bb74bc80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88677bb9e23c493a server_cookie=b7f4acbfe122f962 in_seq=0 out_seq=0 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae28ff9640 1 -- 172.21.15.67:0/275479002 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2bb6118a0 con 0x55a2bb749860 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae28ff9640 10 client.25868 handle_command_reply: tid=0 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 client.25868 shutdown 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 msgr2=0x55a2bb6b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b6d0 tx=0x7fae3c00bb90 comp rx=0 tx=0).stop 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 shutdown_connections 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a2bb749860 0x55a2bb74bc80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2bb6a9b20 0x55a2bb6acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a2bb69dcf0 0x55a2bb6b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 --2- 172.21.15.67:0/275479002 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a2bb69d270 0x55a2bb6b1d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 >> 172.21.15.67:0/275479002 conn(0x55a2bb69b5e0 msgr2=0x55a2bb6a7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:11.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.997+0000 7fae28ff9640 0 client.25868 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:11.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.998+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 shutdown_connections 2024-09-10T20:58:11.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.998+0000 7fae498b0740 1 -- 172.21.15.67:0/275479002 wait complete. 2024-09-10T20:58:11.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.998+0000 7fae498b0740 20 client.25868 trim_cache size 0 max 16384 2024-09-10T20:58:11.006 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 msgr2=0x7fae2c0b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 0x7fae2c0b7840 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae30010fb0 tx=0x7fae300047d0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 msgr2=0x7fae40119550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae3000b4a0 tx=0x7fae3000b960 comp rx=0 tx=0).stop 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 shutdown_connections 2024-09-10T20:58:11.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae4011c0a0 0x7fae40112970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fae2c0b5380 0x7fae2c0b7840 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae4010a530 0x7fae40119a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 --2- 172.21.15.67:0/3917262919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae4010a150 0x7fae40119550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 >> 172.21.15.67:0/3917262919 conn(0x7fae4006dfc0 msgr2=0x7fae4011c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 shutdown_connections 2024-09-10T20:58:11.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:10.999+0000 7fae2bfff640 1 -- 172.21.15.67:0/3917262919 wait complete. 2024-09-10T20:58:12.548 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:12 smithi067 ceph-mon[30891]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 636 op/s 2024-09-10T20:58:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:12 smithi083 ceph-mon[35058]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 636 op/s 2024-09-10T20:58:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:12 smithi172 ceph-mon[35265]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 636 op/s 2024-09-10T20:58:12.831 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:58:12.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:58:13.220 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:13.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 -- 172.21.15.67:0/3462527427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 msgr2=0x7ffbb8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 --2- 172.21.15.67:0/3462527427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb8108c10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009900 tx=0x7ffba802a3f0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 -- 172.21.15.67:0/3462527427 shutdown_connections 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 --2- 172.21.15.67:0/3462527427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8109150 0x7ffbb810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 --2- 172.21.15.67:0/3462527427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb8108c10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 --2- 172.21.15.67:0/3462527427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8102dc0 0x7ffbb81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 -- 172.21.15.67:0/3462527427 >> 172.21.15.67:0/3462527427 conn(0x7ffbb80fe870 msgr2=0x7ffbb8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 -- 172.21.15.67:0/3462527427 shutdown_connections 2024-09-10T20:58:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.808+0000 7ffbbff68640 1 -- 172.21.15.67:0/3462527427 wait complete. 2024-09-10T20:58:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbff68640 1 Processor -- start 2024-09-10T20:58:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbff68640 1 -- start start 2024-09-10T20:58:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbff68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 0x7ffbb8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbff68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbff68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 0x7ffbb819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50434/0 (socket says 172.21.15.67:50434) 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 0x7ffbb8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 0x7ffbb8199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:39428/0 (socket says 172.21.15.67:39428) 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.809+0000 7ffbbd503640 1 -- 172.21.15.67:0/1189367634 learned_addr learned my addr 172.21.15.67:0/1189367634 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8112e10 con 0x7ffbb81087d0 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8112c90 con 0x7ffbb8109150 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8112f90 con 0x7ffbb8102dc0 2024-09-10T20:58:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 0x7ffbb819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 -- 172.21.15.67:0/1189367634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 msgr2=0x7ffbb8199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 0x7ffbb8199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 -- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 msgr2=0x7ffbb81997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb819f310 con 0x7ffbb8109150 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbd503640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbe505640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 0x7ffbb819eb40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ec50 tx=0x7ffbb000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbaeffd640 1 -- 172.21.15.67:0/1189367634 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0003b70 con 0x7ffbb8109150 2024-09-10T20:58:13.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb819f600 con 0x7ffbb8109150 2024-09-10T20:58:13.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbaeffd640 1 -- 172.21.15.67:0/1189367634 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb0003d10 con 0x7ffbb8109150 2024-09-10T20:58:13.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.810+0000 7ffbaeffd640 1 -- 172.21.15.67:0/1189367634 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0010830 con 0x7ffbb8109150 2024-09-10T20:58:13.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.811+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb8075380 con 0x7ffbb8109150 2024-09-10T20:58:13.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.814+0000 7ffbaeffd640 1 -- 172.21.15.67:0/1189367634 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ffbb0003ec0 con 0x7ffbb8109150 2024-09-10T20:58:13.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.814+0000 7ffbc233d740 1 Processor -- start 2024-09-10T20:58:13.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.814+0000 7ffbc233d740 1 -- start start 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327725800 0x558327731250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55832769be60 con 0x558327725800 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55832768b290 con 0x558327731790 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbc233d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55832768f0a0 con 0x558327724ee0 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbbd503640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48058/0 (socket says 172.21.15.67:48058) 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbbd503640 1 -- 172.21.15.67:0/4139013085 learned_addr learned my addr 172.21.15.67:0/4139013085 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.815+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327725800 0x558327731250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 -- 172.21.15.67:0/4139013085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 msgr2=0x5583277252c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277252c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 -- 172.21.15.67:0/4139013085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327725800 msgr2=0x558327731250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327725800 0x558327731250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 -- 172.21.15.67:0/4139013085 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583273e9930 con 0x558327731790 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbaeffd640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 0x7ffba40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 0x7ffba40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbbd503640 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1689c90f05b765d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffbaeffd640 1 -- 172.21.15.67:0/1189367634 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffbb00e5fc0 con 0x7ffbb8109150 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffba3fff640 1 -- 172.21.15.67:0/4139013085 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8035050 con 0x558327731790 2024-09-10T20:58:13.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffba3fff640 1 -- 172.21.15.67:0/4139013085 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba80054d0 con 0x558327731790 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.816+0000 7ffba3fff640 1 -- 172.21.15.67:0/4139013085 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8004a80 con 0x558327731790 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.817+0000 7ffbc233d740 1 -- 172.21.15.67:0/4139013085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 msgr2=0x558327733b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.817+0000 7ffbc233d740 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba802a3f0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.817+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 0x7ffba40b7820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x558327728060 tx=0x7ffbb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 -- 172.21.15.67:0/4139013085 shutdown_connections 2024-09-10T20:58:13.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327731790 0x558327733b80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327725800 0x558327731250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 --2- 172.21.15.67:0/4139013085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 -- 172.21.15.67:0/4139013085 >> 172.21.15.67:0/4139013085 conn(0x558327722d10 msgr2=0x558327723eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.819+0000 7ffbc233d740 1 -- 172.21.15.67:0/4139013085 shutdown_connections 2024-09-10T20:58:13.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.820+0000 7ffbc233d740 1 -- 172.21.15.67:0/4139013085 wait complete. 2024-09-10T20:58:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.820+0000 7ffbc233d740 1 -- start start 2024-09-10T20:58:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.821+0000 7ffbc233d740 1 Processor -- start 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.821+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x55832772e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.821+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x55832772ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbc233d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5583274ec890 con 0x558327731790 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x55832772e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x55832772e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:39436/0 (socket says 172.21.15.67:39436) 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbdd04640 1 -- 172.21.15.67:0/3422272006 learned_addr learned my addr 172.21.15.67:0/3422272006 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558327625d40 con 0x558327725800 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558327734430 con 0x558327724ee0 2024-09-10T20:58:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x55832772ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbe505640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbc233d740 10 client.0 _ll_register_callbacks cb 0x558327689c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 -- 172.21.15.67:0/3422272006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 msgr2=0x55832772e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x55832772e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 -- 172.21.15.67:0/3422272006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 msgr2=0x55832772f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.822+0000 7ffbbd503640 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832773d810 con 0x558327725800 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffbbd503640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x55832772ec80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558327724e90 tx=0x7ffba8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f63f4cef962145 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffba17fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba804e070 con 0x558327725800 2024-09-10T20:58:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba80054d0 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffba8004880 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.823+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffba805a050 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.824+0000 7ffbc233d740 10 client.25880 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.824+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558327740180 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.824+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8031790 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffba804aa60 con 0x558327725800 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 10 client.25880 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 20 client.25880 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277416d0 0x558327743b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 4 client.25880 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffba80054d0 con 0x5583277416d0 2024-09-10T20:58:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277416d0 0x558327743b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffba17fa640 10 client.25880 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:13.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.825+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277416d0 0x558327743b50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e684532258ce2c6a server_cookie=9d959bea9c0ac01e in_seq=0 out_seq=0 2024-09-10T20:58:13.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.826+0000 7ffba17fa640 1 -- 172.21.15.67:0/3422272006 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ffba80054d0 con 0x5583277416d0 2024-09-10T20:58:13.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.826+0000 7ffba17fa640 10 client.25880 handle_command_reply: tid=0 2024-09-10T20:58:13.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.826+0000 7ffbc233d740 1 client.25880 shutdown 2024-09-10T20:58:13.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.826+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 msgr2=0x55832772ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.826+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x55832772ec80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x558327724e90 tx=0x7ffba8005d50 comp rx=0 tx=0).stop 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 shutdown_connections 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277416d0 0x558327743b50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x55832772ec80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3422272006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x55832772e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 >> 172.21.15.67:0/3422272006 conn(0x558327722d10 msgr2=0x558327721f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffba17fa640 0 client.25880 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 shutdown_connections 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 1 -- 172.21.15.67:0/3422272006 wait complete. 2024-09-10T20:58:13.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.827+0000 7ffbc233d740 20 client.25880 trim_cache size 0 max 16384 2024-09-10T20:58:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.859+0000 7ffbc233d740 1 Processor -- start 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.859+0000 7ffbc233d740 1 -- start start 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x558327724370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327730480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b2e20 con 0x558327731790 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b06f0 con 0x558327725800 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbc233d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81ae540 con 0x558327724ee0 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x558327724370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x558327724370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:39446/0 (socket says 172.21.15.67:39446) 2024-09-10T20:58:13.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.860+0000 7ffbbdd04640 1 -- 172.21.15.67:0/3576438213 learned_addr learned my addr 172.21.15.67:0/3576438213 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 -- 172.21.15.67:0/3576438213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 msgr2=0x558327724370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x558327724370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 -- 172.21.15.67:0/3576438213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 msgr2=0x558327730480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:58:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327730480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.861+0000 7ffbbe505640 1 -- 172.21.15.67:0/3576438213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558327723790 con 0x558327731790 2024-09-10T20:58:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.862+0000 7ffbbe505640 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772b950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00e3b60 tx=0x7ffbb00a87b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed0ff15daf324a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.868+0000 7ffba37fe640 1 -- 172.21.15.67:0/3576438213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0009820 con 0x558327731790 2024-09-10T20:58:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.868+0000 7ffba37fe640 1 -- 172.21.15.67:0/3576438213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb0004660 con 0x558327731790 2024-09-10T20:58:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.868+0000 7ffba37fe640 1 -- 172.21.15.67:0/3576438213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004440 con 0x558327731790 2024-09-10T20:58:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.871+0000 7ffbc233d740 1 -- 172.21.15.67:0/3576438213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 msgr2=0x55832772b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.871+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772b950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00e3b60 tx=0x7ffbb00a87b0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.874+0000 7ffbc233d740 1 -- 172.21.15.67:0/3576438213 shutdown_connections 2024-09-10T20:58:13.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.874+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x55832772b950 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.874+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327730480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.874+0000 7ffbc233d740 1 --2- 172.21.15.67:0/3576438213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x558327724370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.874+0000 7ffbc233d740 1 -- 172.21.15.67:0/3576438213 >> 172.21.15.67:0/3576438213 conn(0x558327722d10 msgr2=0x55832772fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.881+0000 7ffbc233d740 1 -- 172.21.15.67:0/3576438213 shutdown_connections 2024-09-10T20:58:13.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.884+0000 7ffbc233d740 1 -- 172.21.15.67:0/3576438213 wait complete. 2024-09-10T20:58:13.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.884+0000 7ffbc233d740 1 -- start start 2024-09-10T20:58:13.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.885+0000 7ffbc233d740 1 Processor -- start 2024-09-10T20:58:13.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.885+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327736670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbbdd04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:39456/0 (socket says 172.21.15.67:39456) 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbc233d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x5583277a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbbdd04640 1 -- 172.21.15.67:0/2576231553 learned_addr learned my addr 172.21.15.67:0/2576231553 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81aebb0 con 0x558327731790 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b0020 con 0x558327725800 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.886+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81af280 con 0x558327724ee0 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbc233d740 10 client.0 _ll_register_callbacks cb 0x7ffbb40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbbdd04640 1 -- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 msgr2=0x558327736670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327736670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbbdd04640 1 -- 172.21.15.67:0/2576231553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 msgr2=0x5583277a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x5583277a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.887+0000 7ffbbdd04640 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583277a7e80 con 0x558327724ee0 2024-09-10T20:58:13.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.891+0000 7ffbbdd04640 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4004640 tx=0x7ffbb40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d96e441046c0043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:13.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.891+0000 7ffba17fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:13.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.891+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4036060 con 0x558327724ee0 2024-09-10T20:58:13.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.891+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffbb401fbd0 con 0x558327724ee0 2024-09-10T20:58:13.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.891+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55832769ddb0 con 0x558327724ee0 2024-09-10T20:58:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.892+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffbb401fdd0 con 0x558327724ee0 2024-09-10T20:58:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.893+0000 7ffbc233d740 10 client.25855 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:13.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.893+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5583277af2d0 con 0x558327724ee0 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.893+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55832769ddb0 con 0x558327724ee0 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.893+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffbb401e660 con 0x558327724ee0 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 10 client.25855 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 20 client.25855 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277af9b0 0x5583277b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 4 client.25855 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:58:13.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558327699860 con 0x5583277af9b0 2024-09-10T20:58:13.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.894+0000 7ffbbd503640 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277af9b0 0x5583277b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.897+0000 7ffbbd503640 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277af9b0 0x5583277b1df0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291359af467d2704 server_cookie=772540cc00eee16d in_seq=0 out_seq=0 2024-09-10T20:58:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.897+0000 7ffba17fa640 10 client.25855 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffba17fa640 1 -- 172.21.15.67:0/2576231553 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558327699860 con 0x5583277af9b0 2024-09-10T20:58:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffba17fa640 10 client.25855 handle_command_reply: tid=0 2024-09-10T20:58:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 client.25855 shutdown 2024-09-10T20:58:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 msgr2=0x5583277360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4004640 tx=0x7ffbb40046c0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 shutdown_connections 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5583277af9b0 0x5583277b1df0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558327731790 0x5583277a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558327725800 0x558327736670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 --2- 172.21.15.67:0/2576231553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558327724ee0 0x5583277360d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 >> 172.21.15.67:0/2576231553 conn(0x558327722d10 msgr2=0x558327730590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffba17fa640 0 client.25855 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 shutdown_connections 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.900+0000 7ffbc233d740 1 -- 172.21.15.67:0/2576231553 wait complete. 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.901+0000 7ffbc233d740 20 client.25855 trim_cache size 0 max 16384 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "f15fee58-a6bb-478a-9502-37153f1e699f", 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:58:13.906 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.902+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 msgr2=0x7ffba40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.902+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 0x7ffba40b7820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x558327728060 tx=0x7ffbb4005f90 comp rx=0 tx=0).stop 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.902+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 msgr2=0x7ffbb819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 0x7ffbb819eb40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ec50 tx=0x7ffbb000c6a0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 shutdown_connections 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbb8109150 0x7ffbb819eb40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbb81087d0 0x7ffbb81997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffba40b5360 0x7ffba40b7820 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 --2- 172.21.15.67:0/1189367634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbb8102dc0 0x7ffbb8199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 >> 172.21.15.67:0/1189367634 conn(0x7ffbb80fe870 msgr2=0x7ffbb8100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 shutdown_connections 2024-09-10T20:58:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:13.903+0000 7ffbbff68640 1 -- 172.21.15.67:0/1189367634 wait complete. 2024-09-10T20:58:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 400.0 s, 2196.4 tps, lat 45.328 ms stddev 48.543 2024-09-10T20:58:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:14 smithi067 ceph-mon[30891]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-10T20:58:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:14 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:58:14.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:14 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:14 smithi083 ceph-mon[35058]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-10T20:58:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:14 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:58:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:14 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:14 smithi172 ceph-mon[35265]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-09-10T20:58:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:14 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:58:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:14 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:14.713 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:58:15.098 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.518 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:15 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:58:15.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:58:15.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:58:15.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:15 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 -- 172.21.15.67:0/645493437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff30010a3b0 msgr2=0x7ff30010a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 --2- 172.21.15.67:0/645493437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff30010a3b0 0x7ff30010a790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00074e0 tx=0x7ff2f002b070 comp rx=0 tx=0).stop 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 -- 172.21.15.67:0/645493437 shutdown_connections 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 --2- 172.21.15.67:0/645493437 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3000759f0 0x7ff30007c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 --2- 172.21.15.67:0/645493437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff300075070 0x7ff3000754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 --2- 172.21.15.67:0/645493437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff30010a3b0 0x7ff30010a790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 -- 172.21.15.67:0/645493437 >> 172.21.15.67:0/645493437 conn(0x7ff30006dfc0 msgr2=0x7ff30006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 -- 172.21.15.67:0/645493437 shutdown_connections 2024-09-10T20:58:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.641+0000 7ff304b85640 1 -- 172.21.15.67:0/645493437 wait complete. 2024-09-10T20:58:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 Processor -- start 2024-09-10T20:58:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 -- start start 2024-09-10T20:58:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 0x7ff30007bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30010a3b0 0x7ff3000773a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff30007f690 con 0x7ff30010a3b0 2024-09-10T20:58:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff30007f510 con 0x7ff300075070 2024-09-10T20:58:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.642+0000 7ff304b85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff30007f810 con 0x7ff3000759f0 2024-09-10T20:58:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:39464/0 (socket says 172.21.15.67:39464) 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/1467931917 learned_addr learned my addr 172.21.15.67:0/1467931917 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 0x7ff30007bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/1467931917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 msgr2=0x7ff30007bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 0x7ff30007bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30010a3b0 msgr2=0x7ff3000773a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30010a3b0 0x7ff3000773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.643+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/1467931917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3000779e0 con 0x7ff3000759f0 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 0x7ff30007bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00ea20 tx=0x7ff2ec00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff2f77fe640 1 -- 172.21.15.67:0/1467931917 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00cd80 con 0x7ff3000759f0 2024-09-10T20:58:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3001bcf00 con 0x7ff3000759f0 2024-09-10T20:58:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3001bd440 con 0x7ff3000759f0 2024-09-10T20:58:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff2f77fe640 1 -- 172.21.15.67:0/1467931917 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2ec0054d0 con 0x7ff3000759f0 2024-09-10T20:58:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.644+0000 7ff2f77fe640 1 -- 172.21.15.67:0/1467931917 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec010430 con 0x7ff3000759f0 2024-09-10T20:58:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.649+0000 7ff306f5a740 1 Processor -- start 2024-09-10T20:58:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.649+0000 7ff2f77fe640 1 -- 172.21.15.67:0/1467931917 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff2ec0106f0 con 0x7ff3000759f0 2024-09-10T20:58:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 -- start start 2024-09-10T20:58:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff2f77fe640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 0x7ff2e40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e91d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560b54df9e50 con 0x560b54e839c0 2024-09-10T20:58:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560b54de9280 con 0x560b54e830a0 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff306f5a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560b54ded090 con 0x560b54e8f950 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48092/0 (socket says 172.21.15.67:48092) 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff2fe59c640 1 -- 172.21.15.67:0/3255078518 learned_addr learned my addr 172.21.15.67:0/3255078518 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.651+0000 7ff2f77fe640 1 -- 172.21.15.67:0/1467931917 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff2ec0e5f60 con 0x7ff3000759f0 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 -- 172.21.15.67:0/3255078518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 msgr2=0x560b54e91d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e91d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 -- 172.21.15.67:0/3255078518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 msgr2=0x560b54e8f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fed9d640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 0x7ff2e40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 -- 172.21.15.67:0/3255078518 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b54b47650 con 0x560b54e830a0 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0007600 tx=0x7ff2f0005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3dbb86decf0e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2f4ff9640 1 -- 172.21.15.67:0/3255078518 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0007a50 con 0x560b54e830a0 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.652+0000 7ff2f4ff9640 1 -- 172.21.15.67:0/3255078518 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f0040070 con 0x560b54e830a0 2024-09-10T20:58:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.653+0000 7ff2f4ff9640 1 -- 172.21.15.67:0/3255078518 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004490 con 0x560b54e830a0 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.653+0000 7ff306f5a740 1 -- 172.21.15.67:0/3255078518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 msgr2=0x560b54e83480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.653+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0007600 tx=0x7ff2f0005d30 comp rx=0 tx=0).stop 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.654+0000 7ff2fed9d640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 0x7ff2e40b78a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8005c40 tx=0x7ff2f8005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 -- 172.21.15.67:0/3255078518 shutdown_connections 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e91d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3255078518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e83480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 -- 172.21.15.67:0/3255078518 >> 172.21.15.67:0/3255078518 conn(0x560b54e80ed0 msgr2=0x560b54e82070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 -- 172.21.15.67:0/3255078518 shutdown_connections 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 -- 172.21.15.67:0/3255078518 wait complete. 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.655+0000 7ff306f5a740 1 -- start start 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 Processor -- start 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e8cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560b54c4a700 con 0x560b54e839c0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560b54d84110 con 0x560b54e830a0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560b54e92610 con 0x560b54e8f950 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48100/0 (socket says 172.21.15.67:48100) 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff2fe59c640 1 -- 172.21.15.67:0/1685875080 learned_addr learned my addr 172.21.15.67:0/1685875080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff306f5a740 10 client.0 _ll_register_callbacks cb 0x560b54d9d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.656+0000 7ff2fed9d640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e8cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 -- 172.21.15.67:0/1685875080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 msgr2=0x560b54e8cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e8cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 -- 172.21.15.67:0/1685875080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 msgr2=0x560b54e8c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 -- 172.21.15.67:0/1685875080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b54db1c40 con 0x560b54e830a0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f0040070 con 0x560b54e830a0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0005ab0 tx=0x7ff2f00045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf5363e39a5c40d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2e1ffb640 10 client.25889 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/1685875080 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0007de0 con 0x560b54e830a0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/1685875080 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff2f0004920 con 0x560b54e830a0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/1685875080 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2f0004b60 con 0x560b54e830a0 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff306f5a740 10 client.25889 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.657+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x560b54e9de10 con 0x560b54e830a0 2024-09-10T20:58:15.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.658+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/1685875080 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff2f002b9b0 con 0x560b54e830a0 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 10 client.25889 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 10 client.25889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 20 client.25889 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54ea1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 4 client.25889 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b54dfbda0 con 0x560b54e9f160 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.660+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54ea1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff2e1ffb640 10 client.25889 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54ea1550 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27adbf906140bb9f server_cookie=a33f17d8f973a45e in_seq=0 out_seq=0 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/1685875080 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b54dfbda0 con 0x560b54e9f160 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff2e1ffb640 10 client.25889 handle_command_reply: tid=0 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff306f5a740 1 client.25889 shutdown 2024-09-10T20:58:15.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 msgr2=0x560b54e8f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0005ab0 tx=0x7ff2f00045f0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 shutdown_connections 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54ea1550 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.661+0000 7ff2e1ffb640 0 client.25889 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e8f950 0x560b54e8cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e839c0 0x560b54e8c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 --2- 172.21.15.67:0/1685875080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e830a0 0x560b54e8f1d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 >> 172.21.15.67:0/1685875080 conn(0x560b54e80ed0 msgr2=0x560b54e86a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 shutdown_connections 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 1 -- 172.21.15.67:0/1685875080 wait complete. 2024-09-10T20:58:15.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.662+0000 7ff306f5a740 20 client.25889 trim_cache size 0 max 16384 2024-09-10T20:58:15.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 Processor -- start 2024-09-10T20:58:15.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 -- start start 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e830a0 0x560b54e80710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 0x560b54e89850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8010c50 con 0x560b54e8f950 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e800e520 con 0x560b54e839c0 2024-09-10T20:58:15.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff306f5a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e800c370 con 0x560b54e830a0 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff2fed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 0x560b54e89850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff2fdd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff2fed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 0x560b54e89850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50504/0 (socket says 172.21.15.67:50504) 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff2fdd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48108/0 (socket says 172.21.15.67:48108) 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.688+0000 7ff2fed9d640 1 -- 172.21.15.67:0/3586077770 learned_addr learned my addr 172.21.15.67:0/3586077770 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.689+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3586077770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e830a0 msgr2=0x560b54e80710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.689+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e830a0 0x560b54e80710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.689+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3586077770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 msgr2=0x560b54e89850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.689+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 0x560b54e89850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.689+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3586077770 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b54e8cf30 con 0x560b54e839c0 2024-09-10T20:58:15.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.690+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x560b54e81db0 tx=0x7ff2ec0105d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96f54521a548c838 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.690+0000 7ff2e3fff640 1 -- 172.21.15.67:0/3586077770 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0ac200 con 0x560b54e839c0 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.690+0000 7ff2e3fff640 1 -- 172.21.15.67:0/3586077770 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2ec005680 con 0x560b54e839c0 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.690+0000 7ff2e3fff640 1 -- 172.21.15.67:0/3586077770 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0b5c80 con 0x560b54e839c0 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.691+0000 7ff306f5a740 1 -- 172.21.15.67:0/3586077770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 msgr2=0x560b54e8e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.691+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x560b54e81db0 tx=0x7ff2ec0105d0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.692+0000 7ff306f5a740 1 -- 172.21.15.67:0/3586077770 shutdown_connections 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.692+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e8f950 0x560b54e89850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.692+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e839c0 0x560b54e8e360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.692+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3586077770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e830a0 0x560b54e80710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.692+0000 7ff306f5a740 1 -- 172.21.15.67:0/3586077770 >> 172.21.15.67:0/3586077770 conn(0x560b54e80ed0 msgr2=0x560b54e8dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.693+0000 7ff306f5a740 1 -- 172.21.15.67:0/3586077770 shutdown_connections 2024-09-10T20:58:15.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.693+0000 7ff306f5a740 1 -- 172.21.15.67:0/3586077770 wait complete. 2024-09-10T20:58:15.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.693+0000 7ff306f5a740 1 -- start start 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 Processor -- start 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 0x560b54ea2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 0x560b54ea3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e8f950 0x560b54f0acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e800c9e0 con 0x560b54e830a0 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 0x560b54ea2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff2fe59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 0x560b54ea2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:50516/0 (socket says 172.21.15.67:50516) 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff2fe59c640 1 -- 172.21.15.67:0/3185183030 learned_addr learned my addr 172.21.15.67:0/3185183030 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:15.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 0x560b54ea3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff2fed9d640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e8f950 0x560b54f0acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.694+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e800de50 con 0x560b54e8f950 2024-09-10T20:58:15.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.695+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e800d0b0 con 0x560b54e839c0 2024-09-10T20:58:15.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.695+0000 7ff306f5a740 10 client.0 _ll_register_callbacks cb 0x7ff2ec005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:15.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:58:15.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:58:15.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:58:15.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:15 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:15.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e8f950 msgr2=0x560b54f0acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e8f950 0x560b54f0acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3185183030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 msgr2=0x560b54ea2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 0x560b54ea2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b54f0b410 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2fdd9b640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 0x560b54ea3380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0a8cc0 tx=0x7ff2ec0b27e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cf55bb54d0cf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.696+0000 7ff2e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0ac200 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff2ec0ac950 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2ec005680 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2ec0acdf0 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff306f5a740 10 client.25867 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.697+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560b54f0c700 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2ec005680 con 0x560b54e839c0 2024-09-10T20:58:15.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff2ec06bce0 con 0x560b54e839c0 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 10 client.25867 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 10 client.25867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 20 client.25867 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54f0ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 4 client.25867 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560b54df7850 con 0x560b54e9f160 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.698+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54f0ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff2e1ffb640 10 client.25867 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff2fe59c640 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54f0ee60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2c5a6f2b1d0996 server_cookie=6ed848de37d0641d in_seq=0 out_seq=0 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff2e1ffb640 1 -- 172.21.15.67:0/3185183030 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x560b54df7850 con 0x560b54e9f160 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff2e1ffb640 10 client.25867 handle_command_reply: tid=0 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff306f5a740 1 client.25867 shutdown 2024-09-10T20:58:15.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 msgr2=0x560b54ea3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 0x560b54ea3380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0a8cc0 tx=0x7ff2ec0b27e0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 shutdown_connections 2024-09-10T20:58:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.699+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560b54e9f160 0x560b54f0ee60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560b54e8f950 0x560b54f0acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff2e1ffb640 0 client.25867 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b54e839c0 0x560b54ea3380 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 --2- 172.21.15.67:0/3185183030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560b54e830a0 0x560b54ea2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 >> 172.21.15.67:0/3185183030 conn(0x560b54e80ed0 msgr2=0x560b54e8dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 shutdown_connections 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 1 -- 172.21.15.67:0/3185183030 wait complete. 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.700+0000 7ff306f5a740 20 client.25867 trim_cache size 0 max 16384 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:58:15.707 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "f15fee58-a6bb-478a-9502-37153f1e699f", 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:58:15.709 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:58:15.712 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:15.714 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.701+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 msgr2=0x7ff2e40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.701+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 0x7ff2e40b78a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8005c40 tx=0x7ff2f8005bd0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.701+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 msgr2=0x7ff300076e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.701+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00ea20 tx=0x7ff2ec00ee20 comp rx=0 tx=0).stop 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 shutdown_connections 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff30010a3b0 0x7ff3000773a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff2e40b53e0 0x7ff2e40b78a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3000759f0 0x7ff300076e60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 --2- 172.21.15.67:0/1467931917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff300075070 0x7ff30007bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 >> 172.21.15.67:0/1467931917 conn(0x7ff30006dfc0 msgr2=0x7ff30010c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 shutdown_connections 2024-09-10T20:58:15.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:15.702+0000 7ff304b85640 1 -- 172.21.15.67:0/1467931917 wait complete. 2024-09-10T20:58:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:16 smithi083 ceph-mon[35058]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-09-10T20:58:16.698 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:16 smithi067 ceph-mon[30891]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-09-10T20:58:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:16 smithi172 ceph-mon[35265]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-09-10T20:58:16.741 INFO:tasks.cephfs.filesystem:scrub status for tag:f15fee58-a6bb-478a-9502-37153f1e699f - {'path': '/', 'tag': 'f15fee58-a6bb-478a-9502-37153f1e699f', 'options': 'recursive,force'} 2024-09-10T20:58:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:18 smithi083 ceph-mon[35058]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 699 op/s 2024-09-10T20:58:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:18 smithi172 ceph-mon[35265]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 699 op/s 2024-09-10T20:58:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:18 smithi067 ceph-mon[30891]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 699 op/s 2024-09-10T20:58:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 405.0 s, 2407.6 tps, lat 41.944 ms stddev 50.427 2024-09-10T20:58:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:20 smithi083 ceph-mon[35058]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-10T20:58:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:20 smithi172 ceph-mon[35265]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-10T20:58:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:20 smithi067 ceph-mon[30891]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 702 op/s 2024-09-10T20:58:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:22 smithi083 ceph-mon[35058]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 656 op/s 2024-09-10T20:58:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:22 smithi172 ceph-mon[35265]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 656 op/s 2024-09-10T20:58:22.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:22 smithi067 ceph-mon[30891]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 656 op/s 2024-09-10T20:58:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 410.0 s, 2464.2 tps, lat 40.581 ms stddev 45.222 2024-09-10T20:58:24.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:24 smithi083 ceph-mon[35058]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 759 op/s 2024-09-10T20:58:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:24 smithi172 ceph-mon[35265]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 759 op/s 2024-09-10T20:58:24.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:24 smithi067 ceph-mon[30891]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 759 op/s 2024-09-10T20:58:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:26 smithi083 ceph-mon[35058]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 666 op/s 2024-09-10T20:58:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:58:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:58:26.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:58:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:26 smithi172 ceph-mon[35265]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 666 op/s 2024-09-10T20:58:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:58:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:58:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:58:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:26 smithi067 ceph-mon[30891]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 666 op/s 2024-09-10T20:58:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:58:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:58:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:58:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:28 smithi083 ceph-mon[35058]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-09-10T20:58:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:28 smithi172 ceph-mon[35265]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-09-10T20:58:28.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:28 smithi067 ceph-mon[30891]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-09-10T20:58:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 415.0 s, 3017.4 tps, lat 32.802 ms stddev 50.991 2024-09-10T20:58:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:30 smithi083 ceph-mon[35058]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 735 op/s 2024-09-10T20:58:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:30 smithi172 ceph-mon[35265]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 735 op/s 2024-09-10T20:58:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:30 smithi067 ceph-mon[30891]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 735 op/s 2024-09-10T20:58:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:32 smithi083 ceph-mon[35058]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-09-10T20:58:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:32 smithi172 ceph-mon[35265]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-09-10T20:58:32.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:32 smithi067 ceph-mon[30891]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-09-10T20:58:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 420.0 s, 2301.8 tps, lat 43.890 ms stddev 52.974 2024-09-10T20:58:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:34 smithi083 ceph-mon[35058]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-09-10T20:58:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:34 smithi172 ceph-mon[35265]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-09-10T20:58:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:34 smithi067 ceph-mon[30891]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-09-10T20:58:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:36 smithi083 ceph-mon[35058]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-10T20:58:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:36 smithi172 ceph-mon[35265]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-10T20:58:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:36 smithi067 ceph-mon[30891]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 768 op/s 2024-09-10T20:58:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:38 smithi083 ceph-mon[35058]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 857 op/s 2024-09-10T20:58:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:38 smithi172 ceph-mon[35265]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 857 op/s 2024-09-10T20:58:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:38 smithi067 ceph-mon[30891]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 MiB/s wr, 857 op/s 2024-09-10T20:58:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 425.0 s, 2220.0 tps, lat 44.976 ms stddev 61.572 2024-09-10T20:58:40.597 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:40 smithi067 ceph-mon[30891]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 812 op/s 2024-09-10T20:58:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:40 smithi083 ceph-mon[35058]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 812 op/s 2024-09-10T20:58:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:40 smithi172 ceph-mon[35265]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 812 op/s 2024-09-10T20:58:41.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:41 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:58:41.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:41 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:58:41.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:41 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 698 op/s 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Unable to set osd_memory_target on smithi172 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Unable to set osd_memory_target on smithi083 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: Unable to set osd_memory_target on smithi067 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:58:42.643 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:58:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 698 op/s 2024-09-10T20:58:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Unable to set osd_memory_target on smithi172 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Unable to set osd_memory_target on smithi083 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T20:58:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: Unable to set osd_memory_target on smithi067 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:58:42.701 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:58:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 MiB/s wr, 698 op/s 2024-09-10T20:58:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Unable to set osd_memory_target on smithi172 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Unable to set osd_memory_target on smithi083 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T20:58:42.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Adjusting osd_memory_target on smithi067 to 176.0M 2024-09-10T20:58:42.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: Unable to set osd_memory_target on smithi067 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-10T20:58:42.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:58:42.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:58:42.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:58:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 430.0 s, 2286.0 tps, lat 43.788 ms stddev 51.205 2024-09-10T20:58:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:44 smithi083 ceph-mon[35058]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 817 op/s 2024-09-10T20:58:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:44 smithi172 ceph-mon[35265]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 817 op/s 2024-09-10T20:58:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:44 smithi067 ceph-mon[30891]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 817 op/s 2024-09-10T20:58:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:46 smithi083 ceph-mon[35058]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 689 op/s 2024-09-10T20:58:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:46 smithi172 ceph-mon[35265]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 689 op/s 2024-09-10T20:58:46.742 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:58:46.782 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:46 smithi067 ceph-mon[30891]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 20 MiB/s wr, 689 op/s 2024-09-10T20:58:47.125 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 -- 172.21.15.67:0/4267660878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60108770 msgr2=0x7f7c60108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 --2- 172.21.15.67:0/4267660878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60108770 0x7f7c60108bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c4802a410 comp rx=0 tx=0).stop 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 -- 172.21.15.67:0/4267660878 shutdown_connections 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 --2- 172.21.15.67:0/4267660878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c601090f0 0x7f7c6010f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 --2- 172.21.15.67:0/4267660878 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60108770 0x7f7c60108bb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 --2- 172.21.15.67:0/4267660878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c60101320 0x7f7c60101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 -- 172.21.15.67:0/4267660878 >> 172.21.15.67:0/4267660878 conn(0x7f7c60078060 msgr2=0x7f7c600ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 -- 172.21.15.67:0/4267660878 shutdown_connections 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 -- 172.21.15.67:0/4267660878 wait complete. 2024-09-10T20:58:47.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.706+0000 7f7c654fc640 1 Processor -- start 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 -- start start 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c60108770 0x7f7c601997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c601090f0 0x7f7c6019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c60112dc0 con 0x7f7c60101320 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c60112c40 con 0x7f7c601090f0 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c654fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c60112f40 con 0x7f7c60108770 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49672/0 (socket says 172.21.15.67:49672) 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 -- 172.21.15.67:0/3019895785 learned_addr learned my addr 172.21.15.67:0/3019895785 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c57fff640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c60108770 0x7f7c601997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c601090f0 0x7f7c6019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 -- 172.21.15.67:0/3019895785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c60108770 msgr2=0x7f7c601997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c60108770 0x7f7c601997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 -- 172.21.15.67:0/3019895785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c601090f0 msgr2=0x7f7c6019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c601090f0 0x7f7c6019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 -- 172.21.15.67:0/3019895785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6019f360 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.707+0000 7f7c5effd640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000ea60 tx=0x7f7c5000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.708+0000 7f7c5cff9640 1 -- 172.21.15.67:0/3019895785 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000cde0 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.708+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6019f650 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.708+0000 7f7c5cff9640 1 -- 172.21.15.67:0/3019895785 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c500035f0 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.708+0000 7f7c5cff9640 1 -- 172.21.15.67:0/3019895785 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50010690 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.708+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c60102170 con 0x7f7c60101320 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.710+0000 7f7c678d1740 1 Processor -- start 2024-09-10T20:58:47.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 -- start start 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c5cff9640 1 -- 172.21.15.67:0/3019895785 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7c50004000 con 0x7f7c60101320 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b89c0 0x55828d4c4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55828d42ee50 con 0x55828d4c4950 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55828d41e280 con 0x55828d4b80a0 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c678d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55828d422090 con 0x55828d4b89c0 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c5f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49674/0 (socket says 172.21.15.67:49674) 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c5f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43692/0 (socket says 172.21.15.67:43692) 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c57fff640 1 -- 172.21.15.67:0/4280943153 learned_addr learned my addr 172.21.15.67:0/4280943153 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:47.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.711+0000 7f7c5effd640 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b89c0 0x55828d4c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 -- 172.21.15.67:0/4280943153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b89c0 msgr2=0x55828d4c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b89c0 0x55828d4c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 -- 172.21.15.67:0/4280943153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 msgr2=0x55828d4b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 -- 172.21.15.67:0/4280943153 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828d17c650 con 0x55828d4c4950 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c5cff9640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 0x7f7c4c0bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c57fff640 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c48032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be2226046f7bcd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 0x7f7c4c0bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c5cff9640 1 -- 172.21.15.67:0/3019895785 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7c500e5e50 con 0x7f7c60101320 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c557fa640 1 -- 172.21.15.67:0/4280943153 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48040070 con 0x55828d4c4950 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c557fa640 1 -- 172.21.15.67:0/4280943153 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c48004030 con 0x55828d4c4950 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.712+0000 7f7c557fa640 1 -- 172.21.15.67:0/4280943153 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48035040 con 0x55828d4c4950 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 -- 172.21.15.67:0/4280943153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 msgr2=0x55828d4c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 0x7f7c4c0bbbb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005fd0 tx=0x7f7c58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c48032b20 comp rx=0 tx=0).stop 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 -- 172.21.15.67:0/4280943153 shutdown_connections 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4c6d40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b89c0 0x55828d4c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 --2- 172.21.15.67:0/4280943153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b80a0 0x55828d4b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 -- 172.21.15.67:0/4280943153 >> 172.21.15.67:0/4280943153 conn(0x55828d4b5ed0 msgr2=0x55828d4b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 -- 172.21.15.67:0/4280943153 shutdown_connections 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.713+0000 7f7c678d1740 1 -- 172.21.15.67:0/4280943153 wait complete. 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 -- start start 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 Processor -- start 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 0x55828d4c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 0x55828d4c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55828d27f700 con 0x55828d4b80a0 2024-09-10T20:58:47.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55828d3b9110 con 0x55828d4b89c0 2024-09-10T20:58:47.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55828d4c7570 con 0x55828d4c4950 2024-09-10T20:58:47.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 0x55828d4c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c678d1740 10 client.0 _ll_register_callbacks cb 0x55828d3d2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 0x55828d4c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49682/0 (socket says 172.21.15.67:49682) 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c5effd640 1 -- 172.21.15.67:0/2334543644 learned_addr learned my addr 172.21.15.67:0/2334543644 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.714+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 0x55828d4c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 -- 172.21.15.67:0/2334543644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 msgr2=0x55828d4c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 0x55828d4c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 -- 172.21.15.67:0/2334543644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 msgr2=0x55828d4c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 0x55828d4c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 -- 172.21.15.67:0/2334543644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828d3e6c40 con 0x55828d4b89c0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c5f7fe640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 0x55828d4c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c16c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c48005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6dd6ae989c5ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c467fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48035070 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c48004030 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7c48005230 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c48040040 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c678d1740 10 client.25907 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55828d4d2ed0 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.715+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c48004030 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c48003990 con 0x55828d4b89c0 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 10 client.25907 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 10 client.25907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:47.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 20 client.25907 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d4d4330 0x55828d4d67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 4 client.25907 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55828d430da0 con 0x55828d4d4330 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d4d4330 0x55828d4d67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d4d4330 0x55828d4d67f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6691596f06c9588a server_cookie=a28961d748ca010f in_seq=0 out_seq=0 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.716+0000 7f7c467fc640 10 client.25907 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c467fc640 1 -- 172.21.15.67:0/2334543644 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55828d430da0 con 0x55828d4d4330 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c467fc640 10 client.25907 handle_command_reply: tid=0 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 client.25907 shutdown 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 msgr2=0x55828d4c16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c16c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009900 tx=0x7f7c48005fd0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 shutdown_connections 2024-09-10T20:58:47.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d4d4330 0x55828d4d67f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4c4950 0x55828d4c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c467fc640 0 client.25907 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c16c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2334543644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b80a0 0x55828d4c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 >> 172.21.15.67:0/2334543644 conn(0x55828d4b5ed0 msgr2=0x55828d4bba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 shutdown_connections 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.717+0000 7f7c678d1740 1 -- 172.21.15.67:0/2334543644 wait complete. 2024-09-10T20:58:47.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.718+0000 7f7c678d1740 20 client.25907 trim_cache size 0 max 16384 2024-09-10T20:58:47.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.738+0000 7f7c678d1740 1 Processor -- start 2024-09-10T20:58:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.740+0000 7f7c678d1740 1 -- start start 2024-09-10T20:58:47.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.740+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.740+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.740+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4bff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43708/0 (socket says 172.21.15.67:43708) 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 -- 172.21.15.67:0/458062115 learned_addr learned my addr 172.21.15.67:0/458062115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601ae9a0 con 0x55828d4c4950 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601ac270 con 0x55828d4b89c0 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601aa0c0 con 0x55828d4b80a0 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 -- 172.21.15.67:0/458062115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 msgr2=0x55828d4d07a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4d07a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 -- 172.21.15.67:0/458062115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 msgr2=0x55828d4bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 -- 172.21.15.67:0/458062115 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828d4c2060 con 0x55828d4b89c0 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.741+0000 7f7c57fff640 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005c40 tx=0x7f7c48009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c38cc1748db1e240 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.742+0000 7f7c54ff9640 1 -- 172.21.15.67:0/458062115 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48035040 con 0x55828d4b89c0 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.742+0000 7f7c54ff9640 1 -- 172.21.15.67:0/458062115 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c480044b0 con 0x55828d4b89c0 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.743+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 msgr2=0x55828d4c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.743+0000 7f7c678d1740 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005c40 tx=0x7f7c48009650 comp rx=0 tx=0).stop 2024-09-10T20:58:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 shutdown_connections 2024-09-10T20:58:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4c4950 0x55828d4bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4b89c0 0x55828d4c0bb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 --2- 172.21.15.67:0/458062115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 >> 172.21.15.67:0/458062115 conn(0x55828d4b5ed0 msgr2=0x55828d4b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.753+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 shutdown_connections 2024-09-10T20:58:47.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.755+0000 7f7c678d1740 1 -- 172.21.15.67:0/458062115 wait complete. 2024-09-10T20:58:47.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.755+0000 7f7c678d1740 1 -- start start 2024-09-10T20:58:47.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.756+0000 7f7c678d1740 1 Processor -- start 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.756+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4bf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4c4950 0x55828d4cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601aa730 con 0x55828d4b89c0 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601abba0 con 0x55828d4c4950 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c601aae00 con 0x55828d4b80a0 2024-09-10T20:58:47.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c678d1740 10 client.0 _ll_register_callbacks cb 0x7f7c58009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:47.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49704/0 (socket says 172.21.15.67:49704) 2024-09-10T20:58:47.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c57fff640 1 -- 172.21.15.67:0/2650656335 learned_addr learned my addr 172.21.15.67:0/2650656335 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:47.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 -- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4c4950 msgr2=0x55828d4cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4c4950 0x55828d4cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 -- 172.21.15.67:0/2650656335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 msgr2=0x55828d4cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c5effd640 1 -- 172.21.15.67:0/2650656335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828d53c1a0 con 0x55828d4b80a0 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.757+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c5effd640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4bf240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d010 tx=0x7f7c50009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49846c3f03acd938 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c467fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:47.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c500a84e0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c480044b0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7c500a88b0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c500abdb0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c678d1740 10 client.25882 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.758+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55828d55adc0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c480044b0 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7c500a7f90 con 0x55828d4b80a0 2024-09-10T20:58:47.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 10 client.25882 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 20 client.25882 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d55b590 0x55828d55d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 4 client.25882 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.759+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55828d42c850 con 0x55828d55b590 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.760+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d55b590 0x55828d55d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.761+0000 7f7c467fc640 10 client.25882 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:47.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.761+0000 7f7c57fff640 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d55b590 0x55828d55d9b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a062e11075c2f054 server_cookie=ab1e8a199781b496 in_seq=0 out_seq=0 2024-09-10T20:58:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.762+0000 7f7c467fc640 1 -- 172.21.15.67:0/2650656335 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55828d42c850 con 0x55828d55b590 2024-09-10T20:58:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.762+0000 7f7c467fc640 10 client.25882 handle_command_reply: tid=0 2024-09-10T20:58:47.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.762+0000 7f7c678d1740 1 client.25882 shutdown 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.763+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 msgr2=0x55828d4bf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.763+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4bf240 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d010 tx=0x7f7c50009310 comp rx=0 tx=0).stop 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 shutdown_connections 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55828d55b590 0x55828d55d9b0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55828d4c4950 0x55828d4cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55828d4b89c0 0x55828d4cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 --2- 172.21.15.67:0/2650656335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55828d4b80a0 0x55828d4bf240 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 >> 172.21.15.67:0/2650656335 conn(0x55828d4b5ed0 msgr2=0x55828d4bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c467fc640 0 client.25882 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 shutdown_connections 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 1 -- 172.21.15.67:0/2650656335 wait complete. 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.764+0000 7f7c678d1740 20 client.25882 trim_cache size 0 max 16384 2024-09-10T20:58:47.769 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:58:47.770 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.771 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.772 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.773 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.774 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:58:47.775 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:58:47.776 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:58:47.776 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:47.776 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:58:47.776 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:58:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.766+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 msgr2=0x7f7c4c0bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.766+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 0x7f7c4c0bbbb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005fd0 tx=0x7f7c58009500 comp rx=0 tx=0).stop 2024-09-10T20:58:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.766+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 msgr2=0x7f7c601992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:47.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.766+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000ea60 tx=0x7f7c5000ef20 comp rx=0 tx=0).stop 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.766+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 shutdown_connections 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c601090f0 0x7f7c6019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7c4c0b96f0 0x7f7c4c0bbbb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c60108770 0x7f7c601997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 --2- 172.21.15.67:0/3019895785 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c60101320 0x7f7c601992b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 >> 172.21.15.67:0/3019895785 conn(0x7f7c60078060 msgr2=0x7f7c60107f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 shutdown_connections 2024-09-10T20:58:47.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:47.767+0000 7f7c654fc640 1 -- 172.21.15.67:0/3019895785 wait complete. 2024-09-10T20:58:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:48 smithi083 ceph-mon[35058]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 715 op/s 2024-09-10T20:58:48.668 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:48 smithi067 ceph-mon[30891]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 715 op/s 2024-09-10T20:58:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:48 smithi172 ceph-mon[35265]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 715 op/s 2024-09-10T20:58:48.713 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:58:48.714 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:58:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 435.0 s, 2390.4 tps, lat 41.784 ms stddev 59.710 2024-09-10T20:58:49.160 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 -- 172.21.15.67:0/3631780177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec095cf0 msgr2=0x7fbbec0960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 --2- 172.21.15.67:0/3631780177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec095cf0 0x7fbbec0960d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009900 tx=0x7fbbe402a440 comp rx=0 tx=0).stop 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 -- 172.21.15.67:0/3631780177 shutdown_connections 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 --2- 172.21.15.67:0/3631780177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec099ab0 0x7fbbec0a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 --2- 172.21.15.67:0/3631780177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099130 0x7fbbec099570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 --2- 172.21.15.67:0/3631780177 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec095cf0 0x7fbbec0960d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:49.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 -- 172.21.15.67:0/3631780177 >> 172.21.15.67:0/3631780177 conn(0x7fbbec00b310 msgr2=0x7fbbec00db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:49.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 -- 172.21.15.67:0/3631780177 shutdown_connections 2024-09-10T20:58:49.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.739+0000 7fbbf9641640 1 -- 172.21.15.67:0/3631780177 wait complete. 2024-09-10T20:58:49.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 Processor -- start 2024-09-10T20:58:49.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 -- start start 2024-09-10T20:58:49.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 0x7fbbec132f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099ab0 0x7fbbec0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec0a5a10 con 0x7fbbec095cf0 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec0a5890 con 0x7fbbec099130 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf9641640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec0a5b90 con 0x7fbbec099ab0 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:49.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49712/0 (socket says 172.21.15.67:49712) 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf2ffd640 1 -- 172.21.15.67:0/2556079439 learned_addr learned my addr 172.21.15.67:0/2556079439 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.740+0000 7fbbf27fc640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 0x7fbbec132f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf37fe640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099ab0 0x7fbbec0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 -- 172.21.15.67:0/2556079439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099ab0 msgr2=0x7fbbec0a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099ab0 0x7fbbec0a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 -- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 msgr2=0x7fbbec1329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 -- 172.21.15.67:0/2556079439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec0a1ef0 con 0x7fbbec099130 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf2ffd640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbf27fc640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 0x7fbbec132f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009fd0 tx=0x7fbbe800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8015020 con 0x7fbbec099130 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe8011ce0 con 0x7fbbec099130 2024-09-10T20:58:49.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.741+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8010de0 con 0x7fbbec099130 2024-09-10T20:58:49.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.742+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec0a21e0 con 0x7fbbec099130 2024-09-10T20:58:49.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.742+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec12e690 con 0x7fbbec099130 2024-09-10T20:58:49.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.743+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec0960d0 con 0x7fbbec099130 2024-09-10T20:58:49.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.746+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbbe8011830 con 0x7fbbec099130 2024-09-10T20:58:49.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.746+0000 7fbbdbfff640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 0x7fbbdc0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:49.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.747+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbbe80e55c0 con 0x7fbbec099130 2024-09-10T20:58:49.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.747+0000 7fbbf2ffd640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 0x7fbbdc0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:49.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.747+0000 7fbbf2ffd640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 0x7fbbdc0b78a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40096c0 tx=0x7fbbe4009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:49.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:49.751+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbbe801f020 con 0x7fbbec099130 2024-09-10T20:58:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.087+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbec0a2410 con 0x7fbbec099130 2024-09-10T20:58:50.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.087+0000 7fbbdbfff640 1 -- 172.21.15.67:0/2556079439 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7fbbe80ac450 con 0x7fbbec099130 2024-09-10T20:58:50.092 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:58:50.092 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:58:50.092 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 msgr2=0x7fbbdc0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 0x7fbbdc0b78a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40096c0 tx=0x7fbbe4009590 comp rx=0 tx=0).stop 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 msgr2=0x7fbbec132f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 0x7fbbec132f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009fd0 tx=0x7fbbe800b870 comp rx=0 tx=0).stop 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 shutdown_connections 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbbdc0b53e0 0x7fbbdc0b78a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:50.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec099ab0 0x7fbbec0a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:50.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbec099130 0x7fbbec132f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:50.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 --2- 172.21.15.67:0/2556079439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbec095cf0 0x7fbbec1329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:50.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 >> 172.21.15.67:0/2556079439 conn(0x7fbbec00b310 msgr2=0x7fbbec097110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:50.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 shutdown_connections 2024-09-10T20:58:50.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:50.090+0000 7fbbf9641640 1 -- 172.21.15.67:0/2556079439 wait complete. 2024-09-10T20:58:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:50 smithi083 ceph-mon[35058]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 633 op/s 2024-09-10T20:58:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:50 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2556079439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:50.693 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:50 smithi067 ceph-mon[30891]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 633 op/s 2024-09-10T20:58:50.694 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:50 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2556079439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:50 smithi172 ceph-mon[35265]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 633 op/s 2024-09-10T20:58:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:50 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2556079439' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:58:51.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:58:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 -- 172.21.15.67:0/1378422961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 msgr2=0x7fa04c10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1378422961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 0x7fa04c10cb30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa038009900 tx=0x7fa03802a410 comp rx=0 tx=0).stop 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 -- 172.21.15.67:0/1378422961 shutdown_connections 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1378422961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 0x7fa04c10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1378422961 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 0x7fa04c10cb30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1378422961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 -- 172.21.15.67:0/1378422961 >> 172.21.15.67:0/1378422961 conn(0x7fa04c0fd7c0 msgr2=0x7fa04c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 -- 172.21.15.67:0/1378422961 shutdown_connections 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.000+0000 7fa0531e9640 1 -- 172.21.15.67:0/1378422961 wait complete. 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.001+0000 7fa0531e9640 1 Processor -- start 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.001+0000 7fa0531e9640 1 -- start start 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 0x7fa04c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 0x7fa04c1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112df0 con 0x7fa04c104640 2024-09-10T20:58:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112c70 con 0x7fa04c103d20 2024-09-10T20:58:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa0531e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c112f70 con 0x7fa04c10d180 2024-09-10T20:58:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43754/0 (socket says 172.21.15.67:43754) 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.002+0000 7fa050f85640 1 -- 172.21.15.67:0/1791418929 learned_addr learned my addr 172.21.15.67:0/1791418929 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa051786640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 0x7fa04c1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa050f85640 1 -- 172.21.15.67:0/1791418929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 msgr2=0x7fa04c1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa050f85640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 0x7fa04c1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa050f85640 1 -- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 msgr2=0x7fa04c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa050f85640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 0x7fa04c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.003+0000 7fa050f85640 1 -- 172.21.15.67:0/1791418929 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c1a15f0 con 0x7fa04c103d20 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa050f85640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa04000e9f0 tx=0x7fa04000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa049ffb640 1 -- 172.21.15.67:0/1791418929 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04000cd80 con 0x7fa04c103d20 2024-09-10T20:58:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c1a18e0 con 0x7fa04c103d20 2024-09-10T20:58:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa049ffb640 1 -- 172.21.15.67:0/1791418929 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0400108e0 con 0x7fa04c103d20 2024-09-10T20:58:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa049ffb640 1 -- 172.21.15.67:0/1791418929 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040018980 con 0x7fa04c103d20 2024-09-10T20:58:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.004+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c1a8170 con 0x7fa04c103d20 2024-09-10T20:58:52.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.007+0000 7fa0555be740 1 Processor -- start 2024-09-10T20:58:52.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.007+0000 7fa049ffb640 1 -- 172.21.15.67:0/1791418929 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa040010430 con 0x7fa04c103d20 2024-09-10T20:58:52.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.007+0000 7fa0555be740 1 -- start start 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a8df0 0x561cc90b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561cc901eea0 con 0x561cc90a8df0 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561cc900e2d0 con 0x561cc90b4d80 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa0555be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561cc90120e0 con 0x561cc90a84d0 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa051786640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.008+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa051786640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:33024/0 (socket says 172.21.15.67:33024) 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43770/0 (socket says 172.21.15.67:43770) 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa051786640 1 -- 172.21.15.67:0/2501392967 learned_addr learned my addr 172.21.15.67:0/2501392967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:52.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa050f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a8df0 0x561cc90b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa049ffb640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 0x7fa03c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.009+0000 7fa051786640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 0x7fa03c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.011+0000 7fa049ffb640 1 -- 172.21.15.67:0/1791418929 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa0400e5f80 con 0x7fa04c103d20 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.013+0000 7fa051786640 1 -- 172.21.15.67:0/2501392967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 msgr2=0x561cc90b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.013+0000 7fa051786640 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.013+0000 7fa051786640 1 -- 172.21.15.67:0/2501392967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a8df0 msgr2=0x561cc90b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.013+0000 7fa051786640 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a8df0 0x561cc90b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.013+0000 7fa051786640 1 -- 172.21.15.67:0/2501392967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc8d6c650 con 0x561cc90a84d0 2024-09-10T20:58:52.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.016+0000 7fa051786640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 0x7fa03c0b78a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa04401c000 tx=0x7fa04401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.021+0000 7fa051786640 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa044005f40 tx=0x7fa044014f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b06dfd57487a3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.025+0000 7fa036ffd640 1 -- 172.21.15.67:0/2501392967 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04400ebc0 con 0x561cc90a84d0 2024-09-10T20:58:52.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.025+0000 7fa036ffd640 1 -- 172.21.15.67:0/2501392967 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa04400ed60 con 0x561cc90a84d0 2024-09-10T20:58:52.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.026+0000 7fa0555be740 1 -- 172.21.15.67:0/2501392967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 msgr2=0x561cc90a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.026+0000 7fa0555be740 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa044005f40 tx=0x7fa044014f70 comp rx=0 tx=0).stop 2024-09-10T20:58:52.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.030+0000 7fa0555be740 1 -- 172.21.15.67:0/2501392967 shutdown_connections 2024-09-10T20:58:52.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.030+0000 7fa0555be740 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.030+0000 7fa0555be740 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a8df0 0x561cc90b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.030+0000 7fa0555be740 1 --2- 172.21.15.67:0/2501392967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a84d0 0x561cc90a88b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.031+0000 7fa0555be740 1 -- 172.21.15.67:0/2501392967 >> 172.21.15.67:0/2501392967 conn(0x561cc90a6300 msgr2=0x561cc90a74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.040+0000 7fa0555be740 1 -- 172.21.15.67:0/2501392967 shutdown_connections 2024-09-10T20:58:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.041+0000 7fa0555be740 1 -- 172.21.15.67:0/2501392967 wait complete. 2024-09-10T20:58:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.042+0000 7fa0555be740 1 -- start start 2024-09-10T20:58:52.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.042+0000 7fa0555be740 1 Processor -- start 2024-09-10T20:58:52.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa0555be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa0555be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 0x561cc90b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43774/0 (socket says 172.21.15.67:43774) 2024-09-10T20:58:52.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 0x561cc90b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.043+0000 7fa050f85640 1 -- 172.21.15.67:0/241629838 learned_addr learned my addr 172.21.15.67:0/241629838 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc90b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561cc8e6f700 con 0x561cc90b4d80 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561cc8fa9160 con 0x561cc90a84d0 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561cc90c0200 con 0x561cc90a8df0 2024-09-10T20:58:52.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa0555be740 10 client.0 _ll_register_callbacks cb 0x561cc8fc29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:52.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa04bfff640 1 -- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 msgr2=0x561cc90b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa04bfff640 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa04bfff640 1 -- 172.21.15.67:0/241629838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 msgr2=0x561cc90b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa04bfff640 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc90b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.044+0000 7fa04bfff640 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc8fd6c90 con 0x561cc90a8df0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.045+0000 7fa04bfff640 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 0x561cc90b19a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa03802a930 tx=0x7fa038031d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2032a1953789fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.045+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04400ed60 con 0x561cc90a8df0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.045+0000 7fa02bfff640 10 client.25897 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.045+0000 7fa02bfff640 1 -- 172.21.15.67:0/241629838 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038040070 con 0x561cc90a8df0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.046+0000 7fa02bfff640 1 -- 172.21.15.67:0/241629838 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa0380318b0 con 0x561cc90a8df0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.046+0000 7fa02bfff640 1 -- 172.21.15.67:0/241629838 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa038035040 con 0x561cc90a8df0 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.047+0000 7fa0555be740 10 client.25897 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:52.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.047+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=34}) -- 0x561cc90cb9c0 con 0x561cc90a8df0 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa02bfff640 1 -- 172.21.15.67:0/241629838 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa038004030 con 0x561cc90a8df0 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 10 client.25897 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 10 client.25897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 20 client.25897 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc90ccd60 0x561cc90cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 4 client.25897 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:52.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.048+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa04400ed60 con 0x561cc90ccd60 2024-09-10T20:58:52.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.051+0000 7fa050f85640 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc90ccd60 0x561cc90cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.060+0000 7fa050f85640 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc90ccd60 0x561cc90cf190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71a4eb013def6fc0 server_cookie=f47d9d1373b42f0f in_seq=0 out_seq=0 2024-09-10T20:58:52.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.060+0000 7fa02bfff640 10 client.25897 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:52.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.061+0000 7fa02bfff640 1 -- 172.21.15.67:0/241629838 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa04400ed60 con 0x561cc90ccd60 2024-09-10T20:58:52.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.061+0000 7fa02bfff640 10 client.25897 handle_command_reply: tid=0 2024-09-10T20:58:52.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.061+0000 7fa0555be740 1 client.25897 shutdown 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 msgr2=0x561cc90b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 0x561cc90b19a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa03802a930 tx=0x7fa038031d40 comp rx=0 tx=0).stop 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 shutdown_connections 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc90ccd60 0x561cc90cf190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc90b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90a8df0 0x561cc90b19a0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa03802a930 tx=0x7fa038031d40 comp rx=0 tx=0).stop 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 --2- 172.21.15.67:0/241629838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.066+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 >> 172.21.15.67:0/241629838 conn(0x561cc90a6300 msgr2=0x561cc90abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.067+0000 7fa02bfff640 0 client.25897 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.067+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 shutdown_connections 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.067+0000 7fa0555be740 1 -- 172.21.15.67:0/241629838 wait complete. 2024-09-10T20:58:52.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.067+0000 7fa0555be740 20 client.25897 trim_cache size 0 max 16384 2024-09-10T20:58:52.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.086+0000 7fa0555be740 1 Processor -- start 2024-09-10T20:58:52.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.086+0000 7fa0555be740 1 -- start start 2024-09-10T20:58:52.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a84d0 0x561cc90a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1aea80 con 0x561cc90a84d0 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ac350 con 0x561cc90b4d80 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa0555be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1aa1e0 con 0x561cc90ad130 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa050f85640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a84d0 0x561cc90a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43788/0 (socket says 172.21.15.67:43788) 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 -- 172.21.15.67:0/606159776 learned_addr learned my addr 172.21.15.67:0/606159776 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa051786640 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 -- 172.21.15.67:0/606159776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 msgr2=0x561cc90aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 -- 172.21.15.67:0/606159776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a84d0 msgr2=0x561cc90a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a84d0 0x561cc90a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.087+0000 7fa04bfff640 1 -- 172.21.15.67:0/606159776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc90a1990 con 0x561cc90b4d80 2024-09-10T20:58:52.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.088+0000 7fa04bfff640 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa038009230 tx=0x7fa038037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=509d125fadd2dce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.088+0000 7fa0367fc640 1 -- 172.21.15.67:0/606159776 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03805c070 con 0x561cc90b4d80 2024-09-10T20:58:52.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.088+0000 7fa0367fc640 1 -- 172.21.15.67:0/606159776 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa038009520 con 0x561cc90b4d80 2024-09-10T20:58:52.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.088+0000 7fa0367fc640 1 -- 172.21.15.67:0/606159776 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038000e60 con 0x561cc90b4d80 2024-09-10T20:58:52.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- 172.21.15.67:0/606159776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 msgr2=0x561cc90acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa038009230 tx=0x7fa038037000 comp rx=0 tx=0).stop 2024-09-10T20:58:52.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- 172.21.15.67:0/606159776 shutdown_connections 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90b4d80 0x561cc90acbf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 --2- 172.21.15.67:0/606159776 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90a84d0 0x561cc90a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- 172.21.15.67:0/606159776 >> 172.21.15.67:0/606159776 conn(0x561cc90a6300 msgr2=0x561cc90b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- 172.21.15.67:0/606159776 shutdown_connections 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- 172.21.15.67:0/606159776 wait complete. 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 -- start start 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.089+0000 7fa0555be740 1 Processor -- start 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc9138c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1aa830 con 0x561cc90b4d80 2024-09-10T20:58:52.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1abc80 con 0x561cc90a84d0 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1aaee0 con 0x561cc90ad130 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa050f85640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43794/0 (socket says 172.21.15.67:43794) 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa050f85640 1 -- 172.21.15.67:0/671125664 learned_addr learned my addr 172.21.15.67:0/671125664 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa0555be740 10 client.0 _ll_register_callbacks cb 0x7fa040005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa051786640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc9138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 -- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 msgr2=0x561cc90c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 -- 172.21.15.67:0/671125664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 msgr2=0x561cc9138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc9138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa04bfff640 1 -- 172.21.15.67:0/671125664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc91391a0 con 0x561cc90ad130 2024-09-10T20:58:52.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.090+0000 7fa051786640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc9138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa04bfff640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90c1e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa038009850 tx=0x7fa038031e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1f3fb26aa0f0689 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa02bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03805c030 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa038054040 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa038009520 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa038040070 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa0555be740 10 client.25903 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561cc913a400 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.091+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa038009520 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa03803c540 con 0x561cc90ad130 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 10 client.25903 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 10 client.25903 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:58:52.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 20 client.25903 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc913aa00 0x561cc913cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 4 client.25903 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561cc9020df0 con 0x561cc913aa00 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa050f85640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc913aa00 0x561cc913cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa02bfff640 10 client.25903 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa050f85640 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc913aa00 0x561cc913cdf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff4df4f7b0e78fb4 server_cookie=89a301beb305554a in_seq=0 out_seq=0 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa02bfff640 1 -- 172.21.15.67:0/671125664 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561cc9020df0 con 0x561cc913aa00 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa02bfff640 10 client.25903 handle_command_reply: tid=0 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.092+0000 7fa0555be740 1 client.25903 shutdown 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 msgr2=0x561cc90c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90c1e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa038009850 tx=0x7fa038031e30 comp rx=0 tx=0).stop 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 shutdown_connections 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561cc913aa00 0x561cc913cdf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561cc90b4d80 0x561cc9138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa02bfff640 0 client.25903 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561cc90ad130 0x561cc90c1e10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 --2- 172.21.15.67:0/671125664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561cc90a84d0 0x561cc90c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 >> 172.21.15.67:0/671125664 conn(0x561cc90a6300 msgr2=0x561cc90b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 shutdown_connections 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 1 -- 172.21.15.67:0/671125664 wait complete. 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.093+0000 7fa0555be740 20 client.25903 trim_cache size 0 max 16384 2024-09-10T20:58:52.103 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 msgr2=0x7fa03c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 0x7fa03c0b78a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa04401c000 tx=0x7fa04401e000 comp rx=0 tx=0).stop 2024-09-10T20:58:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 msgr2=0x7fa04c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa04000e9f0 tx=0x7fa04000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 shutdown_connections 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa03c0b53e0 0x7fa03c0b78a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa04c10d180 0x7fa04c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa04c104640 0x7fa04c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 --2- 172.21.15.67:0/1791418929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa04c103d20 0x7fa04c19b540 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 >> 172.21.15.67:0/1791418929 conn(0x7fa04c0fd7c0 msgr2=0x7fa04c0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 shutdown_connections 2024-09-10T20:58:52.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:52.094+0000 7fa0531e9640 1 -- 172.21.15.67:0/1791418929 wait complete. 2024-09-10T20:58:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:52 smithi083 ceph-mon[35058]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 632 op/s 2024-09-10T20:58:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:52 smithi172 ceph-mon[35265]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 632 op/s 2024-09-10T20:58:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:52 smithi067 ceph-mon[30891]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 632 op/s 2024-09-10T20:58:52.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:58:53.274 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:54.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 440.0 s, 1866.0 tps, lat 53.806 ms stddev 64.268 2024-09-10T20:58:54.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.202+0000 7fa2c051f640 1 -- 172.21.15.67:0/1746249991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8101b30 msgr2=0x7fa2b8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.202+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1746249991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8101b30 0x7fa2b8101f10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009900 tx=0x7fa2a802a410 comp rx=0 tx=0).stop 2024-09-10T20:58:54.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.202+0000 7fa2c051f640 1 -- 172.21.15.67:0/1746249991 shutdown_connections 2024-09-10T20:58:54.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.202+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1746249991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8106f70 0x7fa2b81073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.202+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1746249991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8102450 0x7fa2b8106920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.203+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1746249991 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8101b30 0x7fa2b8101f10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.203+0000 7fa2c051f640 1 -- 172.21.15.67:0/1746249991 >> 172.21.15.67:0/1746249991 conn(0x7fa2b80fd7e0 msgr2=0x7fa2b80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.203+0000 7fa2c051f640 1 -- 172.21.15.67:0/1746249991 shutdown_connections 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.203+0000 7fa2c051f640 1 -- 172.21.15.67:0/1746249991 wait complete. 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.204+0000 7fa2c051f640 1 Processor -- start 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.204+0000 7fa2c051f640 1 -- start start 2024-09-10T20:58:54.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.204+0000 7fa2c051f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 0x7fa2b8115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.204+0000 7fa2c051f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2c051f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 0x7fa2b8110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2c051f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b81087f0 con 0x7fa2b8102450 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2be2bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 0x7fa2b8115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49264/0 (socket says 172.21.15.67:49264) 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1655646180 learned_addr learned my addr 172.21.15.67:0/1655646180 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:54.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b8108670 con 0x7fa2b8101b30 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.206+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b8108970 con 0x7fa2b8106f70 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 0x7fa2b8110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1655646180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 msgr2=0x7fa2b8110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 0x7fa2b8110140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1655646180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 msgr2=0x7fa2b8115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 0x7fa2b8115ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1655646180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b8110a00 con 0x7fa2b8102450 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 0x7fa2b8110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 0x7fa2b8115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:54.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400e9c0 tx=0x7fa2b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2af7fe640 1 -- 172.21.15.67:0/1655646180 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400ccc0 con 0x7fa2b8102450 2024-09-10T20:58:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2af7fe640 1 -- 172.21.15.67:0/1655646180 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2b40035f0 con 0x7fa2b8102450 2024-09-10T20:58:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.207+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b8110cf0 con 0x7fa2b8102450 2024-09-10T20:58:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.209+0000 7fa2af7fe640 1 -- 172.21.15.67:0/1655646180 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400ce60 con 0x7fa2b8102450 2024-09-10T20:58:54.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.209+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b81b4be0 con 0x7fa2b8102450 2024-09-10T20:58:54.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.211+0000 7fa2af7fe640 1 -- 172.21.15.67:0/1655646180 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fa2b4004000 con 0x7fa2b8102450 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.212+0000 7fa2c28f4740 1 Processor -- start 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.212+0000 7fa2c28f4740 1 -- start start 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a425470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a427da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56280a37eea0 con 0x56280a4259b0 2024-09-10T20:58:54.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56280a36e2d0 con 0x56280a4080f0 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56280a3720e0 con 0x56280a408a10 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2beabc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2af7fe640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 0x7fa2a40b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2beabc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44586/0 (socket says 172.21.15.67:44586) 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2beabc640 1 -- 172.21.15.67:0/487281182 learned_addr learned my addr 172.21.15.67:0/487281182 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.213+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a425470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2af7fe640 1 -- 172.21.15.67:0/1655646180 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa2b40e5ea0 con 0x7fa2b8102450 2024-09-10T20:58:54.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 0x7fa2a40b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a427da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 -- 172.21.15.67:0/487281182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 msgr2=0x56280a425470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a425470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 -- 172.21.15.67:0/487281182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 msgr2=0x56280a427da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a427da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2beabc640 1 -- 172.21.15.67:0/487281182 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56280a0cc650 con 0x56280a4080f0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.214+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a427da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.215+0000 7fa2beabc640 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005c40 tx=0x7fa2b0012f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6fdb1a29776a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.215+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 0x7fa2a40b7770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001c000 tx=0x7fa2b0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.215+0000 7fa2acff9640 1 -- 172.21.15.67:0/487281182 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0023070 con 0x56280a4080f0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.215+0000 7fa2acff9640 1 -- 172.21.15.67:0/487281182 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2b000ec30 con 0x56280a4080f0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.215+0000 7fa2acff9640 1 -- 172.21.15.67:0/487281182 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b000f3c0 con 0x56280a4080f0 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- 172.21.15.67:0/487281182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 msgr2=0x56280a4084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005c40 tx=0x7fa2b0012f80 comp rx=0 tx=0).stop 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- 172.21.15.67:0/487281182 shutdown_connections 2024-09-10T20:58:54.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a427da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a425470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/487281182 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4084d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- 172.21.15.67:0/487281182 >> 172.21.15.67:0/487281182 conn(0x56280a405f20 msgr2=0x56280a4070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- 172.21.15.67:0/487281182 shutdown_connections 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- 172.21.15.67:0/487281182 wait complete. 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 -- start start 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.216+0000 7fa2c28f4740 1 Processor -- start 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4080f0 0x56280a425320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a422770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56280a1cf700 con 0x56280a4080f0 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56280a309160 con 0x56280a4259b0 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56280a428600 con 0x56280a408a10 2024-09-10T20:58:54.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2c28f4740 10 client.0 _ll_register_callbacks cb 0x56280a3229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44592/0 (socket says 172.21.15.67:44592) 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 -- 172.21.15.67:0/409324973 learned_addr learned my addr 172.21.15.67:0/409324973 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 -- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 msgr2=0x56280a422770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a422770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 -- 172.21.15.67:0/409324973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4080f0 msgr2=0x56280a425320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4080f0 0x56280a425320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.217+0000 7fa2beabc640 1 -- 172.21.15.67:0/409324973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56280a336c90 con 0x56280a4259b0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2beabc640 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00095d0 tx=0x7fa2b0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ee4051cfc9e751 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0034060 con 0x56280a4259b0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2b000ec30 con 0x56280a4259b0 2024-09-10T20:58:54.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa2b0010420 con 0x56280a4259b0 2024-09-10T20:58:54.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa2b0023050 con 0x56280a4259b0 2024-09-10T20:58:54.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2c28f4740 10 client.25946 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:54.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.218+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56280a433f70 con 0x56280a4259b0 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2b000ec30 con 0x56280a4259b0 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa2b001e070 con 0x56280a4259b0 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 10 client.25946 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 10 client.25946 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 20 client.25946 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:54.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a435600 0x56280a437ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 4 client.25946 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56280a380df0 con 0x56280a435600 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.219+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a435600 0x56280a437ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.220+0000 7fa2a1ffb640 10 client.25946 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.220+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a435600 0x56280a437ac0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76c0010094054db2 server_cookie=5b18a167efb8441a in_seq=0 out_seq=0 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.220+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/409324973 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56280a380df0 con 0x56280a435600 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.220+0000 7fa2a1ffb640 10 client.25946 handle_command_reply: tid=0 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.220+0000 7fa2c28f4740 1 client.25946 shutdown 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 msgr2=0x56280a422df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00095d0 tx=0x7fa2b0005fd0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 shutdown_connections 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a435600 0x56280a437ac0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4259b0 0x56280a422df0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a422770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2a1ffb640 0 client.25946 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/409324973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4080f0 0x56280a425320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 >> 172.21.15.67:0/409324973 conn(0x56280a405f20 msgr2=0x56280a40bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 shutdown_connections 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 1 -- 172.21.15.67:0/409324973 wait complete. 2024-09-10T20:58:54.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.221+0000 7fa2c28f4740 20 client.25946 trim_cache size 0 max 16384 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.241+0000 7fa2c28f4740 1 Processor -- start 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.241+0000 7fa2c28f4740 1 -- start start 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a421010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b81b6e80 con 0x56280a4259b0 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b8074d40 con 0x56280a4080f0 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b806b9d0 con 0x56280a408a10 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2be2bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51094/0 (socket says 172.21.15.67:51094) 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1010861459 learned_addr learned my addr 172.21.15.67:0/1010861459 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a421010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1010861459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 msgr2=0x56280a4317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1010861459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 msgr2=0x56280a421010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a421010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.242+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1010861459 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56280a4236c0 con 0x56280a408a10 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.243+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4003ee0 tx=0x7fa2b40abf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c67243ffd62fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.243+0000 7fa2a3fff640 1 -- 172.21.15.67:0/1010861459 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b40ac140 con 0x56280a408a10 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.243+0000 7fa2a3fff640 1 -- 172.21.15.67:0/1010861459 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2b40acd30 con 0x56280a408a10 2024-09-10T20:58:54.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.243+0000 7fa2a3fff640 1 -- 172.21.15.67:0/1010861459 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b40b1110 con 0x56280a408a10 2024-09-10T20:58:54.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1010861459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 msgr2=0x56280a400e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4003ee0 tx=0x7fa2b40abf80 comp rx=0 tx=0).stop 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1010861459 shutdown_connections 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a421010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a400e70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1010861459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a4317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.244+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1010861459 >> 172.21.15.67:0/1010861459 conn(0x56280a405f20 msgr2=0x56280a427820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.245+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1010861459 shutdown_connections 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.245+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1010861459 wait complete. 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.246+0000 7fa2c28f4740 1 -- start start 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.246+0000 7fa2c28f4740 1 Processor -- start 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.246+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a42dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2be2bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a42dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2be2bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a42dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44616/0 (socket says 172.21.15.67:44616) 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a4289a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b8073220 con 0x56280a4259b0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b8074670 con 0x56280a4080f0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80738d0 con 0x56280a408a10 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2c28f4740 10 client.0 _ll_register_callbacks cb 0x7fa2b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51108/0 (socket says 172.21.15.67:51108) 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1860114149 learned_addr learned my addr 172.21.15.67:0/1860114149 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a4289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1860114149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 msgr2=0x56280a42dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a42dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1860114149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 msgr2=0x56280a4289a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a4289a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 -- 172.21.15.67:0/1860114149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56280a4017e0 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2beabc640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a4289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2bdaba640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009760 tx=0x7fa2b40ac630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519764dc0e6115e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.247+0000 7fa2a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b40b2620 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa2b40b0120 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2b40acd30 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa2b40b5bc0 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2c28f4740 10 client.25918 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.248+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56280a4a3070 con 0x56280a408a10 2024-09-10T20:58:54.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2b40acd30 con 0x56280a408a10 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa2b40a7f80 con 0x56280a408a10 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 10 client.25918 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 10 client.25918 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 20 client.25918 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a4a36b0 0x56280a4a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 4 client.25918 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56280a37c8a0 con 0x56280a4a36b0 2024-09-10T20:58:54.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.249+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a4a36b0 0x56280a4a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.250+0000 7fa2be2bb640 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a4a36b0 0x56280a4a5ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3aefb487b2ac8711 server_cookie=ebef3c1d1eedfb87 in_seq=0 out_seq=0 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.250+0000 7fa2a1ffb640 10 client.25918 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2a1ffb640 1 -- 172.21.15.67:0/1860114149 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56280a37c8a0 con 0x56280a4a36b0 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2a1ffb640 10 client.25918 handle_command_reply: tid=0 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 client.25918 shutdown 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 msgr2=0x56280a42e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009760 tx=0x7fa2b40ac630 comp rx=0 tx=0).stop 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 shutdown_connections 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56280a4a36b0 0x56280a4a5ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56280a4259b0 0x56280a4289a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2a1ffb640 0 client.25918 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56280a408a10 0x56280a42e190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 --2- 172.21.15.67:0/1860114149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56280a4080f0 0x56280a42dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 >> 172.21.15.67:0/1860114149 conn(0x56280a405f20 msgr2=0x56280a420fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 shutdown_connections 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 1 -- 172.21.15.67:0/1860114149 wait complete. 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.251+0000 7fa2c28f4740 20 client.25918 trim_cache size 0 max 16384 2024-09-10T20:58:54.260 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 msgr2=0x7fa2a40b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 0x7fa2a40b7770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa2b001c000 tx=0x7fa2b0020000 comp rx=0 tx=0).stop 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 msgr2=0x7fa2b81161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400e9c0 tx=0x7fa2b400ee80 comp rx=0 tx=0).stop 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 shutdown_connections 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fa2a40b52b0 0x7fa2a40b7770 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2b8106f70 0x7fa2b8110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b8102450 0x7fa2b81161e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 --2- 172.21.15.67:0/1655646180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2b8101b30 0x7fa2b8115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:54.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 >> 172.21.15.67:0/1655646180 conn(0x7fa2b80fd7e0 msgr2=0x7fa2b81048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:54.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 shutdown_connections 2024-09-10T20:58:54.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:54.253+0000 7fa2c051f640 1 -- 172.21.15.67:0/1655646180 wait complete. 2024-09-10T20:58:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:54 smithi083 ceph-mon[35058]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 777 op/s 2024-09-10T20:58:54.648 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:54 smithi067 ceph-mon[30891]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 777 op/s 2024-09-10T20:58:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:54 smithi172 ceph-mon[35265]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 777 op/s 2024-09-10T20:58:54.969 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:58:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:56.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 -- 172.21.15.67:0/1966700007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 msgr2=0x7fd74c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1966700007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c10e820 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd744009ca0 tx=0x7fd74402a8c0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 -- 172.21.15.67:0/1966700007 shutdown_connections 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1966700007 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c10e820 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1966700007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c1076a0 0x7fd74c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1966700007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c101c90 0x7fd74c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 -- 172.21.15.67:0/1966700007 >> 172.21.15.67:0/1966700007 conn(0x7fd74c0fd700 msgr2=0x7fd74c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 -- 172.21.15.67:0/1966700007 shutdown_connections 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.954+0000 7fd753f5a640 1 -- 172.21.15.67:0/1966700007 wait complete. 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 Processor -- start 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 -- start start 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c101c90 0x7fd74c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c1a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111ce0 con 0x7fd74c108020 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111b60 con 0x7fd74c1076a0 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.955+0000 7fd753f5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c111e60 con 0x7fd74c101c90 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c1a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44624/0 (socket says 172.21.15.67:44624) 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 -- 172.21.15.67:0/1872035784 learned_addr learned my addr 172.21.15.67:0/1872035784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c101c90 0x7fd74c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 -- 172.21.15.67:0/1872035784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c101c90 msgr2=0x7fd74c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c101c90 0x7fd74c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 -- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 msgr2=0x7fd74c1a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c1a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 -- 172.21.15.67:0/1872035784 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1a1470 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c920 tx=0x7fd73c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd742ffd640 1 -- 172.21.15.67:0/1872035784 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c007c70 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd742ffd640 1 -- 172.21.15.67:0/1872035784 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd73c007e10 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c1a1760 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd742ffd640 1 -- 172.21.15.67:0/1872035784 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c018820 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.956+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1a7e20 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd742ffd640 1 -- 172.21.15.67:0/1872035784 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fd73c00f450 con 0x7fd74c1076a0 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 Processor -- start 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 -- start start 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b604460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 0x55b93b606d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b93b56eea0 con 0x55b93b5f8a10 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b93b55e2d0 con 0x55b93b5f80f0 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.959+0000 7fd75632f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b93b5620e0 con 0x55b93b6049a0 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd751cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b604460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44634/0 (socket says 172.21.15.67:44634) 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 -- 172.21.15.67:0/1375464151 learned_addr learned my addr 172.21.15.67:0/1375464151 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 0x55b93b606d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 -- 172.21.15.67:0/1375464151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 msgr2=0x55b93b606d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 0x55b93b606d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 -- 172.21.15.67:0/1375464151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 msgr2=0x55b93b604460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b604460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 -- 172.21.15.67:0/1375464151 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93b2bc650 con 0x55b93b5f80f0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 0x55b93b606d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7440098b0 tx=0x7fd7440098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebca46632a80c59d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd742ffd640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 0x7fd7380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd737fff640 1 -- 172.21.15.67:0/1375464151 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744031e30 con 0x55b93b5f80f0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 0x7fd7380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd737fff640 1 -- 172.21.15.67:0/1375464151 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd744036030 con 0x55b93b5f80f0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.960+0000 7fd737fff640 1 -- 172.21.15.67:0/1375464151 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744004280 con 0x55b93b5f80f0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd742ffd640 1 -- 172.21.15.67:0/1872035784 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd73c0e5c70 con 0x7fd74c1076a0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 -- 172.21.15.67:0/1375464151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 msgr2=0x55b93b5f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 0x7fd7380b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b93b5f6e00 tx=0x7fd74800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7440098b0 tx=0x7fd7440098e0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 -- 172.21.15.67:0/1375464151 shutdown_connections 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b6049a0 0x55b93b606d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b604460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 --2- 172.21.15.67:0/1375464151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b5f84d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 -- 172.21.15.67:0/1375464151 >> 172.21.15.67:0/1375464151 conn(0x55b93b5f5f20 msgr2=0x55b93b5f70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 -- 172.21.15.67:0/1375464151 shutdown_connections 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.961+0000 7fd75632f740 1 -- 172.21.15.67:0/1375464151 wait complete. 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 -- start start 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 Processor -- start 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b604280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b6016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b93b3bf700 con 0x55b93b6049a0 2024-09-10T20:58:56.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b93b4f9160 con 0x55b93b5f80f0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b93b607440 con 0x55b93b5f8a10 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.962+0000 7fd75632f740 10 client.0 _ll_register_callbacks cb 0x55b93b5129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49322/0 (socket says 172.21.15.67:49322) 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 -- 172.21.15.67:0/3018499421 learned_addr learned my addr 172.21.15.67:0/3018499421 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7514f5640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b6016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd751cf6640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b604280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 -- 172.21.15.67:0/3018499421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 msgr2=0x55b93b6016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b6016d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 -- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 msgr2=0x55b93b604280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b604280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 -- 172.21.15.67:0/3018499421 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93b526c90 con 0x55b93b6049a0 2024-09-10T20:58:56.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7514f5640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b6016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd751cf6640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b604280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7524f7640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd74402a900 tx=0x7fd744031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0fde878f77b4de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7357fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74404a040 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd744036030 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.963+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd74402f860 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd74402fa60 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 10 client.16263 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b93b612d90 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd744036030 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd74404d030 con 0x55b93b6049a0 2024-09-10T20:58:56.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 10 client.16263 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 20 client.16263 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6140e0 0x55b93b6164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 4 client.16263 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b93b570df0 con 0x55b93b6140e0 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.964+0000 7fd751cf6640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6140e0 0x55b93b6164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.965+0000 7fd751cf6640 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6140e0 0x55b93b6164d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a1213470917a663 server_cookie=9e11d950535f7074 in_seq=0 out_seq=0 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.965+0000 7fd7357fa640 10 client.16263 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.965+0000 7fd7357fa640 1 -- 172.21.15.67:0/3018499421 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b93b570df0 con 0x55b93b6140e0 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.965+0000 7fd7357fa640 10 client.16263 handle_command_reply: tid=0 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.965+0000 7fd75632f740 1 client.16263 shutdown 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 msgr2=0x55b93b601d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd74402a900 tx=0x7fd744031760 comp rx=0 tx=0).stop 2024-09-10T20:58:56.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 shutdown_connections 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6140e0 0x55b93b6164d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b601d00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b6016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 --2- 172.21.15.67:0/3018499421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b604280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 >> 172.21.15.67:0/3018499421 conn(0x55b93b5f5f20 msgr2=0x55b93b5fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd7357fa640 0 client.16263 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 shutdown_connections 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 1 -- 172.21.15.67:0/3018499421 wait complete. 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.966+0000 7fd75632f740 20 client.16263 trim_cache size 0 max 16384 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 Processor -- start 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 -- start start 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 0x55b93b6106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 0x55b93b605d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1b2c90 con 0x55b93b5f8a10 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1b0560 con 0x55b93b6049a0 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.980+0000 7fd75632f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1ae3b0 con 0x55b93b5f80f0 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7514f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7514f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49328/0 (socket says 172.21.15.67:49328) 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 0x55b93b605d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7514f5640 1 -- 172.21.15.67:0/560469597 learned_addr learned my addr 172.21.15.67:0/560469597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd751cf6640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 0x55b93b6106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 -- 172.21.15.67:0/560469597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 msgr2=0x55b93b6106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 0x55b93b6106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 -- 172.21.15.67:0/560469597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 msgr2=0x55b93b601b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 -- 172.21.15.67:0/560469597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93b5ffbd0 con 0x55b93b6049a0 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd751cf6640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 0x55b93b6106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7514f5640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7524f7640 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 0x55b93b605d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd74402ade0 tx=0x7fd74402f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c106172dea86cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7377fe640 1 -- 172.21.15.67:0/560469597 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744005bf0 con 0x55b93b6049a0 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7377fe640 1 -- 172.21.15.67:0/560469597 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd744036040 con 0x55b93b6049a0 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.981+0000 7fd7377fe640 1 -- 172.21.15.67:0/560469597 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74402fc00 con 0x55b93b6049a0 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- 172.21.15.67:0/560469597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 msgr2=0x55b93b605d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 0x55b93b605d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd74402ade0 tx=0x7fd74402f310 comp rx=0 tx=0).stop 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- 172.21.15.67:0/560469597 shutdown_connections 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b6049a0 0x55b93b605d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b5f8a10 0x55b93b601b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 --2- 172.21.15.67:0/560469597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f80f0 0x55b93b6106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- 172.21.15.67:0/560469597 >> 172.21.15.67:0/560469597 conn(0x55b93b5f5f20 msgr2=0x55b93b601480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- 172.21.15.67:0/560469597 shutdown_connections 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- 172.21.15.67:0/560469597 wait complete. 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.982+0000 7fd75632f740 1 -- start start 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 Processor -- start 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b60ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b61b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1aea20 con 0x55b93b6049a0 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1afe90 con 0x55b93b5f80f0 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1af0f0 con 0x55b93b5f8a10 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd75632f740 10 client.0 _ll_register_callbacks cb 0x7fd74800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd7524f7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49338/0 (socket says 172.21.15.67:49338) 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd7524f7640 1 -- 172.21.15.67:0/1334140385 learned_addr learned my addr 172.21.15.67:0/1334140385 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.983+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b60ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 -- 172.21.15.67:0/1334140385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 msgr2=0x55b93b61b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7514f5640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b61b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b61b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 -- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 msgr2=0x55b93b60ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b60ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 -- 172.21.15.67:0/1334140385 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b93b61c3d0 con 0x55b93b6049a0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7524f7640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd744004ac0 tx=0x7fd744005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fde3847cd1ef94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7357fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74402f860 con 0x55b93b6049a0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd74402fc00 con 0x55b93b6049a0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd744036040 con 0x55b93b6049a0 2024-09-10T20:58:56.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd74402fe00 con 0x55b93b6049a0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd75632f740 10 client.16269 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b93b680dc0 con 0x55b93b6049a0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.984+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd744036040 con 0x55b93b6049a0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd74404d040 con 0x55b93b6049a0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 10 client.16269 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 20 client.16269 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6811a0 0x55b93b6835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 4 client.16269 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b93b56c8a0 con 0x55b93b6811a0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6811a0 0x55b93b6835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:56.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd7357fa640 10 client.16269 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd751cf6640 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6811a0 0x55b93b6835c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f1708f26656412 server_cookie=8da1de28457b0c62 in_seq=0 out_seq=0 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd7357fa640 1 -- 172.21.15.67:0/1334140385 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b93b56c8a0 con 0x55b93b6811a0 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd7357fa640 10 client.16269 handle_command_reply: tid=0 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 1 client.16269 shutdown 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 msgr2=0x55b93b61bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.985+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd744004ac0 tx=0x7fd744005d00 comp rx=0 tx=0).stop 2024-09-10T20:58:56.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 shutdown_connections 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b93b6811a0 0x55b93b6835c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b93b6049a0 0x55b93b61bc40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b93b5f8a10 0x55b93b61b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd7357fa640 0 client.16269 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 --2- 172.21.15.67:0/1334140385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b93b5f80f0 0x55b93b60ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 >> 172.21.15.67:0/1334140385 conn(0x55b93b5f5f20 msgr2=0x55b93b602d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 shutdown_connections 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 1 -- 172.21.15.67:0/1334140385 wait complete. 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd75632f740 20 client.16269 trim_cache size 0 max 16384 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 msgr2=0x7fd7380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 0x7fd7380b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b93b5f6e00 tx=0x7fd74800b390 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 msgr2=0x7fd74c19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00c920 tx=0x7fd73c00cde0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 shutdown_connections 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd74c108020 0x7fd74c1a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd74c1076a0 0x7fd74c19b900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fd7380b52e0 0x7fd7380b77a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 --2- 172.21.15.67:0/1872035784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd74c101c90 0x7fd74c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.986+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 >> 172.21.15.67:0/1872035784 conn(0x7fd74c0fd700 msgr2=0x7fd74c06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.987+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 shutdown_connections 2024-09-10T20:58:56.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:55.987+0000 7fd753f5a640 1 -- 172.21.15.67:0/1872035784 wait complete. 2024-09-10T20:58:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:56 smithi172 ceph-mon[35265]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-09-10T20:58:56.787 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:56 smithi067 ceph-mon[30891]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-09-10T20:58:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:56 smithi083 ceph-mon[35058]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-09-10T20:58:57.843 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:58:57.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:58:58.109 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:58.531 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:58 smithi067 ceph-mon[30891]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 836 op/s 2024-09-10T20:58:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 -- 172.21.15.67:0/3985190746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f193010d100 msgr2=0x7f193010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 --2- 172.21.15.67:0/3985190746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f193010d100 0x7f193010f560 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1928009ca0 tx=0x7f192802a8c0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 -- 172.21.15.67:0/3985190746 shutdown_connections 2024-09-10T20:58:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 --2- 172.21.15.67:0/3985190746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f193010d100 0x7f193010f560 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 --2- 172.21.15.67:0/3985190746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19301045c0 0x7f193010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 --2- 172.21.15.67:0/3985190746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1930103ca0 0x7f1930104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 -- 172.21.15.67:0/3985190746 >> 172.21.15.67:0/3985190746 conn(0x7f19300fd700 msgr2=0x7f19300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 -- 172.21.15.67:0/3985190746 shutdown_connections 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.615+0000 7f1937186640 1 -- 172.21.15.67:0/3985190746 wait complete. 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 Processor -- start 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 -- start start 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f193010d100 0x7f193019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112d70 con 0x7f19301045c0 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112bf0 con 0x7f1930103ca0 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1937186640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112ef0 con 0x7f193010d100 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1934f22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f192ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f192ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49360/0 (socket says 172.21.15.67:49360) 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.616+0000 7f1934f22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44672/0 (socket says 172.21.15.67:44672) 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f192ffff640 1 -- 172.21.15.67:0/2948879145 learned_addr learned my addr 172.21.15.67:0/2948879145 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1935723640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f193010d100 0x7f193019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 -- 172.21.15.67:0/2948879145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f193010d100 msgr2=0x7f193019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f193010d100 0x7f193019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 -- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 msgr2=0x7f19301997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 -- 172.21.15.67:0/2948879145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193019f310 con 0x7f1930103ca0 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f192ffff640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1934f22640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f192400d720 tx=0x7f192400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f192dffb640 1 -- 172.21.15.67:0/2948879145 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924017070 con 0x7f1930103ca0 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f192dffb640 1 -- 172.21.15.67:0/2948879145 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f192400de30 con 0x7f1930103ca0 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193019f600 con 0x7f1930103ca0 2024-09-10T20:58:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f192dffb640 1 -- 172.21.15.67:0/2948879145 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19240047a0 con 0x7f1930103ca0 2024-09-10T20:58:58.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.617+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19301a5cc0 con 0x7f1930103ca0 2024-09-10T20:58:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.620+0000 7f192dffb640 1 -- 172.21.15.67:0/2948879145 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f19240099d0 con 0x7f1930103ca0 2024-09-10T20:58:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.620+0000 7f193955b740 1 Processor -- start 2024-09-10T20:58:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.620+0000 7f193955b740 1 -- start start 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192dffb640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 0x7f19200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 0x5588635bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558863527e60 con 0x5588635bd790 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558863517290 con 0x5588635b0ee0 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f193955b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55886351b0a0 con 0x5588635b1800 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1935723640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 0x5588635bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1934f22640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 0x7f19200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1935723640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 0x5588635bfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49364/0 (socket says 172.21.15.67:49364) 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1935723640 1 -- 172.21.15.67:0/1044692496 learned_addr learned my addr 172.21.15.67:0/1044692496 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192dffb640 1 -- 172.21.15.67:0/2948879145 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19240e5760 con 0x7f1930103ca0 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1935723640 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 -- 172.21.15.67:0/1044692496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 msgr2=0x5588635b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 -- 172.21.15.67:0/1044692496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 msgr2=0x5588635bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 0x5588635bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 -- 172.21.15.67:0/1044692496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558863275930 con 0x5588635b1800 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1935723640 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f1934f22640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 0x7f19200b7820 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19240a84c0 tx=0x7f1924093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.621+0000 7f192ffff640 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bd250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f191c012860 tx=0x7f191c012d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625ffefe8f3d9e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.622+0000 7f191affd640 1 -- 172.21.15.67:0/1044692496 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c020070 con 0x5588635b1800 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.622+0000 7f191affd640 1 -- 172.21.15.67:0/1044692496 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c00dd70 con 0x5588635b1800 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.622+0000 7f191affd640 1 -- 172.21.15.67:0/1044692496 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c01bdd0 con 0x5588635b1800 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.622+0000 7f193955b740 1 -- 172.21.15.67:0/1044692496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 msgr2=0x5588635bd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.622+0000 7f193955b740 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bd250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f191c012860 tx=0x7f191c012d20 comp rx=0 tx=0).stop 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- 172.21.15.67:0/1044692496 shutdown_connections 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635bd790 0x5588635bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bd250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- 172.21.15.67:0/1044692496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- 172.21.15.67:0/1044692496 >> 172.21.15.67:0/1044692496 conn(0x5588635aed10 msgr2=0x5588635afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- 172.21.15.67:0/1044692496 shutdown_connections 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- 172.21.15.67:0/1044692496 wait complete. 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- start start 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 Processor -- start 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b0ee0 0x5588635ba6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558863378890 con 0x5588635b0ee0 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5588634b1d40 con 0x5588635bd790 2024-09-10T20:58:58.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.623+0000 7f193955b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5588635c0440 con 0x5588635b1800 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f193955b740 10 client.0 _ll_register_callbacks cb 0x558863515c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f1935723640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b0ee0 0x5588635ba6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51212/0 (socket says 172.21.15.67:51212) 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 -- 172.21.15.67:0/503296216 learned_addr learned my addr 172.21.15.67:0/503296216 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f1935723640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 -- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 msgr2=0x5588635bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 -- 172.21.15.67:0/503296216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b0ee0 msgr2=0x5588635ba6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b0ee0 0x5588635ba6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 -- 172.21.15.67:0/503296216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588635c97d0 con 0x5588635b1800 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f1935723640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f192ffff640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f191c000c00 tx=0x7f191c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b65730f5559bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f190ffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c020040 con 0x5588635b1800 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.624+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c00dd70 con 0x5588635b1800 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f191c01bb50 con 0x5588635b1800 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f191c00bd20 con 0x5588635b1800 2024-09-10T20:58:58.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 10 client.25942 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5588635cc1d0 con 0x5588635b1800 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c00dd70 con 0x5588635b1800 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f191c026920 con 0x5588635b1800 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 10 client.25942 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 10 client.25942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 20 client.25942 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x5588635cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 4 client.25942 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558863529db0 con 0x5588635cd5e0 2024-09-10T20:58:58.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.625+0000 7f1935723640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x5588635cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.626+0000 7f190ffff640 10 client.25942 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.626+0000 7f1935723640 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x5588635cf9d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ebc625dc8caea5a server_cookie=1b97b02d1900939c in_seq=0 out_seq=0 2024-09-10T20:58:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.626+0000 7f190ffff640 1 -- 172.21.15.67:0/503296216 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558863529db0 con 0x5588635cd5e0 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.626+0000 7f190ffff640 10 client.25942 handle_command_reply: tid=0 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 client.25942 shutdown 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 msgr2=0x5588635bac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f191c000c00 tx=0x7f191c005740 comp rx=0 tx=0).stop 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 shutdown_connections 2024-09-10T20:58:58.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x5588635cf9d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b1800 0x5588635bac20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f190ffff640 0 client.25942 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 --2- 172.21.15.67:0/503296216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b0ee0 0x5588635ba6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 >> 172.21.15.67:0/503296216 conn(0x5588635aed10 msgr2=0x5588635adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 shutdown_connections 2024-09-10T20:58:58.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 1 -- 172.21.15.67:0/503296216 wait complete. 2024-09-10T20:58:58.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.627+0000 7f193955b740 20 client.25942 trim_cache size 0 max 16384 2024-09-10T20:58:58.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 Processor -- start 2024-09-10T20:58:58.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 -- start start 2024-09-10T20:58:58.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 0x5588635d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19301ae9a0 con 0x5588635b1800 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f19301ac270 con 0x5588635bd790 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f193955b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19301aa0c0 con 0x5588635b0ee0 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f1935723640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 0x5588635d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49392/0 (socket says 172.21.15.67:49392) 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f1935723640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 0x5588635d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51214/0 (socket says 172.21.15.67:51214) 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 -- 172.21.15.67:0/4115843774 learned_addr learned my addr 172.21.15.67:0/4115843774 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f1935723640 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 -- 172.21.15.67:0/4115843774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 msgr2=0x5588635d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 0x5588635d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 -- 172.21.15.67:0/4115843774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 msgr2=0x5588635b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.645+0000 7f192ffff640 1 -- 172.21.15.67:0/4115843774 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588635af790 con 0x5588635b1800 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f192ffff640 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f191c005c40 tx=0x7f191c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e338e2284a2f92c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f191a7fc640 1 -- 172.21.15.67:0/4115843774 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c0253d0 con 0x5588635b1800 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f191a7fc640 1 -- 172.21.15.67:0/4115843774 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c005040 con 0x5588635b1800 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f191a7fc640 1 -- 172.21.15.67:0/4115843774 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c00db20 con 0x5588635b1800 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f193955b740 1 -- 172.21.15.67:0/4115843774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 msgr2=0x5588635d5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.646+0000 7f193955b740 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f191c005c40 tx=0x7f191c00bf60 comp rx=0 tx=0).stop 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 -- 172.21.15.67:0/4115843774 shutdown_connections 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635bd790 0x5588635b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635d5540 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 --2- 172.21.15.67:0/4115843774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635b0ee0 0x5588635d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 -- 172.21.15.67:0/4115843774 >> 172.21.15.67:0/4115843774 conn(0x5588635aed10 msgr2=0x5588635b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 -- 172.21.15.67:0/4115843774 shutdown_connections 2024-09-10T20:58:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 -- 172.21.15.67:0/4115843774 wait complete. 2024-09-10T20:58:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 -- start start 2024-09-10T20:58:58.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.647+0000 7f193955b740 1 Processor -- start 2024-09-10T20:58:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635bd790 0x5588635c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19301aa730 con 0x5588635b1800 2024-09-10T20:58:58.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f19301abba0 con 0x5588635b0ee0 2024-09-10T20:58:58.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19301aae00 con 0x5588635bd790 2024-09-10T20:58:58.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f193955b740 10 client.0 _ll_register_callbacks cb 0x7f191c012760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:58:58.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f192ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:44712/0 (socket says 172.21.15.67:44712) 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 -- 172.21.15.67:0/3486679554 learned_addr learned my addr 172.21.15.67:0/3486679554 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635bd790 0x5588635c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 -- 172.21.15.67:0/3486679554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635bd790 msgr2=0x5588635c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635bd790 0x5588635c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 -- 172.21.15.67:0/3486679554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 msgr2=0x5588635c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 -- 172.21.15.67:0/3486679554 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588635c2c90 con 0x5588635b0ee0 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f192ffff640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f1935723640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1928005e30 tx=0x7f191c005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1531322f4ce7279f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f190ffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:58:58.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.648+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928004b40 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1928004ce0 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c005040 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f192802f660 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 10 client.25988 fetch_fsmap learned FSMap version 34 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55886363ab10 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f191c005040 con 0x5588635b0ee0 2024-09-10T20:58:58.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f192805f030 con 0x5588635b0ee0 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 10 client.25988 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 10 client.25988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 20 client.25988 populate_metadata read hostname 'smithi067' 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x55886363d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 4 client.25988 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558863525860 con 0x5588635cd5e0 2024-09-10T20:58:58.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.649+0000 7f192ffff640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x55886363d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.650+0000 7f192ffff640 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x55886363d2d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=addd0f0b609bfb5b server_cookie=13ae9b4089eb37fc in_seq=0 out_seq=0 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.650+0000 7f190ffff640 10 client.25988 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f190ffff640 1 -- 172.21.15.67:0/3486679554 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558863525860 con 0x5588635cd5e0 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f190ffff640 10 client.25988 handle_command_reply: tid=0 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 client.25988 shutdown 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 msgr2=0x5588635c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1928005e30 tx=0x7f191c005bb0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 shutdown_connections 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5588635cd5e0 0x55886363d2d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f190ffff640 0 client.25988 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588635bd790 0x5588635c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5588635b1800 0x5588635c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 --2- 172.21.15.67:0/3486679554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5588635b0ee0 0x5588635c5700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.651+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 >> 172.21.15.67:0/3486679554 conn(0x5588635aed10 msgr2=0x5588635ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 shutdown_connections 2024-09-10T20:58:58.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f193955b740 1 -- 172.21.15.67:0/3486679554 wait complete. 2024-09-10T20:58:58.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f193955b740 20 client.25988 trim_cache size 0 max 16384 2024-09-10T20:58:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:58:58.666 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:58:58.666 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "8c5e9db5-2a09-4b0a-b7cc-f9df12052330", 2024-09-10T20:58:58.666 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:58:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 msgr2=0x7f19200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 0x7f19200b7820 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f19240a84c0 tx=0x7f1924093040 comp rx=0 tx=0).stop 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 msgr2=0x7f1930199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f192400d720 tx=0x7f192400dbe0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 shutdown_connections 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19200b5360 0x7f19200b7820 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f193010d100 0x7f193019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19301045c0 0x7f19301997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 --2- 172.21.15.67:0/2948879145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1930103ca0 0x7f1930199260 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:58:58.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.652+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 >> 172.21.15.67:0/2948879145 conn(0x7f19300fd700 msgr2=0x7f193010f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:58:58.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.653+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 shutdown_connections 2024-09-10T20:58:58.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:58:58.653+0000 7f1937186640 1 -- 172.21.15.67:0/2948879145 wait complete. 2024-09-10T20:58:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:58 smithi172 ceph-mon[35265]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 836 op/s 2024-09-10T20:58:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:58 smithi083 ceph-mon[35058]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 836 op/s 2024-09-10T20:58:59.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 445.0 s, 825.1 tps, lat 50.742 ms stddev 104.642 2024-09-10T20:58:59.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:59 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:58:59.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:58:59 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:59.590 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:58:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:59 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:58:59.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:58:59 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:58:59.852 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:58:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:59 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:58:59.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:58:59 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 -- 172.21.15.67:0/413005042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9214101c90 msgr2=0x7f9214102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 --2- 172.21.15.67:0/413005042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9214101c90 0x7f9214102070 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9204009900 tx=0x7f920402a410 comp rx=0 tx=0).stop 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 -- 172.21.15.67:0/413005042 shutdown_connections 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 --2- 172.21.15.67:0/413005042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 0x7f921410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 --2- 172.21.15.67:0/413005042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92141076a0 0x7f9214107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 --2- 172.21.15.67:0/413005042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9214101c90 0x7f9214102070 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 -- 172.21.15.67:0/413005042 >> 172.21.15.67:0/413005042 conn(0x7f92140fd700 msgr2=0x7f92140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.340+0000 7f921a68a640 1 -- 172.21.15.67:0/413005042 shutdown_connections 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 -- 172.21.15.67:0/413005042 wait complete. 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 Processor -- start 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 -- start start 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9214101c90 0x7f92141992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 0x7f921419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9214111ce0 con 0x7f92141076a0 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9214111b60 con 0x7f9214101c90 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f921a68a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9214111e60 con 0x7f9214108020 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.341+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49426/0 (socket says 172.21.15.67:49426) 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 -- 172.21.15.67:0/156718866 learned_addr learned my addr 172.21.15.67:0/156718866 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f9218c27640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 0x7f921419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f9213fff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9214101c90 0x7f92141992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 -- 172.21.15.67:0/156718866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 msgr2=0x7f921419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 0x7f921419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 -- 172.21.15.67:0/156718866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9214101c90 msgr2=0x7f92141992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9214101c90 0x7f92141992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 -- 172.21.15.67:0/156718866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921419f360 con 0x7f92141076a0 2024-09-10T20:59:00.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f920bfff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00ea60 tx=0x7f91fc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f9211ffb640 1 -- 172.21.15.67:0/156718866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00cde0 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921419f650 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f9211ffb640 1 -- 172.21.15.67:0/156718866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91fc0035f0 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f9211ffb640 1 -- 172.21.15.67:0/156718866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc010690 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.342+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141a5ee0 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 Processor -- start 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 -- start start 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f9211ffb640 1 -- 172.21.15.67:0/156718866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f91fc004000 con 0x7f92141076a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09269c0 0x5646e0932410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e0932950 0x5646e0934d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5646e089ce50 con 0x5646e09260a0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5646e088c280 con 0x5646e09269c0 2024-09-10T20:59:00.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f921ca5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5646e0890090 con 0x5646e0932950 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.345+0000 7f9218c27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49434/0 (socket says 172.21.15.67:49434) 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 -- 172.21.15.67:0/3150268686 learned_addr learned my addr 172.21.15.67:0/3150268686 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f920bfff640 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e0932950 0x5646e0934d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9213fff640 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09269c0 0x5646e0932410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 -- 172.21.15.67:0/3150268686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e0932950 msgr2=0x5646e0934d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e0932950 0x5646e0934d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 -- 172.21.15.67:0/3150268686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09269c0 msgr2=0x5646e0932410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09269c0 0x5646e0932410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 -- 172.21.15.67:0/3150268686 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646e05ea650 con 0x5646e09260a0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f9218c27640 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f920c010370 tx=0x7f920c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26065c113ef3fa37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f920a7fc640 1 -- 172.21.15.67:0/3150268686 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c016070 con 0x5646e09260a0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f920a7fc640 1 -- 172.21.15.67:0/3150268686 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f920c004d20 con 0x5646e09260a0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.346+0000 7f920a7fc640 1 -- 172.21.15.67:0/3150268686 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c005390 con 0x5646e09260a0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f9211ffb640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 0x7f92000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f9213fff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 0x7f92000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f9211ffb640 1 -- 172.21.15.67:0/156718866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91fc0e5f30 con 0x7f92141076a0 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 -- 172.21.15.67:0/3150268686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 msgr2=0x5646e0926480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f920c010370 tx=0x7f920c010830 comp rx=0 tx=0).stop 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 -- 172.21.15.67:0/3150268686 shutdown_connections 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e0932950 0x5646e0934d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09269c0 0x5646e0932410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 --2- 172.21.15.67:0/3150268686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09260a0 0x5646e0926480 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 -- 172.21.15.67:0/3150268686 >> 172.21.15.67:0/3150268686 conn(0x5646e0923ed0 msgr2=0x5646e0925070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 -- 172.21.15.67:0/3150268686 shutdown_connections 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f9213fff640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 0x7f92000b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9204031440 tx=0x7f92040058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.347+0000 7f921ca5f740 1 -- 172.21.15.67:0/3150268686 wait complete. 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 -- start start 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 Processor -- start 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e09321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5646e06ed700 con 0x5646e09269c0 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5646e0827110 con 0x5646e0932950 2024-09-10T20:59:00.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5646e09355d0 con 0x5646e09260a0 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49450/0 (socket says 172.21.15.67:49450) 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f920bfff640 1 -- 172.21.15.67:0/4192579635 learned_addr learned my addr 172.21.15.67:0/4192579635 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f921ca5f740 10 client.0 _ll_register_callbacks cb 0x5646e0840990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f9213fff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e09321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.348+0000 7f9218c27640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 -- 172.21.15.67:0/4192579635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 msgr2=0x5646e09321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e09321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 -- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 msgr2=0x5646e092fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 -- 172.21.15.67:0/4192579635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646e0854c40 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f920bfff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009230 tx=0x7f91fc003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf491097aed9dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f91f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0abe90 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91fc0ab980 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f920c004d20 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91fc0ac230 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f921ca5f740 10 client.16299 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5646e0940ef0 con 0x5646e09269c0 2024-09-10T20:59:00.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.349+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f920c004d20 con 0x5646e09269c0 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91fc0ab3f0 con 0x5646e09269c0 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 10 client.16299 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 20 client.16299 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e0942350 0x5646e0944740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 4 client.16299 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646e089eda0 con 0x5646e0942350 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f9213fff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e0942350 0x5646e0944740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f9213fff640 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e0942350 0x5646e0944740 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc017c0e3aec67cb server_cookie=e9a778b8bd3310a3 in_seq=0 out_seq=0 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.350+0000 7f91f37fe640 10 client.16299 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f91f37fe640 1 -- 172.21.15.67:0/4192579635 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646e089eda0 con 0x5646e0942350 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f91f37fe640 10 client.16299 handle_command_reply: tid=0 2024-09-10T20:59:00.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 client.16299 shutdown 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 msgr2=0x5646e092f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009230 tx=0x7f91fc003cf0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 shutdown_connections 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e0942350 0x5646e0944740 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092f640 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4192579635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e09321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f91f37fe640 0 client.16299 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 >> 172.21.15.67:0/4192579635 conn(0x5646e0923ed0 msgr2=0x5646e0929a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 shutdown_connections 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 1 -- 172.21.15.67:0/4192579635 wait complete. 2024-09-10T20:59:00.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.351+0000 7f921ca5f740 20 client.16299 trim_cache size 0 max 16384 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 Processor -- start 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 -- start start 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e0931380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92141b0b40 con 0x5646e09269c0 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92141ae410 con 0x5646e0932950 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f921ca5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92141ac260 con 0x5646e09260a0 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f920bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49452/0 (socket says 172.21.15.67:49452) 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.369+0000 7f920bfff640 1 -- 172.21.15.67:0/4053734507 learned_addr learned my addr 172.21.15.67:0/4053734507 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:00.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9218c27640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9213fff640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e0931380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 -- 172.21.15.67:0/4053734507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 msgr2=0x5646e0931380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e0931380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 -- 172.21.15.67:0/4053734507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 msgr2=0x5646e092cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 -- 172.21.15.67:0/4053734507 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646e09267f0 con 0x5646e09269c0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9213fff640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e0931380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9218c27640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f920bfff640 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c760 tx=0x7f91fc009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1d17900377de1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9209ffb640 1 -- 172.21.15.67:0/4053734507 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0abe90 con 0x5646e09269c0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9209ffb640 1 -- 172.21.15.67:0/4053734507 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91fc0ace20 con 0x5646e09269c0 2024-09-10T20:59:00.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.370+0000 7f9209ffb640 1 -- 172.21.15.67:0/4053734507 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0a8d70 con 0x5646e09269c0 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- 172.21.15.67:0/4053734507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 msgr2=0x5646e092c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c760 tx=0x7f91fc009490 comp rx=0 tx=0).stop 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- 172.21.15.67:0/4053734507 shutdown_connections 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e0932950 0x5646e092cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e09269c0 0x5646e092c850 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 --2- 172.21.15.67:0/4053734507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09260a0 0x5646e0931380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- 172.21.15.67:0/4053734507 >> 172.21.15.67:0/4053734507 conn(0x5646e0923ed0 msgr2=0x5646e0930c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- 172.21.15.67:0/4053734507 shutdown_connections 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- 172.21.15.67:0/4053734507 wait complete. 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.371+0000 7f921ca5f740 1 -- start start 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 Processor -- start 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 0x5646e09379b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09269c0 0x5646e0937ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92141ac8d0 con 0x5646e0932950 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92141add40 con 0x5646e09260a0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92141acfa0 con 0x5646e09269c0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f921ca5f740 10 client.0 _ll_register_callbacks cb 0x7f91fc004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9218c27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9218c27640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49466/0 (socket says 172.21.15.67:49466) 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9218c27640 1 -- 172.21.15.67:0/926075009 learned_addr learned my addr 172.21.15.67:0/926075009 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 0x5646e09379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f920bfff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09269c0 0x5646e0937ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 -- 172.21.15.67:0/926075009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09269c0 msgr2=0x5646e0937ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09269c0 0x5646e0937ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 -- 172.21.15.67:0/926075009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 msgr2=0x5646e0938430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:00.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9213fff640 1 -- 172.21.15.67:0/926075009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646e09af3b0 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.372+0000 7f9218c27640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f9213fff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 0x5646e09379b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9204009230 tx=0x7f9204009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dee5cbb005cdc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204035050 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f92040043d0 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91fc0ace20 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9204005040 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 10 client.26006 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5646e09b06c0 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91fc0ace20 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f92040035f0 con 0x5646e09260a0 2024-09-10T20:59:00.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 10 client.26006 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 10 client.26006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 20 client.26006 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e09b0e40 0x5646e09b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 4 client.26006 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.373+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646e089a850 con 0x5646e09b0e40 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f920bfff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e09b0e40 0x5646e09b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f920bfff640 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e09b0e40 0x5646e09b3260 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e07b8b3e1c1498d server_cookie=5473e48eb7769b90 in_seq=0 out_seq=0 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f91f37fe640 10 client.26006 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f91f37fe640 1 -- 172.21.15.67:0/926075009 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3416 (crc 0 0 0) 0x5646e089a850 con 0x5646e09b0e40 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f91f37fe640 10 client.26006 handle_command_reply: tid=0 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 client.26006 shutdown 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 msgr2=0x5646e09379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 0x5646e09379b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9204009230 tx=0x7f9204009260 comp rx=0 tx=0).stop 2024-09-10T20:59:00.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 shutdown_connections 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5646e09b0e40 0x5646e09b3260 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5646e0932950 0x5646e0938430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646e09269c0 0x5646e0937ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f91f37fe640 0 client.26006 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 --2- 172.21.15.67:0/926075009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5646e09260a0 0x5646e09379b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.374+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 >> 172.21.15.67:0/926075009 conn(0x5646e0923ed0 msgr2=0x5646e0931490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 shutdown_connections 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921ca5f740 1 -- 172.21.15.67:0/926075009 wait complete. 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921ca5f740 20 client.26006 trim_cache size 0 max 16384 2024-09-10T20:59:00.389 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "scrub active (0 inodes in the stack)", 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "8c5e9db5-2a09-4b0a-b7cc-f9df12052330", 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.390 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.391 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.392 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.393 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.394 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.395 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:00.396 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:00.397 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 msgr2=0x7f92000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 0x7f92000b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9204031440 tx=0x7f92040058b0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 msgr2=0x7f92141997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00ea60 tx=0x7f91fc00ef20 comp rx=0 tx=0).stop 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 shutdown_connections 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f92000b52e0 0x7f92000b77a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9214108020 0x7f921419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92141076a0 0x7f92141997f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 --2- 172.21.15.67:0/156718866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9214101c90 0x7f92141992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:00.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 >> 172.21.15.67:0/156718866 conn(0x7f92140fd700 msgr2=0x7f921406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:00.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 shutdown_connections 2024-09-10T20:59:00.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:00.375+0000 7f921a68a640 1 -- 172.21.15.67:0/156718866 wait complete. 2024-09-10T20:59:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:00 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:59:00.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:00 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:00 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:59:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:00 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:59:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:00 smithi067 ceph-mon[30891]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 996 op/s 2024-09-10T20:59:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:00 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:59:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:00 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:00 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:59:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:00 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:59:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:00 smithi172 ceph-mon[35265]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 996 op/s 2024-09-10T20:59:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:00 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:59:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:00 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:00 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:59:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:00 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:59:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:00 smithi083 ceph-mon[35058]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 MiB/s wr, 996 op/s 2024-09-10T20:59:01.075 INFO:tasks.cephfs.filesystem:scrub status for tag:8c5e9db5-2a09-4b0a-b7cc-f9df12052330 - {'path': '/', 'tag': '8c5e9db5-2a09-4b0a-b7cc-f9df12052330', 'options': 'recursive,force'} 2024-09-10T20:59:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:02 smithi172 ceph-mon[35265]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 1.09k op/s 2024-09-10T20:59:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:02 smithi067 ceph-mon[30891]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 1.09k op/s 2024-09-10T20:59:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:02 smithi083 ceph-mon[35058]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 29 MiB/s wr, 1.09k op/s 2024-09-10T20:59:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 450.0 s, 339.4 tps, lat 465.912 ms stddev 1691.838 2024-09-10T20:59:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:04 smithi172 ceph-mon[35265]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 1.31k op/s 2024-09-10T20:59:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:04 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:04 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:04.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:04 smithi067 ceph-mon[30891]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 1.31k op/s 2024-09-10T20:59:04.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:04 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:04.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:04 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:04 smithi083 ceph-mon[35058]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 39 MiB/s wr, 1.31k op/s 2024-09-10T20:59:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:04 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:04 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:06 smithi067 ceph-mon[30891]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 36 MiB/s wr, 1.15k op/s 2024-09-10T20:59:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:06 smithi083 ceph-mon[35058]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 36 MiB/s wr, 1.15k op/s 2024-09-10T20:59:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:06 smithi172 ceph-mon[35265]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 36 MiB/s wr, 1.15k op/s 2024-09-10T20:59:08.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:08 smithi067 ceph-mon[30891]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 36 MiB/s wr, 1.16k op/s 2024-09-10T20:59:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:08 smithi083 ceph-mon[35058]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 36 MiB/s wr, 1.16k op/s 2024-09-10T20:59:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:08 smithi172 ceph-mon[35265]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 36 MiB/s wr, 1.16k op/s 2024-09-10T20:59:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 455.0 s, 2553.8 tps, lat 39.195 ms stddev 52.655 2024-09-10T20:59:10.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:10 smithi067 ceph-mon[30891]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 1.04k op/s 2024-09-10T20:59:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:10 smithi083 ceph-mon[35058]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 1.04k op/s 2024-09-10T20:59:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:10 smithi172 ceph-mon[35265]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 1.04k op/s 2024-09-10T20:59:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:11.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:11.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:11.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:11.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:11.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:11.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:12 smithi067 ceph-mon[30891]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 MiB/s wr, 820 op/s 2024-09-10T20:59:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:12 smithi083 ceph-mon[35058]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 MiB/s wr, 820 op/s 2024-09-10T20:59:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:12 smithi172 ceph-mon[35265]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 MiB/s wr, 820 op/s 2024-09-10T20:59:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 460.0 s, 2256.2 tps, lat 44.093 ms stddev 49.872 2024-09-10T20:59:14.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:14 smithi067 ceph-mon[30891]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 896 op/s 2024-09-10T20:59:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:14 smithi083 ceph-mon[35058]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 896 op/s 2024-09-10T20:59:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:14 smithi172 ceph-mon[35265]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 896 op/s 2024-09-10T20:59:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:16 smithi067 ceph-mon[30891]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 690 op/s 2024-09-10T20:59:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:16 smithi083 ceph-mon[35058]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 690 op/s 2024-09-10T20:59:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:16 smithi172 ceph-mon[35265]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 690 op/s 2024-09-10T20:59:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:18 smithi067 ceph-mon[30891]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-09-10T20:59:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:18 smithi083 ceph-mon[35058]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-09-10T20:59:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:18 smithi172 ceph-mon[35265]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 12 MiB/s wr, 811 op/s 2024-09-10T20:59:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 465.0 s, 2620.4 tps, lat 37.968 ms stddev 47.114 2024-09-10T20:59:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:20 smithi067 ceph-mon[30891]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:59:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:20 smithi083 ceph-mon[35058]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:59:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:20 smithi172 ceph-mon[35265]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 814 op/s 2024-09-10T20:59:22.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:22 smithi067 ceph-mon[30891]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T20:59:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:22 smithi083 ceph-mon[35058]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T20:59:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:22 smithi172 ceph-mon[35265]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T20:59:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 470.0 s, 2506.2 tps, lat 40.194 ms stddev 47.317 2024-09-10T20:59:24.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:24 smithi067 ceph-mon[30891]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:59:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:24 smithi083 ceph-mon[35058]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:59:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:24 smithi172 ceph-mon[35265]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-10T20:59:26.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:26 smithi172 ceph-mon[35265]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-10T20:59:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:26 smithi067 ceph-mon[30891]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-10T20:59:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:26 smithi083 ceph-mon[35058]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-09-10T20:59:28.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:28 smithi067 ceph-mon[30891]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-09-10T20:59:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:28 smithi083 ceph-mon[35058]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-09-10T20:59:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:28 smithi172 ceph-mon[35265]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 787 op/s 2024-09-10T20:59:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 475.0 s, 2278.0 tps, lat 43.214 ms stddev 50.718 2024-09-10T20:59:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:30 smithi067 ceph-mon[30891]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 714 op/s 2024-09-10T20:59:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:30 smithi083 ceph-mon[35058]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 714 op/s 2024-09-10T20:59:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:30 smithi172 ceph-mon[35265]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 9.4 MiB/s wr, 714 op/s 2024-09-10T20:59:31.077 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:59:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:32.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 -- 172.21.15.67:0/701910922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 msgr2=0x7f1f04107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 --2- 172.21.15.67:0/701910922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04107ae0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009860 tx=0x7f1ef802a360 comp rx=0 tx=0).stop 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 -- 172.21.15.67:0/701910922 shutdown_connections 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 --2- 172.21.15.67:0/701910922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04108020 0x7f1f0406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 --2- 172.21.15.67:0/701910922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04107ae0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 --2- 172.21.15.67:0/701910922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04101c90 0x7f1f04102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.267+0000 7f1f0982a640 1 -- 172.21.15.67:0/701910922 >> 172.21.15.67:0/701910922 conn(0x7f1f040fd700 msgr2=0x7f1f040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.268+0000 7f1f0982a640 1 -- 172.21.15.67:0/701910922 shutdown_connections 2024-09-10T20:59:32.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.268+0000 7f1f0982a640 1 -- 172.21.15.67:0/701910922 wait complete. 2024-09-10T20:59:32.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.269+0000 7f1f0982a640 1 Processor -- start 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.269+0000 7f1f0982a640 1 -- start start 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.269+0000 7f1f0982a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f0982a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04111090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48014/0 (socket says 172.21.15.67:48014) 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f0982a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04108020 0x7f1f041115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1844285141 learned_addr learned my addr 172.21.15.67:0/1844285141 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f027fc640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04111090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f037fe640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04108020 0x7f1f041115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04115010 con 0x7f1f041076a0 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04114e90 con 0x7f1f04101c90 2024-09-10T20:59:32.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.270+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04115190 con 0x7f1f04108020 2024-09-10T20:59:32.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1844285141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04108020 msgr2=0x7f1f041115d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04108020 0x7f1f041115d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 msgr2=0x7f1f04111090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04111090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f041abab0 con 0x7f1f04101c90 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400d950 tx=0x7f1ef400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.271+0000 7f1f08828640 1 -- 172.21.15.67:0/1844285141 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4017070 con 0x7f1f04101c90 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.272+0000 7f1f08828640 1 -- 172.21.15.67:0/1844285141 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ef4009c30 con 0x7f1f04101c90 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.272+0000 7f1f08828640 1 -- 172.21.15.67:0/1844285141 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400f620 con 0x7f1f04101c90 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.272+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f041abda0 con 0x7f1f04101c90 2024-09-10T20:59:32.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.272+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f041ac200 con 0x7f1f04101c90 2024-09-10T20:59:32.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.275+0000 7f1f08828640 1 -- 172.21.15.67:0/1844285141 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1ef4010460 con 0x7f1f04101c90 2024-09-10T20:59:32.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 Processor -- start 2024-09-10T20:59:32.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 -- start start 2024-09-10T20:59:32.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f08828640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 0x7f1eec0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd013410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd015d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5557dcf7de50 con 0x5557dd0079c0 2024-09-10T20:59:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5557dcf6d280 con 0x5557dd0070a0 2024-09-10T20:59:32.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5557dcf71090 con 0x5557dd013950 2024-09-10T20:59:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f037fe640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 0x7f1eec0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f08828640 1 -- 172.21.15.67:0/1844285141 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1ef40e5670 con 0x7f1f04101c90 2024-09-10T20:59:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd015d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48024/0 (socket says 172.21.15.67:48024) 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.277+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1459363922 learned_addr learned my addr 172.21.15.67:0/1459363922 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1459363922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 msgr2=0x5557dd015d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd015d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1459363922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 msgr2=0x5557dd013410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd013410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f02ffd640 1 -- 172.21.15.67:0/1459363922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557dcccb650 con 0x5557dd0070a0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.278+0000 7f1f037fe640 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd015d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.279+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40abea0 tx=0x7f1ef40ab990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc6939e6cf28237 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.279+0000 7f1f037fe640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 0x7f1eec0b78f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009330 tx=0x7f1efc009280 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.279+0000 7f1ee9ffb640 1 -- 172.21.15.67:0/1459363922 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4020020 con 0x5557dd0070a0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.279+0000 7f1ee9ffb640 1 -- 172.21.15.67:0/1459363922 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ef40abf10 con 0x5557dd0070a0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.279+0000 7f1ee9ffb640 1 -- 172.21.15.67:0/1459363922 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4093300 con 0x5557dd0070a0 2024-09-10T20:59:32.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.280+0000 7f1f0bbff740 1 -- 172.21.15.67:0/1459363922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 msgr2=0x5557dd007480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.280+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40abea0 tx=0x7f1ef40ab990 comp rx=0 tx=0).stop 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 -- 172.21.15.67:0/1459363922 shutdown_connections 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd015d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd013410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/1459363922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd007480 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 -- 172.21.15.67:0/1459363922 >> 172.21.15.67:0/1459363922 conn(0x5557dd004ed0 msgr2=0x5557dd006070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 -- 172.21.15.67:0/1459363922 shutdown_connections 2024-09-10T20:59:32.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 -- 172.21.15.67:0/1459363922 wait complete. 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.281+0000 7f1f0bbff740 1 -- start start 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 Processor -- start 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd013220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd010c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5557dcdce700 con 0x5557dd0079c0 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5557dcf08110 con 0x5557dd0070a0 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5557dd0165d0 con 0x5557dd013950 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.282+0000 7f1f0bbff740 10 client.0 _ll_register_callbacks cb 0x5557dcf21990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45720/0 (socket says 172.21.15.67:45720) 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 -- 172.21.15.67:0/2086079994 learned_addr learned my addr 172.21.15.67:0/2086079994 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 -- 172.21.15.67:0/2086079994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 msgr2=0x5557dd010c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd010c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 -- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 msgr2=0x5557dd013220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd013220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.283+0000 7f1f027fc640 1 -- 172.21.15.67:0/2086079994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557dcf35c40 con 0x5557dd0079c0 2024-09-10T20:59:32.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.284+0000 7f1f027fc640 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009780 tx=0x7f1ef8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b3953103455fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.284+0000 7f1ee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8043020 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1ef80306f0 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ef40abf10 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ef8037040 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1f0bbff740 10 client.16314 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.285+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557dd021f30 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.286+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ef40abf10 con 0x5557dd0079c0 2024-09-10T20:59:32.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.286+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1ef803e480 con 0x5557dd0079c0 2024-09-10T20:59:32.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 10 client.16314 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:32.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 20 client.16314 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd023340 0x5557dd0257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 4 client.16314 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.287+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557dcf7fda0 con 0x5557dd023340 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.288+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd023340 0x5557dd0257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.289+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd023340 0x5557dd0257b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d7073f1adf02d7 server_cookie=f745460a6ce16e4f in_seq=0 out_seq=0 2024-09-10T20:59:32.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.289+0000 7f1ee2ffd640 10 client.16314 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:32.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.291+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/2086079994 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557dcf7fda0 con 0x5557dd023340 2024-09-10T20:59:32.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.291+0000 7f1ee2ffd640 10 client.16314 handle_command_reply: tid=0 2024-09-10T20:59:32.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.291+0000 7f1f0bbff740 1 client.16314 shutdown 2024-09-10T20:59:32.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.291+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 msgr2=0x5557dd010670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.291+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009780 tx=0x7f1ef8004270 comp rx=0 tx=0).stop 2024-09-10T20:59:32.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 shutdown_connections 2024-09-10T20:59:32.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd023340 0x5557dd0257b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd010c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd010670 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/2086079994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd013220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 >> 172.21.15.67:0/2086079994 conn(0x5557dd004ed0 msgr2=0x5557dd00aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1ee2ffd640 0 client.16314 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 shutdown_connections 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 1 -- 172.21.15.67:0/2086079994 wait complete. 2024-09-10T20:59:32.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.292+0000 7f1f0bbff740 20 client.16314 trim_cache size 0 max 16384 2024-09-10T20:59:32.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.328+0000 7f1f0bbff740 1 Processor -- start 2024-09-10T20:59:32.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.329+0000 7f1f0bbff740 1 -- start start 2024-09-10T20:59:32.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd0070a0 0x5557dd00fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0079c0 0x5557dd00eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b7250 con 0x5557dd013950 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b4b20 con 0x5557dd0079c0 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b2970 con 0x5557dd0070a0 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45728/0 (socket says 172.21.15.67:45728) 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 -- 172.21.15.67:0/770173692 learned_addr learned my addr 172.21.15.67:0/770173692 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:32.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 -- 172.21.15.67:0/770173692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd0070a0 msgr2=0x5557dd00fb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd0070a0 0x5557dd00fb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 -- 172.21.15.67:0/770173692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0079c0 msgr2=0x5557dd00eef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0079c0 0x5557dd00eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.330+0000 7f1f037fe640 1 -- 172.21.15.67:0/770173692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557dd010fc0 con 0x5557dd013950 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.331+0000 7f1f037fe640 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1efc005f60 tx=0x7f1efc0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852701c47330646d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.331+0000 7f1ee97fa640 1 -- 172.21.15.67:0/770173692 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc025070 con 0x5557dd013950 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.331+0000 7f1ee97fa640 1 -- 172.21.15.67:0/770173692 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc021430 con 0x5557dd013950 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.331+0000 7f1ee97fa640 1 -- 172.21.15.67:0/770173692 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc01f620 con 0x5557dd013950 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.332+0000 7f1f0bbff740 1 -- 172.21.15.67:0/770173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 msgr2=0x5557dd00f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1efc005f60 tx=0x7f1efc0095e0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 -- 172.21.15.67:0/770173692 shutdown_connections 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd013950 0x5557dd00f430 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0079c0 0x5557dd00eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/770173692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd0070a0 0x5557dd00fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 -- 172.21.15.67:0/770173692 >> 172.21.15.67:0/770173692 conn(0x5557dd004ed0 msgr2=0x5557dd00b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.333+0000 7f1f0bbff740 1 -- 172.21.15.67:0/770173692 shutdown_connections 2024-09-10T20:59:32.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.334+0000 7f1f0bbff740 1 -- 172.21.15.67:0/770173692 wait complete. 2024-09-10T20:59:32.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.335+0000 7f1f0bbff740 1 -- start start 2024-09-10T20:59:32.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.335+0000 7f1f0bbff740 1 Processor -- start 2024-09-10T20:59:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd01b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd01bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd016820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b2fe0 con 0x5557dd0079c0 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b4450 con 0x5557dd0070a0 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f041b36b0 con 0x5557dd013950 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f0bbff740 10 client.0 _ll_register_callbacks cb 0x7f1ef80096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd01b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f037fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd016820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd01b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48040/0 (socket says 172.21.15.67:48040) 2024-09-10T20:59:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.336+0000 7f1f02ffd640 1 -- 172.21.15.67:0/287215337 learned_addr learned my addr 172.21.15.67:0/287215337 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 -- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 msgr2=0x5557dd01b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd01b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 -- 172.21.15.67:0/287215337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 msgr2=0x5557dd01bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd01bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 -- 172.21.15.67:0/287215337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557dd01c5e0 con 0x5557dd013950 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.337+0000 7f1f037fe640 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd016820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1efc005f60 tx=0x7f1efc00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c67d0dbb5e50d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.338+0000 7f1ee2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.338+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc025040 con 0x5557dd013950 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.338+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1efc004c40 con 0x5557dd013950 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.338+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc021430 con 0x5557dd013950 2024-09-10T20:59:32.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.338+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1efc004e40 con 0x5557dd013950 2024-09-10T20:59:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.339+0000 7f1f0bbff740 10 client.25978 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.339+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557dd090890 con 0x5557dd013950 2024-09-10T20:59:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.339+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc02e070 con 0x5557dd013950 2024-09-10T20:59:32.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1efc00b050 con 0x5557dd013950 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 10 client.25978 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 20 client.25978 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd090ec0 0x5557dd0932e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 4 client.25978 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.340+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1efc021430 con 0x5557dd090ec0 2024-09-10T20:59:32.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.341+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd090ec0 0x5557dd0932e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:32.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.341+0000 7f1f02ffd640 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd090ec0 0x5557dd0932e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a24b55c2f6ac0562 server_cookie=f511eb0882771779 in_seq=0 out_seq=0 2024-09-10T20:59:32.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1ee2ffd640 10 client.25978 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:32.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1ee2ffd640 1 -- 172.21.15.67:0/287215337 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x7f1efc021430 con 0x5557dd090ec0 2024-09-10T20:59:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1ee2ffd640 10 client.25978 handle_command_reply: tid=0 2024-09-10T20:59:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1f0bbff740 1 client.25978 shutdown 2024-09-10T20:59:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 msgr2=0x5557dd016820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.342+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd016820 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1efc005f60 tx=0x7f1efc00eb20 comp rx=0 tx=0).stop 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 shutdown_connections 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557dd090ec0 0x5557dd0932e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557dd013950 0x5557dd016820 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557dd0079c0 0x5557dd01bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 --2- 172.21.15.67:0/287215337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557dd0070a0 0x5557dd01b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 >> 172.21.15.67:0/287215337 conn(0x5557dd004ed0 msgr2=0x5557dd00eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1ee2ffd640 0 client.25978 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:32.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.343+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 shutdown_connections 2024-09-10T20:59:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.346+0000 7f1f0bbff740 1 -- 172.21.15.67:0/287215337 wait complete. 2024-09-10T20:59:32.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.346+0000 7f1f0bbff740 20 client.25978 trim_cache size 0 max 16384 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:59:32.351 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.352 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.353 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:59:32.354 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:59:32.357 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:32.358 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.347+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 msgr2=0x7f1eec0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.347+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 0x7f1eec0b78f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009330 tx=0x7f1efc009280 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 msgr2=0x7f1f04110b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ef400d950 tx=0x7f1ef400de10 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 shutdown_connections 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1eec0b5430 0x7f1eec0b78f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f04108020 0x7f1f041115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f041076a0 0x7f1f04111090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 --2- 172.21.15.67:0/1844285141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f04101c90 0x7f1f04110b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.348+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 >> 172.21.15.67:0/1844285141 conn(0x7f1f040fd700 msgr2=0x7f1f04103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.349+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 shutdown_connections 2024-09-10T20:59:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:32.349+0000 7f1f0982a640 1 -- 172.21.15.67:0/1844285141 wait complete. 2024-09-10T20:59:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:32 smithi067 ceph-mon[30891]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.6 MiB/s wr, 673 op/s 2024-09-10T20:59:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:32 smithi083 ceph-mon[35058]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.6 MiB/s wr, 673 op/s 2024-09-10T20:59:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:32 smithi172 ceph-mon[35265]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.6 MiB/s wr, 673 op/s 2024-09-10T20:59:33.273 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T20:59:33.274 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T20:59:33.725 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 480.0 s, 2534.8 tps, lat 39.617 ms stddev 49.031 2024-09-10T20:59:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.263+0000 7ff7192b2640 1 -- 172.21.15.67:0/1286799634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 msgr2=0x7ff7141020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.263+0000 7ff7192b2640 1 --2- 172.21.15.67:0/1286799634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff7141020a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff704009860 tx=0x7ff70402a340 comp rx=0 tx=0).stop 2024-09-10T20:59:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 -- 172.21.15.67:0/1286799634 shutdown_connections 2024-09-10T20:59:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 --2- 172.21.15.67:0/1286799634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff714108050 0x7ff71410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 --2- 172.21.15.67:0/1286799634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7141076d0 0x7ff714107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 --2- 172.21.15.67:0/1286799634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff7141020a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 -- 172.21.15.67:0/1286799634 >> 172.21.15.67:0/1286799634 conn(0x7ff7140fd750 msgr2=0x7ff7140ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 -- 172.21.15.67:0/1286799634 shutdown_connections 2024-09-10T20:59:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 -- 172.21.15.67:0/1286799634 wait complete. 2024-09-10T20:59:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.264+0000 7ff7192b2640 1 Processor -- start 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 -- start start 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff71406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 0x7ff714073e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff714111d10 con 0x7ff714108050 2024-09-10T20:59:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff714111b90 con 0x7ff714101cc0 2024-09-10T20:59:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7192b2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff714111e90 con 0x7ff7141076d0 2024-09-10T20:59:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7137fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7137fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45752/0 (socket says 172.21.15.67:45752) 2024-09-10T20:59:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7137fe640 1 -- 172.21.15.67:0/252677018 learned_addr learned my addr 172.21.15.67:0/252677018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:34.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff71406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7127fc640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 0x7ff714073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 -- 172.21.15.67:0/252677018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 msgr2=0x7ff714073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 0x7ff714073e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 -- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 msgr2=0x7ff7140743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff712ffd640 1 -- 172.21.15.67:0/252677018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff714074c80 con 0x7ff714101cc0 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7127fc640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 0x7ff714073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.265+0000 7ff7137fe640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff712ffd640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff71406bc80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff704035040 tx=0x7ff704032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704037040 con 0x7ff714101cc0 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff704004050 con 0x7ff714101cc0 2024-09-10T20:59:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040035f0 con 0x7ff714101cc0 2024-09-10T20:59:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7141b01e0 con 0x7ff714101cc0 2024-09-10T20:59:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.266+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71406fc40 con 0x7ff714101cc0 2024-09-10T20:59:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.268+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff714102f70 con 0x7ff714101cc0 2024-09-10T20:59:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.269+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff704003790 con 0x7ff714101cc0 2024-09-10T20:59:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.269+0000 7ff6fbfff640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 0x7ff6fc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.270+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff704105190 con 0x7ff714101cc0 2024-09-10T20:59:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.270+0000 7ff7127fc640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 0x7ff6fc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.270+0000 7ff7127fc640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 0x7ff6fc0b7820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff714106f90 tx=0x7ff708009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.275+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff70404a020 con 0x7ff714101cc0 2024-09-10T20:59:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.637+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff71402e5c0 con 0x7ff714101cc0 2024-09-10T20:59:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.638+0000 7ff6fbfff640 1 -- 172.21.15.67:0/252677018 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7ff7040cc020 con 0x7ff714101cc0 2024-09-10T20:59:34.642 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T20:59:34.642 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T20:59:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T20:59:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 msgr2=0x7ff6fc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 0x7ff6fc0b7820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff714106f90 tx=0x7ff708009260 comp rx=0 tx=0).stop 2024-09-10T20:59:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 msgr2=0x7ff71406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff71406bc80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff704035040 tx=0x7ff704032d50 comp rx=0 tx=0).stop 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 shutdown_connections 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff714108050 0x7ff7140743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff6fc0b5360 0x7ff6fc0b7820 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7141076d0 0x7ff714073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 --2- 172.21.15.67:0/252677018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff714101cc0 0x7ff71406bc80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 >> 172.21.15.67:0/252677018 conn(0x7ff7140fd750 msgr2=0x7ff7140ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 shutdown_connections 2024-09-10T20:59:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:34.640+0000 7ff7192b2640 1 -- 172.21.15.67:0/252677018 wait complete. 2024-09-10T20:59:34.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:34 smithi067 ceph-mon[30891]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 755 op/s 2024-09-10T20:59:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:34 smithi083 ceph-mon[35058]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 755 op/s 2024-09-10T20:59:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:34 smithi172 ceph-mon[35265]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 755 op/s 2024-09-10T20:59:35.325 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T20:59:35.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/252677018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:59:35.740 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/252677018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:59:35.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/252677018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T20:59:36.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.444+0000 7fe5f6919640 1 -- 172.21.15.67:0/1360360746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 msgr2=0x7fe5f01111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.444+0000 7fe5f6919640 1 --2- 172.21.15.67:0/1360360746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 0x7fe5f01111b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009900 tx=0x7fe5ec02a410 comp rx=0 tx=0).stop 2024-09-10T20:59:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.446+0000 7fe5f6919640 1 -- 172.21.15.67:0/1360360746 shutdown_connections 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.446+0000 7fe5f6919640 1 --2- 172.21.15.67:0/1360360746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f011c0a0 0x7fe5f011e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.446+0000 7fe5f6919640 1 --2- 172.21.15.67:0/1360360746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f010a530 0x7fe5f010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.446+0000 7fe5f6919640 1 --2- 172.21.15.67:0/1360360746 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 0x7fe5f01111b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.446+0000 7fe5f6919640 1 -- 172.21.15.67:0/1360360746 >> 172.21.15.67:0/1360360746 conn(0x7fe5f006cb30 msgr2=0x7fe5f006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.447+0000 7fe5f6919640 1 -- 172.21.15.67:0/1360360746 shutdown_connections 2024-09-10T20:59:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.447+0000 7fe5f6919640 1 -- 172.21.15.67:0/1360360746 wait complete. 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.448+0000 7fe5f6919640 1 Processor -- start 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.448+0000 7fe5f6919640 1 -- start start 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.449+0000 7fe5f6919640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 0x7fe5f01a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.449+0000 7fe5f6919640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.449+0000 7fe5f6919640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 0x7fe5f01ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.449+0000 7fe5f6919640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0121aa0 con 0x7fe5f010a150 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.449+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.450+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48440/0 (socket says 172.21.15.67:48440) 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.450+0000 7fe5f5116640 1 -- 172.21.15.67:0/2682580366 learned_addr learned my addr 172.21.15.67:0/2682580366 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.450+0000 7fe5f6118640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 0x7fe5f01ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.450+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0121920 con 0x7fe5f011c0a0 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.450+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f0121c20 con 0x7fe5f010a530 2024-09-10T20:59:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f5116640 1 -- 172.21.15.67:0/2682580366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 msgr2=0x7fe5f01ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 0x7fe5f01ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f5116640 1 -- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 msgr2=0x7fe5f01a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 0x7fe5f01a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f5116640 1 -- 172.21.15.67:0/2682580366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f01adf80 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.451+0000 7fe5f6118640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 0x7fe5f01ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.453+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c970 tx=0x7fe5e000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.456+0000 7fe5e6ffd640 1 -- 172.21.15.67:0/2682580366 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0004220 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.456+0000 7fe5e6ffd640 1 -- 172.21.15.67:0/2682580366 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e00043c0 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.456+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f01ae270 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.456+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f01b4930 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.456+0000 7fe5e6ffd640 1 -- 172.21.15.67:0/2682580366 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0003e30 con 0x7fe5f010a530 2024-09-10T20:59:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.464+0000 7fe5e6ffd640 1 -- 172.21.15.67:0/2682580366 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe5e00079b0 con 0x7fe5f010a530 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 Processor -- start 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 -- start start 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 0x561f7a75f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a761f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561f7a6c9ea0 con 0x561f7a753bf0 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561f7a6b92d0 con 0x561f7a7532d0 2024-09-10T20:59:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.465+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f7a6bd0e0 con 0x561f7a75fb80 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.466+0000 7fe5f6118640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.466+0000 7fe5f6118640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48098/0 (socket says 172.21.15.67:48098) 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.466+0000 7fe5f6118640 1 -- 172.21.15.67:0/261145628 learned_addr learned my addr 172.21.15.67:0/261145628 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.467+0000 7fe5f6118640 1 -- 172.21.15.67:0/261145628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 msgr2=0x561f7a761f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f5917640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 0x561f7a75f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f5116640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a761f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f6118640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a761f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f6118640 1 -- 172.21.15.67:0/261145628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 msgr2=0x561f7a75f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f6118640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 0x561f7a75f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.468+0000 7fe5f6118640 1 -- 172.21.15.67:0/261145628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7a417650 con 0x561f7a7532d0 2024-09-10T20:59:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.469+0000 7fe5f5917640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 0x561f7a75f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:59:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.469+0000 7fe5f6118640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80117e0 tx=0x7fe5e8011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e99bebbe544535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.469+0000 7fe5f5116640 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a761f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:59:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.470+0000 7fe5dbfff640 1 -- 172.21.15.67:0/261145628 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8011310 con 0x561f7a7532d0 2024-09-10T20:59:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.470+0000 7fe5dbfff640 1 -- 172.21.15.67:0/261145628 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e8003e20 con 0x561f7a7532d0 2024-09-10T20:59:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.470+0000 7fe5dbfff640 1 -- 172.21.15.67:0/261145628 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80044f0 con 0x561f7a7532d0 2024-09-10T20:59:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.470+0000 7fe5e6ffd640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 0x7fe5dc0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.471+0000 7fe5e6ffd640 1 -- 172.21.15.67:0/2682580366 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5e00e59b0 con 0x7fe5f010a530 2024-09-10T20:59:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.471+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 0x7fe5dc0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.471+0000 7fe5f9f50740 1 -- 172.21.15.67:0/261145628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 msgr2=0x561f7a7536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.471+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80117e0 tx=0x7fe5e8011ca0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 -- 172.21.15.67:0/261145628 shutdown_connections 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a761f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a753bf0 0x561f7a75f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/261145628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a7536b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 -- 172.21.15.67:0/261145628 >> 172.21.15.67:0/261145628 conn(0x561f7a751100 msgr2=0x561f7a7522a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 0x7fe5dc0b7a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02a930 tx=0x7fe5ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 -- 172.21.15.67:0/261145628 shutdown_connections 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.472+0000 7fe5f9f50740 1 -- 172.21.15.67:0/261145628 wait complete. 2024-09-10T20:59:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.473+0000 7fe5f9f50740 1 -- start start 2024-09-10T20:59:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.473+0000 7fe5f9f50740 1 Processor -- start 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.473+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a7532d0 0x561f7a75f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.473+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.473+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a75ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561f7a51a700 con 0x561f7a7532d0 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561f7a654160 con 0x561f7a753bf0 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f9f50740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561f7a762800 con 0x561f7a75fb80 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f9f50740 10 client.0 _ll_register_callbacks cb 0x561f7a66d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48108/0 (socket says 172.21.15.67:48108) 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 -- 172.21.15.67:0/2703808167 learned_addr learned my addr 172.21.15.67:0/2703808167 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f6118640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a75ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a7532d0 0x561f7a75f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 -- 172.21.15.67:0/2703808167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 msgr2=0x561f7a75ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a75ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 -- 172.21.15.67:0/2703808167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a7532d0 msgr2=0x561f7a75f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a7532d0 0x561f7a75f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.474+0000 7fe5f5116640 1 -- 172.21.15.67:0/2703808167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7a681c90 con 0x561f7a753bf0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5f6118640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a75ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00a8710 tx=0x7fe5e00abb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=459a0cf3f329e886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e001d040 con 0x561f7a753bf0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5e00a83b0 con 0x561f7a753bf0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5e8003e20 con 0x561f7a753bf0 2024-09-10T20:59:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5e00ac140 con 0x561f7a753bf0 2024-09-10T20:59:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5f9f50740 10 client.26033 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.475+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561f7a76e0d0 con 0x561f7a753bf0 2024-09-10T20:59:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e8003e20 con 0x561f7a753bf0 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5e00cdb20 con 0x561f7a753bf0 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 10 client.26033 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 10 client.26033 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 20 client.26033 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a76f5e0 0x561f7a771a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 4 client.26033 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.476+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f7a6cbdf0 con 0x561f7a76f5e0 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.477+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a76f5e0 0x561f7a771a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.477+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a76f5e0 0x561f7a771a10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d543ec1f6779cada server_cookie=da0897a66c1979c4 in_seq=0 out_seq=0 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.477+0000 7fe5d97fa640 10 client.26033 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:59:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2703808167 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f7a6cbdf0 con 0x561f7a76f5e0 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5d97fa640 10 client.26033 handle_command_reply: tid=0 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 client.26033 shutdown 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 msgr2=0x561f7a75c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00a8710 tx=0x7fe5e00abb50 comp rx=0 tx=0).stop 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 shutdown_connections 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a76f5e0 0x561f7a771a10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a75fb80 0x561f7a75ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a75c860 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5d97fa640 0 client.26033 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2703808167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a7532d0 0x561f7a75f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.478+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 >> 172.21.15.67:0/2703808167 conn(0x561f7a751100 msgr2=0x561f7a756c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.479+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 shutdown_connections 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.479+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2703808167 wait complete. 2024-09-10T20:59:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.479+0000 7fe5f9f50740 20 client.26033 trim_cache size 0 max 16384 2024-09-10T20:59:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.500+0000 7fe5f9f50740 1 Processor -- start 2024-09-10T20:59:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f9f50740 1 -- start start 2024-09-10T20:59:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a750a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 0x561f7a756a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f5917640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a750a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f5917640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a750a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48116/0 (socket says 172.21.15.67:48116) 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f5917640 1 -- 172.21.15.67:0/289383365 learned_addr learned my addr 172.21.15.67:0/289383365 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.501+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a756f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 0x561f7a756a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d4010cf0 con 0x561f7a75fb80 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400e5c0 con 0x561f7a7532d0 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400c410 con 0x561f7a753bf0 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f6118640 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a756f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 -- 172.21.15.67:0/289383365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 msgr2=0x561f7a750a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a750a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 -- 172.21.15.67:0/289383365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 msgr2=0x561f7a756f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a756f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.502+0000 7fe5f5116640 1 -- 172.21.15.67:0/289383365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7a757580 con 0x561f7a753bf0 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.503+0000 7fe5f5116640 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 0x561f7a756a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0007590 tx=0x7fe5e0003a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d465092f18eb1ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.503+0000 7fe5db7fe640 1 -- 172.21.15.67:0/289383365 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e001d070 con 0x561f7a753bf0 2024-09-10T20:59:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.503+0000 7fe5db7fe640 1 -- 172.21.15.67:0/289383365 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5e00b5240 con 0x561f7a753bf0 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.503+0000 7fe5db7fe640 1 -- 172.21.15.67:0/289383365 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00cdb20 con 0x561f7a753bf0 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.504+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 msgr2=0x561f7a756a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.504+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 0x561f7a756a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0007590 tx=0x7fe5e0003a10 comp rx=0 tx=0).stop 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.505+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 shutdown_connections 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.505+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a756f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.505+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a753bf0 0x561f7a756a40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.505+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/289383365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a7532d0 0x561f7a750a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.505+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 >> 172.21.15.67:0/289383365 conn(0x561f7a751100 msgr2=0x561f7a756330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.506+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 shutdown_connections 2024-09-10T20:59:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.506+0000 7fe5f9f50740 1 -- 172.21.15.67:0/289383365 wait complete. 2024-09-10T20:59:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.506+0000 7fe5f9f50740 1 -- start start 2024-09-10T20:59:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.507+0000 7fe5f9f50740 1 Processor -- start 2024-09-10T20:59:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.507+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.507+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f9f50740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a7d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f5917640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f5917640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48478/0 (socket says 172.21.15.67:48478) 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f5116640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48118/0 (socket says 172.21.15.67:48118) 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f5917640 1 -- 172.21.15.67:0/2847103139 learned_addr learned my addr 172.21.15.67:0/2847103139 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400ca80 con 0x561f7a75fb80 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400def0 con 0x561f7a753bf0 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d400d150 con 0x561f7a7532d0 2024-09-10T20:59:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.508+0000 7fe5f6118640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a7d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f9f50740 10 client.0 _ll_register_callbacks cb 0x7fe5e000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 -- 172.21.15.67:0/2847103139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 msgr2=0x561f7a764380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 -- 172.21.15.67:0/2847103139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 msgr2=0x561f7a7d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a7d5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7a7d5ba0 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f7a6c78a0 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f5116640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00b5640 tx=0x7fe5e00cddd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7ef265a6bd58f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5d97fa640 10 client.26039 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2847103139 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e001d070 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2847103139 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5e00a7a90 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2847103139 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5e00a7cd0 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f9f50740 10 client.26039 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.509+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x561f7a7dcde0 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2847103139 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5e00aae10 con 0x561f7a753bf0 2024-09-10T20:59:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 10 client.26039 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 10 client.26039 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 20 client.26039 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a7dd120 0x561f7a7df510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 4 client.26039 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f7a6c4cd0 con 0x561f7a7dd120 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a7dd120 0x561f7a7df510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5f5917640 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a7dd120 0x561f7a7df510 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43a5d165e816c3d3 server_cookie=77879ad3f16f0022 in_seq=0 out_seq=0 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.510+0000 7fe5d97fa640 10 client.26039 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5d97fa640 1 -- 172.21.15.67:0/2847103139 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f7a6c4cd0 con 0x561f7a7dd120 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5d97fa640 10 client.26039 handle_command_reply: tid=0 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 client.26039 shutdown 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 msgr2=0x561f7a764920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00b5640 tx=0x7fe5e00cddd0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 shutdown_connections 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x561f7a7dd120 0x561f7a7df510 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561f7a75fb80 0x561f7a7d5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561f7a753bf0 0x561f7a764920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5d97fa640 0 client.26039 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 --2- 172.21.15.67:0/2847103139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561f7a7532d0 0x561f7a764380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 >> 172.21.15.67:0/2847103139 conn(0x561f7a751100 msgr2=0x561f7a756b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 shutdown_connections 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 1 -- 172.21.15.67:0/2847103139 wait complete. 2024-09-10T20:59:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.511+0000 7fe5f9f50740 20 client.26039 trim_cache size 0 max 16384 2024-09-10T20:59:36.520 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.512+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 msgr2=0x7fe5dc0b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.512+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 0x7fe5dc0b7a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02a930 tx=0x7fe5ec000bc0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.512+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 msgr2=0x7fe5f01a8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.512+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c970 tx=0x7fe5e000ce30 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.512+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 shutdown_connections 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5f011c0a0 0x7fe5f01ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5dc0b5560 0x7fe5dc0b7a20 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec02a930 tx=0x7fe5ec000bc0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5f010a530 0x7fe5f01a8410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 --2- 172.21.15.67:0/2682580366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f010a150 0x7fe5f01a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 >> 172.21.15.67:0/2682580366 conn(0x7fe5f006cb30 msgr2=0x7fe5f011c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 shutdown_connections 2024-09-10T20:59:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:36.513+0000 7fe5f6919640 1 -- 172.21.15.67:0/2682580366 wait complete. 2024-09-10T20:59:36.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:36 smithi067 ceph-mon[30891]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 676 op/s 2024-09-10T20:59:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:36 smithi083 ceph-mon[35058]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 676 op/s 2024-09-10T20:59:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:36 smithi172 ceph-mon[35265]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 676 op/s 2024-09-10T20:59:37.364 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T20:59:37.770 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 -- 172.21.15.67:0/2895193277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810aa70 msgr2=0x7f28681178c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 --2- 172.21.15.67:0/2895193277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810aa70 0x7f28681178c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f285c009890 tx=0x7f285c032c50 comp rx=0 tx=0).stop 2024-09-10T20:59:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 -- 172.21.15.67:0/2895193277 shutdown_connections 2024-09-10T20:59:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 --2- 172.21.15.67:0/2895193277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2868117e00 0x7f286811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 --2- 172.21.15.67:0/2895193277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810aa70 0x7f28681178c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 --2- 172.21.15.67:0/2895193277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f286810a150 0x7f286810a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.348+0000 7f286e308640 1 -- 172.21.15.67:0/2895193277 >> 172.21.15.67:0/2895193277 conn(0x7f286806dfc0 msgr2=0x7f286806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.349+0000 7f286e308640 1 -- 172.21.15.67:0/2895193277 shutdown_connections 2024-09-10T20:59:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.350+0000 7f286e308640 1 -- 172.21.15.67:0/2895193277 wait complete. 2024-09-10T20:59:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.350+0000 7f286e308640 1 Processor -- start 2024-09-10T20:59:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.351+0000 7f286e308640 1 -- start start 2024-09-10T20:59:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.351+0000 7f286e308640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 0x7f286819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286e308640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f286810aa70 0x7f28681a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 0x7f286819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 0x7f286819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48504/0 (socket says 172.21.15.67:48504) 2024-09-10T20:59:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286e308640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 0x7f28681a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f2867fff640 1 -- 172.21.15.67:0/657139814 learned_addr learned my addr 172.21.15.67:0/657139814 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286e308640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f286810fcb0 con 0x7f2868117e00 2024-09-10T20:59:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286e308640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f286810fb30 con 0x7f286810aa70 2024-09-10T20:59:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f28677fe640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f286810aa70 0x7f28681a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286e308640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f286810fe30 con 0x7f286810a150 2024-09-10T20:59:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.352+0000 7f286c8a5640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 0x7f28681a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.353+0000 7f286c8a5640 1 -- 172.21.15.67:0/657139814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 msgr2=0x7f286819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.353+0000 7f286c8a5640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 0x7f286819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.353+0000 7f286c8a5640 1 -- 172.21.15.67:0/657139814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f286810aa70 msgr2=0x7f28681a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.353+0000 7f286c8a5640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f286810aa70 0x7f28681a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.353+0000 7f286c8a5640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28681a57b0 con 0x7f2868117e00 2024-09-10T20:59:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.355+0000 7f286c8a5640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 0x7f28681a4fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fd0 tx=0x7f286000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.360+0000 7f28657fa640 1 -- 172.21.15.67:0/657139814 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286000ce20 con 0x7f2868117e00 2024-09-10T20:59:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.360+0000 7f28657fa640 1 -- 172.21.15.67:0/657139814 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2860005020 con 0x7f2868117e00 2024-09-10T20:59:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.361+0000 7f28657fa640 1 -- 172.21.15.67:0/657139814 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860010690 con 0x7f2868117e00 2024-09-10T20:59:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.361+0000 7f286e308640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28681a5aa0 con 0x7f2868117e00 2024-09-10T20:59:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.361+0000 7f286e308640 1 -- 172.21.15.67:0/657139814 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28681ac160 con 0x7f2868117e00 2024-09-10T20:59:38.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 Processor -- start 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 -- start start 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b64760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48510/0 (socket says 172.21.15.67:48510) 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28677fe640 1 -- 172.21.15.67:0/318331680 learned_addr learned my addr 172.21.15.67:0/318331680 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5628b3abdea0 con 0x5628b3b47d00 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5628b3aad2d0 con 0x5628b3b64ca0 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.365+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5628b3ab10e0 con 0x5628b3b473e0 2024-09-10T20:59:38.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 -- 172.21.15.67:0/318331680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 msgr2=0x5628b3b67090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b67090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 -- 172.21.15.67:0/318331680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 msgr2=0x5628b3b64760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T20:59:38.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b64760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.366+0000 7f28677fe640 1 -- 172.21.15.67:0/318331680 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b380b650 con 0x5628b3b473e0 2024-09-10T20:59:38.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.372+0000 7f28677fe640 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f285c009890 tx=0x7f285c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966b925d87008d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.372+0000 7f28657fa640 1 -- 172.21.15.67:0/657139814 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2860020070 con 0x7f2868117e00 2024-09-10T20:59:38.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.372+0000 7f284dffb640 1 -- 172.21.15.67:0/318331680 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c040040 con 0x5628b3b473e0 2024-09-10T20:59:38.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.373+0000 7f284dffb640 1 -- 172.21.15.67:0/318331680 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f285c03bbe0 con 0x5628b3b473e0 2024-09-10T20:59:38.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.373+0000 7f284dffb640 1 -- 172.21.15.67:0/318331680 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c033870 con 0x5628b3b473e0 2024-09-10T20:59:38.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 msgr2=0x5628b3b477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28657fa640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 0x7f28500b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f285c009890 tx=0x7f285c005f90 comp rx=0 tx=0).stop 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 shutdown_connections 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b67090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b64760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 --2- 172.21.15.67:0/318331680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b477c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28657fa640 1 -- 172.21.15.67:0/657139814 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f28600e6210 con 0x7f2868117e00 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 >> 172.21.15.67:0/318331680 conn(0x5628b3b45210 msgr2=0x5628b3b463b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.374+0000 7f2867fff640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 0x7f28500b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.375+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 shutdown_connections 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.375+0000 7f28706dd740 1 -- 172.21.15.67:0/318331680 wait complete. 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.375+0000 7f2867fff640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 0x7f28500b77c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5628b3b4b620 tx=0x7f285800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.375+0000 7f28706dd740 1 -- start start 2024-09-10T20:59:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.375+0000 7f28706dd740 1 Processor -- start 2024-09-10T20:59:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b47d00 0x5628b3b61840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b64ca0 0x5628b3b61d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5628b390e700 con 0x5628b3b64ca0 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5628b3a48160 con 0x5628b3b47d00 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5628b3b67800 con 0x5628b3b473e0 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28706dd740 10 client.0 _ll_register_callbacks cb 0x5628b3a619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48514/0 (socket says 172.21.15.67:48514) 2024-09-10T20:59:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 -- 172.21.15.67:0/1154854980 learned_addr learned my addr 172.21.15.67:0/1154854980 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f28677fe640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b47d00 0x5628b3b61840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f286c8a5640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b64ca0 0x5628b3b61d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 -- 172.21.15.67:0/1154854980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b47d00 msgr2=0x5628b3b61840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b47d00 0x5628b3b61840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 -- 172.21.15.67:0/1154854980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b64ca0 msgr2=0x5628b3b61d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b64ca0 0x5628b3b61d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.376+0000 7f2867fff640 1 -- 172.21.15.67:0/1154854980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b3a75c90 con 0x5628b3b473e0 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f2867fff640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2858003df0 tx=0x7f2858004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45980bb0ebf2d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858005220 con 0x5628b3b473e0 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f285c03bbe0 con 0x5628b3b473e0 2024-09-10T20:59:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f28580053c0 con 0x5628b3b473e0 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28580055c0 con 0x5628b3b473e0 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28706dd740 10 client.26011 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5628b3b73070 con 0x5628b3b473e0 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f285c03bbe0 con 0x5628b3b473e0 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.377+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f285801e810 con 0x5628b3b473e0 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 10 client.26011 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 10 client.26011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 20 client.26011 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3b74520 0x5628b3b769a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 4 client.26011 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628b3abfdf0 con 0x5628b3b74520 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28677fe640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3b74520 0x5628b3b769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28677fe640 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3b74520 0x5628b3b769a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16614c24c2174a4e server_cookie=9920a2f676d5a75e in_seq=0 out_seq=0 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.378+0000 7f28477fe640 10 client.26011 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.379+0000 7f28477fe640 1 -- 172.21.15.67:0/1154854980 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628b3abfdf0 con 0x5628b3b74520 2024-09-10T20:59:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.379+0000 7f28477fe640 10 client.26011 handle_command_reply: tid=0 2024-09-10T20:59:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.379+0000 7f28706dd740 1 client.26011 shutdown 2024-09-10T20:59:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.379+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 msgr2=0x5628b3b643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.379+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2858003df0 tx=0x7f2858004730 comp rx=0 tx=0).stop 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 shutdown_connections 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3b74520 0x5628b3b769a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b64ca0 0x5628b3b61d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b47d00 0x5628b3b61840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 --2- 172.21.15.67:0/1154854980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b643f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 >> 172.21.15.67:0/1154854980 conn(0x5628b3b45210 msgr2=0x5628b3b442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28477fe640 0 client.26011 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:59:38.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 shutdown_connections 2024-09-10T20:59:38.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 1 -- 172.21.15.67:0/1154854980 wait complete. 2024-09-10T20:59:38.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.380+0000 7f28706dd740 20 client.26011 trim_cache size 0 max 16384 2024-09-10T20:59:38.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.398+0000 7f28706dd740 1 Processor -- start 2024-09-10T20:59:38.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.398+0000 7f28706dd740 1 -- start start 2024-09-10T20:59:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.398+0000 7f28706dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b66ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.398+0000 7f28706dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b66ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45830/0 (socket says 172.21.15.67:45830) 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f2867fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b66ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48526/0 (socket says 172.21.15.67:48526) 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 -- 172.21.15.67:0/1589627555 learned_addr learned my addr 172.21.15.67:0/1589627555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28706dd740 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b46120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b6e90 con 0x5628b3b47d00 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b4760 con 0x5628b3b64ca0 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b25b0 con 0x5628b3b473e0 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f286c8a5640 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b46120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 -- 172.21.15.67:0/1589627555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 msgr2=0x5628b3b66ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b66ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 -- 172.21.15.67:0/1589627555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 msgr2=0x5628b3b46120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b46120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 -- 172.21.15.67:0/1589627555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b3b64020 con 0x5628b3b47d00 2024-09-10T20:59:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.399+0000 7f28677fe640 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f285c00b010 tx=0x7f285c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe59f75f0fcdbbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.400+0000 7f284d7fa640 1 -- 172.21.15.67:0/1589627555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c040040 con 0x5628b3b47d00 2024-09-10T20:59:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.400+0000 7f284d7fa640 1 -- 172.21.15.67:0/1589627555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f285c033a70 con 0x5628b3b47d00 2024-09-10T20:59:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.400+0000 7f284d7fa640 1 -- 172.21.15.67:0/1589627555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c014880 con 0x5628b3b47d00 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 msgr2=0x5628b3b60d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f285c00b010 tx=0x7f285c000bc0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 shutdown_connections 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b46120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b47d00 0x5628b3b60d50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 --2- 172.21.15.67:0/1589627555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b473e0 0x5628b3b66ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 >> 172.21.15.67:0/1589627555 conn(0x5628b3b45210 msgr2=0x5628b3b668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 shutdown_connections 2024-09-10T20:59:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- 172.21.15.67:0/1589627555 wait complete. 2024-09-10T20:59:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.401+0000 7f28706dd740 1 -- start start 2024-09-10T20:59:38.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.402+0000 7f28706dd740 1 Processor -- start 2024-09-10T20:59:38.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.402+0000 7f28706dd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 0x5628b3b6d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.402+0000 7f28706dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 0x5628b3b7c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.402+0000 7f28706dd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f2867fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 0x5628b3b6d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f2867fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 0x5628b3b6d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45840/0 (socket says 172.21.15.67:45840) 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48182/0 (socket says 172.21.15.67:48182) 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 0x5628b3b7c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 0x5628b3b7c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48530/0 (socket says 172.21.15.67:48530) 2024-09-10T20:59:38.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f2867fff640 1 -- 172.21.15.67:0/665343443 learned_addr learned my addr 172.21.15.67:0/665343443 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b2c20 con 0x5628b3b473e0 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b4090 con 0x5628b3b64ca0 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28681b32f0 con 0x5628b3b47d00 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f28706dd740 10 client.0 _ll_register_callbacks cb 0x7f2858004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 -- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 msgr2=0x5628b3b7c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 0x5628b3b7c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 -- 172.21.15.67:0/665343443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 msgr2=0x5628b3b6d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 0x5628b3b6d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.403+0000 7f286c8a5640 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b3be0470 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f286c8a5640 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28600a9c10 tx=0x7f28600a8950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b4ff070ed4a2be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28600d3070 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f28600abe00 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f285c033a70 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f28600ad0a0 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f28706dd740 10 client.26057 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5628b3be1630 con 0x5628b3b64ca0 2024-09-10T20:59:38.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f285c033a70 con 0x5628b3b64ca0 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.404+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f28600ab790 con 0x5628b3b64ca0 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 10 client.26057 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 10 client.26057 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 20 client.26057 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3be1d80 0x5628b3be41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 4 client.26057 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628b3b408d0 con 0x5628b3be1d80 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f2867fff640 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3be1d80 0x5628b3be41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f2846ffd640 10 client.26057 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f2867fff640 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3be1d80 0x5628b3be41a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96ba5dc96fdf9ee6 server_cookie=282498fe54df634 in_seq=0 out_seq=0 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f2846ffd640 1 -- 172.21.15.67:0/665343443 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628b3b408d0 con 0x5628b3be1d80 2024-09-10T20:59:38.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f2846ffd640 10 client.26057 handle_command_reply: tid=0 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.405+0000 7f28706dd740 1 client.26057 shutdown 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 msgr2=0x5628b3b7c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28600a9c10 tx=0x7f28600a8950 comp rx=0 tx=0).stop 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 shutdown_connections 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5628b3be1d80 0x5628b3be41a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5628b3b64ca0 0x5628b3b7c6e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628b3b47d00 0x5628b3b7c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f2846ffd640 0 client.26057 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 --2- 172.21.15.67:0/665343443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5628b3b473e0 0x5628b3b6d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 >> 172.21.15.67:0/665343443 conn(0x5628b3b45210 msgr2=0x5628b3b615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 shutdown_connections 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 1 -- 172.21.15.67:0/665343443 wait complete. 2024-09-10T20:59:38.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.406+0000 7f28706dd740 20 client.26057 trim_cache size 0 max 16384 2024-09-10T20:59:38.422 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:59:38.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 msgr2=0x7f28500b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 0x7f28500b77c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x5628b3b4b620 tx=0x7f285800b480 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 msgr2=0x7f28681a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 0x7f28681a4fe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2860009fd0 tx=0x7f286000ef10 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 shutdown_connections 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2868117e00 0x7f28681a4fe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f286810aa70 0x7f28681a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f28500b5300 0x7f28500b77c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 --2- 172.21.15.67:0/657139814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f286810a150 0x7f286819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 >> 172.21.15.67:0/657139814 conn(0x7f286806dfc0 msgr2=0x7f28681181e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 shutdown_connections 2024-09-10T20:59:38.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:38.407+0000 7f284effd640 1 -- 172.21.15.67:0/657139814 wait complete. 2024-09-10T20:59:38.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:38 smithi067 ceph-mon[30891]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 688 op/s 2024-09-10T20:59:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:38 smithi083 ceph-mon[35058]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 688 op/s 2024-09-10T20:59:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:38 smithi172 ceph-mon[35265]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.3 MiB/s wr, 688 op/s 2024-09-10T20:59:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 485.0 s, 1977.0 tps, lat 50.998 ms stddev 60.759 2024-09-10T20:59:39.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T20:59:39.524 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 -- 172.21.15.67:0/3441281979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 msgr2=0x7fe8a8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 --2- 172.21.15.67:0/3441281979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 0x7fe8a8102070 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe89800b9f0 tx=0x7fe89802c0a0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 -- 172.21.15.67:0/3441281979 shutdown_connections 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 --2- 172.21.15.67:0/3441281979 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 --2- 172.21.15.67:0/3441281979 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8a81076a0 0x7fe8a8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 --2- 172.21.15.67:0/3441281979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 0x7fe8a8102070 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.103+0000 7fe8ae437640 1 -- 172.21.15.67:0/3441281979 >> 172.21.15.67:0/3441281979 conn(0x7fe8a80fd700 msgr2=0x7fe8a80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.104+0000 7fe8ae437640 1 -- 172.21.15.67:0/3441281979 shutdown_connections 2024-09-10T20:59:40.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.104+0000 7fe8ae437640 1 -- 172.21.15.67:0/3441281979 wait complete. 2024-09-10T20:59:40.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.104+0000 7fe8ae437640 1 Processor -- start 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.104+0000 7fe8ae437640 1 -- start start 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 0x7fe8a8197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8a81076a0 0x7fe8a8197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110be0 con 0x7fe8a8108020 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110a60 con 0x7fe8a81076a0 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ae437640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8110d60 con 0x7fe8a8101c90 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ac9d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ac9d4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45856/0 (socket says 172.21.15.67:45856) 2024-09-10T20:59:40.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.105+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1253779857 learned_addr learned my addr 172.21.15.67:0/1253779857 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.106+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1253779857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 msgr2=0x7fe8a8197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.106+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 0x7fe8a8197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.106+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1253779857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8a81076a0 msgr2=0x7fe8a8197650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.106+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8a81076a0 0x7fe8a8197650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.106+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1253779857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a819d1c0 con 0x7fe8a8108020 2024-09-10T20:59:40.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.107+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000eb10 tx=0x7fe8a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.108+0000 7fe8a57fa640 1 -- 172.21.15.67:0/1253779857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0004b20 con 0x7fe8a8108020 2024-09-10T20:59:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.108+0000 7fe8a57fa640 1 -- 172.21.15.67:0/1253779857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a0004cc0 con 0x7fe8a8108020 2024-09-10T20:59:40.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.108+0000 7fe8a57fa640 1 -- 172.21.15.67:0/1253779857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0010720 con 0x7fe8a8108020 2024-09-10T20:59:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.109+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a819d4b0 con 0x7fe8a8108020 2024-09-10T20:59:40.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.109+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a81a3b70 con 0x7fe8a8108020 2024-09-10T20:59:40.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.112+0000 7fe8a57fa640 1 -- 172.21.15.67:0/1253779857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe8a0005020 con 0x7fe8a8108020 2024-09-10T20:59:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 Processor -- start 2024-09-10T20:59:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 -- start start 2024-09-10T20:59:40.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8a57fa640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 0x7fe8900b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef4c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef5ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55807eec2ea0 con 0x55807ef589a0 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55807eeb22d0 con 0x55807ef4ca10 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.113+0000 7fe8b080c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55807eeb60e0 con 0x55807ef4c0f0 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48214/0 (socket says 172.21.15.67:48214) 2024-09-10T20:59:40.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3274789575 learned_addr learned my addr 172.21.15.67:0/3274789575 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 0x7fe8900b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef5ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a57fa640 1 -- 172.21.15.67:0/1253779857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe8a00e61f0 con 0x7fe8a8108020 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef4c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3274789575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 msgr2=0x55807ef4c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef4c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3274789575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 msgr2=0x55807ef5ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef5ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3274789575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807ec10650 con 0x55807ef4ca10 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef4c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013a60 tx=0x7fe89c013f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c45d1a5e676eaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 0x7fe8900b78f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe89c010860 tx=0x7fe89c00b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe88e7fc640 1 -- 172.21.15.67:0/3274789575 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c024020 con 0x55807ef4ca10 2024-09-10T20:59:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe88e7fc640 1 -- 172.21.15.67:0/3274789575 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89c0098a0 con 0x55807ef4ca10 2024-09-10T20:59:40.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.114+0000 7fe88e7fc640 1 -- 172.21.15.67:0/3274789575 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00ec60 con 0x55807ef4ca10 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 -- 172.21.15.67:0/3274789575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 msgr2=0x55807ef58460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013a60 tx=0x7fe89c013f20 comp rx=0 tx=0).stop 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 -- 172.21.15.67:0/3274789575 shutdown_connections 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef5ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef58460 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3274789575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef4c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 -- 172.21.15.67:0/3274789575 >> 172.21.15.67:0/3274789575 conn(0x55807ef49f20 msgr2=0x55807ef4b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 -- 172.21.15.67:0/3274789575 shutdown_connections 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.115+0000 7fe8b080c740 1 -- 172.21.15.67:0/3274789575 wait complete. 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.116+0000 7fe8b080c740 1 -- start start 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.116+0000 7fe8b080c740 1 Processor -- start 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.117+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef58450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.117+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.117+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 0x55807ef52070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.117+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef58450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.117+0000 7fe8b080c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55807ed13700 con 0x55807ef4ca10 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8b080c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55807ee4d160 con 0x55807ef589a0 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8a7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef58450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48548/0 (socket says 172.21.15.67:48548) 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8a7fff640 1 -- 172.21.15.67:0/1394948844 learned_addr learned my addr 172.21.15.67:0/1394948844 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 0x55807ef52070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55807ef5b4b0 con 0x55807ef4c0f0 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8b080c740 10 client.0 _ll_register_callbacks cb 0x55807ee669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1394948844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 msgr2=0x55807ef58450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef58450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1394948844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 msgr2=0x55807ef518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8ac9d4640 1 -- 172.21.15.67:0/1394948844 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807ee7ac90 con 0x55807ef589a0 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.118+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.119+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 0x55807ef52070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000efd0 tx=0x7fe8a0005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ade913228a53a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.119+0000 7fe8877fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.119+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00508e0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.119+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe8a00b11e0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.119+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe89c0098a0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.120+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe8a00a80f0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.120+0000 7fe8b080c740 10 client.26066 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.120+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55807ef6f7c0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.120+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89c0098a0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe8a00abbe0 con 0x55807ef589a0 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 10 client.26066 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:40.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 10 client.26066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 20 client.26066 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807ef70bd0 0x55807ef72fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 4 client.26066 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807eec4df0 con 0x55807ef70bd0 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807ef70bd0 0x55807ef72fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.121+0000 7fe8877fe640 10 client.26066 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:40.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.122+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807ef70bd0 0x55807ef72fc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02553fe64c8f979 server_cookie=64cc1b71950ec03 in_seq=0 out_seq=0 2024-09-10T20:59:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.123+0000 7fe8877fe640 1 -- 172.21.15.67:0/1394948844 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55807eec4df0 con 0x55807ef70bd0 2024-09-10T20:59:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.123+0000 7fe8877fe640 10 client.26066 handle_command_reply: tid=0 2024-09-10T20:59:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.123+0000 7fe8b080c740 1 client.26066 shutdown 2024-09-10T20:59:40.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.123+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 msgr2=0x55807ef52070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.123+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 0x55807ef52070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000efd0 tx=0x7fe8a0005700 comp rx=0 tx=0).stop 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 shutdown_connections 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807ef70bd0 0x55807ef72fc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8877fe640 0 client.26066 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef589a0 0x55807ef52070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 --2- 172.21.15.67:0/1394948844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef58450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 >> 172.21.15.67:0/1394948844 conn(0x55807ef49f20 msgr2=0x55807ef4fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 shutdown_connections 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 1 -- 172.21.15.67:0/1394948844 wait complete. 2024-09-10T20:59:40.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.124+0000 7fe8b080c740 20 client.26066 trim_cache size 0 max 16384 2024-09-10T20:59:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 Processor -- start 2024-09-10T20:59:40.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 -- start start 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4c0f0 0x55807ef59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef589a0 0x55807ef5dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81aeaa0 con 0x55807ef4ca10 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81ac370 con 0x55807ef4c0f0 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8b080c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81aa1c0 con 0x55807ef589a0 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45878/0 (socket says 172.21.15.67:45878) 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8a77fe640 1 -- 172.21.15.67:0/4045095831 learned_addr learned my addr 172.21.15.67:0/4045095831 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef589a0 0x55807ef5dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.146+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4c0f0 0x55807ef59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.147+0000 7fe8a77fe640 1 -- 172.21.15.67:0/4045095831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef589a0 msgr2=0x55807ef5dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.147+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef589a0 0x55807ef5dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.147+0000 7fe8a77fe640 1 -- 172.21.15.67:0/4045095831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4c0f0 msgr2=0x55807ef59fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.147+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4c0f0 0x55807ef59fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.147+0000 7fe8a77fe640 1 -- 172.21.15.67:0/4045095831 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807ef4a9a0 con 0x55807ef4ca10 2024-09-10T20:59:40.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.148+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55807ef4ae00 tx=0x7fe89c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12b5c81e6e30d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.148+0000 7fe88dffb640 1 -- 172.21.15.67:0/4045095831 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c02e070 con 0x55807ef4ca10 2024-09-10T20:59:40.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.148+0000 7fe88dffb640 1 -- 172.21.15.67:0/4045095831 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89c0098a0 con 0x55807ef4ca10 2024-09-10T20:59:40.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.148+0000 7fe88dffb640 1 -- 172.21.15.67:0/4045095831 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c024040 con 0x55807ef4ca10 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 -- 172.21.15.67:0/4045095831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 msgr2=0x55807ef5a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55807ef4ae00 tx=0x7fe89c005850 comp rx=0 tx=0).stop 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 -- 172.21.15.67:0/4045095831 shutdown_connections 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef589a0 0x55807ef5dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef4ca10 0x55807ef5a4e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 --2- 172.21.15.67:0/4045095831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4c0f0 0x55807ef59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.149+0000 7fe8b080c740 1 -- 172.21.15.67:0/4045095831 >> 172.21.15.67:0/4045095831 conn(0x55807ef49f20 msgr2=0x55807ef5bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.150+0000 7fe8b080c740 1 -- 172.21.15.67:0/4045095831 shutdown_connections 2024-09-10T20:59:40.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.150+0000 7fe8b080c740 1 -- 172.21.15.67:0/4045095831 wait complete. 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.150+0000 7fe8b080c740 1 -- start start 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.150+0000 7fe8b080c740 1 Processor -- start 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef6d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef6a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81aa830 con 0x55807ef589a0 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81abca0 con 0x55807ef4ca10 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a81aaf00 con 0x55807ef4c0f0 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8b080c740 10 client.0 _ll_register_callbacks cb 0x7fe8a00a8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:40.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48242/0 (socket says 172.21.15.67:48242) 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3904735145 learned_addr learned my addr 172.21.15.67:0/3904735145 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8ac9d4640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef6a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef6d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3904735145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 msgr2=0x55807ef6d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef6d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3904735145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 msgr2=0x55807ef6a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef6a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.151+0000 7fe8a77fe640 1 -- 172.21.15.67:0/3904735145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807ef6adc0 con 0x55807ef4ca10 2024-09-10T20:59:40.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.152+0000 7fe8a77fe640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013f60 tx=0x7fe89c005360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a713527f322ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.152+0000 7fe8877fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.152+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c037020 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe89c00ec90 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe89c0098a0 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe89c02e040 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 10 client.26072 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55807efdeb20 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe89c0134e0 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe89c01c070 con 0x55807ef4ca10 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 10 client.26072 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:40.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 10 client.26072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 20 client.26072 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.153+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807efdf020 0x55807efe1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8b080c740 4 client.26072 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe89c0098a0 con 0x55807efdf020 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807efdf020 0x55807efe1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8a7fff640 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807efdf020 0x55807efe1440 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614923b10c699033 server_cookie=e6ef44fbb17a6237 in_seq=0 out_seq=0 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8877fe640 10 client.26072 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8877fe640 1 -- 172.21.15.67:0/3904735145 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe89c0098a0 con 0x55807efdf020 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8877fe640 10 client.26072 handle_command_reply: tid=0 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.154+0000 7fe8b080c740 1 client.26072 shutdown 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 msgr2=0x55807ef6a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe89c013f60 tx=0x7fe89c005360 comp rx=0 tx=0).stop 2024-09-10T20:59:40.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 shutdown_connections 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55807efdf020 0x55807efe1440 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55807ef589a0 0x55807ef6a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8877fe640 0 client.26072 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55807ef4ca10 0x55807ef6a010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 --2- 172.21.15.67:0/3904735145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55807ef4c0f0 0x55807ef6d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 >> 172.21.15.67:0/3904735145 conn(0x55807ef49f20 msgr2=0x55807ef59fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 shutdown_connections 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 1 -- 172.21.15.67:0/3904735145 wait complete. 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.155+0000 7fe8b080c740 20 client.26072 trim_cache size 0 max 16384 2024-09-10T20:59:40.162 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 msgr2=0x7fe8900b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 0x7fe8900b78f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe89c010860 tx=0x7fe89c00b000 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 msgr2=0x7fe8a819c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000eb10 tx=0x7fe8a000c2d0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 shutdown_connections 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8a8108020 0x7fe8a819c9f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8a81076a0 0x7fe8a8197650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe8900b5430 0x7fe8900b78f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 --2- 172.21.15.67:0/1253779857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a8101c90 0x7fe8a8197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 >> 172.21.15.67:0/1253779857 conn(0x7fe8a80fd700 msgr2=0x7fe8a80ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 shutdown_connections 2024-09-10T20:59:40.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:40.156+0000 7fe8ae437640 1 -- 172.21.15.67:0/1253779857 wait complete. 2024-09-10T20:59:40.557 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:40 smithi067 ceph-mon[30891]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 622 op/s 2024-09-10T20:59:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:40 smithi083 ceph-mon[35058]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 622 op/s 2024-09-10T20:59:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:40 smithi172 ceph-mon[35265]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 622 op/s 2024-09-10T20:59:41.905 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T20:59:41.905 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T20:59:42.316 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:42.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:42 smithi067 ceph-mon[30891]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-09-10T20:59:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:59:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:59:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:59:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:59:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:42 smithi083 ceph-mon[35058]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-09-10T20:59:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:59:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:59:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:59:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:59:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:42 smithi172 ceph-mon[35265]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-09-10T20:59:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T20:59:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T20:59:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T20:59:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T20:59:43.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/2377121357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 msgr2=0x7f0a5410f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/2377121357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5410f590 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009ca0 tx=0x7f0a4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/2377121357 shutdown_connections 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/2377121357 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5410f590 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/2377121357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/2377121357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a541040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/2377121357 >> 172.21.15.67:0/2377121357 conn(0x7f0a540fd770 msgr2=0x7f0a540ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/2377121357 shutdown_connections 2024-09-10T20:59:43.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.310+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/2377121357 wait complete. 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 Processor -- start 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 -- start start 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a5410be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112df0 con 0x7f0a5410d130 2024-09-10T20:59:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112c70 con 0x7f0a54103cd0 2024-09-10T20:59:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.311+0000 7f0a5b5f6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112f70 con 0x7f0a541045f0 2024-09-10T20:59:43.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:45572/0 (socket says 172.21.15.67:45572) 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 -- 172.21.15.67:0/3309317527 learned_addr learned my addr 172.21.15.67:0/3309317527 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a59b93640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a59392640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a5410be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 -- 172.21.15.67:0/3309317527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 msgr2=0x7f0a5410be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a5410be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 -- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 msgr2=0x7f0a5419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 -- 172.21.15.67:0/3309317527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a541a02b0 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a59392640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a5410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.312+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e9c0 tx=0x7f0a4400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.313+0000 7f0a4a7fc640 1 -- 172.21.15.67:0/3309317527 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400ccc0 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.313+0000 7f0a4a7fc640 1 -- 172.21.15.67:0/3309317527 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a440035f0 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.313+0000 7f0a4a7fc640 1 -- 172.21.15.67:0/3309317527 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400ce60 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.314+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a541a05a0 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.314+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5419c9b0 con 0x7f0a541045f0 2024-09-10T20:59:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.317+0000 7f0a4a7fc640 1 -- 172.21.15.67:0/3309317527 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0a44020070 con 0x7f0a541045f0 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.317+0000 7f0a4a7fc640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 0x7f0a400b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a59392640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 0x7f0a400b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a4a7fc640 1 -- 172.21.15.67:0/3309317527 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0a440e5e40 con 0x7f0a541045f0 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 Processor -- start 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 -- start start 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x555765660e60 con 0x5557656f6790 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x555765650290 con 0x5557656ea800 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.318+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5557656540a0 con 0x5557656e9ee0 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a59b93640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55672/0 (socket says 172.21.15.67:55672) 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 -- 172.21.15.67:0/2345114733 learned_addr learned my addr 172.21.15.67:0/2345114733 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 -- 172.21.15.67:0/2345114733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 msgr2=0x5557656ea2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656ea2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 -- 172.21.15.67:0/2345114733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 msgr2=0x5557656f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 -- 172.21.15.67:0/2345114733 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557653ae930 con 0x5557656ea800 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a58b91640 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ac330 tx=0x7f0a440ac040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc7ebec658468e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a3f7fe640 1 -- 172.21.15.67:0/2345114733 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440ac630 con 0x5557656ea800 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a59392640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 0x7f0a400b78f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c70 tx=0x7f0a50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a3f7fe640 1 -- 172.21.15.67:0/2345114733 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a440b1110 con 0x5557656ea800 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.319+0000 7f0a3f7fe640 1 -- 172.21.15.67:0/2345114733 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a81c0 con 0x5557656ea800 2024-09-10T20:59:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.320+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/2345114733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 msgr2=0x5557656f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.320+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ac330 tx=0x7f0a440ac040 comp rx=0 tx=0).stop 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/2345114733 shutdown_connections 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656f6250 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/2345114733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/2345114733 >> 172.21.15.67:0/2345114733 conn(0x5557656e7d10 msgr2=0x5557656e8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/2345114733 shutdown_connections 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/2345114733 wait complete. 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 -- start start 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.321+0000 7f0a5d9cb740 1 Processor -- start 2024-09-10T20:59:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5557654b1890 con 0x5557656f6790 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5557655ead40 con 0x5557656e9ee0 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5557656f9440 con 0x5557656ea800 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a5d9cb740 10 client.0 _ll_register_callbacks cb 0x55576564ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55680/0 (socket says 172.21.15.67:55680) 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 -- 172.21.15.67:0/3939150335 learned_addr learned my addr 172.21.15.67:0/3939150335 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 -- 172.21.15.67:0/3939150335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 msgr2=0x5557656f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 -- 172.21.15.67:0/3939150335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 msgr2=0x5557656f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.322+0000 7f0a59392640 1 -- 172.21.15.67:0/3939150335 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557657028f0 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a59392640 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a50004570 tx=0x7f0a50004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abd19cabedd153b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50012920 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a440b1110 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0a50012ac0 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a50012cc0 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a5d9cb740 10 client.26084 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555765705300 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.323+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a440b1110 con 0x5557656e9ee0 2024-09-10T20:59:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a50020430 con 0x5557656e9ee0 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 10 client.26084 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 10 client.26084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 20 client.26084 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765708d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 4 client.26084 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555765662db0 con 0x5557657068b0 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765708d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a3cff9640 10 client.26084 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.324+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765708d40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123e2c3116962d87 server_cookie=40e90d82054ac40 in_seq=0 out_seq=0 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a3cff9640 1 -- 172.21.15.67:0/3939150335 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555765662db0 con 0x5557657068b0 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a3cff9640 10 client.26084 handle_command_reply: tid=0 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 client.26084 shutdown 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 msgr2=0x5557656f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a50004570 tx=0x7f0a50004730 comp rx=0 tx=0).stop 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 shutdown_connections 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765708d40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x5557656f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a3cff9640 0 client.26084 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:43.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3939150335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656e9ee0 0x5557656f3820 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 >> 172.21.15.67:0/3939150335 conn(0x5557656e7d10 msgr2=0x5557656e6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.325+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 shutdown_connections 2024-09-10T20:59:43.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.326+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3939150335 wait complete. 2024-09-10T20:59:43.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.326+0000 7f0a5d9cb740 20 client.26084 trim_cache size 0 max 16384 2024-09-10T20:59:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 Processor -- start 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 -- start start 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 0x5557656f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bf9e0 con 0x5557656e9ee0 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bd2b0 con 0x5557656f6790 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bb100 con 0x5557656ea800 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a59392640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 0x5557656f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a59b93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a59392640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 0x5557656f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37946/0 (socket says 172.21.15.67:37946) 2024-09-10T20:59:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a59392640 1 -- 172.21.15.67:0/3689952956 learned_addr learned my addr 172.21.15.67:0/3689952956 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.348+0000 7f0a59b93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55688/0 (socket says 172.21.15.67:55688) 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 -- 172.21.15.67:0/3689952956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 msgr2=0x5557656f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 -- 172.21.15.67:0/3689952956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 msgr2=0x5557656f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 0x5557656f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 -- 172.21.15.67:0/3689952956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557656e8790 con 0x5557656ea800 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a59b93640 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a58b91640 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ac330 tx=0x7f0a440ac0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95c416a2a26e18d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a3effd640 1 -- 172.21.15.67:0/3689952956 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a8c80 con 0x5557656ea800 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a3effd640 1 -- 172.21.15.67:0/3689952956 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a440b1110 con 0x5557656ea800 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.349+0000 7f0a3effd640 1 -- 172.21.15.67:0/3689952956 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a81e0 con 0x5557656ea800 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3689952956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 msgr2=0x5557656f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3ea0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ac330 tx=0x7f0a440ac0b0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3689952956 shutdown_connections 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656f6790 0x5557656f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656ea800 0x5557656f3ea0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/3689952956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656e9ee0 0x5557656f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3689952956 >> 172.21.15.67:0/3689952956 conn(0x5557656e7d10 msgr2=0x5557656f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3689952956 shutdown_connections 2024-09-10T20:59:43.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/3689952956 wait complete. 2024-09-10T20:59:43.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 -- start start 2024-09-10T20:59:43.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.350+0000 7f0a5d9cb740 1 Processor -- start 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x555765772850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bb770 con 0x5557656f6790 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bcbe0 con 0x5557656ea800 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541bbe40 con 0x5557656e9ee0 2024-09-10T20:59:43.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55694/0 (socket says 172.21.15.67:55694) 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 -- 172.21.15.67:0/1913916286 learned_addr learned my addr 172.21.15.67:0/1913916286 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a59392640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a5d9cb740 10 client.0 _ll_register_callbacks cb 0x7f0a50009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 -- 172.21.15.67:0/1913916286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 msgr2=0x5557656fad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656fad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 -- 172.21.15.67:0/1913916286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 msgr2=0x555765772850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x555765772850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.351+0000 7f0a58b91640 1 -- 172.21.15.67:0/1913916286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555765772dc0 con 0x5557656ea800 2024-09-10T20:59:43.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a440b1110 con 0x5557656ea800 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a58b91640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0a4401f000 tx=0x7f0a440a8a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a2ecf55e604ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a3cff9640 10 client.26090 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a3cff9640 1 -- 172.21.15.67:0/1913916286 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a440b9070 con 0x5557656ea800 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a3cff9640 1 -- 172.21.15.67:0/1913916286 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0a440aba90 con 0x5557656ea800 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.352+0000 7f0a3cff9640 1 -- 172.21.15.67:0/1913916286 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a440ac630 con 0x5557656ea800 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.353+0000 7f0a5d9cb740 10 client.26090 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.353+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x555765773f50 con 0x5557656ea800 2024-09-10T20:59:43.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a3cff9640 1 -- 172.21.15.67:0/1913916286 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a440a7f80 con 0x5557656ea800 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 10 client.26090 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 10 client.26090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 20 client.26090 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765775f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 4 client.26090 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55576565e860 con 0x5557657068b0 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.354+0000 7f0a59392640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765775f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.355+0000 7f0a3cff9640 10 client.26090 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.355+0000 7f0a59392640 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765775f60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3325c2d39b9d4366 server_cookie=768a21c4f33753c8 in_seq=0 out_seq=0 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a3cff9640 1 -- 172.21.15.67:0/1913916286 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55576565e860 con 0x5557657068b0 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a3cff9640 10 client.26090 handle_command_reply: tid=0 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 client.26090 shutdown 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 msgr2=0x5557656fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0a4401f000 tx=0x7f0a440a8a30 comp rx=0 tx=0).stop 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 shutdown_connections 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5557657068b0 0x555765775f60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5557656f6790 0x555765772850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557656ea800 0x5557656fb270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 --2- 172.21.15.67:0/1913916286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5557656e9ee0 0x5557656fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 >> 172.21.15.67:0/1913916286 conn(0x5557656e7d10 msgr2=0x5557656e6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.356+0000 7f0a3cff9640 0 client.26090 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 shutdown_connections 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5d9cb740 1 -- 172.21.15.67:0/1913916286 wait complete. 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5d9cb740 20 client.26090 trim_cache size 0 max 16384 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T20:59:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1", 2024-09-10T20:59:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T20:59:43.365 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:59:43.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 msgr2=0x7f0a400b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 0x7f0a400b78f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c70 tx=0x7f0a50005f90 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 msgr2=0x7f0a5410c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e9c0 tx=0x7f0a4400ee80 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 shutdown_connections 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0a5410d130 0x7f0a5419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0a400b5430 0x7f0a400b78f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a541045f0 0x7f0a5410c390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 --2- 172.21.15.67:0/3309317527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a54103cd0 0x7f0a5410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.357+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 >> 172.21.15.67:0/3309317527 conn(0x7f0a540fd770 msgr2=0x7f0a5410f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.358+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 shutdown_connections 2024-09-10T20:59:43.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:43.358+0000 7f0a5b5f6640 1 -- 172.21.15.67:0/3309317527 wait complete. 2024-09-10T20:59:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 490.0 s, 1752.2 tps, lat 55.581 ms stddev 62.539 2024-09-10T20:59:44.060 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T20:59:44.435 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:59:44.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T20:59:44.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:44 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-10T20:59:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T20:59:44.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:44 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.4 MiB/s wr, 726 op/s 2024-09-10T20:59:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T20:59:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:59:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:59:44.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:44.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T20:59:44.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:44 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:45.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 -- 172.21.15.67:0/171611114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076a0 msgr2=0x7fe9e0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/171611114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076a0 0x7fe9e0107ae0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009900 tx=0x7fe9cc02a410 comp rx=0 tx=0).stop 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 -- 172.21.15.67:0/171611114 shutdown_connections 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/171611114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0108020 0x7fe9e010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/171611114 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e01076a0 0x7fe9e0107ae0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/171611114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e0101c90 0x7fe9e0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 -- 172.21.15.67:0/171611114 >> 172.21.15.67:0/171611114 conn(0x7fe9e00fd700 msgr2=0x7fe9e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 -- 172.21.15.67:0/171611114 shutdown_connections 2024-09-10T20:59:45.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.018+0000 7fe9e6d06640 1 -- 172.21.15.67:0/171611114 wait complete. 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 Processor -- start 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 -- start start 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 0x7fe9e019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e0108020 0x7fe9e019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111cf0 con 0x7fe9e0108020 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111b70 con 0x7fe9e01076a0 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.019+0000 7fe9e6d06640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0111e70 con 0x7fe9e0101c90 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9e4aa2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 0x7fe9e019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9e4aa2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 0x7fe9e019a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:45630/0 (socket says 172.21.15.67:45630) 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55720/0 (socket says 172.21.15.67:55720) 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/2713022156 learned_addr learned my addr 172.21.15.67:0/2713022156 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9e52a3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e0108020 0x7fe9e019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 -- 172.21.15.67:0/2713022156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 msgr2=0x7fe9e019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 0x7fe9e019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 -- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e0108020 msgr2=0x7fe9e019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e0108020 0x7fe9e019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 -- 172.21.15.67:0/2713022156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e01a54a0 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.020+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc02aa00 tx=0x7fe9cc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.021+0000 7fe9ddffb640 1 -- 172.21.15.67:0/2713022156 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc03f070 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.021+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e01a5730 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.021+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e01a5c30 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.021+0000 7fe9ddffb640 1 -- 172.21.15.67:0/2713022156 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc031b50 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.021+0000 7fe9ddffb640 1 -- 172.21.15.67:0/2713022156 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc049060 con 0x7fe9e01076a0 2024-09-10T20:59:45.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.023+0000 7fe9ddffb640 1 -- 172.21.15.67:0/2713022156 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe9cc04c060 con 0x7fe9e01076a0 2024-09-10T20:59:45.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.023+0000 7fe9e90db740 1 Processor -- start 2024-09-10T20:59:45.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 -- start start 2024-09-10T20:59:45.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93250da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c932677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556c931c6e50 con 0x556c9325a7e0 2024-09-10T20:59:45.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556c931b6280 con 0x556c93250480 2024-09-10T20:59:45.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e90db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556c931ba090 con 0x556c932653e0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9ddffb640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 0x7fe9d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e52a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e52a3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55730/0 (socket says 172.21.15.67:55730) 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e52a3640 1 -- 172.21.15.67:0/925989413 learned_addr learned my addr 172.21.15.67:0/925989413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93250da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 0x7fe9d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9dffff640 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c932677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.024+0000 7fe9ddffb640 1 -- 172.21.15.67:0/2713022156 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9cc105eb0 con 0x7fe9e01076a0 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 -- 172.21.15.67:0/925989413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 msgr2=0x556c932677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c932677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 -- 172.21.15.67:0/925989413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 msgr2=0x556c93250da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93250da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 -- 172.21.15.67:0/925989413 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c92f14650 con 0x556c93250480 2024-09-10T20:59:45.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8012ca0 tx=0x7fe9d8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff62c6215df44248 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 0x7fe9d00b77a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8010c40 tx=0x7fe9d8017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9caffd640 1 -- 172.21.15.67:0/925989413 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8023070 con 0x556c93250480 2024-09-10T20:59:45.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9caffd640 1 -- 172.21.15.67:0/925989413 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d8009c30 con 0x556c93250480 2024-09-10T20:59:45.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.025+0000 7fe9caffd640 1 -- 172.21.15.67:0/925989413 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8005020 con 0x556c93250480 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- 172.21.15.67:0/925989413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 msgr2=0x556c93250860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8012ca0 tx=0x7fe9d8010740 comp rx=0 tx=0).stop 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- 172.21.15.67:0/925989413 shutdown_connections 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c932677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93250da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 --2- 172.21.15.67:0/925989413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c93250860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- 172.21.15.67:0/925989413 >> 172.21.15.67:0/925989413 conn(0x556c9324e2b0 msgr2=0x556c9324f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- 172.21.15.67:0/925989413 shutdown_connections 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- 172.21.15.67:0/925989413 wait complete. 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.026+0000 7fe9e90db740 1 -- start start 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 Processor -- start 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c9325a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c93257b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556c93017700 con 0x556c9325a7e0 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556c93151110 con 0x556c93250480 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556c93268170 con 0x556c932653e0 2024-09-10T20:59:45.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e90db740 10 client.0 _ll_register_callbacks cb 0x556c9316a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37990/0 (socket says 172.21.15.67:37990) 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 -- 172.21.15.67:0/2631575340 learned_addr learned my addr 172.21.15.67:0/2631575340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c9325a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c93257b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 -- 172.21.15.67:0/2631575340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 msgr2=0x556c93257b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c93257b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 -- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 msgr2=0x556c9325a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c9325a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9dffff640 1 -- 172.21.15.67:0/2631575340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9317ec40 con 0x556c9325a7e0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.027+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c9325a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0c9910 tx=0x7fe9cc0c8e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95782833b1842c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0ccb00 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9cc0d57a0 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d8009c30 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe9cc07c1a0 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9e90db740 10 client.16392 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556c93273b00 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.028+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9cc0cc1b0 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe9cc0cb900 con 0x556c9325a7e0 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 10 client.16392 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 20 client.16392 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c93274ef0 0x556c932772e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 4 client.16392 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe9d8009c30 con 0x556c93274ef0 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.029+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c93274ef0 0x556c932772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.030+0000 7fe9bffff640 10 client.16392 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.030+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c93274ef0 0x556c932772e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf89912f63354a3 server_cookie=d8f6defa0b79d14e in_seq=0 out_seq=0 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9bffff640 1 -- 172.21.15.67:0/2631575340 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe9d8009c30 con 0x556c93274ef0 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9bffff640 10 client.16392 handle_command_reply: tid=0 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 client.16392 shutdown 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 msgr2=0x556c93257550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0c9910 tx=0x7fe9cc0c8e20 comp rx=0 tx=0).stop 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 shutdown_connections 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c93274ef0 0x556c932772e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9bffff640 0 client.16392 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c932653e0 0x556c93257b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c93257550 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2631575340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c93250480 0x556c9325a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.031+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 >> 172.21.15.67:0/2631575340 conn(0x556c9324e2b0 msgr2=0x556c932535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.032+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 shutdown_connections 2024-09-10T20:59:45.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.032+0000 7fe9e90db740 1 -- 172.21.15.67:0/2631575340 wait complete. 2024-09-10T20:59:45.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.032+0000 7fe9e90db740 20 client.16392 trim_cache size 0 max 16384 2024-09-10T20:59:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 Processor -- start 2024-09-10T20:59:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 -- start start 2024-09-10T20:59:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 0x556c932713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c932535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c932653e0 0x556c93253b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aea40 con 0x556c9325a7e0 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01ac310 con 0x556c932653e0 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e90db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aa160 con 0x556c93250480 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c932535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c932535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37996/0 (socket says 172.21.15.67:37996) 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9dffff640 1 -- 172.21.15.67:0/225809821 learned_addr learned my addr 172.21.15.67:0/225809821 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.059+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 0x556c932713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c932653e0 0x556c93253b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/225809821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c932653e0 msgr2=0x556c93253b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c932653e0 0x556c93253b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/225809821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 msgr2=0x556c932535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c932535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/225809821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c93254040 con 0x556c93250480 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 0x556c932713d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x556c93258380 tx=0x7fe9d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbdd756c211d44c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9ca7fc640 1 -- 172.21.15.67:0/225809821 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4025640 con 0x556c93250480 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9ca7fc640 1 -- 172.21.15.67:0/225809821 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d4004490 con 0x556c93250480 2024-09-10T20:59:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.060+0000 7fe9ca7fc640 1 -- 172.21.15.67:0/225809821 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4010a50 con 0x556c93250480 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 -- 172.21.15.67:0/225809821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 msgr2=0x556c932713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 0x556c932713d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x556c93258380 tx=0x7fe9d40046c0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 -- 172.21.15.67:0/225809821 shutdown_connections 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c932653e0 0x556c93253b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c9325a7e0 0x556c932535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 --2- 172.21.15.67:0/225809821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c93250480 0x556c932713d0 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x556c93258380 tx=0x7fe9d40046c0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.061+0000 7fe9e90db740 1 -- 172.21.15.67:0/225809821 >> 172.21.15.67:0/225809821 conn(0x556c9324e2b0 msgr2=0x556c93255df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.063+0000 7fe9e90db740 1 -- 172.21.15.67:0/225809821 shutdown_connections 2024-09-10T20:59:45.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.063+0000 7fe9e90db740 1 -- 172.21.15.67:0/225809821 wait complete. 2024-09-10T20:59:45.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 -- start start 2024-09-10T20:59:45.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 Processor -- start 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 0x556c9326ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 0x556c932e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aa7d0 con 0x556c932653e0 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01abc40 con 0x556c9326b3c0 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e01aaea0 con 0x556c9325a7e0 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e90db740 10 client.0 _ll_register_callbacks cb 0x7fe9cc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:59:45.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 0x556c9326ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e4aa2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e4aa2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:45678/0 (socket says 172.21.15.67:45678) 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 0x556c9326ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38012/0 (socket says 172.21.15.67:38012) 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.064+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/2185871751 learned_addr learned my addr 172.21.15.67:0/2185871751 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 0x556c932e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 msgr2=0x556c932e1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 0x556c932e1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/2185871751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 msgr2=0x556c9326ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 0x556c9326ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 -- 172.21.15.67:0/2185871751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c932e25f0 con 0x556c9325a7e0 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e52a3640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 0x556c932e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e4aa2640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009e50 tx=0x7fe9d40040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4706ede393bd7db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:59:45.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9bffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4033060 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9d4026960 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d4004490 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.065+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe9d402a070 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 10 client.26062 fetch_fsmap learned FSMap version 34 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556c932e3900 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d4004490 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d4023020 con 0x556c9325a7e0 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 10 client.26062 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 10 client.26062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 20 client.26062 populate_metadata read hostname 'smithi067' 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c932e3f00 0x556c932e6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 4 client.26062 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T20:59:45.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c931c8da0 con 0x556c932e3f00 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.066+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c932e3f00 0x556c932e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9bffff640 10 client.26062 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9dffff640 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c932e3f00 0x556c932e6320 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b58783f3d1b4c7ed server_cookie=b34fd750b04533e3 in_seq=0 out_seq=0 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9bffff640 1 -- 172.21.15.67:0/2185871751 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x556c931c8da0 con 0x556c932e3f00 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9bffff640 10 client.26062 handle_command_reply: tid=0 2024-09-10T20:59:45.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 client.26062 shutdown 2024-09-10T20:59:45.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 msgr2=0x556c9326a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009e50 tx=0x7fe9d40040c0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 shutdown_connections 2024-09-10T20:59:45.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556c932e3f00 0x556c932e6320 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556c9326b3c0 0x556c932e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556c932653e0 0x556c9326ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 --2- 172.21.15.67:0/2185871751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c9325a7e0 0x556c9326a830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9bffff640 0 client.26062 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.067+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 >> 172.21.15.67:0/2185871751 conn(0x556c9324e2b0 msgr2=0x556c93255d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 shutdown_connections 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e90db740 1 -- 172.21.15.67:0/2185871751 wait complete. 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e90db740 20 client.26062 trim_cache size 0 max 16384 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T20:59:45.077 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1", 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.078 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.079 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.080 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T20:59:45.081 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.083 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T20:59:45.084 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T20:59:45.085 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 msgr2=0x7fe9d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 0x7fe9d00b77a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8010c40 tx=0x7fe9d8017000 comp rx=0 tx=0).stop 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 msgr2=0x7fe9e019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc02aa00 tx=0x7fe9cc003b90 comp rx=0 tx=0).stop 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 shutdown_connections 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe9e0108020 0x7fe9e019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e01076a0 0x7fe9e019a600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe9d00b52e0 0x7fe9d00b77a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 --2- 172.21.15.67:0/2713022156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e0101c90 0x7fe9e019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:59:45.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.068+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 >> 172.21.15.67:0/2713022156 conn(0x7fe9e00fd700 msgr2=0x7fe9e00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:59:45.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.069+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 shutdown_connections 2024-09-10T20:59:45.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T20:59:45.069+0000 7fe9e6d06640 1 -- 172.21.15.67:0/2713022156 wait complete. 2024-09-10T20:59:45.782 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:45 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:45.828 INFO:tasks.cephfs.filesystem:scrub status for tag:d954cbbc-ffbf-4f04-83f9-3f2226bebfb1 - {'path': '/', 'tag': 'd954cbbc-ffbf-4f04-83f9-3f2226bebfb1', 'options': 'recursive,force'} 2024-09-10T20:59:45.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:45 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:45.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:45 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T20:59:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:46 smithi083 ceph-mon[35058]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2024-09-10T20:59:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:46 smithi172 ceph-mon[35265]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2024-09-10T20:59:47.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:46 smithi067 ceph-mon[30891]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 MiB/s wr, 656 op/s 2024-09-10T20:59:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:48 smithi083 ceph-mon[35058]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 697 op/s 2024-09-10T20:59:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:48 smithi172 ceph-mon[35265]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 697 op/s 2024-09-10T20:59:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 495.0 s, 1981.6 tps, lat 51.310 ms stddev 57.551 2024-09-10T20:59:49.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:48 smithi067 ceph-mon[30891]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 697 op/s 2024-09-10T20:59:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:50 smithi083 ceph-mon[35058]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-10T20:59:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:50 smithi172 ceph-mon[35265]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-10T20:59:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:50 smithi067 ceph-mon[30891]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-10T20:59:52.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:52 smithi067 ceph-mon[30891]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2024-09-10T20:59:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:52 smithi083 ceph-mon[35058]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2024-09-10T20:59:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:52 smithi172 ceph-mon[35265]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 622 op/s 2024-09-10T20:59:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 500.0 s, 1837.4 tps, lat 54.872 ms stddev 59.963 2024-09-10T20:59:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:54 smithi083 ceph-mon[35058]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 696 op/s 2024-09-10T20:59:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:54 smithi172 ceph-mon[35265]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 696 op/s 2024-09-10T20:59:55.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:54 smithi067 ceph-mon[30891]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 696 op/s 2024-09-10T20:59:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:56 smithi083 ceph-mon[35058]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-09-10T20:59:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T20:59:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:56 smithi172 ceph-mon[35265]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-09-10T20:59:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T20:59:57.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:56 smithi067 ceph-mon[30891]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-09-10T20:59:57.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:57.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:57.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T20:59:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 20:59:58 smithi083 ceph-mon[35058]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-09-10T20:59:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 20:59:58 smithi172 ceph-mon[35265]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-09-10T20:59:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 505.0 s, 2814.6 tps, lat 35.394 ms stddev 42.995 2024-09-10T20:59:59.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 20:59:58 smithi067 ceph-mon[30891]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-09-10T21:00:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-10T21:00:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: Health detail: HEALTH_WARN 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:00.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: [WRN] BLUESTORE_SLOW_OP_ALERT: 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.0 observed slow operation indications in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.1 observed slow operation indications in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.2 observed slow operation indications in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.3 observed slow operation indications in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.4 observed slow operation indications in BlueStore 2024-09-10T21:00:00.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.5 observed slow operation indications in BlueStore 2024-09-10T21:00:00.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.6 observed slow operation indications in BlueStore 2024-09-10T21:00:00.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.7 observed slow operation indications in BlueStore 2024-09-10T21:00:00.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.9 observed slow operation indications in BlueStore 2024-09-10T21:00:00.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.10 observed slow operation indications in BlueStore 2024-09-10T21:00:00.894 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:00 smithi083 ceph-mon[35058]: osd.11 observed slow operation indications in BlueStore 2024-09-10T21:00:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-10T21:00:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: Health detail: HEALTH_WARN 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: [WRN] BLUESTORE_SLOW_OP_ALERT: 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.0 observed slow operation indications in BlueStore 2024-09-10T21:00:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.1 observed slow operation indications in BlueStore 2024-09-10T21:00:00.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.2 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.3 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.4 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.5 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.6 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.7 observed slow operation indications in BlueStore 2024-09-10T21:00:00.951 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.9 observed slow operation indications in BlueStore 2024-09-10T21:00:00.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.10 observed slow operation indications in BlueStore 2024-09-10T21:00:00.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:00 smithi172 ceph-mon[35265]: osd.11 observed slow operation indications in BlueStore 2024-09-10T21:00:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 688 op/s 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: Health detail: HEALTH_WARN 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: [WRN] BLUESTORE_SLOW_OP_ALERT: 11 OSD(s) experiencing slow operations in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.0 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.1 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.2 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.3 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.4 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.5 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.6 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.7 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.9 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.10 observed slow operation indications in BlueStore 2024-09-10T21:00:01.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:00 smithi067 ceph-mon[30891]: osd.11 observed slow operation indications in BlueStore 2024-09-10T21:00:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:02 smithi083 ceph-mon[35058]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-09-10T21:00:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:02 smithi172 ceph-mon[35265]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-09-10T21:00:03.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:02 smithi067 ceph-mon[30891]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-09-10T21:00:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 510.0 s, 2348.4 tps, lat 42.964 ms stddev 50.363 2024-09-10T21:00:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:04 smithi083 ceph-mon[35058]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.3 MiB/s wr, 753 op/s 2024-09-10T21:00:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:04 smithi172 ceph-mon[35265]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.3 MiB/s wr, 753 op/s 2024-09-10T21:00:05.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:04 smithi067 ceph-mon[30891]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.3 MiB/s wr, 753 op/s 2024-09-10T21:00:06.893 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:06 smithi083 ceph-mon[35058]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-10T21:00:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:06 smithi172 ceph-mon[35265]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-10T21:00:07.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:06 smithi067 ceph-mon[30891]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.2 MiB/s wr, 655 op/s 2024-09-10T21:00:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:08 smithi083 ceph-mon[35058]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-10T21:00:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:08 smithi172 ceph-mon[35265]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-10T21:00:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 515.0 s, 2577.4 tps, lat 38.477 ms stddev 44.279 2024-09-10T21:00:09.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:08 smithi067 ceph-mon[30891]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.1 MiB/s wr, 747 op/s 2024-09-10T21:00:10.860 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:10 smithi067 ceph-mon[30891]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.6 MiB/s wr, 697 op/s 2024-09-10T21:00:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:10 smithi083 ceph-mon[35058]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.6 MiB/s wr, 697 op/s 2024-09-10T21:00:10.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:10 smithi172 ceph-mon[35265]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.6 MiB/s wr, 697 op/s 2024-09-10T21:00:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:12 smithi083 ceph-mon[35058]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2024-09-10T21:00:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:12 smithi172 ceph-mon[35265]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2024-09-10T21:00:13.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:12 smithi067 ceph-mon[30891]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.0 MiB/s wr, 594 op/s 2024-09-10T21:00:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 520.0 s, 1979.2 tps, lat 50.828 ms stddev 55.682 2024-09-10T21:00:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:14 smithi083 ceph-mon[35058]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.3 MiB/s wr, 705 op/s 2024-09-10T21:00:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:14 smithi172 ceph-mon[35265]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.3 MiB/s wr, 705 op/s 2024-09-10T21:00:15.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:14 smithi067 ceph-mon[30891]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.3 MiB/s wr, 705 op/s 2024-09-10T21:00:15.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:00:16.166 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 -- 172.21.15.67:0/765085276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac1076a0 msgr2=0x7f1bac107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/765085276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac1076a0 0x7f1bac107ae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009900 tx=0x7f1ba002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 -- 172.21.15.67:0/765085276 shutdown_connections 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/765085276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/765085276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac1076a0 0x7f1bac107ae0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/765085276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac101c90 0x7f1bac102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 -- 172.21.15.67:0/765085276 >> 172.21.15.67:0/765085276 conn(0x7f1bac0fd700 msgr2=0x7f1bac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 -- 172.21.15.67:0/765085276 shutdown_connections 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.764+0000 7f1bb0a31640 1 -- 172.21.15.67:0/765085276 wait complete. 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.765+0000 7f1bb0a31640 1 Processor -- start 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.765+0000 7f1bb0a31640 1 -- start start 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.765+0000 7f1bb0a31640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.765+0000 7f1bb0a31640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac1076a0 0x7f1bac197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.765+0000 7f1bb0a31640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1bb0a31640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac110be0 con 0x7f1bac101c90 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1bb0a31640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac110a60 con 0x7f1bac108020 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1bb0a31640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac110d60 con 0x7f1bac1076a0 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38412/0 (socket says 172.21.15.67:38412) 2024-09-10T21:00:16.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1ba9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac1076a0 0x7f1bac197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 -- 172.21.15.67:0/2077572925 learned_addr learned my addr 172.21.15.67:0/2077572925 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:16.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baad9d640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 -- 172.21.15.67:0/2077572925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac1076a0 msgr2=0x7f1bac197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac1076a0 0x7f1bac197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 -- 172.21.15.67:0/2077572925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 msgr2=0x7f1bac19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 -- 172.21.15.67:0/2077572925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac19d180 con 0x7f1bac101c90 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baad9d640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.766+0000 7f1baa59c640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00b4a0 tx=0x7f1b9c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.767+0000 7f1b9b7fe640 1 -- 172.21.15.67:0/2077572925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c014070 con 0x7f1bac101c90 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.767+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac19d470 con 0x7f1bac101c90 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.767+0000 7f1b9b7fe640 1 -- 172.21.15.67:0/2077572925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b9c010ac0 con 0x7f1bac101c90 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.767+0000 7f1b9b7fe640 1 -- 172.21.15.67:0/2077572925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c017c30 con 0x7f1bac101c90 2024-09-10T21:00:16.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.768+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1a7f40 con 0x7f1bac101c90 2024-09-10T21:00:16.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.771+0000 7f1b9b7fe640 1 -- 172.21.15.67:0/2077572925 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1b9c010610 con 0x7f1bac101c90 2024-09-10T21:00:16.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.772+0000 7f1b9b7fe640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 0x7f1b940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.772+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 0x7f1b940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.772+0000 7f1bb2e06740 1 Processor -- start 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.772+0000 7f1b9b7fe640 1 -- 172.21.15.67:0/2077572925 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1b9c0e4d80 con 0x7f1bac101c90 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.772+0000 7f1bb2e06740 1 -- start start 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082480 0x562d5b082860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 0x562d5b08e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562d5aff8e50 con 0x562d5b08ed30 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562d5afe8280 con 0x562d5b082da0 2024-09-10T21:00:16.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d5afec090 con 0x562d5b082480 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38416/0 (socket says 172.21.15.67:38416) 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 -- 172.21.15.67:0/1360094904 learned_addr learned my addr 172.21.15.67:0/1360094904 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 0x7f1b940b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0031440 tx=0x7f1ba0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 0x562d5b08e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baa59c640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082480 0x562d5b082860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 -- 172.21.15.67:0/1360094904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082480 msgr2=0x562d5b082860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082480 0x562d5b082860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 -- 172.21.15.67:0/1360094904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 msgr2=0x562d5b08e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 0x562d5b08e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1baad9d640 1 -- 172.21.15.67:0/1360094904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d5ad46650 con 0x562d5b08ed30 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.773+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 0x562d5b08e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:16.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.774+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c620 tx=0x7f1ba4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d36818bb63ff11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.774+0000 7f1b98ff9640 1 -- 172.21.15.67:0/1360094904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba401a020 con 0x562d5b08ed30 2024-09-10T21:00:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.774+0000 7f1b98ff9640 1 -- 172.21.15.67:0/1360094904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba4003b70 con 0x562d5b08ed30 2024-09-10T21:00:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.774+0000 7f1b98ff9640 1 -- 172.21.15.67:0/1360094904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400a810 con 0x562d5b08ed30 2024-09-10T21:00:16.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1360094904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 msgr2=0x562d5b091120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400c620 tx=0x7f1ba4009500 comp rx=0 tx=0).stop 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1360094904 shutdown_connections 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b08ed30 0x562d5b091120 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082da0 0x562d5b08e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1360094904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082480 0x562d5b082860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.775+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1360094904 >> 172.21.15.67:0/1360094904 conn(0x562d5b0802b0 msgr2=0x562d5b081450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.776+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1360094904 shutdown_connections 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.776+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1360094904 wait complete. 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.776+0000 7f1bb2e06740 1 -- start start 2024-09-10T21:00:16.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 Processor -- start 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082480 0x562d5b08e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082da0 0x562d5b08b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562d5ae49700 con 0x562d5b082480 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562d5af83110 con 0x562d5b08ed30 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d5b0919b0 con 0x562d5b082da0 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1bb2e06740 10 client.0 _ll_register_callbacks cb 0x562d5af9c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:42360/0 (socket says 172.21.15.67:42360) 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082480 0x562d5b08e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 -- 172.21.15.67:0/1806214670 learned_addr learned my addr 172.21.15.67:0/1806214670 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082da0 0x562d5b08b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 -- 172.21.15.67:0/1806214670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082da0 msgr2=0x562d5b08b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082da0 0x562d5b08b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 -- 172.21.15.67:0/1806214670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082480 msgr2=0x562d5b08e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.777+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082480 0x562d5b08e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1baad9d640 1 -- 172.21.15.67:0/1806214670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d5afb0c40 con 0x562d5b08ed30 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1baad9d640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4005f40 tx=0x7f1ba4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c75fd685ad655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1b91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba401a030 con 0x562d5b08ed30 2024-09-10T21:00:16.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1ba4004a40 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba4003b70 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ba4004c40 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1bb2e06740 10 client.26120 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.778+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562d5b09d270 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba402f070 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1ba400a570 con 0x562d5b08ed30 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 10 client.26120 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 10 client.26120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 20 client.26120 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b0a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 4 client.26120 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d5affada0 con 0x562d5b09e670 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.779+0000 7f1baa59c640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b0a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.780+0000 7f1b91ffb640 10 client.26120 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:16.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.780+0000 7f1baa59c640 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b0a0a60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b797605c0813b81a server_cookie=83efc699d5f3d1b in_seq=0 out_seq=0 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.781+0000 7f1b91ffb640 1 -- 172.21.15.67:0/1806214670 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d5affada0 con 0x562d5b09e670 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.781+0000 7f1b91ffb640 10 client.26120 handle_command_reply: tid=0 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 client.26120 shutdown 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 msgr2=0x562d5b08bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4005f40 tx=0x7f1ba4004730 comp rx=0 tx=0).stop 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 shutdown_connections 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b0a0a60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b08ed30 0x562d5b08bf20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1b91ffb640 0 client.26120 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b082da0 0x562d5b08b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/1806214670 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082480 0x562d5b08e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 >> 172.21.15.67:0/1806214670 conn(0x562d5b0802b0 msgr2=0x562d5b085e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 shutdown_connections 2024-09-10T21:00:16.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 1 -- 172.21.15.67:0/1806214670 wait complete. 2024-09-10T21:00:16.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.782+0000 7f1bb2e06740 20 client.26120 trim_cache size 0 max 16384 2024-09-10T21:00:16.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 Processor -- start 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 -- start start 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b08d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b090120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b090660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b2e60 con 0x562d5b082da0 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b0730 con 0x562d5b082480 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1ae580 con 0x562d5b08ed30 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b08d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1baa59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b08d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:42374/0 (socket says 172.21.15.67:42374) 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1baa59c640 1 -- 172.21.15.67:0/215330564 learned_addr learned my addr 172.21.15.67:0/215330564 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:16.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1baad9d640 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b090660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.812+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b090120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 -- 172.21.15.67:0/215330564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 msgr2=0x562d5b090660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b090660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 -- 172.21.15.67:0/215330564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 msgr2=0x562d5b08d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b08d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 -- 172.21.15.67:0/215330564 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d5b091510 con 0x562d5b082da0 2024-09-10T21:00:16.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.813+0000 7f1ba9d9b640 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b090120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009230 tx=0x7f1ba003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb50c5d65ab049 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.814+0000 7f1b93fff640 1 -- 172.21.15.67:0/215330564 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0035040 con 0x562d5b082da0 2024-09-10T21:00:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.814+0000 7f1b93fff640 1 -- 172.21.15.67:0/215330564 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba00054e0 con 0x562d5b082da0 2024-09-10T21:00:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.814+0000 7f1b93fff640 1 -- 172.21.15.67:0/215330564 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00035f0 con 0x562d5b082da0 2024-09-10T21:00:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.815+0000 7f1bb2e06740 1 -- 172.21.15.67:0/215330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 msgr2=0x562d5b090120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.815+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b090120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009230 tx=0x7f1ba003d000 comp rx=0 tx=0).stop 2024-09-10T21:00:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.818+0000 7f1bb2e06740 1 -- 172.21.15.67:0/215330564 shutdown_connections 2024-09-10T21:00:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.818+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b090660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.818+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b090120 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.818+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/215330564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b08d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.818+0000 7f1bb2e06740 1 -- 172.21.15.67:0/215330564 >> 172.21.15.67:0/215330564 conn(0x562d5b0802b0 msgr2=0x562d5b08cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.822+0000 7f1bb2e06740 1 -- 172.21.15.67:0/215330564 shutdown_connections 2024-09-10T21:00:16.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.822+0000 7f1bb2e06740 1 -- 172.21.15.67:0/215330564 wait complete. 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.822+0000 7f1bb2e06740 1 -- start start 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.822+0000 7f1bb2e06740 1 Processor -- start 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b096c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b0971c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1aebf0 con 0x562d5b082da0 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1b0060 con 0x562d5b082480 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1af2c0 con 0x562d5b08ed30 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1bb2e06740 10 client.0 _ll_register_callbacks cb 0x7f1ba0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1baad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:58710/0 (socket says 172.21.15.67:58710) 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.823+0000 7f1baad9d640 1 -- 172.21.15.67:0/3031455810 learned_addr learned my addr 172.21.15.67:0/3031455810 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:16.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baa59c640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 -- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 msgr2=0x562d5b096c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b096c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 -- 172.21.15.67:0/3031455810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 msgr2=0x562d5b0971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b0971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 -- 172.21.15.67:0/3031455810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d5b092170 con 0x562d5b08ed30 2024-09-10T21:00:16.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.824+0000 7f1baad9d640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400a9c0 tx=0x7f1ba400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3268e992459469 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.826+0000 7f1b91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.826+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba401a070 con 0x562d5b08ed30 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.826+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1ba400a500 con 0x562d5b08ed30 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.826+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba00054e0 con 0x562d5b08ed30 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.827+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1ba400a700 con 0x562d5b08ed30 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.827+0000 7f1bb2e06740 10 client.26077 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.827+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562d5b1252c0 con 0x562d5b08ed30 2024-09-10T21:00:16.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba00054e0 con 0x562d5b08ed30 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1ba401f960 con 0x562d5b08ed30 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 10 client.26077 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 10 client.26077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 20 client.26077 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b127a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 4 client.26077 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d5aff6850 con 0x562d5b09e670 2024-09-10T21:00:16.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.828+0000 7f1baa59c640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b127a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1baa59c640 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b127a00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf265b0581ad8510 server_cookie=c4fc405285d829e5 in_seq=0 out_seq=0 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1b91ffb640 10 client.26077 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1b91ffb640 1 -- 172.21.15.67:0/3031455810 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x562d5aff6850 con 0x562d5b09e670 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1b91ffb640 10 client.26077 handle_command_reply: tid=0 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 client.26077 shutdown 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 msgr2=0x562d5b091c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400a9c0 tx=0x7f1ba400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 shutdown_connections 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562d5b09e670 0x562d5b127a00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d5b08ed30 0x562d5b091c30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1b91ffb640 0 client.26077 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.829+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562d5b082da0 0x562d5b0971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1bb2e06740 1 --2- 172.21.15.67:0/3031455810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562d5b082480 0x562d5b096c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 >> 172.21.15.67:0/3031455810 conn(0x562d5b0802b0 msgr2=0x562d5b08d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 shutdown_connections 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1bb2e06740 1 -- 172.21.15.67:0/3031455810 wait complete. 2024-09-10T21:00:16.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.830+0000 7f1bb2e06740 20 client.26077 trim_cache size 0 max 16384 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.837 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.838 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.839 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:00:16.840 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.841 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.842 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:16.843 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 msgr2=0x7f1b940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 0x7f1b940b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0031440 tx=0x7f1ba0005b50 comp rx=0 tx=0).stop 2024-09-10T21:00:16.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 msgr2=0x7f1bac1970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00b4a0 tx=0x7f1b9c00b960 comp rx=0 tx=0).stop 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 shutdown_connections 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bac108020 0x7f1bac19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1b940b52e0 0x7f1b940b77a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bac1076a0 0x7f1bac197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 --2- 172.21.15.67:0/2077572925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bac101c90 0x7f1bac1970d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 >> 172.21.15.67:0/2077572925 conn(0x7f1bac0fd700 msgr2=0x7f1bac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 shutdown_connections 2024-09-10T21:00:16.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:16.831+0000 7f1bb0a31640 1 -- 172.21.15.67:0/2077572925 wait complete. 2024-09-10T21:00:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:16 smithi083 ceph-mon[35058]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-09-10T21:00:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:16 smithi172 ceph-mon[35265]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-09-10T21:00:17.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:16 smithi067 ceph-mon[30891]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 7.0 MiB/s wr, 661 op/s 2024-09-10T21:00:17.713 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:00:17.713 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:00:18.075 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:18.864 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:18 smithi067 ceph-mon[30891]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 -- 172.21.15.67:0/1157753370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04941076a0 msgr2=0x7f0494107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 --2- 172.21.15.67:0/1157753370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04941076a0 0x7f0494107ae0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0484009900 tx=0x7f048402a410 comp rx=0 tx=0).stop 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 -- 172.21.15.67:0/1157753370 shutdown_connections 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 --2- 172.21.15.67:0/1157753370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0494108020 0x7f049410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 --2- 172.21.15.67:0/1157753370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04941076a0 0x7f0494107ae0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 --2- 172.21.15.67:0/1157753370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494101c90 0x7f0494102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 -- 172.21.15.67:0/1157753370 >> 172.21.15.67:0/1157753370 conn(0x7f04940fd700 msgr2=0x7f04940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 -- 172.21.15.67:0/1157753370 shutdown_connections 2024-09-10T21:00:18.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 -- 172.21.15.67:0/1157753370 wait complete. 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.859+0000 7f049b91b640 1 Processor -- start 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 -- start start 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 0x7f049419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 0x7f04941a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0494114fb0 con 0x7f0494101c90 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0494114e30 con 0x7f0494108020 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f049b91b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0494115130 con 0x7f04941076a0 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38456/0 (socket says 172.21.15.67:38456) 2024-09-10T21:00:18.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 -- 172.21.15.67:0/736427067 learned_addr learned my addr 172.21.15.67:0/736427067 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f0498eb6640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 0x7f049419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f0499eb8640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 0x7f04941a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 -- 172.21.15.67:0/736427067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 msgr2=0x7f049419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 0x7f049419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 -- 172.21.15.67:0/736427067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 msgr2=0x7f04941a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 0x7f04941a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f04996b7640 1 -- 172.21.15.67:0/736427067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04941a1510 con 0x7f0494101c90 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f0498eb6640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 0x7f049419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.860+0000 7f0499eb8640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 0x7f04941a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f04996b7640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f049000d950 tx=0x7f049000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490017030 con 0x7f0494101c90 2024-09-10T21:00:18.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0490004020 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04941a1800 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900047a0 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.861+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04941a7ec0 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.862+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0494102070 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.864+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0490009a30 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.865+0000 7f048a7fc640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 0x7f04800b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.865+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f04900e5c80 con 0x7f0494101c90 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.866+0000 7f0498eb6640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 0x7f04800b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:18.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.867+0000 7f0498eb6640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 0x7f04800b7810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0484005ab0 tx=0x7f0484005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:18.870+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04900acb10 con 0x7f0494101c90 2024-09-10T21:00:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:18 smithi083 ceph-mon[35058]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-10T21:00:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:18 smithi172 ceph-mon[35265]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-10T21:00:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 525.0 s, 1839.8 tps, lat 54.022 ms stddev 58.596 2024-09-10T21:00:19.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.232+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f049402e5c0 con 0x7f0494101c90 2024-09-10T21:00:19.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.233+0000 7f048a7fc640 1 -- 172.21.15.67:0/736427067 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f04900ac410 con 0x7f0494101c90 2024-09-10T21:00:19.238 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:00:19.238 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:00:19.238 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:00:19.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 msgr2=0x7f04800b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:19.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 0x7f04800b7810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0484005ab0 tx=0x7f0484005a20 comp rx=0 tx=0).stop 2024-09-10T21:00:19.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 msgr2=0x7f049419b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:19.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f049000d950 tx=0x7f049000de10 comp rx=0 tx=0).stop 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 shutdown_connections 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0494108020 0x7f04941a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f04800b5350 0x7f04800b7810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04941076a0 0x7f049419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 --2- 172.21.15.67:0/736427067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0494101c90 0x7f049419b460 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 >> 172.21.15.67:0/736427067 conn(0x7f04940fd700 msgr2=0x7f04940ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 shutdown_connections 2024-09-10T21:00:19.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:19.237+0000 7f049b91b640 1 -- 172.21.15.67:0/736427067 wait complete. 2024-09-10T21:00:19.891 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:19 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/736427067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:00:19.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:19 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/736427067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:00:19.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:00:19.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:19 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/736427067' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:00:20.303 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:20.736 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:20 smithi067 ceph-mon[30891]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:20 smithi083 ceph-mon[35058]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:20 smithi172 ceph-mon[35265]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 -- 172.21.15.67:0/1351820844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0101c90 msgr2=0x7efda0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 --2- 172.21.15.67:0/1351820844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0101c90 0x7efda0102070 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009900 tx=0x7efd9c02a400 comp rx=0 tx=0).stop 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 -- 172.21.15.67:0/1351820844 shutdown_connections 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 --2- 172.21.15.67:0/1351820844 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda0108020 0x7efda010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 --2- 172.21.15.67:0/1351820844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda01076a0 0x7efda0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 --2- 172.21.15.67:0/1351820844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0101c90 0x7efda0102070 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 -- 172.21.15.67:0/1351820844 >> 172.21.15.67:0/1351820844 conn(0x7efda00fd700 msgr2=0x7efda00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 -- 172.21.15.67:0/1351820844 shutdown_connections 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.855+0000 7efda78b9640 1 -- 172.21.15.67:0/1351820844 wait complete. 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 Processor -- start 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 -- start start 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda01076a0 0x7efda00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 0x7efda00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111ca0 con 0x7efda0108020 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111b20 con 0x7efda01076a0 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda78b9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111e20 con 0x7efda0101c90 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda4e54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda01076a0 0x7efda00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5e56640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 0x7efda00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:58742/0 (socket says 172.21.15.67:58742) 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 -- 172.21.15.67:0/2247345767 learned_addr learned my addr 172.21.15.67:0/2247345767 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 -- 172.21.15.67:0/2247345767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda01076a0 msgr2=0x7efda00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda01076a0 0x7efda00fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 -- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 msgr2=0x7efda00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 0x7efda00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5655640 1 -- 172.21.15.67:0/2247345767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda01a76d0 con 0x7efda0101c90 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.856+0000 7efda5e56640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 0x7efda00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efda5655640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd9c005940 tx=0x7efd9c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efd967fc640 1 -- 172.21.15.67:0/2247345767 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c03f030 con 0x7efda0101c90 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efd967fc640 1 -- 172.21.15.67:0/2247345767 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd9c003cb0 con 0x7efda0101c90 2024-09-10T21:00:21.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda01a7960 con 0x7efda0101c90 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efd967fc640 1 -- 172.21.15.67:0/2247345767 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c035070 con 0x7efda0101c90 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.857+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda01a7e40 con 0x7efda0101c90 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.862+0000 7efd967fc640 1 -- 172.21.15.67:0/2247345767 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7efd9c03bbf0 con 0x7efda0101c90 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 Processor -- start 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 -- start start 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6190b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a61917460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61919d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563a61881ea0 con 0x563a6190ba10 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563a618712d0 con 0x563a6190b0f0 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda9c8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563a618750e0 con 0x563a619179a0 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda5655640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a61917460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda5655640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a61917460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38492/0 (socket says 172.21.15.67:38492) 2024-09-10T21:00:21.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda5655640 1 -- 172.21.15.67:0/244700413 learned_addr learned my addr 172.21.15.67:0/244700413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efda5e56640 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6190b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.863+0000 7efd967fc640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 0x7efd8c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda4e54640 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61919d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 0x7efd8c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 -- 172.21.15.67:0/244700413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 msgr2=0x563a61919d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61919d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 -- 172.21.15.67:0/244700413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 msgr2=0x563a61917460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a61917460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efd967fc640 1 -- 172.21.15.67:0/2247345767 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd9c106690 con 0x7efda0101c90 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 -- 172.21.15.67:0/244700413 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a615cf650 con 0x563a6190b0f0 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6190b4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd98007310 tx=0x7efd980117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d649d40fb989b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efda5e56640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 0x7efd8c0b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd9800a000 tx=0x7efd9801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efd8b7fe640 1 -- 172.21.15.67:0/244700413 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9801c970 con 0x563a6190b0f0 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efd8b7fe640 1 -- 172.21.15.67:0/244700413 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd9801d440 con 0x563a6190b0f0 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.864+0000 7efd8b7fe640 1 -- 172.21.15.67:0/244700413 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9800e610 con 0x563a6190b0f0 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 -- 172.21.15.67:0/244700413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 msgr2=0x563a6190b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6190b4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd98007310 tx=0x7efd980117b0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 -- 172.21.15.67:0/244700413 shutdown_connections 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61919d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a61917460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 --2- 172.21.15.67:0/244700413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6190b4d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 -- 172.21.15.67:0/244700413 >> 172.21.15.67:0/244700413 conn(0x563a61908f20 msgr2=0x563a6190a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 -- 172.21.15.67:0/244700413 shutdown_connections 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.865+0000 7efda9c8e740 1 -- 172.21.15.67:0/244700413 wait complete. 2024-09-10T21:00:21.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 -- start start 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 Processor -- start 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 0x563a619146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61914d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563a616d2700 con 0x563a6190b0f0 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563a6180c160 con 0x563a6190ba10 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563a6191a560 con 0x563a619179a0 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda9c8e740 10 client.0 _ll_register_callbacks cb 0x563a618259e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:21.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.866+0000 7efda5655640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda4e54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 0x563a619146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38506/0 (socket says 172.21.15.67:38506) 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 -- 172.21.15.67:0/1679092062 learned_addr learned my addr 172.21.15.67:0/1679092062 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5e56640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61914d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 -- 172.21.15.67:0/1679092062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 msgr2=0x563a61914d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61914d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 -- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 msgr2=0x563a619146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 0x563a619146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 -- 172.21.15.67:0/1679092062 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a61839c90 con 0x563a6190b0f0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda4e54640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 0x563a619146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda5655640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0c8f40 tx=0x7efd9c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7189d6f4dad93e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efd88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:00:21.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c049070 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd9c0cd190 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.867+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd9801d440 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efd9c0ccd00 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 10 client.16431 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563a61925ec0 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd9801d440 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7efd9c0b8170 con 0x563a6190b0f0 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 10 client.16431 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 20 client.16431 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61927320 0x563a61929790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 4 client.16431 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a61883df0 con 0x563a61927320 2024-09-10T21:00:21.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.868+0000 7efda4e54640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61927320 0x563a61929790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.869+0000 7efd88ff9640 10 client.16431 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.869+0000 7efda4e54640 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61927320 0x563a61929790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cac771beacdebd0e server_cookie=e7a11734e374940d in_seq=0 out_seq=0 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.869+0000 7efd88ff9640 1 -- 172.21.15.67:0/1679092062 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a61883df0 con 0x563a61927320 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.869+0000 7efd88ff9640 10 client.16431 handle_command_reply: tid=0 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.869+0000 7efda9c8e740 1 client.16431 shutdown 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 msgr2=0x563a61917290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0c8f40 tx=0x7efd9c03b6b0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 shutdown_connections 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61927320 0x563a61929790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a61914d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190ba10 0x563a619146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 --2- 172.21.15.67:0/1679092062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190b0f0 0x563a61917290 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 >> 172.21.15.67:0/1679092062 conn(0x563a61908f20 msgr2=0x563a6190eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efd88ff9640 0 client.16431 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 shutdown_connections 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 1 -- 172.21.15.67:0/1679092062 wait complete. 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.870+0000 7efda9c8e740 20 client.16431 trim_cache size 0 max 16384 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 Processor -- start 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 -- start start 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a6190b0f0 0x563a619237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6190f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 0x563a6190fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efda01b2d40 con 0x563a6190ba10 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efda01b0610 con 0x563a619179a0 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda9c8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efda01ae460 con 0x563a6190b0f0 2024-09-10T21:00:21.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.888+0000 7efda4e54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6190f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 0x563a6190fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda4e54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6190f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38522/0 (socket says 172.21.15.67:38522) 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda4e54640 1 -- 172.21.15.67:0/2129062671 learned_addr learned my addr 172.21.15.67:0/2129062671 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5655640 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a6190b0f0 0x563a619237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 -- 172.21.15.67:0/2129062671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a6190b0f0 msgr2=0x563a619237c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a6190b0f0 0x563a619237c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 -- 172.21.15.67:0/2129062671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 msgr2=0x563a6190f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6190f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 -- 172.21.15.67:0/2129062671 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6190b840 con 0x563a619179a0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efda5e56640 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 0x563a6190fef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd98013540 tx=0x7efd98013fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437d22f78b120dde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efd8affd640 1 -- 172.21.15.67:0/2129062671 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98013050 con 0x563a619179a0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efd8affd640 1 -- 172.21.15.67:0/2129062671 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd98003e20 con 0x563a619179a0 2024-09-10T21:00:21.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.889+0000 7efd8affd640 1 -- 172.21.15.67:0/2129062671 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9801cd40 con 0x563a619179a0 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- 172.21.15.67:0/2129062671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 msgr2=0x563a6190fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 0x563a6190fef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd98013540 tx=0x7efd98013fd0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- 172.21.15.67:0/2129062671 shutdown_connections 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a619179a0 0x563a6190fef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6190f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2129062671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a6190b0f0 0x563a619237c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- 172.21.15.67:0/2129062671 >> 172.21.15.67:0/2129062671 conn(0x563a61908f20 msgr2=0x563a61929330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- 172.21.15.67:0/2129062671 shutdown_connections 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- 172.21.15.67:0/2129062671 wait complete. 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.890+0000 7efda9c8e740 1 -- start start 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 Processor -- start 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6191f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a6191a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7efda01aead0 con 0x563a6190ba10 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efda01aff40 con 0x563a6190b0f0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efda01af1a0 con 0x563a619179a0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda9c8e740 10 client.0 _ll_register_callbacks cb 0x7efd9c03bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda4e54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6191f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda4e54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38538/0 (socket says 172.21.15.67:38538) 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda4e54640 1 -- 172.21.15.67:0/2636158725 learned_addr learned my addr 172.21.15.67:0/2636158725 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5e56640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a6191a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 -- 172.21.15.67:0/2636158725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 msgr2=0x563a6191a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a6191a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 -- 172.21.15.67:0/2636158725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 msgr2=0x563a6191fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda5655640 1 -- 172.21.15.67:0/2636158725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a619203b0 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.891+0000 7efda4e54640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda5655640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6191f830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ccec0 tx=0x7efd9c0045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c12af20ad41246 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9c049050 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd9c0cd190 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd98003e20 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efd9c005d50 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 10 client.26147 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563a61994690 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd98003e20 con 0x563a6190b0f0 2024-09-10T21:00:21.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7efd9c0cc190 con 0x563a6190b0f0 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 10 client.26147 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 10 client.26147 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 20 client.26147 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61994c30 0x563a61997050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 4 client.26147 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.892+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a6187f8a0 con 0x563a61994c30 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda4e54640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61994c30 0x563a61997050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efd88ff9640 10 client.26147 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda4e54640 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61994c30 0x563a61997050 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3676c9528795d77 server_cookie=bf02a9459366915b in_seq=0 out_seq=0 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efd88ff9640 1 -- 172.21.15.67:0/2636158725 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a6187f8a0 con 0x563a61994c30 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efd88ff9640 10 client.26147 handle_command_reply: tid=0 2024-09-10T21:00:21.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 client.26147 shutdown 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 msgr2=0x563a6191f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6191f830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0ccec0 tx=0x7efd9c0045a0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 shutdown_connections 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x563a61994c30 0x563a61997050 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563a619179a0 0x563a6191a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563a6190ba10 0x563a6191fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 --2- 172.21.15.67:0/2636158725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563a6190b0f0 0x563a6191f830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efd88ff9640 0 client.26147 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.893+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 >> 172.21.15.67:0/2636158725 conn(0x563a61908f20 msgr2=0x563a6190f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.894+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 shutdown_connections 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.894+0000 7efda9c8e740 1 -- 172.21.15.67:0/2636158725 wait complete. 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.894+0000 7efda9c8e740 20 client.26147 trim_cache size 0 max 16384 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 msgr2=0x7efd8c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 0x7efd8c0b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd9800a000 tx=0x7efd9801d000 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 msgr2=0x7efda00fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd9c005940 tx=0x7efd9c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 shutdown_connections 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efda0108020 0x7efda00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efda01076a0 0x7efda00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7efd8c0b52e0 0x7efd8c0b77a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 --2- 172.21.15.67:0/2247345767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0101c90 0x7efda00fdc00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 >> 172.21.15.67:0/2247345767 conn(0x7efda00fd700 msgr2=0x7efda006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 shutdown_connections 2024-09-10T21:00:21.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:20.897+0000 7efda78b9640 1 -- 172.21.15.67:0/2247345767 wait complete. 2024-09-10T21:00:21.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:00:22.079 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:22.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 -- 172.21.15.67:0/1373237355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b81076d0 msgr2=0x7fe5b8107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 --2- 172.21.15.67:0/1373237355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b81076d0 0x7fe5b8107b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009900 tx=0x7fe5a802a410 comp rx=0 tx=0).stop 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 -- 172.21.15.67:0/1373237355 shutdown_connections 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 --2- 172.21.15.67:0/1373237355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b8108050 0x7fe5b810e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 --2- 172.21.15.67:0/1373237355 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b81076d0 0x7fe5b8107b10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 --2- 172.21.15.67:0/1373237355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b81020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 -- 172.21.15.67:0/1373237355 >> 172.21.15.67:0/1373237355 conn(0x7fe5b80fd770 msgr2=0x7fe5b80ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 -- 172.21.15.67:0/1373237355 shutdown_connections 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.662+0000 7fe5bff26640 1 -- 172.21.15.67:0/1373237355 wait complete. 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 Processor -- start 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 -- start start 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b81076d0 0x7fe5b80fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b8108050 0x7fe5b80fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8111cd0 con 0x7fe5b8108050 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8111b50 con 0x7fe5b8101cc0 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bff26640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b8111e50 con 0x7fe5b81076d0 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5be4c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b8108050 0x7fe5b80fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55284/0 (socket says 172.21.15.67:55284) 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 -- 172.21.15.67:0/2306622272 learned_addr learned my addr 172.21.15.67:0/2306622272 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b81076d0 0x7fe5b80fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 -- 172.21.15.67:0/2306622272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b81076d0 msgr2=0x7fe5b80fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b81076d0 0x7fe5b80fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 -- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b8108050 msgr2=0x7fe5b80fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b8108050 0x7fe5b80fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.663+0000 7fe5bdcc2640 1 -- 172.21.15.67:0/2306622272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b81a7700 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9f0 tx=0x7fe5b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5aeffd640 1 -- 172.21.15.67:0/2306622272 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400cd80 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b81a79f0 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b81a7f50 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5aeffd640 1 -- 172.21.15.67:0/2306622272 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5b40108e0 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.664+0000 7fe5aeffd640 1 -- 172.21.15.67:0/2306622272 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40188e0 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.669+0000 7fe5aeffd640 1 -- 172.21.15.67:0/2306622272 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe5b4010430 con 0x7fe5b8101cc0 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.669+0000 7fe5c22fb740 1 Processor -- start 2024-09-10T21:00:22.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.669+0000 7fe5c22fb740 1 -- start start 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48c918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 0x55ef48c9d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ef48c07ea0 con 0x55ef48c914d0 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ef48bf72d0 con 0x55ef48c9dd80 2024-09-10T21:00:22.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ef48bfb0e0 con 0x55ef48c91df0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5be4c3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48c918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5aeffd640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 0x7fe5a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55290/0 (socket says 172.21.15.67:55290) 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/61968048 learned_addr learned my addr 172.21.15.67:0/61968048 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 0x55ef48c9d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5be4c3640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 0x7fe5a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5aeffd640 1 -- 172.21.15.67:0/2306622272 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5b40e5ca0 con 0x7fe5b8101cc0 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/61968048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 msgr2=0x55ef48c9d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 0x55ef48c9d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/61968048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 msgr2=0x55ef48c918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48c918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.670+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/61968048 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef48955650 con 0x55ef48c9dd80 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 0x55ef48c9d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009900 tx=0x7fe5a8032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f11ac51a664a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5be4c3640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 0x7fe5a40b77a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80ffd30 tx=0x7fe5b0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5a3fff640 1 -- 172.21.15.67:0/61968048 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8040070 con 0x55ef48c9dd80 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5a3fff640 1 -- 172.21.15.67:0/61968048 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a8004030 con 0x55ef48c9dd80 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.671+0000 7fe5a3fff640 1 -- 172.21.15.67:0/61968048 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8035040 con 0x55ef48c9dd80 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 -- 172.21.15.67:0/61968048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 msgr2=0x55ef48ca0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009900 tx=0x7fe5a8032b20 comp rx=0 tx=0).stop 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 -- 172.21.15.67:0/61968048 shutdown_connections 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c9dd80 0x55ef48ca0170 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c91df0 0x55ef48c9d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/61968048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48c918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 -- 172.21.15.67:0/61968048 >> 172.21.15.67:0/61968048 conn(0x55ef48c8f300 msgr2=0x55ef48c904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 -- 172.21.15.67:0/61968048 shutdown_connections 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.672+0000 7fe5c22fb740 1 -- 172.21.15.67:0/61968048 wait complete. 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 -- start start 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 Processor -- start 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c914d0 0x55ef48c9d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c9dd80 0x55ef48c9afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ef48a58700 con 0x55ef48c9dd80 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.673+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ef48b92160 con 0x55ef48c91df0 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55306/0 (socket says 172.21.15.67:55306) 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bdcc2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c914d0 0x55ef48c9d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/2928365922 learned_addr learned my addr 172.21.15.67:0/2928365922 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5be4c3640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c9dd80 0x55ef48c9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ef48ca09a0 con 0x55ef48c914d0 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c914d0 msgr2=0x55ef48c9d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c914d0 0x55ef48c9d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/2928365922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c9dd80 msgr2=0x55ef48c9afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c9dd80 0x55ef48c9afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/2928365922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef48bbfc90 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5c22fb740 10 client.0 _ll_register_callbacks cb 0x55ef48bab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a8004030 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80041e0 tx=0x7fe5a8031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ad9bab84d973a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.674+0000 7fe5a17fa640 10 client.26159 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5a17fa640 1 -- 172.21.15.67:0/2928365922 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8040070 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5a17fa640 1 -- 172.21.15.67:0/2928365922 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5a8005430 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5a17fa640 1 -- 172.21.15.67:0/2928365922 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5a8035040 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 10 client.26159 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55ef48cac010 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5a17fa640 1 -- 172.21.15.67:0/2928365922 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5a80314a0 con 0x55ef48c91df0 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 10 client.26159 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:22.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 10 client.26159 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 20 client.26159 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48cad360 0x55ef48caf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 4 client.26159 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.675+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef48c09df0 con 0x55ef48cad360 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.676+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48cad360 0x55ef48caf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.676+0000 7fe5a17fa640 10 client.26159 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.676+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48cad360 0x55ef48caf750 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=661e50f9083483f8 server_cookie=81b26be04ac91f54 in_seq=0 out_seq=0 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5a17fa640 1 -- 172.21.15.67:0/2928365922 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef48c09df0 con 0x55ef48cad360 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5a17fa640 10 client.26159 handle_command_reply: tid=0 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5c22fb740 1 client.26159 shutdown 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 msgr2=0x55ef48c9aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80041e0 tx=0x7fe5a8031400 comp rx=0 tx=0).stop 2024-09-10T21:00:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 shutdown_connections 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.677+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48cad360 0x55ef48caf750 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c9dd80 0x55ef48c9afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48c9aa40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5a17fa640 0 client.26159 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/2928365922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c914d0 0x55ef48c9d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 >> 172.21.15.67:0/2928365922 conn(0x55ef48c8f300 msgr2=0x55ef48c94e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 shutdown_connections 2024-09-10T21:00:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 1 -- 172.21.15.67:0/2928365922 wait complete. 2024-09-10T21:00:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.680+0000 7fe5c22fb740 20 client.26159 trim_cache size 0 max 16384 2024-09-10T21:00:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 Processor -- start 2024-09-10T21:00:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 -- start start 2024-09-10T21:00:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c914d0 0x55ef48c8a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48c97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c010ba0 con 0x55ef48c91df0 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c00e470 con 0x55ef48c914d0 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c00c2c0 con 0x55ef48c9dd80 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.698+0000 7fe5bd4c1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54314/0 (socket says 172.21.15.67:54314) 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/1998237143 learned_addr learned my addr 172.21.15.67:0/1998237143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5be4c3640 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48c97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c914d0 0x55ef48c8a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/1998237143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 msgr2=0x55ef48c97c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48c97c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/1998237143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c914d0 msgr2=0x55ef48c8a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c914d0 0x55ef48c8a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/1998237143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef48c8ffe0 con 0x55ef48c91df0 2024-09-10T21:00:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80057c0 tx=0x7fe5a8047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7713f3d6a18d01e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5a37fe640 1 -- 172.21.15.67:0/1998237143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80051c0 con 0x55ef48c91df0 2024-09-10T21:00:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5a37fe640 1 -- 172.21.15.67:0/1998237143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a8004030 con 0x55ef48c91df0 2024-09-10T21:00:22.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.699+0000 7fe5a37fe640 1 -- 172.21.15.67:0/1998237143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8004920 con 0x55ef48c91df0 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 -- 172.21.15.67:0/1998237143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 msgr2=0x55ef48c8e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80057c0 tx=0x7fe5a8047040 comp rx=0 tx=0).stop 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 -- 172.21.15.67:0/1998237143 shutdown_connections 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48c97c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c91df0 0x55ef48c8e310 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/1998237143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c914d0 0x55ef48c8a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 -- 172.21.15.67:0/1998237143 >> 172.21.15.67:0/1998237143 conn(0x55ef48c8f300 msgr2=0x55ef48c8dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 -- 172.21.15.67:0/1998237143 shutdown_connections 2024-09-10T21:00:22.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.700+0000 7fe5c22fb740 1 -- 172.21.15.67:0/1998237143 wait complete. 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.701+0000 7fe5c22fb740 1 -- start start 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.701+0000 7fe5c22fb740 1 Processor -- start 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.701+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48ca2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48ca2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48d131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c00c930 con 0x55ef48c914d0 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c00dda0 con 0x55ef48c91df0 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c00d000 con 0x55ef48c9dd80 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5c22fb740 10 client.0 _ll_register_callbacks cb 0x7fe5a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bdcc2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48ca2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bdcc2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48ca2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54318/0 (socket says 172.21.15.67:54318) 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bdcc2640 1 -- 172.21.15.67:0/4132870623 learned_addr learned my addr 172.21.15.67:0/4132870623 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:22.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48ca2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5be4c3640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48d131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 msgr2=0x55ef48d131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48d131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/4132870623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 msgr2=0x55ef48ca2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48ca2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.702+0000 7fe5bd4c1640 1 -- 172.21.15.67:0/4132870623 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef48d138e0 con 0x55ef48c91df0 2024-09-10T21:00:22.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.703+0000 7fe5bd4c1640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48ca2d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80329d0 tx=0x7fe5a80056f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1266095688464b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:22.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.705+0000 7fe5a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.705+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8040040 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.705+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe5a80053d0 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.705+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5a8004030 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe5a80035f0 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 10 client.26165 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ef48d1ad70 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5a8004030 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe5a8004ea0 con 0x55ef48c91df0 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 10 client.26165 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 10 client.26165 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 20 client.26165 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48d1b1e0 0x55ef48d1d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 4 client.26165 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:00:22.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.706+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef48c058a0 con 0x55ef48d1b1e0 2024-09-10T21:00:22.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48d1b1e0 0x55ef48d1d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5bdcc2640 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48d1b1e0 0x55ef48d1d5d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d973532f5eeac9c5 server_cookie=c15f13900c81ae77 in_seq=0 out_seq=0 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5a17fa640 10 client.26165 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5a17fa640 1 -- 172.21.15.67:0/4132870623 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef48c058a0 con 0x55ef48d1b1e0 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5a17fa640 10 client.26165 handle_command_reply: tid=0 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5c22fb740 1 client.26165 shutdown 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 msgr2=0x55ef48ca2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.707+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48ca2d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80329d0 tx=0x7fe5a80056f0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 shutdown_connections 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ef48d1b1e0 0x55ef48d1d5d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ef48c9dd80 0x55ef48d131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef48c91df0 0x55ef48ca2d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5a17fa640 0 client.26165 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 --2- 172.21.15.67:0/4132870623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ef48c914d0 0x55ef48ca2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 >> 172.21.15.67:0/4132870623 conn(0x55ef48c8f300 msgr2=0x55ef48c8e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 shutdown_connections 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 1 -- 172.21.15.67:0/4132870623 wait complete. 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.708+0000 7fe5c22fb740 20 client.26165 trim_cache size 0 max 16384 2024-09-10T21:00:22.714 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:00:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 msgr2=0x7fe5a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 0x7fe5a40b77a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80ffd30 tx=0x7fe5b0004ab0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 msgr2=0x7fe5b80fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:22.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9f0 tx=0x7fe5b400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 shutdown_connections 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5b8108050 0x7fe5b80fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe5a40b52e0 0x7fe5a40b77a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5b81076d0 0x7fe5b80fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 --2- 172.21.15.67:0/2306622272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b8101cc0 0x7fe5b80fdc70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 >> 172.21.15.67:0/2306622272 conn(0x7fe5b80fd770 msgr2=0x7fe5b8104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 shutdown_connections 2024-09-10T21:00:22.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:22.709+0000 7fe5bff26640 1 -- 172.21.15.67:0/2306622272 wait complete. 2024-09-10T21:00:22.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:22 smithi083 ceph-mon[35058]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-10T21:00:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:22 smithi172 ceph-mon[35265]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-10T21:00:23.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:22 smithi067 ceph-mon[30891]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 5.8 MiB/s wr, 574 op/s 2024-09-10T21:00:23.479 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:00:23.911 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 530.0 s, 1675.8 tps, lat 59.560 ms stddev 63.932 2024-09-10T21:00:24.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.499+0000 7f4a01b32640 1 -- 172.21.15.67:0/2955729799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 msgr2=0x7f49fc107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.499+0000 7f4a01b32640 1 --2- 172.21.15.67:0/2955729799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc107b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009900 tx=0x7f49e402a3f0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 -- 172.21.15.67:0/2955729799 shutdown_connections 2024-09-10T21:00:24.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 --2- 172.21.15.67:0/2955729799 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc108060 0x7f49fc10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 --2- 172.21.15.67:0/2955729799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc107b20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 --2- 172.21.15.67:0/2955729799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc101cd0 0x7f49fc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 -- 172.21.15.67:0/2955729799 >> 172.21.15.67:0/2955729799 conn(0x7f49fc0fd740 msgr2=0x7f49fc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 -- 172.21.15.67:0/2955729799 shutdown_connections 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.500+0000 7f4a01b32640 1 -- 172.21.15.67:0/2955729799 wait complete. 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 Processor -- start 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 -- start start 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc101cd0 0x7f49fc19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc108060 0x7f49fc1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc110c20 con 0x7f49fc101cd0 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc110aa0 con 0x7f49fc1076e0 2024-09-10T21:00:24.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f4a01b32640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc110da0 con 0x7f49fc108060 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f49f3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f49f3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55344/0 (socket says 172.21.15.67:55344) 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f49f3fff640 1 -- 172.21.15.67:0/3925685659 learned_addr learned my addr 172.21.15.67:0/3925685659 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc101cd0 0x7f49fc19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.501+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc108060 0x7f49fc1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 -- 172.21.15.67:0/3925685659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc108060 msgr2=0x7f49fc1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc108060 0x7f49fc1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 -- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc101cd0 msgr2=0x7f49fc19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc101cd0 0x7f49fc19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 -- 172.21.15.67:0/3925685659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc1a1570 con 0x7f49fc1076e0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49e4005940 tx=0x7f49e40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f97fa640 1 -- 172.21.15.67:0/3925685659 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e403f030 con 0x7f49fc1076e0 2024-09-10T21:00:24.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f97fa640 1 -- 172.21.15.67:0/3925685659 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49e40044c0 con 0x7f49fc1076e0 2024-09-10T21:00:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49fc1a1800 con 0x7f49fc1076e0 2024-09-10T21:00:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49fc1a7f20 con 0x7f49fc1076e0 2024-09-10T21:00:24.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.502+0000 7f49f97fa640 1 -- 172.21.15.67:0/3925685659 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4035070 con 0x7f49fc1076e0 2024-09-10T21:00:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.505+0000 7f4a03f07740 1 Processor -- start 2024-09-10T21:00:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.506+0000 7f49f97fa640 1 -- 172.21.15.67:0/3925685659 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f49e403b960 con 0x7f49fc1076e0 2024-09-10T21:00:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.506+0000 7f4a03f07740 1 -- start start 2024-09-10T21:00:24.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec234460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f49fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f49fbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54336/0 (socket says 172.21.15.67:54336) 2024-09-10T21:00:24.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec236d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562dec19eea0 con 0x562dec2280f0 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562dec18e2d0 con 0x562dec2349a0 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f4a03f07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562dec1920e0 con 0x562dec228a10 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.507+0000 7f49fbfff640 1 -- 172.21.15.67:0/3969364573 learned_addr learned my addr 172.21.15.67:0/3969364573 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec234460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 -- 172.21.15.67:0/3969364573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 msgr2=0x562dec234460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec234460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 -- 172.21.15.67:0/3969364573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 msgr2=0x562dec236d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:00:24.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec236d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 -- 172.21.15.67:0/3969364573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562debeec650 con 0x562dec2280f0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f49f4011440 tx=0x7f49f4011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a058306a7a46ee4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.508+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec234460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.509+0000 7f49f97fa640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 0x7f49e80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.509+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 0x7f49e80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.509+0000 7f49f97fa640 1 -- 172.21.15.67:0/3925685659 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f49e4106210 con 0x7f49fc1076e0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.509+0000 7f49f1ffb640 1 -- 172.21.15.67:0/3969364573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4003c30 con 0x562dec2280f0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.509+0000 7f49f1ffb640 1 -- 172.21.15.67:0/3969364573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49f4003dd0 con 0x562dec2280f0 2024-09-10T21:00:24.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f49f1ffb640 1 -- 172.21.15.67:0/3969364573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f400fae0 con 0x562dec2280f0 2024-09-10T21:00:24.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 -- 172.21.15.67:0/3969364573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 msgr2=0x562dec2284d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 0x7f49e80b7790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x562dec226e00 tx=0x7f49ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f49f4011440 tx=0x7f49f4011900 comp rx=0 tx=0).stop 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 -- 172.21.15.67:0/3969364573 shutdown_connections 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec236d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec234460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.510+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3969364573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2284d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.511+0000 7f4a03f07740 1 -- 172.21.15.67:0/3969364573 >> 172.21.15.67:0/3969364573 conn(0x562dec225f20 msgr2=0x562dec2270c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.511+0000 7f4a03f07740 1 -- 172.21.15.67:0/3969364573 shutdown_connections 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.511+0000 7f4a03f07740 1 -- 172.21.15.67:0/3969364573 wait complete. 2024-09-10T21:00:24.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.511+0000 7f4a03f07740 1 -- start start 2024-09-10T21:00:24.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 Processor -- start 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec2316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 0x562dec231ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562debfef700 con 0x562dec2349a0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562dec129160 con 0x562dec2280f0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562dec2376c0 con 0x562dec228a10 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f4a03f07740 10 client.0 _ll_register_callbacks cb 0x562dec1429e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f49fb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f49fb7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55370/0 (socket says 172.21.15.67:55370) 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f49fb7fe640 1 -- 172.21.15.67:0/3773420090 learned_addr learned my addr 172.21.15.67:0/3773420090 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.512+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 0x562dec231ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec2316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 -- 172.21.15.67:0/3773420090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 msgr2=0x562dec2316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec2316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 -- 172.21.15.67:0/3773420090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 msgr2=0x562dec231ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 0x562dec231ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 -- 172.21.15.67:0/3773420090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dec156c90 con 0x562dec2280f0 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fbfff640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 0x562dec231ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49ec01e9d0 tx=0x7f49ec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538045b1c6bf97b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49daffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.513+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec009db0 con 0x562dec2280f0 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.514+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49f4003dd0 con 0x562dec2280f0 2024-09-10T21:00:24.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.514+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f49ec018030 con 0x562dec2280f0 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.514+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49ec004020 con 0x562dec2280f0 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 10 client.26174 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562dec243030 con 0x562dec2280f0 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49f4003dd0 con 0x562dec2280f0 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f49ec029420 con 0x562dec2280f0 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 10 client.26174 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 10 client.26174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:24.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 20 client.26174 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec246d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 4 client.26174 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dec1a0df0 con 0x562dec244900 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.515+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec246d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.516+0000 7f49daffd640 10 client.26174 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.516+0000 7f49f3fff640 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec246d20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=779df490e7d0a7db server_cookie=d871af0c3d736d9f in_seq=0 out_seq=0 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f49daffd640 1 -- 172.21.15.67:0/3773420090 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562dec1a0df0 con 0x562dec244900 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f49daffd640 10 client.26174 handle_command_reply: tid=0 2024-09-10T21:00:24.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 client.26174 shutdown 2024-09-10T21:00:24.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 msgr2=0x562dec234270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49ec01e9d0 tx=0x7f49ec004730 comp rx=0 tx=0).stop 2024-09-10T21:00:24.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 shutdown_connections 2024-09-10T21:00:24.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec246d20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2349a0 0x562dec231ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f49daffd640 0 client.26174 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec2316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.517+0000 7f4a03f07740 1 --2- 172.21.15.67:0/3773420090 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2280f0 0x562dec234270 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.518+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 >> 172.21.15.67:0/3773420090 conn(0x562dec225f20 msgr2=0x562dec22ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.518+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 shutdown_connections 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.518+0000 7f4a03f07740 1 -- 172.21.15.67:0/3773420090 wait complete. 2024-09-10T21:00:24.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.518+0000 7f4a03f07740 20 client.26174 trim_cache size 0 max 16384 2024-09-10T21:00:24.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 Processor -- start 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 -- start start 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec228a10 0x562dec230bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1b2e60 con 0x562dec2280f0 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1b0730 con 0x562dec228a10 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f4a03f07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1ae580 con 0x562dec2349a0 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f49fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f49fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56080/0 (socket says 172.21.15.67:56080) 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f49fbfff640 1 -- 172.21.15.67:0/1845203831 learned_addr learned my addr 172.21.15.67:0/1845203831 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.540+0000 7f49f3fff640 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec228a10 0x562dec230bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 -- 172.21.15.67:0/1845203831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec228a10 msgr2=0x562dec230bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec228a10 0x562dec230bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 -- 172.21.15.67:0/1845203831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 msgr2=0x562dec2408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 -- 172.21.15.67:0/1845203831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dec233ea0 con 0x562dec2349a0 2024-09-10T21:00:24.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.542+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006010 tx=0x7f49f4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814ec1f0ae047133 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.543+0000 7f49f17fa640 1 -- 172.21.15.67:0/1845203831 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f400f8f0 con 0x562dec2349a0 2024-09-10T21:00:24.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.543+0000 7f49f17fa640 1 -- 172.21.15.67:0/1845203831 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49f4005040 con 0x562dec2349a0 2024-09-10T21:00:24.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.543+0000 7f49f17fa640 1 -- 172.21.15.67:0/1845203831 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4019690 con 0x562dec2349a0 2024-09-10T21:00:24.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.543+0000 7f4a03f07740 1 -- 172.21.15.67:0/1845203831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 msgr2=0x562dec22c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.543+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006010 tx=0x7f49f4009bf0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 -- 172.21.15.67:0/1845203831 shutdown_connections 2024-09-10T21:00:24.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec2349a0 0x562dec22c910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec228a10 0x562dec230bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1845203831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec2408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 -- 172.21.15.67:0/1845203831 >> 172.21.15.67:0/1845203831 conn(0x562dec225f20 msgr2=0x562dec231470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 -- 172.21.15.67:0/1845203831 shutdown_connections 2024-09-10T21:00:24.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.544+0000 7f4a03f07740 1 -- 172.21.15.67:0/1845203831 wait complete. 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.545+0000 7f4a03f07740 1 -- start start 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.545+0000 7f4a03f07740 1 Processor -- start 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.545+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec23c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.545+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec23cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.545+0000 7f4a03f07740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec237910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f4a03f07740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1aebf0 con 0x562dec2280f0 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f4a03f07740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1b0060 con 0x562dec2349a0 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f4a03f07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc1af2c0 con 0x562dec228a10 2024-09-10T21:00:24.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec23c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f4a03f07740 10 client.0 _ll_register_callbacks cb 0x7f49ec009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fb7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec23c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54362/0 (socket says 172.21.15.67:54362) 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fb7fe640 1 -- 172.21.15.67:0/1513187216 learned_addr learned my addr 172.21.15.67:0/1513187216 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec237910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49f3fff640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec23cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 -- 172.21.15.67:0/1513187216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 msgr2=0x562dec23cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec23cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 -- 172.21.15.67:0/1513187216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 msgr2=0x562dec23c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec23c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 -- 172.21.15.67:0/1513187216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dec23d6f0 con 0x562dec2349a0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49fbfff640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec237910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49f401b040 tx=0x7f49f4003e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb975bb68dec1b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.546+0000 7f49daffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f400fb00 con 0x562dec2349a0 2024-09-10T21:00:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f49f400fca0 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49f4005040 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49f4005bd0 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 10 client.26180 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562dec2b1e90 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49f4005040 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f49f4019430 con 0x562dec2349a0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 10 client.26180 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 10 client.26180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 20 client.26180 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec2b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 4 client.26180 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562dec19c8a0 con 0x562dec244900 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.547+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec2b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:24.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.548+0000 7f49daffd640 10 client.26180 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.549+0000 7f49fb7fe640 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec2b43c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed3b771201437b6 server_cookie=730b81f0a4d35f45 in_seq=0 out_seq=0 2024-09-10T21:00:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.551+0000 7f49daffd640 1 -- 172.21.15.67:0/1513187216 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562dec19c8a0 con 0x562dec244900 2024-09-10T21:00:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.551+0000 7f49daffd640 10 client.26180 handle_command_reply: tid=0 2024-09-10T21:00:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 client.26180 shutdown 2024-09-10T21:00:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 msgr2=0x562dec237910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec237910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49f401b040 tx=0x7f49f4003e80 comp rx=0 tx=0).stop 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 shutdown_connections 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562dec244900 0x562dec2b43c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562dec2349a0 0x562dec237910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dec228a10 0x562dec23cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 --2- 172.21.15.67:0/1513187216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562dec2280f0 0x562dec23c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 >> 172.21.15.67:0/1513187216 conn(0x562dec225f20 msgr2=0x562dec22c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f49daffd640 0 client.26180 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 shutdown_connections 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 1 -- 172.21.15.67:0/1513187216 wait complete. 2024-09-10T21:00:24.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.552+0000 7f4a03f07740 20 client.26180 trim_cache size 0 max 16384 2024-09-10T21:00:24.558 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:00:24.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 msgr2=0x7f49e80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 0x7f49e80b7790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x562dec226e00 tx=0x7f49ec005f90 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 msgr2=0x7f49fc19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f49e4005940 tx=0x7f49e40040c0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 shutdown_connections 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f49e80b52d0 0x7f49e80b7790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49fc108060 0x7f49fc1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49fc1076e0 0x7f49fc19ba00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 --2- 172.21.15.67:0/3925685659 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f49fc101cd0 0x7f49fc19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 >> 172.21.15.67:0/3925685659 conn(0x7f49fc0fd740 msgr2=0x7f49fc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 shutdown_connections 2024-09-10T21:00:24.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:24.553+0000 7f4a01b32640 1 -- 172.21.15.67:0/3925685659 wait complete. 2024-09-10T21:00:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:24 smithi172 ceph-mon[35265]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.5 MiB/s wr, 731 op/s 2024-09-10T21:00:25.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:24 smithi067 ceph-mon[30891]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.5 MiB/s wr, 731 op/s 2024-09-10T21:00:25.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:24 smithi083 ceph-mon[35058]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 7.5 MiB/s wr, 731 op/s 2024-09-10T21:00:26.311 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:00:26.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:00:26.707 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:26.897 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:26 smithi067 ceph-mon[30891]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.8 MiB/s wr, 667 op/s 2024-09-10T21:00:26.944 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:26 smithi083 ceph-mon[35058]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.8 MiB/s wr, 667 op/s 2024-09-10T21:00:26.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:26 smithi172 ceph-mon[35265]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.8 MiB/s wr, 667 op/s 2024-09-10T21:00:27.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 -- 172.21.15.67:0/1462576497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b4108030 msgr2=0x7f89b406b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 --2- 172.21.15.67:0/1462576497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b4108030 0x7f89b406b2d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009be0 tx=0x7f89ac02a6e0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 -- 172.21.15.67:0/1462576497 shutdown_connections 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 --2- 172.21.15.67:0/1462576497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b4108030 0x7f89b406b2d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 --2- 172.21.15.67:0/1462576497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b41076b0 0x7f89b4107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 --2- 172.21.15.67:0/1462576497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b4102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 -- 172.21.15.67:0/1462576497 >> 172.21.15.67:0/1462576497 conn(0x7f89b40fd730 msgr2=0x7f89b40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 -- 172.21.15.67:0/1462576497 shutdown_connections 2024-09-10T21:00:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.306+0000 7f89b8df9640 1 -- 172.21.15.67:0/1462576497 wait complete. 2024-09-10T21:00:27.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 Processor -- start 2024-09-10T21:00:27.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 -- start start 2024-09-10T21:00:27.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 0x7f89b419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 0x7f89b41a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4115020 con 0x7f89b4101ca0 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f89b4114ea0 con 0x7f89b41076b0 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b8df9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41151a0 con 0x7f89b4108030 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b259c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54376/0 (socket says 172.21.15.67:54376) 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b259c640 1 -- 172.21.15.67:0/4115627118 learned_addr learned my addr 172.21.15.67:0/4115627118 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.307+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 0x7f89b419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 0x7f89b41a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 -- 172.21.15.67:0/4115627118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 msgr2=0x7f89b41a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 0x7f89b41a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 -- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 msgr2=0x7f89b419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 -- 172.21.15.67:0/4115627118 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b41a1580 con 0x7f89b41076b0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 0x7f89b41a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.308+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 0x7f89b419ba10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009fd0 tx=0x7f89a800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.309+0000 7f89a37fe640 1 -- 172.21.15.67:0/4115627118 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8015020 con 0x7f89b41076b0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.309+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b41a1870 con 0x7f89b41076b0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.309+0000 7f89a37fe640 1 -- 172.21.15.67:0/4115627118 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a8011ce0 con 0x7f89b41076b0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.309+0000 7f89a37fe640 1 -- 172.21.15.67:0/4115627118 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8015020 con 0x7f89b41076b0 2024-09-10T21:00:27.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.309+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b41a7f30 con 0x7f89b41076b0 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 Processor -- start 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 -- start start 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89a37fe640 1 -- 172.21.15.67:0/4115627118 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f89a8011830 con 0x7f89b41076b0 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a20250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56074098ae60 con 0x560740a13ee0 2024-09-10T21:00:27.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56074097a290 con 0x560740a14800 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56074097e0a0 con 0x560740a20790 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89b1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.313+0000 7f89b2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54388/0 (socket says 172.21.15.67:54388) 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56100/0 (socket says 172.21.15.67:56100) 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b2d9d640 1 -- 172.21.15.67:0/3394959626 learned_addr learned my addr 172.21.15.67:0/3394959626 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b259c640 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a20250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 -- 172.21.15.67:0/3394959626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 msgr2=0x560740a20250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a20250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 -- 172.21.15.67:0/3394959626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 msgr2=0x560740a142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 -- 172.21.15.67:0/3394959626 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607406d8930 con 0x560740a20790 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89a80e2a90 tx=0x7f89a80eb810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d848f9145c90ebc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89a37fe640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 0x7f899c0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.314+0000 7f89a0ff9640 1 -- 172.21.15.67:0/3394959626 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a80aaf20 con 0x560740a20790 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.315+0000 7f89a0ff9640 1 -- 172.21.15.67:0/3394959626 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a80abeb0 con 0x560740a20790 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.315+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 0x7f899c0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.315+0000 7f89a0ff9640 1 -- 172.21.15.67:0/3394959626 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a80ab100 con 0x560740a20790 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.315+0000 7f89a37fe640 1 -- 172.21.15.67:0/4115627118 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f89a8011630 con 0x7f89b41076b0 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 0x7f899c0b7bd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0099a0 tx=0x7f89ac02abe0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 -- 172.21.15.67:0/3394959626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 msgr2=0x560740a22b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89a80e2a90 tx=0x7f89a80eb810 comp rx=0 tx=0).stop 2024-09-10T21:00:27.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 -- 172.21.15.67:0/3394959626 shutdown_connections 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a22b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a20250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/3394959626 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 -- 172.21.15.67:0/3394959626 >> 172.21.15.67:0/3394959626 conn(0x560740a11d10 msgr2=0x560740a12eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 -- 172.21.15.67:0/3394959626 shutdown_connections 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.316+0000 7f89bb1ce740 1 -- 172.21.15.67:0/3394959626 wait complete. 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 -- start start 2024-09-10T21:00:27.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 Processor -- start 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a20790 0x560740a1e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5607407db890 con 0x560740a14800 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560740914d40 con 0x560740a20790 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560740a23440 con 0x560740a13ee0 2024-09-10T21:00:27.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89bb1ce740 10 client.0 _ll_register_callbacks cb 0x560740978c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89b259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89b1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89b259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56110/0 (socket says 172.21.15.67:56110) 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89b259c640 1 -- 172.21.15.67:0/1618391457 learned_addr learned my addr 172.21.15.67:0/1618391457 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.317+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a20790 0x560740a1e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 -- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a20790 msgr2=0x560740a1e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a20790 0x560740a1e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 -- 172.21.15.67:0/1618391457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 msgr2=0x560740a1dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 -- 172.21.15.67:0/1618391457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560740a2c770 con 0x560740a13ee0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89b259c640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f89a400bbd0 tx=0x7f89a40039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da18ed72ccb9ec72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f8999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a400be40 con 0x560740a13ee0 2024-09-10T21:00:27.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a80abeb0 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f89a4011650 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89a4011850 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89bb1ce740 10 client.26146 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.318+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560740a2f180 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a80abeb0 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f89a4026b10 con 0x560740a13ee0 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 10 client.26146 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 10 client.26146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 20 client.26146 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740a32b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 4 client.26146 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56074098cdb0 con 0x560740a30690 2024-09-10T21:00:27.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.319+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740a32b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.322+0000 7f89b1d9b640 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740a32b20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad16de7ebc79cacd server_cookie=1bb3223f2c4ec2ec in_seq=0 out_seq=0 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.322+0000 7f8999ffb640 10 client.26146 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f8999ffb640 1 -- 172.21.15.67:0/1618391457 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56074098cdb0 con 0x560740a30690 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f8999ffb640 10 client.26146 handle_command_reply: tid=0 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 client.26146 shutdown 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 msgr2=0x560740a1d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f89a400bbd0 tx=0x7f89a40039c0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 shutdown_connections 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740a32b20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a20790 0x560740a1e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f8999ffb640 0 client.26146 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:27.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1618391457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a13ee0 0x560740a1d6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.323+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 >> 172.21.15.67:0/1618391457 conn(0x560740a11d10 msgr2=0x560740a10f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.324+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 shutdown_connections 2024-09-10T21:00:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.324+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1618391457 wait complete. 2024-09-10T21:00:27.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.324+0000 7f89bb1ce740 20 client.26146 trim_cache size 0 max 16384 2024-09-10T21:00:27.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.354+0000 7f89bb1ce740 1 Processor -- start 2024-09-10T21:00:27.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.354+0000 7f89bb1ce740 1 -- start start 2024-09-10T21:00:27.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a13ee0 0x560740a133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b2e40 con 0x560740a14800 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b0710 con 0x560740a13ee0 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.355+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41ae560 con 0x560740a20790 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56118/0 (socket says 172.21.15.67:56118) 2024-09-10T21:00:27.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 -- 172.21.15.67:0/1702876413 learned_addr learned my addr 172.21.15.67:0/1702876413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 -- 172.21.15.67:0/1702876413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a13ee0 msgr2=0x560740a133d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a13ee0 0x560740a133d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 -- 172.21.15.67:0/1702876413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 msgr2=0x560740a1f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.358+0000 7f89b2d9d640 1 -- 172.21.15.67:0/1702876413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560740a12790 con 0x560740a20790 2024-09-10T21:00:27.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.359+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89ac02ac50 tx=0x7f89ac03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16dd212943e42b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.369+0000 7f899bfff640 1 -- 172.21.15.67:0/1702876413 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac050070 con 0x560740a20790 2024-09-10T21:00:27.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.369+0000 7f899bfff640 1 -- 172.21.15.67:0/1702876413 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac030d70 con 0x560740a20790 2024-09-10T21:00:27.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.370+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1702876413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 msgr2=0x560740a383f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.370+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89ac02ac50 tx=0x7f89ac03f000 comp rx=0 tx=0).stop 2024-09-10T21:00:27.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.372+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1702876413 shutdown_connections 2024-09-10T21:00:27.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.372+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a383f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.372+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a14800 0x560740a1f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.372+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/1702876413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a13ee0 0x560740a133d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.372+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1702876413 >> 172.21.15.67:0/1702876413 conn(0x560740a11d10 msgr2=0x560740a1ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.377+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1702876413 shutdown_connections 2024-09-10T21:00:27.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.381+0000 7f89bb1ce740 1 -- 172.21.15.67:0/1702876413 wait complete. 2024-09-10T21:00:27.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.381+0000 7f89bb1ce740 1 -- start start 2024-09-10T21:00:27.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.381+0000 7f89bb1ce740 1 Processor -- start 2024-09-10T21:00:27.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a28bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a25630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41aebd0 con 0x560740a13ee0 2024-09-10T21:00:27.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41b0040 con 0x560740a14800 2024-09-10T21:00:27.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89b41af2a0 con 0x560740a20790 2024-09-10T21:00:27.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.382+0000 7f89bb1ce740 10 client.0 _ll_register_callbacks cb 0x7f89a4004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:27.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.385+0000 7f89b1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.385+0000 7f89b1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55434/0 (socket says 172.21.15.67:55434) 2024-09-10T21:00:27.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.385+0000 7f89b1d9b640 1 -- 172.21.15.67:0/4038733309 learned_addr learned my addr 172.21.15.67:0/4038733309 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:27.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.385+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a25630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.387+0000 7f89b2d9d640 1 -- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 msgr2=0x560740a250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.387+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.387+0000 7f89b2d9d640 1 -- 172.21.15.67:0/4038733309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 msgr2=0x560740a28bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:27.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.387+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a28bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.387+0000 7f89b2d9d640 1 -- 172.21.15.67:0/4038733309 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560740a25ba0 con 0x560740a20790 2024-09-10T21:00:27.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.389+0000 7f89b2d9d640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a25630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89ac005f00 tx=0x7f89ac04c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba8dd58481557a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:27.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.389+0000 7f8999ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:00:27.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.389+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac05d070 con 0x560740a20790 2024-09-10T21:00:27.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.389+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89ac030d70 con 0x560740a20790 2024-09-10T21:00:27.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.389+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f89ac04cb20 con 0x560740a20790 2024-09-10T21:00:27.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.392+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89ac069050 con 0x560740a20790 2024-09-10T21:00:27.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.392+0000 7f89bb1ce740 10 client.26152 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:27.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.392+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560740a9e430 con 0x560740a20790 2024-09-10T21:00:27.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ac030d70 con 0x560740a20790 2024-09-10T21:00:27.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f89ac055650 con 0x560740a20790 2024-09-10T21:00:27.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 10 client.26152 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:27.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 10 client.26152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:27.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 20 client.26152 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:27.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740aa0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:27.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 4 client.26152 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:00:27.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.393+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560740988860 con 0x560740a30690 2024-09-10T21:00:27.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.394+0000 7f89b259c640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740aa0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:27.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.395+0000 7f89b259c640 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740aa0aa0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444192f7c92a6ea7 server_cookie=6689216fcfc16a26 in_seq=0 out_seq=0 2024-09-10T21:00:27.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.395+0000 7f8999ffb640 10 client.26152 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f8999ffb640 1 -- 172.21.15.67:0/4038733309 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560740988860 con 0x560740a30690 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f8999ffb640 10 client.26152 handle_command_reply: tid=0 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 client.26152 shutdown 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 msgr2=0x560740a25630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a25630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f89ac005f00 tx=0x7f89ac04c460 comp rx=0 tx=0).stop 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 shutdown_connections 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560740a30690 0x560740aa0aa0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560740a20790 0x560740a25630 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560740a14800 0x560740a250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 --2- 172.21.15.67:0/4038733309 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560740a13ee0 0x560740a28bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.398+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 >> 172.21.15.67:0/4038733309 conn(0x560740a11d10 msgr2=0x560740a1f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.399+0000 7f8999ffb640 0 client.26152 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.399+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 shutdown_connections 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.399+0000 7f89bb1ce740 1 -- 172.21.15.67:0/4038733309 wait complete. 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.399+0000 7f89bb1ce740 20 client.26152 trim_cache size 0 max 16384 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "4fd089fd-25a7-43b5-8370-7c6c02380382", 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:00:27.405 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:00:27.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 msgr2=0x7f899c0b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 0x7f899c0b7bd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0099a0 tx=0x7f89ac02abe0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 msgr2=0x7f89b419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 0x7f89b419ba10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009fd0 tx=0x7f89a800b870 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 shutdown_connections 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f899c0b5710 0x7f899c0b7bd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b4108030 0x7f89b41a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89b41076b0 0x7f89b419ba10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 --2- 172.21.15.67:0/4115627118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89b4101ca0 0x7f89b419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 >> 172.21.15.67:0/4115627118 conn(0x7f89b40fd730 msgr2=0x7f89b41054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 shutdown_connections 2024-09-10T21:00:27.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:27.400+0000 7f89b8df9640 1 -- 172.21.15.67:0/4115627118 wait complete. 2024-09-10T21:00:27.914 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:27 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:00:27.914 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:27.914 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:00:27.914 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:27 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:00:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:00:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:27.954 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:27 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:00:27.954 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:27.954 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:00:27.954 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:28.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:00:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:00:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:28 smithi172 ceph-mon[35265]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 656 op/s 2024-09-10T21:00:29.152 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:28 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:00:29.152 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:28 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:00:29.152 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:28 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:29.153 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:28 smithi083 ceph-mon[35058]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 656 op/s 2024-09-10T21:00:29.153 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:28 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:00:29.153 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:28 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:00:29.153 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:28 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:29.154 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:28 smithi067 ceph-mon[30891]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.1 MiB/s wr, 656 op/s 2024-09-10T21:00:29.154 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:28 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:00:29.154 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:28 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:00:29.154 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:28 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:29.154 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 535.0 s, 2289.2 tps, lat 43.817 ms stddev 48.765 2024-09-10T21:00:29.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.280+0000 7fcb53556640 1 -- 172.21.15.67:0/1919083003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c11c0a0 msgr2=0x7fcb4c11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.280+0000 7fcb53556640 1 --2- 172.21.15.67:0/1919083003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c11e490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009900 tx=0x7fcb4802a4d0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.284+0000 7fcb53556640 1 -- 172.21.15.67:0/1919083003 shutdown_connections 2024-09-10T21:00:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.284+0000 7fcb53556640 1 --2- 172.21.15.67:0/1919083003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c11e490 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.284+0000 7fcb53556640 1 --2- 172.21.15.67:0/1919083003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c10a530 0x7fcb4c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.284+0000 7fcb53556640 1 --2- 172.21.15.67:0/1919083003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a150 0x7fcb4c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.284+0000 7fcb53556640 1 -- 172.21.15.67:0/1919083003 >> 172.21.15.67:0/1919083003 conn(0x7fcb4c06dfc0 msgr2=0x7fcb4c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.290+0000 7fcb53556640 1 -- 172.21.15.67:0/1919083003 shutdown_connections 2024-09-10T21:00:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.290+0000 7fcb53556640 1 -- 172.21.15.67:0/1919083003 wait complete. 2024-09-10T21:00:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.291+0000 7fcb53556640 1 Processor -- start 2024-09-10T21:00:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.291+0000 7fcb53556640 1 -- start start 2024-09-10T21:00:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.291+0000 7fcb53556640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.291+0000 7fcb53556640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a530 0x7fcb4c119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb53556640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c112960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb53556640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c121c60 con 0x7fcb4c10a530 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb53556640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c121ae0 con 0x7fcb4c10a150 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb53556640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c121de0 con 0x7fcb4c11c0a0 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55442/0 (socket says 172.21.15.67:55442) 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb512f2640 1 -- 172.21.15.67:0/3294263434 learned_addr learned my addr 172.21.15.67:0/3294263434 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb51af3640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c112960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb50af1640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a530 0x7fcb4c119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb512f2640 1 -- 172.21.15.67:0/3294263434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 msgr2=0x7fcb4c112960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.292+0000 7fcb512f2640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c112960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.293+0000 7fcb512f2640 1 -- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a530 msgr2=0x7fcb4c119a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.293+0000 7fcb512f2640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a530 0x7fcb4c119a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.293+0000 7fcb512f2640 1 -- 172.21.15.67:0/3294263434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c113220 con 0x7fcb4c10a150 2024-09-10T21:00:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.293+0000 7fcb51af3640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c112960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:00:29.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.293+0000 7fcb512f2640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b450 tx=0x7fcb3c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.297+0000 7fcb427fc640 1 -- 172.21.15.67:0/3294263434 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c015020 con 0x7fcb4c10a150 2024-09-10T21:00:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.297+0000 7fcb427fc640 1 -- 172.21.15.67:0/3294263434 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb3c011d40 con 0x7fcb4c10a150 2024-09-10T21:00:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.297+0000 7fcb427fc640 1 -- 172.21.15.67:0/3294263434 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00f340 con 0x7fcb4c10a150 2024-09-10T21:00:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.297+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c113510 con 0x7fcb4c10a150 2024-09-10T21:00:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.297+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1184c0 con 0x7fcb4c10a150 2024-09-10T21:00:29.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.304+0000 7fcb427fc640 1 -- 172.21.15.67:0/3294263434 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcb3c011890 con 0x7fcb4c10a150 2024-09-10T21:00:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 Processor -- start 2024-09-10T21:00:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 -- start start 2024-09-10T21:00:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 0x55a072108860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721147f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a07207ee50 con 0x55a072108480 2024-09-10T21:00:29.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a07206e280 con 0x55a072114d30 2024-09-10T21:00:29.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb5592b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a072072090 con 0x55a072108da0 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb50af1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb50af1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55448/0 (socket says 172.21.15.67:55448) 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.305+0000 7fcb50af1640 1 -- 172.21.15.67:0/1844157949 learned_addr learned my addr 172.21.15.67:0/1844157949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 0x55a072108860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb50af1640 1 -- 172.21.15.67:0/1844157949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 msgr2=0x55a0721147f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb427fc640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 0x7fcb380b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721147f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721147f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb50af1640 1 -- 172.21.15.67:0/1844157949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 msgr2=0x55a072108860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 0x55a072108860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb50af1640 1 -- 172.21.15.67:0/1844157949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a071dcc650 con 0x55a072114d30 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.306+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 0x55a072108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:00:29.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb51af3640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 0x7fcb380b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b4d0 tx=0x7fcb440096b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e474cf404fd564f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb427fc640 1 -- 172.21.15.67:0/3294263434 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb3c0e57f0 con 0x7fcb4c10a150 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb377fe640 1 -- 172.21.15.67:0/1844157949 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400a970 con 0x55a072114d30 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb377fe640 1 -- 172.21.15.67:0/1844157949 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb44019070 con 0x55a072114d30 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.307+0000 7fcb377fe640 1 -- 172.21.15.67:0/1844157949 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44013380 con 0x55a072114d30 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.309+0000 7fcb5592b740 1 -- 172.21.15.67:0/1844157949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 msgr2=0x55a072117120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.309+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b4d0 tx=0x7fcb440096b0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 -- 172.21.15.67:0/1844157949 shutdown_connections 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072114d30 0x55a072117120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721147f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1844157949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108480 0x55a072108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 -- 172.21.15.67:0/1844157949 >> 172.21.15.67:0/1844157949 conn(0x55a0721062b0 msgr2=0x55a072107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb51af3640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 0x7fcb380b79b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb48031440 tx=0x7fcb48009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 -- 172.21.15.67:0/1844157949 shutdown_connections 2024-09-10T21:00:29.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.311+0000 7fcb5592b740 1 -- 172.21.15.67:0/1844157949 wait complete. 2024-09-10T21:00:29.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.312+0000 7fcb5592b740 1 -- start start 2024-09-10T21:00:29.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.312+0000 7fcb5592b740 1 Processor -- start 2024-09-10T21:00:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.312+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a072111a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a072111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a071ecf700 con 0x55a072114d30 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a072009110 con 0x55a072108480 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a0721179b0 con 0x55a072108da0 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb50af1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a072111a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55456/0 (socket says 172.21.15.67:55456) 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 -- 172.21.15.67:0/1501187113 learned_addr learned my addr 172.21.15.67:0/1501187113 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb50af1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a072111a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:56166/0 (socket says 172.21.15.67:56166) 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a072111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb5592b740 10 client.0 _ll_register_callbacks cb 0x55a072022990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 -- 172.21.15.67:0/1501187113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 msgr2=0x55a072111a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a072111a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 -- 172.21.15.67:0/1501187113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 msgr2=0x55a072111ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a072111ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.313+0000 7fcb512f2640 1 -- 172.21.15.67:0/1501187113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a072036c40 con 0x55a072108480 2024-09-10T21:00:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.314+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb44019070 con 0x55a072108480 2024-09-10T21:00:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.314+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0abf10 tx=0x7fcb3c0a86c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49dcfcd16f419b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.314+0000 7fcb34ff9640 10 client.26207 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.315+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1501187113 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0ab6f0 con 0x55a072108480 2024-09-10T21:00:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.315+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1501187113 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb3c0ab1e0 con 0x55a072108480 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.315+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1501187113 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcb3c0ab420 con 0x55a072108480 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.315+0000 7fcb5592b740 10 client.26207 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.315+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55a0721230e0 con 0x55a072108480 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1501187113 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fcb3c0c1b00 con 0x55a072108480 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 10 client.26207 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 10 client.26207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 20 client.26207 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072126cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 4 client.26207 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a072080da0 con 0x55a0721248a0 2024-09-10T21:00:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.316+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072126cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.317+0000 7fcb34ff9640 10 client.26207 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.317+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072126cd0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b69e6941d9d0f63 server_cookie=fdfe27207980c790 in_seq=0 out_seq=0 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1501187113 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a072080da0 con 0x55a0721248a0 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb34ff9640 10 client.26207 handle_command_reply: tid=0 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 client.26207 shutdown 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 msgr2=0x55a0721145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0abf10 tx=0x7fcb3c0a86c0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 shutdown_connections 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072126cd0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a072111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb34ff9640 0 client.26207 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a072111a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1501187113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a0721145e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.318+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 >> 172.21.15.67:0/1501187113 conn(0x55a0721062b0 msgr2=0x55a07210be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.319+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 shutdown_connections 2024-09-10T21:00:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.319+0000 7fcb5592b740 1 -- 172.21.15.67:0/1501187113 wait complete. 2024-09-10T21:00:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.319+0000 7fcb5592b740 20 client.26207 trim_cache size 0 max 16384 2024-09-10T21:00:29.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.346+0000 7fcb5592b740 1 Processor -- start 2024-09-10T21:00:29.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.346+0000 7fcb5592b740 1 -- start start 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55472/0 (socket says 172.21.15.67:55472) 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb512f2640 1 -- 172.21.15.67:0/1416834167 learned_addr learned my addr 172.21.15.67:0/1416834167 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.347+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a0721107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c8310 con 0x55a072114d30 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c5be0 con 0x55a072108480 2024-09-10T21:00:29.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c3a30 con 0x55a072108da0 2024-09-10T21:00:29.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a0721107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 -- 172.21.15.67:0/1416834167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 msgr2=0x55a0721102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 -- 172.21.15.67:0/1416834167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 msgr2=0x55a0721107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a0721107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 -- 172.21.15.67:0/1416834167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a072106d30 con 0x55a072108480 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c011d10 tx=0x7fcb3c01c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767c6e546c6ee3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.348+0000 7fcb36ffd640 1 -- 172.21.15.67:0/1416834167 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0aba90 con 0x55a072108480 2024-09-10T21:00:29.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb36ffd640 1 -- 172.21.15.67:0/1416834167 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb44019070 con 0x55a072108480 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb36ffd640 1 -- 172.21.15.67:0/1416834167 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0abf80 con 0x55a072108480 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 msgr2=0x55a072110f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c011d10 tx=0x7fcb3c01c000 comp rx=0 tx=0).stop 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 shutdown_connections 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072114d30 0x55a0721107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072108da0 0x55a0721102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1416834167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a072110f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 >> 172.21.15.67:0/1416834167 conn(0x55a0721062b0 msgr2=0x55a07210cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.349+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 shutdown_connections 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 -- 172.21.15.67:0/1416834167 wait complete. 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 -- start start 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 Processor -- start 2024-09-10T21:00:29.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108da0 0x55a07211d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 0x55a072117c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c40a0 con 0x55a072108da0 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c5510 con 0x55a072108480 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb5592b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c1c4770 con 0x55a072114d30 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb512f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55480/0 (socket says 172.21.15.67:55480) 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.350+0000 7fcb512f2640 1 -- 172.21.15.67:0/1019925688 learned_addr learned my addr 172.21.15.67:0/1019925688 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb5592b740 10 client.0 _ll_register_callbacks cb 0x7fcb3c011c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108da0 0x55a07211d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 0x55a072117c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb512f2640 1 -- 172.21.15.67:0/1019925688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 msgr2=0x55a072117c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 0x55a072117c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb512f2640 1 -- 172.21.15.67:0/1019925688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108da0 msgr2=0x55a07211d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:00:29.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108da0 0x55a07211d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.351+0000 7fcb512f2640 1 -- 172.21.15.67:0/1019925688 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07211d900 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.352+0000 7fcb51af3640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 0x55a072117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.352+0000 7fcb512f2640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0a91f0 tx=0x7fcb3c0a7b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edc302b184c9062 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.352+0000 7fcb34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0aba90 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb3c0b1bf0 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb44019070 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcb3c0ba050 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb5592b740 10 client.26213 fetch_fsmap learned FSMap version 34 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a072191d20 con 0x55a072108480 2024-09-10T21:00:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.353+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb3c0ac680 con 0x55a072108480 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fcb3c0b1e10 con 0x55a072108480 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 10 client.26213 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 10 client.26213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 20 client.26213 populate_metadata read hostname 'smithi067' 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072194200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 4 client.26213 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fcb44019070 con 0x55a0721248a0 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072194200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb34ff9640 10 client.26213 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.354+0000 7fcb50af1640 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072194200 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4e9d807d526ff04 server_cookie=cad1cce57c820b5f in_seq=0 out_seq=0 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb34ff9640 1 -- 172.21.15.67:0/1019925688 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x7fcb44019070 con 0x55a0721248a0 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb34ff9640 10 client.26213 handle_command_reply: tid=0 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 client.26213 shutdown 2024-09-10T21:00:29.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 msgr2=0x55a07211cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0a91f0 tx=0x7fcb3c0a7b00 comp rx=0 tx=0).stop 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 shutdown_connections 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a0721248a0 0x55a072194200 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a072114d30 0x55a072117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a072108da0 0x55a07211d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 --2- 172.21.15.67:0/1019925688 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a072108480 0x55a07211cc50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 >> 172.21.15.67:0/1019925688 conn(0x55a0721062b0 msgr2=0x55a07210cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb34ff9640 0 client.26213 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 shutdown_connections 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 1 -- 172.21.15.67:0/1019925688 wait complete. 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.355+0000 7fcb5592b740 20 client.26213 trim_cache size 0 max 16384 2024-09-10T21:00:29.363 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "4fd089fd-25a7-43b5-8370-7c6c02380382", 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.365 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:00:29.369 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:00:29.370 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:00:29.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:00:29.372 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:00:29.372 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:00:29.372 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:00:29.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.357+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 msgr2=0x7fcb380b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 0x7fcb380b79b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcb48031440 tx=0x7fcb48009260 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 msgr2=0x7fcb4c119540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b450 tx=0x7fcb3c00b910 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 shutdown_connections 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcb380b54f0 0x7fcb380b79b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb4c11c0a0 0x7fcb4c112960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb4c10a530 0x7fcb4c119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 --2- 172.21.15.67:0/3294263434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb4c10a150 0x7fcb4c119540 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 >> 172.21.15.67:0/3294263434 conn(0x7fcb4c06dfc0 msgr2=0x7fcb4c11c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 shutdown_connections 2024-09-10T21:00:29.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:00:29.358+0000 7fcb53556640 1 -- 172.21.15.67:0/3294263434 wait complete. 2024-09-10T21:00:29.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:29 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:29.996 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:29 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:30.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:29 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:00:30.340 INFO:tasks.cephfs.filesystem:scrub status for tag:4fd089fd-25a7-43b5-8370-7c6c02380382 - {'path': '/', 'tag': '4fd089fd-25a7-43b5-8370-7c6c02380382', 'options': 'recursive,force'} 2024-09-10T21:00:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:30 smithi172 ceph-mon[35265]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 617 op/s 2024-09-10T21:00:31.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:30 smithi067 ceph-mon[30891]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 617 op/s 2024-09-10T21:00:31.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:30 smithi083 ceph-mon[35058]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 617 op/s 2024-09-10T21:00:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:32 smithi172 ceph-mon[35265]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:33.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:32 smithi067 ceph-mon[30891]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:33.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:32 smithi083 ceph-mon[35058]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.0 MiB/s wr, 599 op/s 2024-09-10T21:00:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 540.0 s, 1873.2 tps, lat 53.837 ms stddev 65.538 2024-09-10T21:00:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:34 smithi172 ceph-mon[35265]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-10T21:00:35.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:34 smithi067 ceph-mon[30891]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-10T21:00:35.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:34 smithi083 ceph-mon[35058]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-10T21:00:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:36 smithi172 ceph-mon[35265]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2024-09-10T21:00:37.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:36 smithi067 ceph-mon[30891]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2024-09-10T21:00:37.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:36 smithi083 ceph-mon[35058]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 621 op/s 2024-09-10T21:00:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:38 smithi172 ceph-mon[35265]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 705 op/s 2024-09-10T21:00:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 545.0 s, 2687.8 tps, lat 37.097 ms stddev 44.262 2024-09-10T21:00:39.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:38 smithi067 ceph-mon[30891]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 705 op/s 2024-09-10T21:00:39.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:38 smithi083 ceph-mon[35058]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.2 MiB/s wr, 705 op/s 2024-09-10T21:00:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:40 smithi172 ceph-mon[35265]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 653 op/s 2024-09-10T21:00:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:40 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:00:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:40 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:00:41.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:40 smithi067 ceph-mon[30891]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 653 op/s 2024-09-10T21:00:41.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:40 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:00:41.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:40 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:00:41.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:40 smithi083 ceph-mon[35058]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 653 op/s 2024-09-10T21:00:41.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:40 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:00:41.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:40 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:00:41.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:00:42.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:00:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:00:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:42 smithi067 ceph-mon[30891]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2024-09-10T21:00:42.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:42 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:00:43.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:42 smithi083 ceph-mon[35058]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2024-09-10T21:00:43.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:42 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:00:43.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:42 smithi172 ceph-mon[35265]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 622 op/s 2024-09-10T21:00:43.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:42 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:00:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 550.0 s, 2368.0 tps, lat 42.021 ms stddev 50.413 2024-09-10T21:00:44.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:00:44.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:00:44.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:00:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:00:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:00:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:00:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:00:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:00:44.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:00:45.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:44 smithi067 ceph-mon[30891]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 723 op/s 2024-09-10T21:00:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:44 smithi083 ceph-mon[35058]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 723 op/s 2024-09-10T21:00:45.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:44 smithi172 ceph-mon[35265]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.3 MiB/s wr, 723 op/s 2024-09-10T21:00:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:46 smithi067 ceph-mon[30891]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2024-09-10T21:00:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:46 smithi083 ceph-mon[35058]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2024-09-10T21:00:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:46 smithi172 ceph-mon[35265]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 709 op/s 2024-09-10T21:00:48.049 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:47 smithi067 ceph-mon[30891]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-10T21:00:48.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:47 smithi083 ceph-mon[35058]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-10T21:00:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:47 smithi172 ceph-mon[35265]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.7 MiB/s wr, 670 op/s 2024-09-10T21:00:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 555.0 s, 2595.8 tps, lat 38.753 ms stddev 44.229 2024-09-10T21:00:50.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:50 smithi083 ceph-mon[35058]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-10T21:00:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:50 smithi172 ceph-mon[35265]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-10T21:00:50.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:50 smithi067 ceph-mon[30891]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-09-10T21:00:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:52 smithi083 ceph-mon[35058]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 657 op/s 2024-09-10T21:00:52.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:52 smithi172 ceph-mon[35265]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 657 op/s 2024-09-10T21:00:52.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:52 smithi067 ceph-mon[30891]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.0 MiB/s wr, 657 op/s 2024-09-10T21:00:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 560.0 s, 2312.6 tps, lat 42.605 ms stddev 48.872 2024-09-10T21:00:54.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:54 smithi083 ceph-mon[35058]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 MiB/s wr, 761 op/s 2024-09-10T21:00:54.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:54 smithi172 ceph-mon[35265]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 MiB/s wr, 761 op/s 2024-09-10T21:00:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:54 smithi067 ceph-mon[30891]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.1 MiB/s wr, 761 op/s 2024-09-10T21:00:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:56 smithi083 ceph-mon[35058]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 701 op/s 2024-09-10T21:00:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:56 smithi172 ceph-mon[35265]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 701 op/s 2024-09-10T21:00:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:56 smithi067 ceph-mon[30891]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 701 op/s 2024-09-10T21:00:58.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:00:58 smithi083 ceph-mon[35058]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 700 op/s 2024-09-10T21:00:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:00:58 smithi172 ceph-mon[35265]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 700 op/s 2024-09-10T21:00:58.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:00:58 smithi067 ceph-mon[30891]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 700 op/s 2024-09-10T21:00:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 565.0 s, 2013.2 tps, lat 50.424 ms stddev 63.525 2024-09-10T21:01:00.341 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:01:00.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:00 smithi083 ceph-mon[35058]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-10T21:01:00.404 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:00 smithi067 ceph-mon[30891]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-10T21:01:00.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:00 smithi172 ceph-mon[35265]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7.2 MiB/s wr, 667 op/s 2024-09-10T21:01:00.729 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 -- 172.21.15.67:0/777333071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc101076a0 msgr2=0x7fdc10107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 --2- 172.21.15.67:0/777333071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc101076a0 0x7fdc10107ae0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009900 tx=0x7fdbf802a410 comp rx=0 tx=0).stop 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 -- 172.21.15.67:0/777333071 shutdown_connections 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 --2- 172.21.15.67:0/777333071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc10108020 0x7fdc1010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 --2- 172.21.15.67:0/777333071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc101076a0 0x7fdc10107ae0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 --2- 172.21.15.67:0/777333071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10101c90 0x7fdc10102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.352+0000 7fdc16345640 1 -- 172.21.15.67:0/777333071 >> 172.21.15.67:0/777333071 conn(0x7fdc100fd700 msgr2=0x7fdc100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.354+0000 7fdc16345640 1 -- 172.21.15.67:0/777333071 shutdown_connections 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.354+0000 7fdc16345640 1 -- 172.21.15.67:0/777333071 wait complete. 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.355+0000 7fdc16345640 1 Processor -- start 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.355+0000 7fdc16345640 1 -- start start 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.355+0000 7fdc16345640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 0x7fdc10108910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc16345640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc101076a0 0x7fdc10108e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc16345640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 0x7fdc10109390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc16345640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10111ca0 con 0x7fdc10101c90 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc16345640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10111b20 con 0x7fdc10108020 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc16345640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10111e20 con 0x7fdc101076a0 2024-09-10T21:01:01.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 0x7fdc10108910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 0x7fdc10108910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49000/0 (socket says 172.21.15.67:49000) 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc0ffff640 1 -- 172.21.15.67:0/2216584759 learned_addr learned my addr 172.21.15.67:0/2216584759 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 0x7fdc10109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc07fff640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc101076a0 0x7fdc10108e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 -- 172.21.15.67:0/2216584759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc101076a0 msgr2=0x7fdc10108e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc101076a0 0x7fdc10108e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 -- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 msgr2=0x7fdc10108910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 0x7fdc10108910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 -- 172.21.15.67:0/2216584759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc101a76b0 con 0x7fdc10108020 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.356+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 0x7fdc10109390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009fd0 tx=0x7fdc0800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.357+0000 7fdc0dffb640 1 -- 172.21.15.67:0/2216584759 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0800ce20 con 0x7fdc10108020 2024-09-10T21:01:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.357+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc101a79a0 con 0x7fdc10108020 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.357+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101a7f00 con 0x7fdc10108020 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.357+0000 7fdc0dffb640 1 -- 172.21.15.67:0/2216584759 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc08005020 con 0x7fdc10108020 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.357+0000 7fdc0dffb640 1 -- 172.21.15.67:0/2216584759 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08010690 con 0x7fdc10108020 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc0dffb640 1 -- 172.21.15.67:0/2216584759 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdc080054d0 con 0x7fdc10108020 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 Processor -- start 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 -- start start 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 0x558eeabb3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabc2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558eeab29e50 con 0x558eeabb3480 2024-09-10T21:01:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558eeab19280 con 0x558eeabbfd30 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.360+0000 7fdc1871a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558eeab1d090 con 0x558eeabb3da0 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 0x558eeabb3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 0x558eeabb3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49002/0 (socket says 172.21.15.67:49002) 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:48642/0 (socket says 172.21.15.67:48642) 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc07fff640 1 -- 172.21.15.67:0/1380971178 learned_addr learned my addr 172.21.15.67:0/1380971178 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0dffb640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 0x7fdbfc0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabc2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 0x7fdbfc0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1380971178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 msgr2=0x558eeabc2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabc2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1380971178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 msgr2=0x558eeabb3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 0x558eeabb3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1380971178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eea877650 con 0x558eeabb3da0 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0dffb640 1 -- 172.21.15.67:0/2216584759 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdc080e6240 con 0x7fdc10108020 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009c80 tx=0x7fdc00011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f1cb45c2e97d9ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.361+0000 7fdc067fc640 1 -- 172.21.15.67:0/1380971178 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004230 con 0x558eeabb3da0 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.362+0000 7fdc067fc640 1 -- 172.21.15.67:0/1380971178 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc000043d0 con 0x558eeabb3da0 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.362+0000 7fdc067fc640 1 -- 172.21.15.67:0/1380971178 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004cb0 con 0x558eeabb3da0 2024-09-10T21:01:01.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.362+0000 7fdc148e2640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 0x7fdbfc0b78a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f80 tx=0x7fdc0801b2c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 -- 172.21.15.67:0/1380971178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 msgr2=0x558eeabbf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009c80 tx=0x7fdc00011810 comp rx=0 tx=0).stop 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 -- 172.21.15.67:0/1380971178 shutdown_connections 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabc2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabbf7f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1380971178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3480 0x558eeabb3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.363+0000 7fdc1871a740 1 -- 172.21.15.67:0/1380971178 >> 172.21.15.67:0/1380971178 conn(0x558eeabb12b0 msgr2=0x558eeabb2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.364+0000 7fdc1871a740 1 -- 172.21.15.67:0/1380971178 shutdown_connections 2024-09-10T21:01:01.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.364+0000 7fdc1871a740 1 -- 172.21.15.67:0/1380971178 wait complete. 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.365+0000 7fdc1871a740 1 -- start start 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.365+0000 7fdc1871a740 1 Processor -- start 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabbca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558eea97a700 con 0x558eeabb3da0 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558eeaab4110 con 0x558eeabb3480 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558eeabc29b0 con 0x558eeabbfd30 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc1871a740 10 client.0 _ll_register_callbacks cb 0x558eeaacd990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43704/0 (socket says 172.21.15.67:43704) 2024-09-10T21:01:01.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 -- 172.21.15.67:0/1204018393 learned_addr learned my addr 172.21.15.67:0/1204018393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabbca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 -- 172.21.15.67:0/1204018393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 msgr2=0x558eeabbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 -- 172.21.15.67:0/1204018393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 msgr2=0x558eeabbca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabbca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.366+0000 7fdc07fff640 1 -- 172.21.15.67:0/1204018393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eeaae1c40 con 0x558eeabb3480 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8031440 tx=0x7fdbf8005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9f98d1c75924f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdbef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8035070 con 0x558eeabb3480 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbf8004480 con 0x558eeabb3480 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc000043d0 con 0x558eeabb3480 2024-09-10T21:01:01.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbf8052050 con 0x558eeabb3480 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdc1871a740 10 client.26225 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.367+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558eeabce300 con 0x558eeabb3480 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc000043d0 con 0x558eeabb3480 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdbf8004c50 con 0x558eeabb3480 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 10 client.26225 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 10 client.26225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 20 client.26225 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeabcf760 0x558eeabd1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 4 client.26225 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eeab2bda0 con 0x558eeabcf760 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.368+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeabcf760 0x558eeabd1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.369+0000 7fdbef7fe640 10 client.26225 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:01.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.369+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeabcf760 0x558eeabd1b50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad020c9d0f0ebb09 server_cookie=2666244b5e19895d in_seq=0 out_seq=0 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1204018393 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558eeab2bda0 con 0x558eeabcf760 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdbef7fe640 10 client.26225 handle_command_reply: tid=0 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 client.26225 shutdown 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 msgr2=0x558eeabbf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8031440 tx=0x7fdbf8005b50 comp rx=0 tx=0).stop 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 shutdown_connections 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeabcf760 0x558eeabd1b50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabbca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1204018393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabb3480 0x558eeabbf630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 >> 172.21.15.67:0/1204018393 conn(0x558eeabb12b0 msgr2=0x558eeabb6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdbef7fe640 0 client.26225 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:01.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 shutdown_connections 2024-09-10T21:01:01.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 1 -- 172.21.15.67:0/1204018393 wait complete. 2024-09-10T21:01:01.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.370+0000 7fdc1871a740 20 client.26225 trim_cache size 0 max 16384 2024-09-10T21:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 Processor -- start 2024-09-10T21:01:01.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 -- start start 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabb0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabbb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b2d70 con 0x558eeabac730 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101b0640 con 0x558eeabbfd30 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc1871a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101ae490 con 0x558eeabb3da0 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49014/0 (socket says 172.21.15.67:49014) 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc07fff640 1 -- 172.21.15.67:0/2562026655 learned_addr learned my addr 172.21.15.67:0/2562026655 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.395+0000 7fdc07fff640 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabb0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabbb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 -- 172.21.15.67:0/2562026655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 msgr2=0x558eeabb0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabb0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 -- 172.21.15.67:0/2562026655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 msgr2=0x558eeabbb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabbb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 -- 172.21.15.67:0/2562026655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eeabb3bd0 con 0x558eeabac730 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc07fff640 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8003a70 tx=0x7fdbf8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d591848f349de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc05ffb640 1 -- 172.21.15.67:0/2562026655 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8035070 con 0x558eeabac730 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc05ffb640 1 -- 172.21.15.67:0/2562026655 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf8041070 con 0x558eeabac730 2024-09-10T21:01:01.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.396+0000 7fdc05ffb640 1 -- 172.21.15.67:0/2562026655 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8004750 con 0x558eeabac730 2024-09-10T21:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- 172.21.15.67:0/2562026655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 msgr2=0x558eeabbb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8003a70 tx=0x7fdbf8001e70 comp rx=0 tx=0).stop 2024-09-10T21:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- 172.21.15.67:0/2562026655 shutdown_connections 2024-09-10T21:01:01.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabac730 0x558eeabbb840 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabbfd30 0x558eeabbb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 --2- 172.21.15.67:0/2562026655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabb3da0 0x558eeabb0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- 172.21.15.67:0/2562026655 >> 172.21.15.67:0/2562026655 conn(0x558eeabb12b0 msgr2=0x558eeabb7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- 172.21.15.67:0/2562026655 shutdown_connections 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- 172.21.15.67:0/2562026655 wait complete. 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.397+0000 7fdc1871a740 1 -- start start 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 Processor -- start 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabac730 0x558eeabc7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabc2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101aeb00 con 0x558eeabb3da0 2024-09-10T21:01:01.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101aff70 con 0x558eeabac730 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101af1d0 con 0x558eeabbfd30 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc1871a740 10 client.0 _ll_register_callbacks cb 0x7fdbf8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49016/0 (socket says 172.21.15.67:49016) 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1266814143 learned_addr learned my addr 172.21.15.67:0/1266814143 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabac730 0x558eeabc7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabc2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1266814143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 msgr2=0x558eeabc2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabc2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabac730 msgr2=0x558eeabc7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabac730 0x558eeabc7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 -- 172.21.15.67:0/1266814143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eeabc3140 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdc0ffff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x558eeabb2190 tx=0x7fdc00009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7033ef62028413aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.398+0000 7fdbef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0001e040 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbf8041070 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdc00005020 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdc00005220 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 10 client.16515 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558eeac3ce90 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf8041070 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdc00024040 con 0x558eeabb3da0 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 10 client.16515 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:01.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 20 client.16515 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:01.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeac3d3f0 0x558eeac3f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:01.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 4 client.16515 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:01:01.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.399+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558eeab27850 con 0x558eeac3d3f0 2024-09-10T21:01:01.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.400+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeac3d3f0 0x558eeac3f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.401+0000 7fdc07fff640 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeac3d3f0 0x558eeac3f810 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4517afec17dfebb0 server_cookie=fc4f897fa25e13f2 in_seq=0 out_seq=0 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.401+0000 7fdbef7fe640 10 client.16515 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.401+0000 7fdbef7fe640 1 -- 172.21.15.67:0/1266814143 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x558eeab27850 con 0x558eeac3d3f0 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.401+0000 7fdbef7fe640 10 client.16515 handle_command_reply: tid=0 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.401+0000 7fdc1871a740 1 client.16515 shutdown 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 msgr2=0x558eeabc8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x558eeabb2190 tx=0x7fdc00009f60 comp rx=0 tx=0).stop 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 shutdown_connections 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558eeac3d3f0 0x558eeac3f810 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558eeabbfd30 0x558eeabc2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558eeabb3da0 0x558eeabc8190 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 --2- 172.21.15.67:0/1266814143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558eeabac730 0x558eeabc7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 >> 172.21.15.67:0/1266814143 conn(0x558eeabb12b0 msgr2=0x558eeabbb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.402+0000 7fdbef7fe640 0 client.16515 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.403+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 shutdown_connections 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.403+0000 7fdc1871a740 1 -- 172.21.15.67:0/1266814143 wait complete. 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.403+0000 7fdc1871a740 20 client.16515 trim_cache size 0 max 16384 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:01:01.411 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.412 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.413 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.414 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.415 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.416 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.417 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.418 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:01.419 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 msgr2=0x7fdbfc0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 0x7fdbfc0b78a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdc08000f80 tx=0x7fdc0801b2c0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 msgr2=0x7fdc10109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 0x7fdc10109390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009fd0 tx=0x7fdc0800ef10 comp rx=0 tx=0).stop 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 shutdown_connections 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc10108020 0x7fdc10109390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbfc0b53e0 0x7fdbfc0b78a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc101076a0 0x7fdc10108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 --2- 172.21.15.67:0/2216584759 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdc10101c90 0x7fdc10108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 >> 172.21.15.67:0/2216584759 conn(0x7fdc100fd700 msgr2=0x7fdc10104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 shutdown_connections 2024-09-10T21:01:01.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:01.404+0000 7fdc16345640 1 -- 172.21.15.67:0/2216584759 wait complete. 2024-09-10T21:01:02.239 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:01:02.239 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:01:02.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:02 smithi083 ceph-mon[35058]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.8 MiB/s wr, 609 op/s 2024-09-10T21:01:02.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:02 smithi172 ceph-mon[35265]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.8 MiB/s wr, 609 op/s 2024-09-10T21:01:02.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:02 smithi067 ceph-mon[30891]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7.8 MiB/s wr, 609 op/s 2024-09-10T21:01:02.637 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 -- 172.21.15.67:0/3990232686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107500 msgr2=0x7f3364107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 --2- 172.21.15.67:0/3990232686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107500 0x7f3364107940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3358009860 tx=0x7f335802a340 comp rx=0 tx=0).stop 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 -- 172.21.15.67:0/3990232686 shutdown_connections 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 --2- 172.21.15.67:0/3990232686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107e80 0x7f336410e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 --2- 172.21.15.67:0/3990232686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107500 0x7f3364107940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 --2- 172.21.15.67:0/3990232686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f3364101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 -- 172.21.15.67:0/3990232686 >> 172.21.15.67:0/3990232686 conn(0x7f33640fd5a0 msgr2=0x7f33640ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 -- 172.21.15.67:0/3990232686 shutdown_connections 2024-09-10T21:01:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.252+0000 7f3368a10640 1 -- 172.21.15.67:0/3990232686 wait complete. 2024-09-10T21:01:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 Processor -- start 2024-09-10T21:01:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 -- start start 2024-09-10T21:01:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f336419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:03.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107500 0x7f336419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 0x7f33641a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3364114e90 con 0x7f3364101af0 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3364114d10 con 0x7f3364107e80 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3368a10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3364115010 con 0x7f3364107500 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3362d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f336419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3362d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f336419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53240/0 (socket says 172.21.15.67:53240) 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f336359e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 0x7f33641a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.253+0000 7f3362d9d640 1 -- 172.21.15.67:0/2729277749 learned_addr learned my addr 172.21.15.67:0/2729277749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336259c640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107500 0x7f336419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 -- 172.21.15.67:0/2729277749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107500 msgr2=0x7f336419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107500 0x7f336419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 -- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 msgr2=0x7f336419b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f336419b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 -- 172.21.15.67:0/2729277749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33641a13b0 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f336359e640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 0x7f33641a0be0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f335c00be20 tx=0x7f335c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c019070 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33641a16a0 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f335c0148f0 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c012840 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.254+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641a7d60 con 0x7f3364107e80 2024-09-10T21:01:03.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.256+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3364101ed0 con 0x7f3364107e80 2024-09-10T21:01:03.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.258+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f335c014440 con 0x7f3364107e80 2024-09-10T21:01:03.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.259+0000 7f334bfff640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 0x7f334c0b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:03.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.259+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f335c0e5650 con 0x7f3364107e80 2024-09-10T21:01:03.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.259+0000 7f3362d9d640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 0x7f334c0b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:03.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.260+0000 7f3362d9d640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 0x7f334c0b7890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33540058c0 tx=0x7f3354009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:03.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.263+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f335c0ac540 con 0x7f3364107e80 2024-09-10T21:01:03.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.619+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3364109cc0 con 0x7f3364107e80 2024-09-10T21:01:03.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.620+0000 7f334bfff640 1 -- 172.21.15.67:0/2729277749 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f335c0abe40 con 0x7f3364107e80 2024-09-10T21:01:03.624 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:01:03.625 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:01:03.625 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 msgr2=0x7f334c0b7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 0x7f334c0b7890 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33540058c0 tx=0x7f3354009260 comp rx=0 tx=0).stop 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 msgr2=0x7f33641a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 0x7f33641a0be0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f335c00be20 tx=0x7f335c00bf10 comp rx=0 tx=0).stop 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 shutdown_connections 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3364107e80 0x7f33641a0be0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f334c0b53d0 0x7f334c0b7890 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3364107500 0x7f336419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 --2- 172.21.15.67:0/2729277749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3364101af0 0x7f336419b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:03.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 >> 172.21.15.67:0/2729277749 conn(0x7f33640fd5a0 msgr2=0x7f33640ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:03.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 shutdown_connections 2024-09-10T21:01:03.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:03.622+0000 7f3368a10640 1 -- 172.21.15.67:0/2729277749 wait complete. 2024-09-10T21:01:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 570.0 s, 2107.6 tps, lat 47.167 ms stddev 54.265 2024-09-10T21:01:04.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:04 smithi067 ceph-mon[30891]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.2 MiB/s wr, 663 op/s 2024-09-10T21:01:04.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:04 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2729277749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:04.340 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:01:04.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:04 smithi083 ceph-mon[35058]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.2 MiB/s wr, 663 op/s 2024-09-10T21:01:04.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:04 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2729277749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:04 smithi172 ceph-mon[35265]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 8.2 MiB/s wr, 663 op/s 2024-09-10T21:01:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:04 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2729277749' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:04.710 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:05.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 -- 172.21.15.67:0/3542843696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac108020 msgr2=0x7ffbac10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 --2- 172.21.15.67:0/3542843696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac108020 0x7ffbac10e820 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffba401acb0 tx=0x7ffba403b920 comp rx=0 tx=0).stop 2024-09-10T21:01:05.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 -- 172.21.15.67:0/3542843696 shutdown_connections 2024-09-10T21:01:05.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 --2- 172.21.15.67:0/3542843696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac108020 0x7ffbac10e820 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 --2- 172.21.15.67:0/3542843696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac1076a0 0x7ffbac107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 --2- 172.21.15.67:0/3542843696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.284+0000 7ffbb325a640 1 -- 172.21.15.67:0/3542843696 >> 172.21.15.67:0/3542843696 conn(0x7ffbac0fd700 msgr2=0x7ffbac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.292+0000 7ffbb325a640 1 -- 172.21.15.67:0/3542843696 shutdown_connections 2024-09-10T21:01:05.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.296+0000 7ffbb325a640 1 -- 172.21.15.67:0/3542843696 wait complete. 2024-09-10T21:01:05.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 Processor -- start 2024-09-10T21:01:05.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 -- start start 2024-09-10T21:01:05.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac1076a0 0x7ffbac06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac108020 0x7ffbac10f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac06e2a0 con 0x7ffbac1076a0 2024-09-10T21:01:05.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac06e120 con 0x7ffbac108020 2024-09-10T21:01:05.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.297+0000 7ffbb325a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac06e420 con 0x7ffbac101c90 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40960/0 (socket says 172.21.15.67:40960) 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/291856752 learned_addr learned my addr 172.21.15.67:0/291856752 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac108020 0x7ffbac10f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/291856752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac108020 msgr2=0x7ffbac10f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac108020 0x7ffbac10f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac1076a0 msgr2=0x7ffbac06ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac1076a0 0x7ffbac06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.300+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/291856752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac10fc90 con 0x7ffbac101c90 2024-09-10T21:01:05.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.301+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b450 tx=0x7ffba800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.301+0000 7ffba1ffb640 1 -- 172.21.15.67:0/291856752 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8015020 con 0x7ffbac101c90 2024-09-10T21:01:05.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.301+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac10ff80 con 0x7ffbac101c90 2024-09-10T21:01:05.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.301+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac116660 con 0x7ffbac101c90 2024-09-10T21:01:05.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.305+0000 7ffbb562f740 1 Processor -- start 2024-09-10T21:01:05.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.308+0000 7ffba1ffb640 1 -- 172.21.15.67:0/291856752 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba8011d40 con 0x7ffbac101c90 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffba1ffb640 1 -- 172.21.15.67:0/291856752 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8010e50 con 0x7ffbac101c90 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 -- start start 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bdac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e88bd22ea0 con 0x55e88bdaca10 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e88bd122d0 con 0x55e88bdac0f0 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.309+0000 7ffbb562f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e88bd160e0 con 0x55e88bdb89a0 2024-09-10T21:01:05.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40974/0 (socket says 172.21.15.67:40974) 2024-09-10T21:01:05.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 -- 172.21.15.67:0/1447266144 learned_addr learned my addr 172.21.15.67:0/1447266144 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:05.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bdac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 -- 172.21.15.67:0/1447266144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 msgr2=0x55e88bdac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bdac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 -- 172.21.15.67:0/1447266144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 msgr2=0x55e88bdb8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 -- 172.21.15.67:0/1447266144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88ba70650 con 0x55e88bdb89a0 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.310+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00bae0 tx=0x7ffb9c00d2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b23629073abd35a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.313+0000 7ffb92ffd640 1 -- 172.21.15.67:0/1447266144 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c016070 con 0x55e88bdb89a0 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.313+0000 7ffb92ffd640 1 -- 172.21.15.67:0/1447266144 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9c0054d0 con 0x55e88bdb89a0 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.314+0000 7ffbb562f740 1 -- 172.21.15.67:0/1447266144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 msgr2=0x55e88bdbad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.314+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00bae0 tx=0x7ffb9c00d2e0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.314+0000 7ffba1ffb640 1 -- 172.21.15.67:0/291856752 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ffba80103e0 con 0x7ffbac101c90 2024-09-10T21:01:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.315+0000 7ffba1ffb640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 0x7ffb940b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffba1ffb640 1 -- 172.21.15.67:0/291856752 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffba8010c50 con 0x7ffbac101c90 2024-09-10T21:01:05.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 -- 172.21.15.67:0/1447266144 shutdown_connections 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdbad90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1447266144 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bdac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 -- 172.21.15.67:0/1447266144 >> 172.21.15.67:0/1447266144 conn(0x55e88bda9f20 msgr2=0x55e88bdab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 -- 172.21.15.67:0/1447266144 shutdown_connections 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.316+0000 7ffbb562f740 1 -- 172.21.15.67:0/1447266144 wait complete. 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.317+0000 7ffbb562f740 1 -- start start 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.317+0000 7ffbb562f740 1 Processor -- start 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.317+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdac0f0 0x55e88bdb81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.317+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb562f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e88bb73700 con 0x55e88bdac0f0 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb562f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e88bcad160 con 0x55e88bdaca10 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb562f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e88bddd680 con 0x55e88bdb89a0 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb562f740 10 client.0 _ll_register_callbacks cb 0x55e88bcc69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60090/0 (socket says 172.21.15.67:60090) 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 -- 172.21.15.67:0/1133598027 learned_addr learned my addr 172.21.15.67:0/1133598027 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 -- 172.21.15.67:0/1133598027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 msgr2=0x55e88bdb5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 -- 172.21.15.67:0/1133598027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdac0f0 msgr2=0x55e88bdb81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdac0f0 0x55e88bdb81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.318+0000 7ffba3fff640 1 -- 172.21.15.67:0/1133598027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88bcdac90 con 0x55e88bdaca10 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.319+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c004bf0 tx=0x7ffb9c005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ef96271d1778ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.320+0000 7ffb8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.320+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c016070 con 0x55e88bdaca10 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.320+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb9c0054d0 con 0x55e88bdaca10 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.320+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb9c00dab0 con 0x55e88bdaca10 2024-09-10T21:01:05.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.320+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffb9c00b6e0 con 0x55e88bdaca10 2024-09-10T21:01:05.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.324+0000 7ffbb562f740 10 client.26249 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.324+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e88bde8fa0 con 0x55e88bdaca10 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 0x7ffb940b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9c0054d0 con 0x55e88bdaca10 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffb9c0109e0 con 0x55e88bdaca10 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 10 client.26249 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 10 client.26249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 20 client.26249 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88bdea7f0 0x55e88bdecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 4 client.26249 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.326+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e88bd24df0 con 0x55e88bdea7f0 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.327+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88bdea7f0 0x55e88bdecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.328+0000 7ffb8bfff640 10 client.26249 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.328+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88bdea7f0 0x55e88bdecc30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dbf882c740c5564b server_cookie=c7394e6969b403d7 in_seq=0 out_seq=0 2024-09-10T21:01:05.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.328+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 0x7ffb940b79a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e88bdb8970 tx=0x7ffba401a5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.329+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1133598027 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e88bd24df0 con 0x55e88bdea7f0 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.329+0000 7ffb8bfff640 10 client.26249 handle_command_reply: tid=0 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.329+0000 7ffbb562f740 1 client.26249 shutdown 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 msgr2=0x55e88bdb5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c004bf0 tx=0x7ffb9c005750 comp rx=0 tx=0).stop 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 shutdown_connections 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88bdea7f0 0x55e88bdecc30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdaca10 0x55e88bdb5610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1133598027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdac0f0 0x55e88bdb81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 >> 172.21.15.67:0/1133598027 conn(0x55e88bda9f20 msgr2=0x55e88bdafac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffb8bfff640 0 client.26249 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 shutdown_connections 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 1 -- 172.21.15.67:0/1133598027 wait complete. 2024-09-10T21:01:05.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.330+0000 7ffbb562f740 20 client.26249 trim_cache size 0 max 16384 2024-09-10T21:01:05.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.355+0000 7ffbb562f740 1 Processor -- start 2024-09-10T21:01:05.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.355+0000 7ffbb562f740 1 -- start start 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffb98010d70 con 0x55e88bdaca10 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9800e640 con 0x55e88bdac0f0 2024-09-10T21:01:05.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.356+0000 7ffbb562f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9800c490 con 0x55e88bdb89a0 2024-09-10T21:01:05.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.357+0000 7ffbb17f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.357+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.357+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60096/0 (socket says 172.21.15.67:60096) 2024-09-10T21:01:05.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.357+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1830760887 learned_addr learned my addr 172.21.15.67:0/1830760887 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.357+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1830760887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 msgr2=0x55e88bdb43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1830760887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 msgr2=0x55e88bdb3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1830760887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88bda9c30 con 0x55e88bdac0f0 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:05.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba80b0420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d87d78fb493119c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffb927fc640 1 -- 172.21.15.67:0/1830760887 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80a7f40 con 0x55e88bdac0f0 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffb927fc640 1 -- 172.21.15.67:0/1830760887 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba80a5e50 con 0x55e88bdac0f0 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.358+0000 7ffb927fc640 1 -- 172.21.15.67:0/1830760887 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80a80e0 con 0x55e88bdac0f0 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 -- 172.21.15.67:0/1830760887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 msgr2=0x55e88bda4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba80b0420 comp rx=0 tx=0).stop 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 -- 172.21.15.67:0/1830760887 shutdown_connections 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdb89a0 0x55e88bdb43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bdb3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1830760887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdac0f0 0x55e88bda4e90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 -- 172.21.15.67:0/1830760887 >> 172.21.15.67:0/1830760887 conn(0x55e88bda9f20 msgr2=0x55e88bdaaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.359+0000 7ffbb562f740 1 -- 172.21.15.67:0/1830760887 shutdown_connections 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.360+0000 7ffbb562f740 1 -- 172.21.15.67:0/1830760887 wait complete. 2024-09-10T21:01:05.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.360+0000 7ffbb562f740 1 -- start start 2024-09-10T21:01:05.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.360+0000 7ffbb562f740 1 Processor -- start 2024-09-10T21:01:05.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bde3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdb89a0 0x55e88bdb22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9800cb00 con 0x55e88bdaca10 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9800df70 con 0x55e88bdb89a0 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9800d1d0 con 0x55e88bdac0f0 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb562f740 10 client.0 _ll_register_callbacks cb 0x7ffba4005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb0ff6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:40998/0 (socket says 172.21.15.67:40998) 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.361+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1180299940 learned_addr learned my addr 172.21.15.67:0/1180299940 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bde3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb17f7640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdb89a0 0x55e88bdb22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdb89a0 msgr2=0x55e88bdb22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdb89a0 0x55e88bdb22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1180299940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 msgr2=0x55e88bde3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bde3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 -- 172.21.15.67:0/1180299940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88bdb2b00 con 0x55e88bdac0f0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb0ff6640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffba8014040 tx=0x7ffba80b4d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7affc1a0705020 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffb8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80d2070 con 0x55e88bdac0f0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba80a5e50 con 0x55e88bdac0f0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.362+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffba80c6470 con 0x55e88bdac0f0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffba80a82b0 con 0x55e88bdac0f0 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 10 client.26191 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:05.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e88bde1640 con 0x55e88bdac0f0 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffba80a5e50 con 0x55e88bdac0f0 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffba80c4070 con 0x55e88bdac0f0 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 10 client.26191 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 10 client.26191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 20 client.26191 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88be57b60 0x55e88be59f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 4 client.26191 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e88bd208a0 con 0x55e88be57b60 2024-09-10T21:01:05.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.363+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88be57b60 0x55e88be59f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffba3fff640 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88be57b60 0x55e88be59f80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=126c4b4abdd7c82 server_cookie=b7cc156e0ff84584 in_seq=0 out_seq=0 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffb8bfff640 10 client.26191 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffb8bfff640 1 -- 172.21.15.67:0/1180299940 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e88bd208a0 con 0x55e88be57b60 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffb8bfff640 10 client.26191 handle_command_reply: tid=0 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 client.26191 shutdown 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 msgr2=0x55e88bde2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffba8014040 tx=0x7ffba80b4d40 comp rx=0 tx=0).stop 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 shutdown_connections 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e88be57b60 0x55e88be59f80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e88bdb89a0 0x55e88bdb22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e88bdaca10 0x55e88bde3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 --2- 172.21.15.67:0/1180299940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e88bdac0f0 0x55e88bde2d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffb8bfff640 0 client.26191 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 >> 172.21.15.67:0/1180299940 conn(0x55e88bda9f20 msgr2=0x55e88bdb53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 shutdown_connections 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.364+0000 7ffbb562f740 1 -- 172.21.15.67:0/1180299940 wait complete. 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.365+0000 7ffbb562f740 20 client.26191 trim_cache size 0 max 16384 2024-09-10T21:01:05.373 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:05.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.366+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 msgr2=0x7ffb940b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.366+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 0x7ffb940b79a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55e88bdb8970 tx=0x7ffba401a5d0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.366+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 msgr2=0x7ffbac06fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.366+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b450 tx=0x7ffba800b910 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 shutdown_connections 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffbac108020 0x7ffbac10f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffbac1076a0 0x7ffbac06ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ffb940b54e0 0x7ffb940b79a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 --2- 172.21.15.67:0/291856752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffbac101c90 0x7ffbac06fa40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 >> 172.21.15.67:0/291856752 conn(0x7ffbac0fd700 msgr2=0x7ffbac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 shutdown_connections 2024-09-10T21:01:05.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:05.367+0000 7ffbb325a640 1 -- 172.21.15.67:0/291856752 wait complete. 2024-09-10T21:01:06.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:01:06.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:06 smithi067 ceph-mon[30891]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8.1 MiB/s wr, 652 op/s 2024-09-10T21:01:06.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:06 smithi083 ceph-mon[35058]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8.1 MiB/s wr, 652 op/s 2024-09-10T21:01:06.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:06 smithi172 ceph-mon[35265]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8.1 MiB/s wr, 652 op/s 2024-09-10T21:01:06.537 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 -- 172.21.15.67:0/1138692133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47841076e0 msgr2=0x7f4784107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 --2- 172.21.15.67:0/1138692133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47841076e0 0x7f4784107b20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f477402a410 comp rx=0 tx=0).stop 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 -- 172.21.15.67:0/1138692133 shutdown_connections 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 --2- 172.21.15.67:0/1138692133 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784108060 0x7f478410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 --2- 172.21.15.67:0/1138692133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47841076e0 0x7f4784107b20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 --2- 172.21.15.67:0/1138692133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784101cd0 0x7f47841020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.104+0000 7f478c004640 1 -- 172.21.15.67:0/1138692133 >> 172.21.15.67:0/1138692133 conn(0x7f47840fd780 msgr2=0x7f47840ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.105+0000 7f478c004640 1 -- 172.21.15.67:0/1138692133 shutdown_connections 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.105+0000 7f478c004640 1 -- 172.21.15.67:0/1138692133 wait complete. 2024-09-10T21:01:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.105+0000 7f478c004640 1 Processor -- start 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 -- start start 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 0x7f478410f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 0x7f478410f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4784112e00 con 0x7f4784101cd0 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4784112c80 con 0x7f4784108060 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478c004640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4784112f80 con 0x7f47841076e0 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f4789da0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f4789da0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53336/0 (socket says 172.21.15.67:53336) 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f4789da0640 1 -- 172.21.15.67:0/458585339 learned_addr learned my addr 172.21.15.67:0/458585339 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478959f640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 0x7f478410f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.106+0000 7f478a5a1640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 0x7f478410f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 -- 172.21.15.67:0/458585339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 msgr2=0x7f478410f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 0x7f478410f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 -- 172.21.15.67:0/458585339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 msgr2=0x7f478410f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 0x7f478410f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 -- 172.21.15.67:0/458585339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47841abb90 con 0x7f4784101cd0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f478959f640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 0x7f478410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f478a5a1640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 0x7f478410f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f4789da0640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f478000d950 tx=0x7f478000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f477affd640 1 -- 172.21.15.67:0/458585339 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780017070 con 0x7f4784101cd0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47841abd60 con 0x7f4784101cd0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f477affd640 1 -- 172.21.15.67:0/458585339 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4780009c30 con 0x7f4784101cd0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f477affd640 1 -- 172.21.15.67:0/458585339 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478000f620 con 0x7f4784101cd0 2024-09-10T21:01:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.107+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47841ac210 con 0x7f4784101cd0 2024-09-10T21:01:07.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.111+0000 7f477affd640 1 -- 172.21.15.67:0/458585339 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4780010460 con 0x7f4784101cd0 2024-09-10T21:01:07.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.111+0000 7f478e3d9740 1 Processor -- start 2024-09-10T21:01:07.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.112+0000 7f478e3d9740 1 -- start start 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.112+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a96a10 0x557e43aa2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43aa29a0 0x557e43aa4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478e3d9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e43a0cea0 con 0x557e43aa29a0 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478e3d9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557e439fc2d0 con 0x557e43a960f0 2024-09-10T21:01:07.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478e3d9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e43a000e0 con 0x557e43a96a10 2024-09-10T21:01:07.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60132/0 (socket says 172.21.15.67:60132) 2024-09-10T21:01:07.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 -- 172.21.15.67:0/80726333 learned_addr learned my addr 172.21.15.67:0/80726333 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:07.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478959f640 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43aa29a0 0x557e43aa4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f4789da0640 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a96a10 0x557e43aa2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f477affd640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 0x7f47700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 -- 172.21.15.67:0/80726333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a96a10 msgr2=0x557e43aa2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a96a10 0x557e43aa2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 -- 172.21.15.67:0/80726333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43aa29a0 msgr2=0x557e43aa4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43aa29a0 0x557e43aa4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.113+0000 7f478a5a1640 1 -- 172.21.15.67:0/80726333 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4375a650 con 0x557e43a960f0 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f478a5a1640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 0x7f47700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f477affd640 1 -- 172.21.15.67:0/458585339 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f47800e5790 con 0x7f4784101cd0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f478a5a1640 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f477c00f790 tx=0x7f477c00fc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533a2b44d2f62cea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f476ffff640 1 -- 172.21.15.67:0/80726333 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c00de00 con 0x557e43a960f0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f476ffff640 1 -- 172.21.15.67:0/80726333 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f477c01a400 con 0x557e43a960f0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.114+0000 7f476ffff640 1 -- 172.21.15.67:0/80726333 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c019600 con 0x557e43a960f0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478a5a1640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 0x7f47700b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f477c01e000 tx=0x7f477c01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 -- 172.21.15.67:0/80726333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 msgr2=0x557e43a964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f477c00f790 tx=0x7f477c00fc50 comp rx=0 tx=0).stop 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 -- 172.21.15.67:0/80726333 shutdown_connections 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43aa29a0 0x557e43aa4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a96a10 0x557e43aa2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 --2- 172.21.15.67:0/80726333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43a964d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 -- 172.21.15.67:0/80726333 >> 172.21.15.67:0/80726333 conn(0x557e43a93f20 msgr2=0x557e43a950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 -- 172.21.15.67:0/80726333 shutdown_connections 2024-09-10T21:01:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.115+0000 7f478e3d9740 1 -- 172.21.15.67:0/80726333 wait complete. 2024-09-10T21:01:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.116+0000 7f478e3d9740 1 -- start start 2024-09-10T21:01:07.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.116+0000 7f478e3d9740 1 Processor -- start 2024-09-10T21:01:07.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.116+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.116+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a9f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.116+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478e3d9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557e4385d700 con 0x557e43a96a10 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478e3d9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557e43997160 con 0x557e43a960f0 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478e3d9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e43aa5620 con 0x557e43aa29a0 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41024/0 (socket says 172.21.15.67:41024) 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f4789da0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 -- 172.21.15.67:0/644320960 learned_addr learned my addr 172.21.15.67:0/644320960 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478e3d9740 10 client.0 _ll_register_callbacks cb 0x557e439b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 -- 172.21.15.67:0/644320960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 msgr2=0x557e43aa2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 -- 172.21.15.67:0/644320960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 msgr2=0x557e43a9f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a9f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 -- 172.21.15.67:0/644320960 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e439c4c90 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f4789da0640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f478a5a1640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f477c00d990 tx=0x7f477c010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82f73e36608aa90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.117+0000 7f476d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c01a7c0 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f477c02c070 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f477c01a400 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f477c003970 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 10 client.26203 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557e43ab0f50 con 0x557e43aa29a0 2024-09-10T21:01:07.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f477c01a400 con 0x557e43aa29a0 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f477c0042a0 con 0x557e43aa29a0 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 10 client.26203 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 10 client.26203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 20 client.26203 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43ab4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 4 client.26203 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.118+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e43a0edf0 con 0x557e43ab2350 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.119+0000 7f4789da0640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43ab4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.119+0000 7f476d7fa640 10 client.26203 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.119+0000 7f4789da0640 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43ab4740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c021cf0256b73225 server_cookie=bc5f7f05d19d9826 in_seq=0 out_seq=0 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f476d7fa640 1 -- 172.21.15.67:0/644320960 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e43a0edf0 con 0x557e43ab2350 2024-09-10T21:01:07.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f476d7fa640 10 client.26203 handle_command_reply: tid=0 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 client.26203 shutdown 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 msgr2=0x557e43a9fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f477c00d990 tx=0x7f477c010d80 comp rx=0 tx=0).stop 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 shutdown_connections 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43ab4740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43a9fd10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f476d7fa640 0 client.26203 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a9f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 --2- 172.21.15.67:0/644320960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 >> 172.21.15.67:0/644320960 conn(0x557e43a93f20 msgr2=0x557e43a99a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 shutdown_connections 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 1 -- 172.21.15.67:0/644320960 wait complete. 2024-09-10T21:01:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.120+0000 7f478e3d9740 20 client.26203 trim_cache size 0 max 16384 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 Processor -- start 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 -- start start 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a960f0 0x557e43aae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 0x557e43a9c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b71a0 con 0x557e43a96a10 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b4a70 con 0x557e43aa29a0 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478e3d9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b28e0 con 0x557e43a960f0 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53356/0 (socket says 172.21.15.67:53356) 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 -- 172.21.15.67:0/874488561 learned_addr learned my addr 172.21.15.67:0/874488561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f4789da0640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a960f0 0x557e43aae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478a5a1640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 0x557e43a9c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 -- 172.21.15.67:0/874488561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a960f0 msgr2=0x557e43aae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a960f0 0x557e43aae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 -- 172.21.15.67:0/874488561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 msgr2=0x557e43a9c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 0x557e43a9c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478959f640 1 -- 172.21.15.67:0/874488561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e43a9dbe0 con 0x557e43a96a10 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.138+0000 7f478a5a1640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 0x557e43a9c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.139+0000 7f478959f640 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f4774031550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f006e912ecffac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.139+0000 7f476f7fe640 1 -- 172.21.15.67:0/874488561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774035040 con 0x557e43a96a10 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.139+0000 7f476f7fe640 1 -- 172.21.15.67:0/874488561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4774005040 con 0x557e43a96a10 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.139+0000 7f476f7fe640 1 -- 172.21.15.67:0/874488561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774004af0 con 0x557e43a96a10 2024-09-10T21:01:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 -- 172.21.15.67:0/874488561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 msgr2=0x557e43a92e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4774009900 tx=0x7f4774031550 comp rx=0 tx=0).stop 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 -- 172.21.15.67:0/874488561 shutdown_connections 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43aa29a0 0x557e43a9c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43a92e60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 --2- 172.21.15.67:0/874488561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43a960f0 0x557e43aae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 -- 172.21.15.67:0/874488561 >> 172.21.15.67:0/874488561 conn(0x557e43a93f20 msgr2=0x557e43a92750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 -- 172.21.15.67:0/874488561 shutdown_connections 2024-09-10T21:01:07.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.140+0000 7f478e3d9740 1 -- 172.21.15.67:0/874488561 wait complete. 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.141+0000 7f478e3d9740 1 -- start start 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.141+0000 7f478e3d9740 1 Processor -- start 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43aa6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b2f30 con 0x557e43a96a10 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b43a0 con 0x557e43a960f0 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47841b3600 con 0x557e43aa29a0 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478e3d9740 10 client.0 _ll_register_callbacks cb 0x7f477c01d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478959f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43aa6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478a5a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41036/0 (socket says 172.21.15.67:41036) 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.142+0000 7f478a5a1640 1 -- 172.21.15.67:0/3390055115 learned_addr learned my addr 172.21.15.67:0/3390055115 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f4789da0640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 -- 172.21.15.67:0/3390055115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 msgr2=0x557e43aa6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 -- 172.21.15.67:0/3390055115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 msgr2=0x557e43aa6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43aa6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 -- 172.21.15.67:0/3390055115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e43b1e460 con 0x557e43aa29a0 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478959f640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43aa6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f4789da0640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478a5a1640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f477c0046c0 tx=0x7f477c026970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b413c8732d4d9025 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f476d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c01a400 con 0x557e43aa29a0 2024-09-10T21:01:07.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f477c02c040 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.143+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4774005040 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f477c00f5e0 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 10 client.26209 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557e43b1f760 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4774005040 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f477c003fc0 con 0x557e43aa29a0 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 10 client.26209 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 10 client.26209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 20 client.26209 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43b21ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 4 client.26209 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e43a0a8a0 con 0x557e43ab2350 2024-09-10T21:01:07.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.144+0000 7f4789da0640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43b21ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.145+0000 7f4789da0640 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43b21ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=acf162b8034d6fc6 server_cookie=b4c955a44908b5af in_seq=0 out_seq=0 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.145+0000 7f476d7fa640 10 client.26209 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f476d7fa640 1 -- 172.21.15.67:0/3390055115 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e43a0a8a0 con 0x557e43ab2350 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f476d7fa640 10 client.26209 handle_command_reply: tid=0 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 client.26209 shutdown 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 msgr2=0x557e43aa74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f477c0046c0 tx=0x7f477c026970 comp rx=0 tx=0).stop 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 shutdown_connections 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x557e43ab2350 0x557e43b21ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e43aa29a0 0x557e43aa74e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e43a96a10 0x557e43aa6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 --2- 172.21.15.67:0/3390055115 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557e43a960f0 0x557e43aa6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f476d7fa640 0 client.26209 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.146+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 >> 172.21.15.67:0/3390055115 conn(0x557e43a93f20 msgr2=0x557e43aa1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 shutdown_connections 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478e3d9740 1 -- 172.21.15.67:0/3390055115 wait complete. 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478e3d9740 20 client.26209 trim_cache size 0 max 16384 2024-09-10T21:01:07.154 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 msgr2=0x7f47700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 0x7f47700b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f477c01e000 tx=0x7f477c01f000 comp rx=0 tx=0).stop 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 msgr2=0x7f4784110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f478000d950 tx=0x7f478000de10 comp rx=0 tx=0).stop 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 shutdown_connections 2024-09-10T21:01:07.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4784108060 0x7f478410f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47700b5360 0x7f47700b7820 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47841076e0 0x7f478410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 --2- 172.21.15.67:0/458585339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4784101cd0 0x7f4784110e20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 >> 172.21.15.67:0/458585339 conn(0x7f47840fd780 msgr2=0x7f47840ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 shutdown_connections 2024-09-10T21:01:07.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:07.147+0000 7f478c004640 1 -- 172.21.15.67:0/458585339 wait complete. 2024-09-10T21:01:07.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:01:08.249 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:08.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:08 smithi083 ceph-mon[35058]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 680 op/s 2024-09-10T21:01:08.424 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:08 smithi067 ceph-mon[30891]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 680 op/s 2024-09-10T21:01:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:08 smithi172 ceph-mon[35265]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 680 op/s 2024-09-10T21:01:08.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 -- 172.21.15.67:0/3283533802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 msgr2=0x7f657c1040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 --2- 172.21.15.67:0/3283533802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c1040b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f656c009900 tx=0x7f656c02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 -- 172.21.15.67:0/3283533802 shutdown_connections 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 --2- 172.21.15.67:0/3283533802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 --2- 172.21.15.67:0/3283533802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 --2- 172.21.15.67:0/3283533802 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c1040b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 -- 172.21.15.67:0/3283533802 >> 172.21.15.67:0/3283533802 conn(0x7f657c0fd770 msgr2=0x7f657c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 -- 172.21.15.67:0/3283533802 shutdown_connections 2024-09-10T21:01:08.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.859+0000 7f6581729640 1 -- 172.21.15.67:0/3283533802 wait complete. 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.860+0000 7f6581729640 1 Processor -- start 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.860+0000 7f6581729640 1 -- start start 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.860+0000 7f6581729640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.860+0000 7f6581729640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53386/0 (socket says 172.21.15.67:53386) 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f6581729640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c1a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41046/0 (socket says 172.21.15.67:41046) 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657affd640 1 -- 172.21.15.67:0/2285808677 learned_addr learned my addr 172.21.15.67:0/2285808677 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c1a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f657c112df0 con 0x7f657c103cd0 2024-09-10T21:01:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f657c112c70 con 0x7f657c10d130 2024-09-10T21:01:08.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.861+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f657c112f70 con 0x7f657c1045f0 2024-09-10T21:01:08.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 -- 172.21.15.67:0/2285808677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 msgr2=0x7f657c10c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 -- 172.21.15.67:0/2285808677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 msgr2=0x7f657c1a2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c1a2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c1a3780 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.862+0000 7f657affd640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.863+0000 7f6563fff640 1 -- 172.21.15.67:0/2285808677 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c03f070 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.863+0000 7f6563fff640 1 -- 172.21.15.67:0/2285808677 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f656c031d60 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.863+0000 7f6563fff640 1 -- 172.21.15.67:0/2285808677 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c035030 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.863+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c1a3a10 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.863+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c06cb70 con 0x7f657c103cd0 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.865+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c1a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:08.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.865+0000 7f657a7fc640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:08.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.866+0000 7f6583afe740 1 Processor -- start 2024-09-10T21:01:08.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.867+0000 7f6583afe740 1 -- start start 2024-09-10T21:01:08.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c44758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c4481840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4484170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a3c43ebea0 con 0x55a3c4475df0 2024-09-10T21:01:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a3c43db2d0 con 0x55a3c4481d80 2024-09-10T21:01:08.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.868+0000 7f6583afe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a3c43df0e0 con 0x55a3c44754d0 2024-09-10T21:01:08.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.870+0000 7f6563fff640 1 -- 172.21.15.67:0/2285808677 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f656c0318b0 con 0x7f657c103cd0 2024-09-10T21:01:08.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.871+0000 7f6563fff640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 0x7f65640b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f6563fff640 1 -- 172.21.15.67:0/2285808677 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f656c106430 con 0x7f657c103cd0 2024-09-10T21:01:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c44758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c44758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41052/0 (socket says 172.21.15.67:41052) 2024-09-10T21:01:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f657b7fe640 1 -- 172.21.15.67:0/679970848 learned_addr learned my addr 172.21.15.67:0/679970848 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:08.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f657a7fc640 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4484170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.872+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 0x7f65640b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.873+0000 7f657affd640 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c4481840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.874+0000 7f657affd640 1 -- 172.21.15.67:0/679970848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 msgr2=0x55a3c44758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.874+0000 7f657affd640 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c44758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.874+0000 7f657affd640 1 -- 172.21.15.67:0/679970848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 msgr2=0x55a3c4484170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.874+0000 7f657affd640 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4484170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.874+0000 7f657affd640 1 -- 172.21.15.67:0/679970848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c4139650 con 0x55a3c4475df0 2024-09-10T21:01:08.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.875+0000 7f657affd640 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c4481840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f656c0cc8c0 tx=0x7f656c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10fe3686ff94a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.878+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 0x7f65640b7970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6574009fd0 tx=0x7f6574004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.878+0000 7f65617fa640 1 -- 172.21.15.67:0/679970848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0c8330 con 0x55a3c4475df0 2024-09-10T21:01:08.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.878+0000 7f65617fa640 1 -- 172.21.15.67:0/679970848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f656c0cc6d0 con 0x55a3c4475df0 2024-09-10T21:01:08.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.878+0000 7f65617fa640 1 -- 172.21.15.67:0/679970848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0cd060 con 0x55a3c4475df0 2024-09-10T21:01:08.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.879+0000 7f6583afe740 1 -- 172.21.15.67:0/679970848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 msgr2=0x55a3c4481840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.879+0000 7f6583afe740 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c4481840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f656c0cc8c0 tx=0x7f656c009260 comp rx=0 tx=0).stop 2024-09-10T21:01:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.880+0000 7f6583afe740 1 -- 172.21.15.67:0/679970848 shutdown_connections 2024-09-10T21:01:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.880+0000 7f6583afe740 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4484170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.880+0000 7f6583afe740 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c4481840 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.880+0000 7f6583afe740 1 --2- 172.21.15.67:0/679970848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c44758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.880+0000 7f6583afe740 1 -- 172.21.15.67:0/679970848 >> 172.21.15.67:0/679970848 conn(0x55a3c4473300 msgr2=0x55a3c44744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.883+0000 7f6583afe740 1 -- 172.21.15.67:0/679970848 shutdown_connections 2024-09-10T21:01:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.883+0000 7f6583afe740 1 -- 172.21.15.67:0/679970848 wait complete. 2024-09-10T21:01:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.883+0000 7f6583afe740 1 -- start start 2024-09-10T21:01:08.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.883+0000 7f6583afe740 1 Processor -- start 2024-09-10T21:01:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c447f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55a3c423c700 con 0x55a3c44754d0 2024-09-10T21:01:08.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a3c4376160 con 0x55a3c4481d80 2024-09-10T21:01:08.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a3c44847c0 con 0x55a3c4475df0 2024-09-10T21:01:08.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.884+0000 7f6583afe740 10 client.0 _ll_register_callbacks cb 0x55a3c438f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:08.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.886+0000 7f657affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.886+0000 7f657affd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53398/0 (socket says 172.21.15.67:53398) 2024-09-10T21:01:08.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.886+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c447f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.886+0000 7f657affd640 1 -- 172.21.15.67:0/2475271338 learned_addr learned my addr 172.21.15.67:0/2475271338 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:08.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 -- 172.21.15.67:0/2475271338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 msgr2=0x55a3c447eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 -- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 msgr2=0x55a3c447f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c447f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 -- 172.21.15.67:0/2475271338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c43a3c90 con 0x55a3c44754d0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f657affd640 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c9e30 tx=0x7f656c031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e84fa35fe7b6da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.887+0000 7f655eff5640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.888+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0c8330 con 0x55a3c44754d0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.888+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f656c0d5cc0 con 0x55a3c44754d0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.888+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f656c0cc6d0 con 0x55a3c44754d0 2024-09-10T21:01:08.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.889+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f656c0ccbc0 con 0x55a3c44754d0 2024-09-10T21:01:08.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.889+0000 7f6583afe740 10 client.16554 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:08.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.889+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a3c44a1020 con 0x55a3c44754d0 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.890+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f656c0cc6d0 con 0x55a3c44754d0 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f656c0d11d0 con 0x55a3c44754d0 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 10 client.16554 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 20 client.16554 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c44a2500 0x55a3c44a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 4 client.16554 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:08.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.891+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3c43eddf0 con 0x55a3c44a2500 2024-09-10T21:01:08.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.892+0000 7f657a7fc640 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c44a2500 0x55a3c44a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.893+0000 7f655eff5640 10 client.16554 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:08.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.893+0000 7f657a7fc640 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c44a2500 0x55a3c44a49a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c32ba8c9c59605 server_cookie=4aac05851c8dfaa3 in_seq=0 out_seq=0 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f655eff5640 1 -- 172.21.15.67:0/2475271338 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3c43eddf0 con 0x55a3c44a2500 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f655eff5640 10 client.16554 handle_command_reply: tid=0 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 client.16554 shutdown 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 msgr2=0x55a3c4481650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c9e30 tx=0x7f656c031f10 comp rx=0 tx=0).stop 2024-09-10T21:01:08.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 shutdown_connections 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c44a2500 0x55a3c44a49a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c447f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 --2- 172.21.15.67:0/2475271338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c44754d0 0x55a3c4481650 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 >> 172.21.15.67:0/2475271338 conn(0x55a3c4473300 msgr2=0x55a3c4478e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.894+0000 7f655eff5640 0 client.16554 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:08.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.896+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 shutdown_connections 2024-09-10T21:01:08.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.896+0000 7f6583afe740 1 -- 172.21.15.67:0/2475271338 wait complete. 2024-09-10T21:01:08.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.896+0000 7f6583afe740 20 client.16554 trim_cache size 0 max 16384 2024-09-10T21:01:08.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.914+0000 7f6583afe740 1 Processor -- start 2024-09-10T21:01:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.914+0000 7f6583afe740 1 -- start start 2024-09-10T21:01:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 0x55a3c4472c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6568010d30 con 0x55a3c4481d80 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f656800e600 con 0x55a3c44754d0 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f6583afe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f656800c450 con 0x55a3c4475df0 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 0x55a3c4472c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53412/0 (socket says 172.21.15.67:53412) 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 0x55a3c4472c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60184/0 (socket says 172.21.15.67:60184) 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 -- 172.21.15.67:0/3144566627 learned_addr learned my addr 172.21.15.67:0/3144566627 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:08.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657a7fc640 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 -- 172.21.15.67:0/3144566627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 msgr2=0x55a3c447bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 -- 172.21.15.67:0/3144566627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 msgr2=0x55a3c4472c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.915+0000 7f657b7fe640 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 0x55a3c4472c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.916+0000 7f657b7fe640 1 -- 172.21.15.67:0/3144566627 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3c447fd70 con 0x55a3c4481d80 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.916+0000 7f657b7fe640 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6574014470 tx=0x7f6574009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be08f6c004de639e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.917+0000 7f6560ff9640 1 -- 172.21.15.67:0/3144566627 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657401fb80 con 0x55a3c4481d80 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.917+0000 7f6560ff9640 1 -- 172.21.15.67:0/3144566627 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f657401fd20 con 0x55a3c4481d80 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.917+0000 7f6560ff9640 1 -- 172.21.15.67:0/3144566627 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574013660 con 0x55a3c4481d80 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 -- 172.21.15.67:0/3144566627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 msgr2=0x55a3c447c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6574014470 tx=0x7f6574009a80 comp rx=0 tx=0).stop 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 -- 172.21.15.67:0/3144566627 shutdown_connections 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4481d80 0x55a3c447c1f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c4475df0 0x55a3c447bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 --2- 172.21.15.67:0/3144566627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c44754d0 0x55a3c4472c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 -- 172.21.15.67:0/3144566627 >> 172.21.15.67:0/3144566627 conn(0x55a3c4473300 msgr2=0x55a3c4474800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 -- 172.21.15.67:0/3144566627 shutdown_connections 2024-09-10T21:01:08.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.918+0000 7f6583afe740 1 -- 172.21.15.67:0/3144566627 wait complete. 2024-09-10T21:01:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 -- start start 2024-09-10T21:01:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 Processor -- start 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c4486260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c44867c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4508440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f656800cac0 con 0x55a3c4475df0 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f656800df30 con 0x55a3c4481d80 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f656800d190 con 0x55a3c44754d0 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f6583afe740 10 client.0 _ll_register_callbacks cb 0x7f656c0d16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c44867c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f657a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c44867c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53422/0 (socket says 172.21.15.67:53422) 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.919+0000 7f657a7fc640 1 -- 172.21.15.67:0/2295330631 learned_addr learned my addr 172.21.15.67:0/2295330631 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c4486260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4508440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 -- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 msgr2=0x55a3c4508440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4508440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 -- 172.21.15.67:0/2295330631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 msgr2=0x55a3c44867c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c44867c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 -- 172.21.15.67:0/2295330631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3c4508b30 con 0x55a3c44754d0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657b7fe640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4508440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f657affd640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c4486260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c9190 tx=0x7f656c005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6b83b9397c726a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f655eff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0c8330 con 0x55a3c44754d0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f656c0d5ec0 con 0x55a3c44754d0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.920+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f657401fd20 con 0x55a3c44754d0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f656c0cc6d0 con 0x55a3c44754d0 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 10 client.26221 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:08.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a3c4508b30 con 0x55a3c44754d0 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f657401fd20 con 0x55a3c44754d0 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f656c03b460 con 0x55a3c44754d0 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 10 client.26221 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 10 client.26221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 20 client.26221 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c4510280 0x55a3c4512670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 4 client.26221 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.921+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3c43e98a0 con 0x55a3c4510280 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f657a7fc640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c4510280 0x55a3c4512670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f655eff5640 10 client.26221 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f657a7fc640 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c4510280 0x55a3c4512670 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e28577b3c9c36c server_cookie=ab748e55348960a1 in_seq=0 out_seq=0 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f655eff5640 1 -- 172.21.15.67:0/2295330631 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3c43e98a0 con 0x55a3c4510280 2024-09-10T21:01:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f655eff5640 10 client.26221 handle_command_reply: tid=0 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f6583afe740 1 client.26221 shutdown 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 msgr2=0x55a3c4486260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c4486260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f656c0c9190 tx=0x7f656c005e80 comp rx=0 tx=0).stop 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.922+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 shutdown_connections 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55a3c4510280 0x55a3c4512670 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f655eff5640 0 client.26221 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a3c4481d80 0x55a3c4508440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55a3c4475df0 0x55a3c44867c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 --2- 172.21.15.67:0/2295330631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a3c44754d0 0x55a3c4486260 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 >> 172.21.15.67:0/2295330631 conn(0x55a3c4473300 msgr2=0x55a3c448c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 shutdown_connections 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 1 -- 172.21.15.67:0/2295330631 wait complete. 2024-09-10T21:01:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.923+0000 7f6583afe740 20 client.26221 trim_cache size 0 max 16384 2024-09-10T21:01:08.932 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 msgr2=0x7f65640b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 0x7f65640b7970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6574009fd0 tx=0x7f6574004ab0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 msgr2=0x7f657c10be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ab0 tx=0x7f656c003c10 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 shutdown_connections 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f657c10d130 0x7f657c1a2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f65640b54b0 0x7f65640b7970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657c1045f0 0x7f657c10c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 --2- 172.21.15.67:0/2285808677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f657c103cd0 0x7f657c10be30 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 >> 172.21.15.67:0/2285808677 conn(0x7f657c0fd770 msgr2=0x7f657c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 shutdown_connections 2024-09-10T21:01:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:08.924+0000 7f6581729640 1 -- 172.21.15.67:0/2285808677 wait complete. 2024-09-10T21:01:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 575.0 s, 1887.2 tps, lat 53.124 ms stddev 57.475 2024-09-10T21:01:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:10 smithi083 ceph-mon[35058]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2024-09-10T21:01:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:10 smithi172 ceph-mon[35265]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2024-09-10T21:01:10.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:10 smithi067 ceph-mon[30891]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.9 MiB/s wr, 630 op/s 2024-09-10T21:01:10.652 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:01:10.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:01:11.024 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 -- 172.21.15.67:0/3192189536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf81076a0 msgr2=0x7fdbf8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 --2- 172.21.15.67:0/3192189536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf81076a0 0x7fdbf8107ae0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 -- 172.21.15.67:0/3192189536 shutdown_connections 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 --2- 172.21.15.67:0/3192189536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf8108020 0x7fdbf806aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 --2- 172.21.15.67:0/3192189536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf81076a0 0x7fdbf8107ae0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 --2- 172.21.15.67:0/3192189536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 -- 172.21.15.67:0/3192189536 >> 172.21.15.67:0/3192189536 conn(0x7fdbf80fd700 msgr2=0x7fdbf80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 -- 172.21.15.67:0/3192189536 shutdown_connections 2024-09-10T21:01:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.825+0000 7fdbfd349640 1 -- 172.21.15.67:0/3192189536 wait complete. 2024-09-10T21:01:11.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.826+0000 7fdbfd349640 1 Processor -- start 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.826+0000 7fdbfd349640 1 -- start start 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf81076a0 0x7fdbf819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 0x7fdbf81a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8115060 con 0x7fdbf8108020 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf8114ee0 con 0x7fdbf8101c90 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbfd349640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf81151e0 con 0x7fdbf81076a0 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60218/0 (socket says 172.21.15.67:60218) 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 -- 172.21.15.67:0/1267182122 learned_addr learned my addr 172.21.15.67:0/1267182122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf81076a0 0x7fdbf819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 0x7fdbf81a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 -- 172.21.15.67:0/1267182122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf81076a0 msgr2=0x7fdbf819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf81076a0 0x7fdbf819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 -- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 msgr2=0x7fdbf81a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 0x7fdbf81a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 -- 172.21.15.67:0/1267182122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf81a1520 con 0x7fdbf8101c90 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 0x7fdbf81a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.827+0000 7fdbf6ffd640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000ebc0 tx=0x7fdbf000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.828+0000 7fdbdffff640 1 -- 172.21.15.67:0/1267182122 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0010630 con 0x7fdbf8101c90 2024-09-10T21:01:11.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.828+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf81a1810 con 0x7fdbf8101c90 2024-09-10T21:01:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.828+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf81a80a0 con 0x7fdbf8101c90 2024-09-10T21:01:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.828+0000 7fdbdffff640 1 -- 172.21.15.67:0/1267182122 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf0010c80 con 0x7fdbf8101c90 2024-09-10T21:01:11.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.828+0000 7fdbdffff640 1 -- 172.21.15.67:0/1267182122 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0018aa0 con 0x7fdbf8101c90 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.830+0000 7fdbdffff640 1 -- 172.21.15.67:0/1267182122 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdbf0018c40 con 0x7fdbf8101c90 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.830+0000 7fdbff71e740 1 Processor -- start 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 -- start start 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d46800 0x55dd01d52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d52790 0x55dd01d54b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dd01cbce60 con 0x55dd01d46800 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dd01cac290 con 0x55dd01d45ee0 2024-09-10T21:01:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbff71e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd01cb00a0 con 0x55dd01d52790 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d52790 0x55dd01d54b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbf6ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d46800 0x55dd01d52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60228/0 (socket says 172.21.15.67:60228) 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.831+0000 7fdbf77fe640 1 -- 172.21.15.67:0/4165515370 learned_addr learned my addr 172.21.15.67:0/4165515370 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 -- 172.21.15.67:0/4165515370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d52790 msgr2=0x55dd01d54b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d52790 0x55dd01d54b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 -- 172.21.15.67:0/4165515370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d46800 msgr2=0x55dd01d52250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d46800 0x55dd01d52250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 -- 172.21.15.67:0/4165515370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd01a0a930 con 0x55dd01d45ee0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009b80 tx=0x7fdbe8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa6478feaaf7f109 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbdffff640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 0x7fdbe00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbf6ffd640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 0x7fdbe00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbdd7fa640 1 -- 172.21.15.67:0/4165515370 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8005020 con 0x55dd01d45ee0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbdd7fa640 1 -- 172.21.15.67:0/4165515370 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbe80047a0 con 0x55dd01d45ee0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbdd7fa640 1 -- 172.21.15.67:0/4165515370 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80126b0 con 0x55dd01d45ee0 2024-09-10T21:01:11.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.832+0000 7fdbdffff640 1 -- 172.21.15.67:0/1267182122 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbf00e6180 con 0x7fdbf8101c90 2024-09-10T21:01:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.833+0000 7fdbff71e740 1 -- 172.21.15.67:0/4165515370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 msgr2=0x55dd01d462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.833+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009b80 tx=0x7fdbe8010740 comp rx=0 tx=0).stop 2024-09-10T21:01:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.833+0000 7fdbf6ffd640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 0x7fdbe00b77a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00acae0 tx=0x7fdbf00e9bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.835+0000 7fdbff71e740 1 -- 172.21.15.67:0/4165515370 shutdown_connections 2024-09-10T21:01:11.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.835+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d52790 0x55dd01d54b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.835+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d46800 0x55dd01d52250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.835+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4165515370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d462c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.835+0000 7fdbff71e740 1 -- 172.21.15.67:0/4165515370 >> 172.21.15.67:0/4165515370 conn(0x55dd01d43d10 msgr2=0x55dd01d44eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.836+0000 7fdbff71e740 1 -- 172.21.15.67:0/4165515370 shutdown_connections 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.836+0000 7fdbff71e740 1 -- 172.21.15.67:0/4165515370 wait complete. 2024-09-10T21:01:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.836+0000 7fdbff71e740 1 -- start start 2024-09-10T21:01:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.836+0000 7fdbff71e740 1 Processor -- start 2024-09-10T21:01:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d4f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01d50170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55dd01b0d890 con 0x55dd01d52790 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55dd01c46d40 con 0x55dd01d45ee0 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd01d55440 con 0x55dd01d46800 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbff71e740 10 client.0 _ll_register_callbacks cb 0x55dd01caac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41120/0 (socket says 172.21.15.67:41120) 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 -- 172.21.15.67:0/4274345185 learned_addr learned my addr 172.21.15.67:0/4274345185 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d4f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 -- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 msgr2=0x55dd01d4f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d4f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 -- 172.21.15.67:0/4274345185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 msgr2=0x55dd01d50170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01d50170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.837+0000 7fdbf67fc640 1 -- 172.21.15.67:0/4274345185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd01d5e820 con 0x55dd01d46800 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d4f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f3abad114949d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec035040 con 0x55dd01d46800 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe80047a0 con 0x55dd01d46800 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbec005510 con 0x55dd01d46800 2024-09-10T21:01:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbec004770 con 0x55dd01d46800 2024-09-10T21:01:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbff71e740 10 client.26233 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dd01d611e0 con 0x55dd01d46800 2024-09-10T21:01:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.838+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbe80047a0 con 0x55dd01d46800 2024-09-10T21:01:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdbec003b90 con 0x55dd01d46800 2024-09-10T21:01:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 10 client.26233 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 10 client.26233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 20 client.26233 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01d62740 0x55dd01d64bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 4 client.26233 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd01cbedb0 con 0x55dd01d62740 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01d62740 0x55dd01d64bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbdaff5640 10 client.26233 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.839+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01d62740 0x55dd01d64bc0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62019d9b281f8c94 server_cookie=f71b61a0f0e36b25 in_seq=0 out_seq=0 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbdaff5640 1 -- 172.21.15.67:0/4274345185 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd01cbedb0 con 0x55dd01d62740 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbdaff5640 10 client.26233 handle_command_reply: tid=0 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 client.26233 shutdown 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 msgr2=0x55dd01d4fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec004440 comp rx=0 tx=0).stop 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 shutdown_connections 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01d62740 0x55dd01d64bc0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01d50170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4fc30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 --2- 172.21.15.67:0/4274345185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d45ee0 0x55dd01d4f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 >> 172.21.15.67:0/4274345185 conn(0x55dd01d43d10 msgr2=0x55dd01d42f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.840+0000 7fdbdaff5640 0 client.26233 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.841+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 shutdown_connections 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.841+0000 7fdbff71e740 1 -- 172.21.15.67:0/4274345185 wait complete. 2024-09-10T21:01:11.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.841+0000 7fdbff71e740 20 client.26233 trim_cache size 0 max 16384 2024-09-10T21:01:11.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.865+0000 7fdbff71e740 1 Processor -- start 2024-09-10T21:01:11.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.865+0000 7fdbff71e740 1 -- start start 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d52790 0x55dd01d6a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:53456/0 (socket says 172.21.15.67:53456) 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbf77fe640 1 -- 172.21.15.67:0/2639443605 learned_addr learned my addr 172.21.15.67:0/2639443605 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4010c70 con 0x55dd01d45ee0 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe400e540 con 0x55dd01d52790 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.866+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe400c390 con 0x55dd01d46800 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d52790 0x55dd01d6a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 -- 172.21.15.67:0/2639443605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 msgr2=0x55dd01d4ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 -- 172.21.15.67:0/2639443605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d52790 msgr2=0x55dd01d6a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d52790 0x55dd01d6a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 -- 172.21.15.67:0/2639443605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd01d44790 con 0x55dd01d45ee0 2024-09-10T21:01:11.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.867+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005780 tx=0x7fdbe8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2a04f62eb054cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.868+0000 7fdbdcff9640 1 -- 172.21.15.67:0/2639443605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8005300 con 0x55dd01d45ee0 2024-09-10T21:01:11.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.868+0000 7fdbdcff9640 1 -- 172.21.15.67:0/2639443605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbe80054a0 con 0x55dd01d45ee0 2024-09-10T21:01:11.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbdcff9640 1 -- 172.21.15.67:0/2639443605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8004d30 con 0x55dd01d45ee0 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 msgr2=0x55dd01d4c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005780 tx=0x7fdbe8009750 comp rx=0 tx=0).stop 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 shutdown_connections 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d52790 0x55dd01d6a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d46800 0x55dd01d4ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 --2- 172.21.15.67:0/2639443605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d45ee0 0x55dd01d4c920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.869+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 >> 172.21.15.67:0/2639443605 conn(0x55dd01d43d10 msgr2=0x55dd01d51540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.872+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 shutdown_connections 2024-09-10T21:01:11.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.874+0000 7fdbff71e740 1 -- 172.21.15.67:0/2639443605 wait complete. 2024-09-10T21:01:11.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.874+0000 7fdbff71e740 1 -- start start 2024-09-10T21:01:11.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.874+0000 7fdbff71e740 1 Processor -- start 2024-09-10T21:01:11.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 0x55dd01d595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01dd0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe400ca00 con 0x55dd01d52790 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe400de70 con 0x55dd01d46800 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe400d0d0 con 0x55dd01d45ee0 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbff71e740 10 client.0 _ll_register_callbacks cb 0x7fdbec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 0x55dd01d595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf67fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 0x55dd01d595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:60268/0 (socket says 172.21.15.67:60268) 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf67fc640 1 -- 172.21.15.67:0/129781830 learned_addr learned my addr 172.21.15.67:0/129781830 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41124/0 (socket says 172.21.15.67:41124) 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.875+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01dd0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 -- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 msgr2=0x55dd01d595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 0x55dd01d595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 -- 172.21.15.67:0/129781830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 msgr2=0x55dd01dd0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01dd0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 -- 172.21.15.67:0/129781830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd01dd15c0 con 0x55dd01d45ee0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbf77fe640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005750 tx=0x7fdbe8004930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe63acf00a52e619 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.876+0000 7fdbdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.877+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8005100 con 0x55dd01d45ee0 2024-09-10T21:01:11.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.877+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbe80052a0 con 0x55dd01d45ee0 2024-09-10T21:01:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.877+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe80054a0 con 0x55dd01d45ee0 2024-09-10T21:01:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.878+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdbe80049d0 con 0x55dd01d45ee0 2024-09-10T21:01:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.881+0000 7fdbff71e740 10 client.26236 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:11.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.881+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dd01dc60c0 con 0x55dd01d45ee0 2024-09-10T21:01:11.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbe80054a0 con 0x55dd01d45ee0 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdbe803d070 con 0x55dd01d45ee0 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 10 client.26236 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 10 client.26236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 20 client.26236 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01dc6720 0x55dd01dc8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 4 client.26236 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:01:11.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.884+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dd01cba860 con 0x55dd01dc6720 2024-09-10T21:01:11.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.887+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01dc6720 0x55dd01dc8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:11.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.889+0000 7fdbf67fc640 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01dc6720 0x55dd01dc8b40 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39ae295f4b849292 server_cookie=3d3aa2ac34320d78 in_seq=0 out_seq=0 2024-09-10T21:01:11.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.889+0000 7fdbdaff5640 10 client.26236 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbdaff5640 1 -- 172.21.15.67:0/129781830 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dd01cba860 con 0x55dd01dc6720 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbdaff5640 10 client.26236 handle_command_reply: tid=0 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 client.26236 shutdown 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 msgr2=0x55dd01d59020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005750 tx=0x7fdbe8004930 comp rx=0 tx=0).stop 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 shutdown_connections 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55dd01dc6720 0x55dd01dc8b40 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55dd01d52790 0x55dd01dd0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55dd01d46800 0x55dd01d595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 --2- 172.21.15.67:0/129781830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd01d45ee0 0x55dd01d59020 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 >> 172.21.15.67:0/129781830 conn(0x55dd01d43d10 msgr2=0x55dd01d5d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.893+0000 7fdbdaff5640 0 client.26236 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.894+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 shutdown_connections 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.894+0000 7fdbff71e740 1 -- 172.21.15.67:0/129781830 wait complete. 2024-09-10T21:01:11.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.894+0000 7fdbff71e740 20 client.26236 trim_cache size 0 max 16384 2024-09-10T21:01:11.900 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:11.900 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:01:11.900 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "f3e15e4c-c74b-49ea-8413-178fe49e3fd4", 2024-09-10T21:01:11.901 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:01:11.901 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.895+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 msgr2=0x7fdbe00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.895+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 0x7fdbe00b77a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00acae0 tx=0x7fdbf00e9bc0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 msgr2=0x7fdbf819b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000ebc0 tx=0x7fdbf000c6a0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 shutdown_connections 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbf8108020 0x7fdbf81a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdbe00b52e0 0x7fdbe00b77a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbf81076a0 0x7fdbf819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 --2- 172.21.15.67:0/1267182122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbf8101c90 0x7fdbf819b470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:11.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 >> 172.21.15.67:0/1267182122 conn(0x7fdbf80fd700 msgr2=0x7fdbf81002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:11.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 shutdown_connections 2024-09-10T21:01:11.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:11.896+0000 7fdbfd349640 1 -- 172.21.15.67:0/1267182122 wait complete. 2024-09-10T21:01:12.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:12 smithi083 ceph-mon[35058]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T21:01:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:12 smithi172 ceph-mon[35265]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T21:01:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:12 smithi067 ceph-mon[30891]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T21:01:12.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:13 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.299 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:13.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:01:13.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.392 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:13 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:13.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:13 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 -- 172.21.15.67:0/1927533308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef0104530 msgr2=0x7f6ef010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1927533308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef0104530 0x7f6ef010cb10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009900 tx=0x7f6ed802a410 comp rx=0 tx=0).stop 2024-09-10T21:01:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 -- 172.21.15.67:0/1927533308 shutdown_connections 2024-09-10T21:01:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1927533308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef010d0e0 0x7f6ef010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1927533308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef0104530 0x7f6ef010cb10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1927533308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0103b30 0x7f6ef0103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.848+0000 7f6ef6787640 1 -- 172.21.15.67:0/1927533308 >> 172.21.15.67:0/1927533308 conn(0x7f6ef00fd700 msgr2=0x7f6ef00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.849+0000 7f6ef6787640 1 -- 172.21.15.67:0/1927533308 shutdown_connections 2024-09-10T21:01:13.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.849+0000 7f6ef6787640 1 -- 172.21.15.67:0/1927533308 wait complete. 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.850+0000 7f6ef6787640 1 Processor -- start 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 -- start start 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 0x7f6ef0199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 0x7f6ef019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112d60 con 0x7f6ef010d0e0 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112be0 con 0x7f6ef0104530 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef6787640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0112ee0 con 0x7f6ef0103b30 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:46354/0 (socket says 172.21.15.67:46354) 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6eeffff640 1 -- 172.21.15.67:0/1141583708 learned_addr learned my addr 172.21.15.67:0/1141583708 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:13.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 0x7f6ef019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.852+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 0x7f6ef0199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 -- 172.21.15.67:0/1141583708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 msgr2=0x7f6ef01992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 -- 172.21.15.67:0/1141583708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 msgr2=0x7f6ef0199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 0x7f6ef0199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 -- 172.21.15.67:0/1141583708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef019f3a0 con 0x7f6ef010d0e0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6eeffff640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 0x7f6ef0199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 0x7f6ef019ebd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6eedffb640 1 -- 172.21.15.67:0/1141583708 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800ce20 con 0x7f6ef010d0e0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.853+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef019f690 con 0x7f6ef010d0e0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.854+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01a5d50 con 0x7f6ef010d0e0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.854+0000 7f6eedffb640 1 -- 172.21.15.67:0/1141583708 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee8010430 con 0x7f6ef010d0e0 2024-09-10T21:01:13.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.854+0000 7f6eedffb640 1 -- 172.21.15.67:0/1141583708 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800f620 con 0x7f6ef010d0e0 2024-09-10T21:01:13.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.857+0000 7f6ef8b5c740 1 Processor -- start 2024-09-10T21:01:13.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6eedffb640 1 -- 172.21.15.67:0/1141583708 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6ee801f020 con 0x7f6ef010d0e0 2024-09-10T21:01:13.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 -- start start 2024-09-10T21:01:13.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49ef480 0x55e3a49ef860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a49fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e3a4965e50 con 0x55e3a49fbd30 2024-09-10T21:01:13.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e3a4955280 con 0x55e3a49efda0 2024-09-10T21:01:13.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.858+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3a4959090 con 0x55e3a49ef480 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eedffb640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 0x7f6edc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:59798/0 (socket says 172.21.15.67:59798) 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 -- 172.21.15.67:0/1669036600 learned_addr learned my addr 172.21.15.67:0/1669036600 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eedffb640 1 -- 172.21.15.67:0/1141583708 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6ee80e5910 con 0x7f6ef010d0e0 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 0x7f6edc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 -- 172.21.15.67:0/1669036600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49ef480 msgr2=0x55e3a49ef860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49ef480 0x55e3a49ef860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 -- 172.21.15.67:0/1669036600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 msgr2=0x55e3a49fe120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a49fe120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.859+0000 7f6eeffff640 1 -- 172.21.15.67:0/1669036600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a46b3650 con 0x55e3a49efda0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.860+0000 7f6eeffff640 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009f90 tx=0x7f6ee0011ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d5fab73b28c2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.860+0000 7f6ef4d24640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 0x7f6edc0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80e3440 tx=0x7f6ee8005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.860+0000 7f6ee67fc640 1 -- 172.21.15.67:0/1669036600 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee000f8f0 con 0x55e3a49efda0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.860+0000 7f6ee67fc640 1 -- 172.21.15.67:0/1669036600 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee001a070 con 0x55e3a49efda0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.860+0000 7f6ee67fc640 1 -- 172.21.15.67:0/1669036600 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0016e40 con 0x55e3a49efda0 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/1669036600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 msgr2=0x55e3a49fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009f90 tx=0x7f6ee0011ae0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/1669036600 shutdown_connections 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a49fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49fb7f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/1669036600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49ef480 0x55e3a49ef860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/1669036600 >> 172.21.15.67:0/1669036600 conn(0x55e3a49ed2b0 msgr2=0x55e3a49ee450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/1669036600 shutdown_connections 2024-09-10T21:01:13.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.861+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/1669036600 wait complete. 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.862+0000 7f6ef8b5c740 1 -- start start 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.862+0000 7f6ef8b5c740 1 Processor -- start 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49ef480 0x55e3a49fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e3a47b6700 con 0x55e3a49ef480 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e3a48f0110 con 0x55e3a49efda0 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3a49fe9b0 con 0x55e3a49fbd30 2024-09-10T21:01:13.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:46362/0 (socket says 172.21.15.67:46362) 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ee7fff640 1 -- 172.21.15.67:0/831274077 learned_addr learned my addr 172.21.15.67:0/831274077 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.863+0000 7f6ef8b5c740 10 client.0 _ll_register_callbacks cb 0x55e3a4909990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6eeffff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 -- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 msgr2=0x55e3a49f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 -- 172.21.15.67:0/831274077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49ef480 msgr2=0x55e3a49fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49ef480 0x55e3a49fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 -- 172.21.15.67:0/831274077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a491dc40 con 0x55e3a49fbd30 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009900 tx=0x7f6ed8009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ef9a34a92bab13c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8035070 con 0x55e3a49fbd30 2024-09-10T21:01:13.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee001a070 con 0x55e3a49fbd30 2024-09-10T21:01:13.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.864+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6ed8004030 con 0x55e3a49fbd30 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.865+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6ed8004230 con 0x55e3a49fbd30 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.865+0000 7f6ef8b5c740 10 client.26245 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e3a4a12ba0 con 0x55e3a49fbd30 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee001a070 con 0x55e3a49fbd30 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6ed803c4e0 con 0x55e3a49fbd30 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 10 client.26245 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 10 client.26245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 20 client.26245 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:13.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a14020 0x55e3a4a16470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 4 client.26245 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3a4967da0 con 0x55e3a4a14020 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.866+0000 7f6eeffff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a14020 0x55e3a4a16470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.867+0000 7f6ecf7fe640 10 client.26245 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.867+0000 7f6eeffff640 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a14020 0x55e3a4a16470 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2038cc1de0debd60 server_cookie=144acd96a4d3c778 in_seq=0 out_seq=0 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.867+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/831274077 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3a4967da0 con 0x55e3a4a14020 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.867+0000 7f6ecf7fe640 10 client.26245 handle_command_reply: tid=0 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 client.26245 shutdown 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 msgr2=0x55e3a49f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009900 tx=0x7f6ed8009560 comp rx=0 tx=0).stop 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 shutdown_connections 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a14020 0x55e3a4a16470 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a49f8f20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49efda0 0x55e3a49f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/831274077 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49ef480 0x55e3a49fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ecf7fe640 0 client.26245 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 >> 172.21.15.67:0/831274077 conn(0x55e3a49ed2b0 msgr2=0x55e3a49f2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 shutdown_connections 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/831274077 wait complete. 2024-09-10T21:01:13.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.868+0000 7f6ef8b5c740 20 client.26245 trim_cache size 0 max 16384 2024-09-10T21:01:13.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 Processor -- start 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 -- start start 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a49f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 0x55e3a49f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed0010c60 con 0x55e3a49efda0 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000e530 con 0x55e3a49ef480 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000c380 con 0x55e3a49fbd30 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 0x55e3a49f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ee7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:46370/0 (socket says 172.21.15.67:46370) 2024-09-10T21:01:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3113602244 learned_addr learned my addr 172.21.15.67:0/3113602244 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.893+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a49f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3113602244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 msgr2=0x55e3a49f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a49f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3113602244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 msgr2=0x55e3a49f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 0x55e3a49f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 -- 172.21.15.67:0/3113602244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3a49ee990 con 0x55e3a49fbd30 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6eeffff640 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 0x55e3a49f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80096c0 tx=0x7f6ed802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187a6bd8b893927d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee5ffb640 1 -- 172.21.15.67:0/3113602244 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8035040 con 0x55e3a49fbd30 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee5ffb640 1 -- 172.21.15.67:0/3113602244 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed8056070 con 0x55e3a49fbd30 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.894+0000 7f6ee5ffb640 1 -- 172.21.15.67:0/3113602244 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8003850 con 0x55e3a49fbd30 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/3113602244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 msgr2=0x55e3a4a1bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80096c0 tx=0x7f6ed802a410 comp rx=0 tx=0).stop 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/3113602244 shutdown_connections 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49fbd30 0x55e3a4a1bd80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49efda0 0x55e3a49f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/3113602244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a49f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/3113602244 >> 172.21.15.67:0/3113602244 conn(0x55e3a49ed2b0 msgr2=0x55e3a49fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/3113602244 shutdown_connections 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/3113602244 wait complete. 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.895+0000 7f6ef8b5c740 1 -- start start 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 Processor -- start 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a4a08c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a4a7ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000c9f0 con 0x55e3a49fbd30 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000de60 con 0x55e3a49ef480 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed000d0c0 con 0x55e3a49efda0 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ef8b5c740 10 client.0 _ll_register_callbacks cb 0x7f6ee80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:46382/0 (socket says 172.21.15.67:46382) 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 -- 172.21.15.67:0/496426354 learned_addr learned my addr 172.21.15.67:0/496426354 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a4a7ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a4a08c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 -- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 msgr2=0x55e3a4a08c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a4a08c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 -- 172.21.15.67:0/496426354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 msgr2=0x55e3a4a7ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:13.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.896+0000 7f6eeffff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a4a7ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6eeffff640 1 -- 172.21.15.67:0/496426354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3a4a80560 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6eeffff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009380 tx=0x7f6ee00169a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8865bc67fcd40584 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ecf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0005040 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6ee00051e0 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ed8056070 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6ee00053e0 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ef8b5c740 10 client.26251 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.897+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e3a4a81870 con 0x55e3a49efda0 2024-09-10T21:01:13.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.898+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ed8056070 con 0x55e3a49efda0 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.898+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6ee000f750 con 0x55e3a49efda0 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 10 client.26251 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 10 client.26251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 20 client.26251 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a81e50 0x55e3a4a84270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 4 client.26251 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3a4963850 con 0x55e3a4a81e50 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.899+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a81e50 0x55e3a4a84270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ee7fff640 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a81e50 0x55e3a4a84270 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ec6a4e12c05f73 server_cookie=9bcff18472b5092b in_seq=0 out_seq=0 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ecf7fe640 10 client.26251 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:13.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ecf7fe640 1 -- 172.21.15.67:0/496426354 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55e3a4963850 con 0x55e3a4a81e50 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ecf7fe640 10 client.26251 handle_command_reply: tid=0 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ef8b5c740 1 client.26251 shutdown 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 msgr2=0x55e3a4a091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009380 tx=0x7f6ee00169a0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 shutdown_connections 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.900+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e3a4a81e50 0x55e3a4a84270 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e3a49fbd30 0x55e3a4a7ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ecf7fe640 0 client.26251 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3a49efda0 0x55e3a4a091b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 --2- 172.21.15.67:0/496426354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e3a49ef480 0x55e3a4a08c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 >> 172.21.15.67:0/496426354 conn(0x55e3a49ed2b0 msgr2=0x55e3a49ebbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 shutdown_connections 2024-09-10T21:01:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 1 -- 172.21.15.67:0/496426354 wait complete. 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.901+0000 7f6ef8b5c740 20 client.26251 trim_cache size 0 max 16384 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "f3e15e4c-c74b-49ea-8413-178fe49e3fd4", 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:13.910 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.911 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:01:13.912 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.913 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.914 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:01:13.915 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.916 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.917 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:01:13.918 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:13.919 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 msgr2=0x7f6edc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 0x7f6edc0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80e3440 tx=0x7f6ee8005f70 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 msgr2=0x7f6ef019ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 0x7f6ef019ebd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009fd0 tx=0x7f6ee800ef10 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 shutdown_connections 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ef010d0e0 0x7f6ef019ebd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ef0104530 0x7f6ef0199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6edc0b52e0 0x7f6edc0b77a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 --2- 172.21.15.67:0/1141583708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef0103b30 0x7f6ef01992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 >> 172.21.15.67:0/1141583708 conn(0x7f6ef00fd700 msgr2=0x7f6ef00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 shutdown_connections 2024-09-10T21:01:13.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:13.902+0000 7f6ef6787640 1 -- 172.21.15.67:0/1141583708 wait complete. 2024-09-10T21:01:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 580.0 s, 1640.2 tps, lat 60.358 ms stddev 66.744 2024-09-10T21:01:14.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:14 smithi083 ceph-mon[35058]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-09-10T21:01:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:14 smithi172 ceph-mon[35265]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-09-10T21:01:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:14 smithi067 ceph-mon[30891]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.6 MiB/s wr, 682 op/s 2024-09-10T21:01:15.001 INFO:tasks.cephfs.filesystem:scrub status for tag:f3e15e4c-c74b-49ea-8413-178fe49e3fd4 - {'path': '/', 'tag': 'f3e15e4c-c74b-49ea-8413-178fe49e3fd4', 'options': 'recursive,force'} 2024-09-10T21:01:16.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:16 smithi083 ceph-mon[35058]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 645 op/s 2024-09-10T21:01:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:16 smithi172 ceph-mon[35265]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 645 op/s 2024-09-10T21:01:16.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:16 smithi067 ceph-mon[30891]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 645 op/s 2024-09-10T21:01:18.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:18 smithi083 ceph-mon[35058]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:01:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:18 smithi172 ceph-mon[35265]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:01:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:18 smithi067 ceph-mon[30891]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:01:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 585.0 s, 1544.6 tps, lat 65.351 ms stddev 75.233 2024-09-10T21:01:20.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:20 smithi083 ceph-mon[35058]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T21:01:20.586 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:20 smithi067 ceph-mon[30891]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T21:01:20.586 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:20 smithi172 ceph-mon[35265]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T21:01:22.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:22 smithi083 ceph-mon[35058]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-10T21:01:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:22 smithi172 ceph-mon[35265]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-10T21:01:22.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:22 smithi067 ceph-mon[30891]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-10T21:01:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 590.0 s, 2104.0 tps, lat 47.635 ms stddev 53.752 2024-09-10T21:01:24.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:24 smithi083 ceph-mon[35058]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:24 smithi172 ceph-mon[35265]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:24 smithi067 ceph-mon[30891]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:26 smithi067 ceph-mon[30891]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-09-10T21:01:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:01:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:01:26.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:01:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:26 smithi083 ceph-mon[35058]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-09-10T21:01:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:01:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:01:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:01:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:26 smithi172 ceph-mon[35265]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-09-10T21:01:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:01:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:01:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:01:28.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:28 smithi067 ceph-mon[30891]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 695 op/s 2024-09-10T21:01:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:28 smithi083 ceph-mon[35058]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 695 op/s 2024-09-10T21:01:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:28 smithi172 ceph-mon[35265]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 695 op/s 2024-09-10T21:01:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 595.0 s, 1706.2 tps, lat 57.679 ms stddev 62.501 2024-09-10T21:01:30.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:30 smithi067 ceph-mon[30891]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-09-10T21:01:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:30 smithi083 ceph-mon[35058]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-09-10T21:01:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:30 smithi172 ceph-mon[35265]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-09-10T21:01:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:32 smithi067 ceph-mon[30891]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.4 MiB/s wr, 577 op/s 2024-09-10T21:01:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:32 smithi083 ceph-mon[35058]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.4 MiB/s wr, 577 op/s 2024-09-10T21:01:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:32 smithi172 ceph-mon[35265]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.4 MiB/s wr, 577 op/s 2024-09-10T21:01:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 600.0 s, 2064.2 tps, lat 49.080 ms stddev 56.990 2024-09-10T21:01:34.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:34 smithi067 ceph-mon[30891]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:34 smithi083 ceph-mon[35058]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:34 smithi172 ceph-mon[35265]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 698 op/s 2024-09-10T21:01:36.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:36 smithi067 ceph-mon[30891]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2024-09-10T21:01:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:36 smithi083 ceph-mon[35058]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2024-09-10T21:01:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:36 smithi172 ceph-mon[35265]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 639 op/s 2024-09-10T21:01:38.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:38 smithi067 ceph-mon[30891]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2024-09-10T21:01:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:38 smithi083 ceph-mon[35058]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2024-09-10T21:01:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:38 smithi172 ceph-mon[35265]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 638 op/s 2024-09-10T21:01:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 605.0 s, 3514.0 tps, lat 28.435 ms stddev 36.793 2024-09-10T21:01:40.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:40 smithi067 ceph-mon[30891]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 614 op/s 2024-09-10T21:01:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:40 smithi083 ceph-mon[35058]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 614 op/s 2024-09-10T21:01:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:40 smithi172 ceph-mon[35265]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.3 MiB/s wr, 614 op/s 2024-09-10T21:01:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:42 smithi067 ceph-mon[30891]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 655 op/s 2024-09-10T21:01:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:42 smithi083 ceph-mon[35058]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 655 op/s 2024-09-10T21:01:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:42 smithi172 ceph-mon[35265]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 655 op/s 2024-09-10T21:01:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:43 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:01:43.647 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:43 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:01:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:43 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:01:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 610.0 s, 1494.6 tps, lat 66.770 ms stddev 74.120 2024-09-10T21:01:44.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:44 smithi067 ceph-mon[30891]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 710 op/s 2024-09-10T21:01:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:44 smithi083 ceph-mon[35058]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 710 op/s 2024-09-10T21:01:44.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:44 smithi172 ceph-mon[35265]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 710 op/s 2024-09-10T21:01:45.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:01:45.454 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 698 op/s 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.137 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:01:46.138 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:45 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:01:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 698 op/s 2024-09-10T21:01:46.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:01:46.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:45 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:01:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 698 op/s 2024-09-10T21:01:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:01:46.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:45 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:01:46.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 -- 172.21.15.67:0/2647459375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d4103b70 msgr2=0x7f85d4103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 --2- 172.21.15.67:0/2647459375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d4103b70 0x7f85d4103f50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009900 tx=0x7f85c802a410 comp rx=0 tx=0).stop 2024-09-10T21:01:46.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 -- 172.21.15.67:0/2647459375 shutdown_connections 2024-09-10T21:01:46.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 --2- 172.21.15.67:0/2647459375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d410d120 0x7f85d410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 --2- 172.21.15.67:0/2647459375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 --2- 172.21.15.67:0/2647459375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d4103b70 0x7f85d4103f50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.245+0000 7f85dad45640 1 -- 172.21.15.67:0/2647459375 >> 172.21.15.67:0/2647459375 conn(0x7f85d40fd740 msgr2=0x7f85d40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.246+0000 7f85dad45640 1 -- 172.21.15.67:0/2647459375 shutdown_connections 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.246+0000 7f85dad45640 1 -- 172.21.15.67:0/2647459375 wait complete. 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.246+0000 7f85dad45640 1 Processor -- start 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.247+0000 7f85dad45640 1 -- start start 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4103b70 0x7f85d41034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 0x7f85d4102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4112da0 con 0x7f85d410d120 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4112c20 con 0x7f85d4104570 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85dad45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4112f20 con 0x7f85d4103b70 2024-09-10T21:01:46.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d8ae1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4103b70 0x7f85d41034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49944/0 (socket says 172.21.15.67:49944) 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 0x7f85d4102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 -- 172.21.15.67:0/1575131488 learned_addr learned my addr 172.21.15.67:0/1575131488 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 -- 172.21.15.67:0/1575131488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4103b70 msgr2=0x7f85d41034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4103b70 0x7f85d41034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 -- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 msgr2=0x7f85d4102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 0x7f85d4102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d3fff640 1 -- 172.21.15.67:0/1575131488 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d41abc10 con 0x7f85d4104570 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.248+0000 7f85d92e2640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 0x7f85d4102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85d3fff640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d950 tx=0x7f85c000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85d1ffb640 1 -- 172.21.15.67:0/1575131488 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0017070 con 0x7f85d4104570 2024-09-10T21:01:46.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85d1ffb640 1 -- 172.21.15.67:0/1575131488 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c0009c30 con 0x7f85d4104570 2024-09-10T21:01:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85d1ffb640 1 -- 172.21.15.67:0/1575131488 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f620 con 0x7f85d4104570 2024-09-10T21:01:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d41abde0 con 0x7f85d4104570 2024-09-10T21:01:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.249+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41ac2e0 con 0x7f85d4104570 2024-09-10T21:01:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.251+0000 7f85d1ffb640 1 -- 172.21.15.67:0/1575131488 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f85c0010460 con 0x7f85d4104570 2024-09-10T21:01:46.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 Processor -- start 2024-09-10T21:01:46.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 -- start start 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x56177719d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561777113e50 con 0x56177719dda0 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561777103280 con 0x56177719d480 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.252+0000 7f85dd11a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561777107090 con 0x5617771a9d30 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d8ae1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x56177719d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d8ae1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40644/0 (socket says 172.21.15.67:40644) 2024-09-10T21:01:46.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d8ae1640 1 -- 172.21.15.67:0/3110441650 learned_addr learned my addr 172.21.15.67:0/3110441650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:46.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d1ffb640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 0x7f85c40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d1ffb640 1 -- 172.21.15.67:0/1575131488 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85c00e5710 con 0x7f85d4104570 2024-09-10T21:01:46.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.253+0000 7f85d92e2640 1 -- 172.21.15.67:0/3110441650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 msgr2=0x5617771ac120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d92e2640 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771ac120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d92e2640 1 -- 172.21.15.67:0/3110441650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 msgr2=0x5617771a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d92e2640 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d92e2640 1 -- 172.21.15.67:0/3110441650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561776e61650 con 0x56177719d480 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.254+0000 7f85d92e2640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 0x7f85c40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.255+0000 7f85d92e2640 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x56177719d860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc011c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fdf1d018257e1ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.255+0000 7f85d92e2640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 0x7f85c40b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85cc01c000 tx=0x7f85cc01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.255+0000 7f85beffd640 1 -- 172.21.15.67:0/3110441650 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc017050 con 0x56177719d480 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.255+0000 7f85beffd640 1 -- 172.21.15.67:0/3110441650 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85cc004490 con 0x56177719d480 2024-09-10T21:01:46.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.255+0000 7f85beffd640 1 -- 172.21.15.67:0/3110441650 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc005570 con 0x56177719d480 2024-09-10T21:01:46.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 -- 172.21.15.67:0/3110441650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 msgr2=0x56177719d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x56177719d860 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc011c90 comp rx=0 tx=0).stop 2024-09-10T21:01:46.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 -- 172.21.15.67:0/3110441650 shutdown_connections 2024-09-10T21:01:46.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3110441650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x56177719d860 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 -- 172.21.15.67:0/3110441650 >> 172.21.15.67:0/3110441650 conn(0x56177719b2b0 msgr2=0x56177719c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 -- 172.21.15.67:0/3110441650 shutdown_connections 2024-09-10T21:01:46.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.256+0000 7f85dd11a740 1 -- 172.21.15.67:0/3110441650 wait complete. 2024-09-10T21:01:46.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 -- start start 2024-09-10T21:01:46.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 Processor -- start 2024-09-10T21:01:46.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561776f64700 con 0x56177719dda0 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56177709e110 con 0x56177719d480 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.257+0000 7f85dd11a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5617771bd960 con 0x5617771a9d30 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85dd11a740 10 client.0 _ll_register_callbacks cb 0x5617770b7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:32898/0 (socket says 172.21.15.67:32898) 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85d8ae1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85d8ae1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:49970/0 (socket says 172.21.15.67:49970) 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.258+0000 7f85d8ae1640 1 -- 172.21.15.67:0/3304174740 learned_addr learned my addr 172.21.15.67:0/3304174740 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:46.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 -- 172.21.15.67:0/3304174740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 msgr2=0x5617771a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 -- 172.21.15.67:0/3304174740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 msgr2=0x5617771a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 -- 172.21.15.67:0/3304174740 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617770cbc40 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85c8000c00 tx=0x7f85c8032f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721d627f05e73302 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.259+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8035040 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85c8031860 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85cc004490 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f85c804d070 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 10 client.26327 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5617771c9400 con 0x56177719d480 2024-09-10T21:01:46.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85cc004490 con 0x56177719d480 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f85c8004750 con 0x56177719d480 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 10 client.26327 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 10 client.26327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 20 client.26327 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5617771cab60 0x5617771ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 4 client.26327 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561777115da0 con 0x5617771cab60 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.260+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5617771cab60 0x5617771ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.261+0000 7f85b3fff640 10 client.26327 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:46.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.261+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5617771cab60 0x5617771ccf80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3e534cdaa7db33 server_cookie=277ea720ba229cb4 in_seq=0 out_seq=0 2024-09-10T21:01:46.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.262+0000 7f85b3fff640 1 -- 172.21.15.67:0/3304174740 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561777115da0 con 0x5617771cab60 2024-09-10T21:01:46.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.262+0000 7f85b3fff640 10 client.26327 handle_command_reply: tid=0 2024-09-10T21:01:46.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.262+0000 7f85dd11a740 1 client.26327 shutdown 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 msgr2=0x5617771a9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85c8000c00 tx=0x7f85c8032f80 comp rx=0 tx=0).stop 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 shutdown_connections 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5617771cab60 0x5617771ccf80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617771a9d30 0x5617771a72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3304174740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719d480 0x5617771a9760 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 >> 172.21.15.67:0/3304174740 conn(0x56177719b2b0 msgr2=0x5617771a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85b3fff640 0 client.26327 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 shutdown_connections 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 1 -- 172.21.15.67:0/3304174740 wait complete. 2024-09-10T21:01:46.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.263+0000 7f85dd11a740 20 client.26327 trim_cache size 0 max 16384 2024-09-10T21:01:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.285+0000 7f85dd11a740 1 Processor -- start 2024-09-10T21:01:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 -- start start 2024-09-10T21:01:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x56177719abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617771a9d30 0x5617771a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41ae9d0 con 0x56177719dda0 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41a5960 con 0x5617771a9d30 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85dd11a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41a37b0 con 0x56177719d480 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85d3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40656/0 (socket says 172.21.15.67:40656) 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85d3fff640 1 -- 172.21.15.67:0/3735707112 learned_addr learned my addr 172.21.15.67:0/3735707112 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:46.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.286+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x56177719abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 -- 172.21.15.67:0/3735707112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 msgr2=0x56177719abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x56177719abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 -- 172.21.15.67:0/3735707112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617771a9d30 msgr2=0x5617771a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617771a9d30 0x5617771a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 -- 172.21.15.67:0/3735707112 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617771a9390 con 0x56177719dda0 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x56177719abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85d3fff640 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f85c00a91c0 tx=0x7f85c0010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd962dcea716ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85be7fc640 1 -- 172.21.15.67:0/3735707112 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0020040 con 0x56177719dda0 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85be7fc640 1 -- 172.21.15.67:0/3735707112 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c00b0980 con 0x56177719dda0 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.287+0000 7f85be7fc640 1 -- 172.21.15.67:0/3735707112 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c00930b0 con 0x56177719dda0 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- 172.21.15.67:0/3735707112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 msgr2=0x5617771a3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f85c00a91c0 tx=0x7f85c0010cb0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- 172.21.15.67:0/3735707112 shutdown_connections 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617771a9d30 0x5617771a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56177719dda0 0x5617771a3dc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 --2- 172.21.15.67:0/3735707112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x56177719abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- 172.21.15.67:0/3735707112 >> 172.21.15.67:0/3735707112 conn(0x56177719b2b0 msgr2=0x5617771a8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- 172.21.15.67:0/3735707112 shutdown_connections 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- 172.21.15.67:0/3735707112 wait complete. 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 -- start start 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.288+0000 7f85dd11a740 1 Processor -- start 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x5617771c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 0x5617771c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41a3e20 con 0x5617771a9d30 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41a5290 con 0x56177719dda0 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41a44f0 con 0x56177719d480 2024-09-10T21:01:46.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85dd11a740 10 client.0 _ll_register_callbacks cb 0x7f85c8005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:46.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40658/0 (socket says 172.21.15.67:40658) 2024-09-10T21:01:46.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 -- 172.21.15.67:0/4078827201 learned_addr learned my addr 172.21.15.67:0/4078827201 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:46.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x5617771c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d3fff640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 0x5617771c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 -- 172.21.15.67:0/4078827201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 msgr2=0x5617771c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x5617771c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 -- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 msgr2=0x5617771c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 0x5617771c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d92e2640 1 -- 172.21.15.67:0/4078827201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617771be120 con 0x5617771a9d30 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.289+0000 7f85d3fff640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 0x5617771c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.290+0000 7f85d92e2640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005140 tx=0x7f85cc00fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec82c663c95607ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:46.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.290+0000 7f85b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.290+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc017030 con 0x5617771a9d30 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f85cc011250 con 0x5617771a9d30 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c00b0980 con 0x5617771a9d30 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f85cc004490 con 0x5617771a9d30 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85dd11a740 10 client.16602 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5617772382c0 con 0x5617771a9d30 2024-09-10T21:01:46.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c00b0980 con 0x5617771a9d30 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.291+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f85cc02e040 con 0x5617771a9d30 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 10 client.16602 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 20 client.16602 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561777238800 0x56177723ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 4 client.16602 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561777111850 con 0x561777238800 2024-09-10T21:01:46.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561777238800 0x56177723ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85b3fff640 10 client.16602 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85d8ae1640 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561777238800 0x56177723ac20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2379a78b821fa19 server_cookie=6214c01bf84f88f2 in_seq=0 out_seq=0 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85b3fff640 1 -- 172.21.15.67:0/4078827201 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x561777111850 con 0x561777238800 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.292+0000 7f85b3fff640 10 client.16602 handle_command_reply: tid=0 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 client.16602 shutdown 2024-09-10T21:01:46.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 msgr2=0x5617771bdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005140 tx=0x7f85cc00fb70 comp rx=0 tx=0).stop 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 shutdown_connections 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561777238800 0x56177723ac20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5617771a9d30 0x5617771bdbe0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56177719dda0 0x5617771c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85b3fff640 0 client.16602 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:46.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 --2- 172.21.15.67:0/4078827201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56177719d480 0x5617771c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 >> 172.21.15.67:0/4078827201 conn(0x56177719b2b0 msgr2=0x5617771a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 shutdown_connections 2024-09-10T21:01:46.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 1 -- 172.21.15.67:0/4078827201 wait complete. 2024-09-10T21:01:46.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.293+0000 7f85dd11a740 20 client.16602 trim_cache size 0 max 16384 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.306 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:01:46.307 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.308 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.310 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:01:46.311 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.312 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.313 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:46.314 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:46.315 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:46.315 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:46.315 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:46.315 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:46.315 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 msgr2=0x7f85c40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 0x7f85c40b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85cc01c000 tx=0x7f85cc01e000 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 msgr2=0x7f85d41019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d950 tx=0x7f85c000de10 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 shutdown_connections 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d410d120 0x7f85d4102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f85d4104570 0x7f85d41019f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f85c40b5360 0x7f85c40b7820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 --2- 172.21.15.67:0/1575131488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85d4103b70 0x7f85d41034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:46.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 >> 172.21.15.67:0/1575131488 conn(0x7f85d40fd740 msgr2=0x7f85d40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:46.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 shutdown_connections 2024-09-10T21:01:46.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:46.294+0000 7f85dad45640 1 -- 172.21.15.67:0/1575131488 wait complete. 2024-09-10T21:01:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:47.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:01:47.451 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:01:47.452 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:01:47.810 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:48.127 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:47 smithi067 ceph-mon[30891]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-09-10T21:01:48.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:47 smithi083 ceph-mon[35058]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-09-10T21:01:48.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:47 smithi172 ceph-mon[35265]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 701 op/s 2024-09-10T21:01:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 -- 172.21.15.67:0/596555734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e8103ca0 msgr2=0x7f12e8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 --2- 172.21.15.67:0/596555734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e8103ca0 0x7f12e8104080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009900 tx=0x7f12dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:01:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 -- 172.21.15.67:0/596555734 shutdown_connections 2024-09-10T21:01:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 --2- 172.21.15.67:0/596555734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 --2- 172.21.15.67:0/596555734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e81045c0 0x7f12e810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 --2- 172.21.15.67:0/596555734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e8103ca0 0x7f12e8104080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 -- 172.21.15.67:0/596555734 >> 172.21.15.67:0/596555734 conn(0x7f12e80fd700 msgr2=0x7f12e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 -- 172.21.15.67:0/596555734 shutdown_connections 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.351+0000 7f12eef6b640 1 -- 172.21.15.67:0/596555734 wait complete. 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12eef6b640 1 Processor -- start 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12eef6b640 1 -- start start 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12eef6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 0x7f12e8103400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12eef6b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12eef6b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12e7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50014/0 (socket says 172.21.15.67:50014) 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12ecd07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 0x7f12e8103400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.352+0000 7f12ed508640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:48.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12ecd07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 0x7f12e8103400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:32930/0 (socket says 172.21.15.67:32930) 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12ed508640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40680/0 (socket says 172.21.15.67:40680) 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f12e8112d70 con 0x7f12e810d100 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 -- 172.21.15.67:0/3904850975 learned_addr learned my addr 172.21.15.67:0/3904850975 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f12e8112bf0 con 0x7f12e81045c0 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12e8112ef0 con 0x7f12e8103ca0 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 -- 172.21.15.67:0/3904850975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 msgr2=0x7f12e8103400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 0x7f12e8103400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 -- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 msgr2=0x7f12e8101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e81abc00 con 0x7f12e81045c0 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12ed508640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:48.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e7fff640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e9c0 tx=0x7f12d400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.353+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4004220 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.354+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d40043c0 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.354+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e81abdd0 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.354+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4010430 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.354+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e81ac2d0 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.355+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e8104080 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.356+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f12d400c8b0 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.357+0000 7f12e5ffb640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 0x7f12d80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.357+0000 7f12ecd07640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 0x7f12d80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.357+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f12d40e6100 con 0x7f12e81045c0 2024-09-10T21:01:48.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.357+0000 7f12ecd07640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 0x7f12d80b7820 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f12dc031440 tx=0x7f12dc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:48.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.360+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f12d40acff0 con 0x7f12e81045c0 2024-09-10T21:01:48.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.654+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12e8102c50 con 0x7f12e81045c0 2024-09-10T21:01:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.654+0000 7f12e5ffb640 1 -- 172.21.15.67:0/3904850975 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f12e8102c50 con 0x7f12e81045c0 2024-09-10T21:01:48.659 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:01:48.659 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:01:48.659 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 msgr2=0x7f12d80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 0x7f12d80b7820 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f12dc031440 tx=0x7f12dc005b50 comp rx=0 tx=0).stop 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 msgr2=0x7f12e8101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e9c0 tx=0x7f12d400edc0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 shutdown_connections 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f12e810d100 0x7f12e8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12e81045c0 0x7f12e8101950 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f12d80b5360 0x7f12d80b7820 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 --2- 172.21.15.67:0/3904850975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12e8103ca0 0x7f12e8103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:48.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.658+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 >> 172.21.15.67:0/3904850975 conn(0x7f12e80fd700 msgr2=0x7f12e80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:48.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.659+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 shutdown_connections 2024-09-10T21:01:48.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:48.659+0000 7f12eef6b640 1 -- 172.21.15.67:0/3904850975 wait complete. 2024-09-10T21:01:48.919 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:48 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3904850975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 615.0 s, 1708.4 tps, lat 58.583 ms stddev 65.521 2024-09-10T21:01:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:48 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3904850975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:49.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:48 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3904850975' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:01:49.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:01:49.841 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:50.131 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:49 smithi067 ceph-mon[30891]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 697 op/s 2024-09-10T21:01:50.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:49 smithi083 ceph-mon[35058]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 697 op/s 2024-09-10T21:01:50.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:49 smithi172 ceph-mon[35265]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 697 op/s 2024-09-10T21:01:50.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.407+0000 7f3a1b766640 1 -- 172.21.15.67:0/3803233890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a150 msgr2=0x7f3a141111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.407+0000 7f3a1b766640 1 --2- 172.21.15.67:0/3803233890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a150 0x7f3a141111b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009900 tx=0x7f3a1002a480 comp rx=0 tx=0).stop 2024-09-10T21:01:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.412+0000 7f3a1b766640 1 -- 172.21.15.67:0/3803233890 shutdown_connections 2024-09-10T21:01:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.412+0000 7f3a1b766640 1 --2- 172.21.15.67:0/3803233890 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a1411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.412+0000 7f3a1b766640 1 --2- 172.21.15.67:0/3803233890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a530 0x7f3a1410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.412+0000 7f3a1b766640 1 --2- 172.21.15.67:0/3803233890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a150 0x7f3a141111b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.412+0000 7f3a1b766640 1 -- 172.21.15.67:0/3803233890 >> 172.21.15.67:0/3803233890 conn(0x7f3a1406dfc0 msgr2=0x7f3a1406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.417+0000 7f3a1b766640 1 -- 172.21.15.67:0/3803233890 shutdown_connections 2024-09-10T21:01:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.417+0000 7f3a1b766640 1 -- 172.21.15.67:0/3803233890 wait complete. 2024-09-10T21:01:50.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.418+0000 7f3a1b766640 1 Processor -- start 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.418+0000 7f3a1b766640 1 -- start start 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 0x7f3a141a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 0x7f3a141a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14121b20 con 0x7f3a1410a150 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141219a0 con 0x7f3a1411c0a0 2024-09-10T21:01:50.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a1b766640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14121ca0 con 0x7f3a1410a530 2024-09-10T21:01:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 0x7f3a141a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 0x7f3a141a85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:32940/0 (socket says 172.21.15.67:32940) 2024-09-10T21:01:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a19502640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 0x7f3a141a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a19d03640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a19d03640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50028/0 (socket says 172.21.15.67:50028) 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.419+0000 7f3a19d03640 1 -- 172.21.15.67:0/1175279811 learned_addr learned my addr 172.21.15.67:0/1175279811 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 -- 172.21.15.67:0/1175279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 msgr2=0x7f3a141a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 0x7f3a141a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 -- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 msgr2=0x7f3a141a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 0x7f3a141a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 -- 172.21.15.67:0/1175279811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a141ae120 con 0x7f3a1411c0a0 2024-09-10T21:01:50.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19502640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 0x7f3a141a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.420+0000 7f3a19d03640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00eaa0 tx=0x7f3a0c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.421+0000 7f3a0a7fc640 1 -- 172.21.15.67:0/1175279811 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c00cdb0 con 0x7f3a1411c0a0 2024-09-10T21:01:50.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.421+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a141ae410 con 0x7f3a1411c0a0 2024-09-10T21:01:50.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.421+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a14111880 con 0x7f3a1411c0a0 2024-09-10T21:01:50.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.424+0000 7f3a0a7fc640 1 -- 172.21.15.67:0/1175279811 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a0c005020 con 0x7f3a1411c0a0 2024-09-10T21:01:50.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.424+0000 7f3a0a7fc640 1 -- 172.21.15.67:0/1175279811 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0116d0 con 0x7f3a1411c0a0 2024-09-10T21:01:50.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.426+0000 7f3a1db3b740 1 Processor -- start 2024-09-10T21:01:50.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 -- start start 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557b7a019ea0 con 0x557b7a0a3df0 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557b7a0092d0 con 0x557b7a0a34d0 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557b7a00d0e0 con 0x557b7a0afd80 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a19502640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a19502640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40694/0 (socket says 172.21.15.67:40694) 2024-09-10T21:01:50.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.427+0000 7f3a19502640 1 -- 172.21.15.67:0/730145612 learned_addr learned my addr 172.21.15.67:0/730145612 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:50.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.430+0000 7f3a0a7fc640 1 -- 172.21.15.67:0/1175279811 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3a0c00f040 con 0x7f3a1411c0a0 2024-09-10T21:01:50.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.431+0000 7f3a0a7fc640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 0x7f3a000b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.431+0000 7f3a0a7fc640 1 -- 172.21.15.67:0/1175279811 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3a0c0e5900 con 0x7f3a1411c0a0 2024-09-10T21:01:50.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.432+0000 7f3a19d03640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 0x7f3a000b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.433+0000 7f3a18d01640 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.433+0000 7f3a18d01640 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19d03640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 0x7f3a000b78a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0a9300 tx=0x7f3a0c00cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 -- 172.21.15.67:0/730145612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 msgr2=0x557b7a0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 -- 172.21.15.67:0/730145612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 msgr2=0x557b7a0a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 -- 172.21.15.67:0/730145612 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b79d67650 con 0x557b7a0a3df0 2024-09-10T21:01:50.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.434+0000 7f3a19502640 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3a10006010 tx=0x7f3a100052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46552af2e99a11fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.440+0000 7f39ff7fe640 1 -- 172.21.15.67:0/730145612 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10041070 con 0x557b7a0a3df0 2024-09-10T21:01:50.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.440+0000 7f39ff7fe640 1 -- 172.21.15.67:0/730145612 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a100054c0 con 0x557b7a0a3df0 2024-09-10T21:01:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.441+0000 7f3a1db3b740 1 -- 172.21.15.67:0/730145612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 msgr2=0x557b7a0af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.441+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3a10006010 tx=0x7f3a100052d0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 -- 172.21.15.67:0/730145612 shutdown_connections 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0af840 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/730145612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 -- 172.21.15.67:0/730145612 >> 172.21.15.67:0/730145612 conn(0x557b7a0a1300 msgr2=0x557b7a0a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 -- 172.21.15.67:0/730145612 shutdown_connections 2024-09-10T21:01:50.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 -- 172.21.15.67:0/730145612 wait complete. 2024-09-10T21:01:50.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.442+0000 7f3a1db3b740 1 -- start start 2024-09-10T21:01:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.443+0000 7f3a1db3b740 1 Processor -- start 2024-09-10T21:01:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.444+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40708/0 (socket says 172.21.15.67:40708) 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a18d01640 1 -- 172.21.15.67:0/3921466658 learned_addr learned my addr 172.21.15.67:0/3921466658 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 0x557b7a0ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 0x557b7a0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557b79e6a700 con 0x557b7a0a34d0 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557b79fa4160 con 0x557b7a0afd80 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557b7a0b29f0 con 0x557b7a0a3df0 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.445+0000 7f3a1db3b740 10 client.0 _ll_register_callbacks cb 0x557b79fbd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.446+0000 7f3a19502640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 0x557b7a0ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.446+0000 7f3a19502640 1 -- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 msgr2=0x557b7a0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.446+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 0x557b7a0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a19502640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 0x557b7a0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a19502640 1 -- 172.21.15.67:0/3921466658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 msgr2=0x557b7a0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a19502640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a19502640 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b79fd1c90 con 0x557b7a0a3df0 2024-09-10T21:01:50.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 0x557b7a0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:01:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f3a19502640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 0x557b7a0ac9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a10005c20 tx=0x7f3a100048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1642970202860510 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.448+0000 7f39fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10041040 con 0x557b7a0a3df0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a100054c0 con 0x557b7a0a3df0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3a10004440 con 0x557b7a0a3df0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3a10004a60 con 0x557b7a0a3df0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f3a1db3b740 10 client.26284 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557b7a0be340 con 0x557b7a0a3df0 2024-09-10T21:01:50.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.449+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a100054c0 con 0x557b7a0a3df0 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3a1003a050 con 0x557b7a0a3df0 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 10 client.26284 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 10 client.26284 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 20 client.26284 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a0bf8a0 0x557b7a0c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 4 client.26284 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:50.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b7a01bdf0 con 0x557b7a0bf8a0 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a0bf8a0 0x557b7a0c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.450+0000 7f39fcff9640 10 client.26284 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.451+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a0bf8a0 0x557b7a0c1d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52cc46657713a55e server_cookie=c9c593aa6db04e3e in_seq=0 out_seq=0 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.451+0000 7f39fcff9640 1 -- 172.21.15.67:0/3921466658 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b7a01bdf0 con 0x557b7a0bf8a0 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.451+0000 7f39fcff9640 10 client.26284 handle_command_reply: tid=0 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.451+0000 7f3a1db3b740 1 client.26284 shutdown 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 msgr2=0x557b7a0ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 0x557b7a0ac9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a10005c20 tx=0x7f3a100048f0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 shutdown_connections 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a0bf8a0 0x557b7a0c1d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0afd80 0x557b7a0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0a3df0 0x557b7a0ac9f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3921466658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 >> 172.21.15.67:0/3921466658 conn(0x557b7a0a1300 msgr2=0x557b7a0a6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f39fcff9640 0 client.26284 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 shutdown_connections 2024-09-10T21:01:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3921466658 wait complete. 2024-09-10T21:01:50.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.452+0000 7f3a1db3b740 20 client.26284 trim_cache size 0 max 16384 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.473+0000 7f3a1db3b740 1 Processor -- start 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.473+0000 7f3a1db3b740 1 -- start start 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.473+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.473+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.473+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39f8010d50 con 0x557b7a0a34d0 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f39f800e620 con 0x557b7a0a3df0 2024-09-10T21:01:50.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39f800c470 con 0x557b7a0afd80 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50068/0 (socket says 172.21.15.67:50068) 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 -- 172.21.15.67:0/84003028 learned_addr learned my addr 172.21.15.67:0/84003028 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 -- 172.21.15.67:0/84003028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 msgr2=0x557b7a0ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 -- 172.21.15.67:0/84003028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 msgr2=0x557b7a0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.474+0000 7f3a19502640 1 -- 172.21.15.67:0/84003028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b7a0a3c20 con 0x557b7a0a3df0 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.475+0000 7f3a19502640 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a10004000 tx=0x7f3a100052d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8cdd26bfe352a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.475+0000 7f39feffd640 1 -- 172.21.15.67:0/84003028 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10041040 con 0x557b7a0a3df0 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.475+0000 7f39feffd640 1 -- 172.21.15.67:0/84003028 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1004f070 con 0x557b7a0a3df0 2024-09-10T21:01:50.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.475+0000 7f39feffd640 1 -- 172.21.15.67:0/84003028 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a100035f0 con 0x557b7a0a3df0 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- 172.21.15.67:0/84003028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 msgr2=0x557b7a0ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3a10004000 tx=0x7f3a100052d0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- 172.21.15.67:0/84003028 shutdown_connections 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a3df0 0x557b7a0ab270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/84003028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a34d0 0x557b7a0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- 172.21.15.67:0/84003028 >> 172.21.15.67:0/84003028 conn(0x557b7a0a1300 msgr2=0x557b7a0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- 172.21.15.67:0/84003028 shutdown_connections 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- 172.21.15.67:0/84003028 wait complete. 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 -- start start 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.476+0000 7f3a1db3b740 1 Processor -- start 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f39f800cae0 con 0x557b7a0a3df0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f39f800df50 con 0x557b7a0a34d0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39f800d1b0 con 0x557b7a0afd80 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a1db3b740 10 client.0 _ll_register_callbacks cb 0x7f3a10005220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a18d01640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40726/0 (socket says 172.21.15.67:40726) 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 -- 172.21.15.67:0/3132800445 learned_addr learned my addr 172.21.15.67:0/3132800445 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 -- 172.21.15.67:0/3132800445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 msgr2=0x557b7a0a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 -- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 msgr2=0x557b7a0b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:50.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a19502640 1 -- 172.21.15.67:0/3132800445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b7a0a6810 con 0x557b7a0a3df0 2024-09-10T21:01:50.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.477+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.478+0000 7f3a19502640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3a10059040 tx=0x7f3a100056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcb76d6baa1c5f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.478+0000 7f39fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10063070 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3a100035f0 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1004f070 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3a10041040 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f3a1db3b740 10 client.16620 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.480+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557b7a0b7970 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a1004f070 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3a1003a070 con 0x557b7a0a3df0 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 10 client.16620 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 10 client.16620 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 20 client.16620 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a12cae0 0x557b7a12ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 4 client.16620 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b7a0178a0 con 0x557b7a12cae0 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a12cae0 0x557b7a12ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f39fcff9640 10 client.16620 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.481+0000 7f3a18d01640 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a12cae0 0x557b7a12ef00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e17ca058f4175c82 server_cookie=c0fe48f6e8da9134 in_seq=0 out_seq=0 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f39fcff9640 1 -- 172.21.15.67:0/3132800445 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b7a0178a0 con 0x557b7a12cae0 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f39fcff9640 10 client.16620 handle_command_reply: tid=0 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 client.16620 shutdown 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 msgr2=0x557b7a0b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3a10059040 tx=0x7f3a100056f0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 shutdown_connections 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557b7a12cae0 0x557b7a12ef00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b7a0afd80 0x557b7a0a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557b7a0a3df0 0x557b7a0b85d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 --2- 172.21.15.67:0/3132800445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557b7a0a34d0 0x557b7a0b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 >> 172.21.15.67:0/3132800445 conn(0x557b7a0a1300 msgr2=0x557b7a0ab1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.489 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f39fcff9640 0 client.16620 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 shutdown_connections 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 1 -- 172.21.15.67:0/3132800445 wait complete. 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.482+0000 7f3a1db3b740 20 client.16620 trim_cache size 0 max 16384 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 msgr2=0x7f3a000b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 0x7f3a000b78a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0a9300 tx=0x7f3a0c00cf50 comp rx=0 tx=0).stop 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 msgr2=0x7f3a141ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00eaa0 tx=0x7f3a0c00ef60 comp rx=0 tx=0).stop 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 shutdown_connections 2024-09-10T21:01:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a1411c0a0 0x7f3a141ad950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3a000b53e0 0x7f3a000b78a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a1410a530 0x7f3a141a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 --2- 172.21.15.67:0/1175279811 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a1410a150 0x7f3a141a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.483+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 >> 172.21.15.67:0/1175279811 conn(0x7f3a1406dfc0 msgr2=0x7f3a1411c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.484+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 shutdown_connections 2024-09-10T21:01:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:50.484+0000 7f3a1b766640 1 -- 172.21.15.67:0/1175279811 wait complete. 2024-09-10T21:01:51.251 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:01:51.639 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:52.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.256+0000 7f920c810640 1 -- 172.21.15.67:0/500168393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 msgr2=0x7f92081020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.256+0000 7f920c810640 1 --2- 172.21.15.67:0/500168393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f92081020b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009900 tx=0x7f91fc02a410 comp rx=0 tx=0).stop 2024-09-10T21:01:52.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.257+0000 7f920c810640 1 -- 172.21.15.67:0/500168393 shutdown_connections 2024-09-10T21:01:52.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.257+0000 7f920c810640 1 --2- 172.21.15.67:0/500168393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9208108060 0x7f920810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.257+0000 7f920c810640 1 --2- 172.21.15.67:0/500168393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92081076e0 0x7f9208107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.257+0000 7f920c810640 1 --2- 172.21.15.67:0/500168393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f92081020b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.257+0000 7f920c810640 1 -- 172.21.15.67:0/500168393 >> 172.21.15.67:0/500168393 conn(0x7f92080fd740 msgr2=0x7f92080ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.258+0000 7f920c810640 1 -- 172.21.15.67:0/500168393 shutdown_connections 2024-09-10T21:01:52.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.258+0000 7f920c810640 1 -- 172.21.15.67:0/500168393 wait complete. 2024-09-10T21:01:52.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.259+0000 7f920c810640 1 Processor -- start 2024-09-10T21:01:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.259+0000 7f920c810640 1 -- start start 2024-09-10T21:01:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.259+0000 7f920c810640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f9208196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.259+0000 7f920c810640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.259+0000 7f920c810640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9208108060 0x7f920819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35290/0 (socket says 172.21.15.67:35290) 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 -- 172.21.15.67:0/2242524087 learned_addr learned my addr 172.21.15.67:0/2242524087 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9208110c60 con 0x7f9208101cd0 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9208110ae0 con 0x7f9208108060 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9208110de0 con 0x7f92081076e0 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f920659c640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f9208196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 -- 172.21.15.67:0/2242524087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9208108060 msgr2=0x7f920819c7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:01:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9208108060 0x7f920819c7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 -- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 msgr2=0x7f9208196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f9208196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f9205d9b640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920819cfc0 con 0x7f92081076e0 2024-09-10T21:01:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.260+0000 7f920659c640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f9208196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f9205d9b640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91f800e9f0 tx=0x7f91f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f91f77fe640 1 -- 172.21.15.67:0/2242524087 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f800cd80 con 0x7f92081076e0 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f91f77fe640 1 -- 172.21.15.67:0/2242524087 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f80108e0 con 0x7f92081076e0 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f91f77fe640 1 -- 172.21.15.67:0/2242524087 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8018980 con 0x7f92081076e0 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920819d2b0 con 0x7f92081076e0 2024-09-10T21:01:52.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.261+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92081a3970 con 0x7f92081076e0 2024-09-10T21:01:52.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.265+0000 7f920ebe5740 1 Processor -- start 2024-09-10T21:01:52.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.265+0000 7f91f77fe640 1 -- 172.21.15.67:0/2242524087 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f91f8010430 con 0x7f92081076e0 2024-09-10T21:01:52.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 -- start start 2024-09-10T21:01:52.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 0x55e9ef533330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f91f77fe640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 0x7f91f00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef542cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 0x55e9ef54cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef4abea0 con 0x55e9ef532f50 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef49b2d0 con 0x55e9ef542870 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920ebe5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef49f0e0 con 0x55e9ef5431f0 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f920659c640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 0x7f91f00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f9206d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 0x55e9ef54cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f9205d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef542cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f9206d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 0x55e9ef54cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35294/0 (socket says 172.21.15.67:35294) 2024-09-10T21:01:52.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f9206d9d640 1 -- 172.21.15.67:0/3741345983 learned_addr learned my addr 172.21.15.67:0/3741345983 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:52.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.267+0000 7f9206d9d640 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 0x55e9ef533330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 -- 172.21.15.67:0/3741345983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 msgr2=0x55e9ef54cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 0x55e9ef54cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 -- 172.21.15.67:0/3741345983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 msgr2=0x55e9ef533330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 0x55e9ef533330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 -- 172.21.15.67:0/3741345983 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef1f9650 con 0x55e9ef542870 2024-09-10T21:01:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9206d9d640 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 0x55e9ef533330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:01:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f91f77fe640 1 -- 172.21.15.67:0/2242524087 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91f80e5fd0 con 0x7f92081076e0 2024-09-10T21:01:52.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef542cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c6a0 tx=0x7f91f8018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11dc303cd67dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f91f4ff9640 1 -- 172.21.15.67:0/3741345983 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80a6e60 con 0x55e9ef542870 2024-09-10T21:01:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f91f4ff9640 1 -- 172.21.15.67:0/3741345983 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f80ac270 con 0x55e9ef542870 2024-09-10T21:01:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.268+0000 7f91f4ff9640 1 -- 172.21.15.67:0/3741345983 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b5cf0 con 0x55e9ef542870 2024-09-10T21:01:52.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.269+0000 7f920ebe5740 1 -- 172.21.15.67:0/3741345983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 msgr2=0x55e9ef542cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.269+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef542cb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c6a0 tx=0x7f91f8018420 comp rx=0 tx=0).stop 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 -- 172.21.15.67:0/3741345983 shutdown_connections 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef5431f0 0x55e9ef54cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef542cb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3741345983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef532f50 0x55e9ef533330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 -- 172.21.15.67:0/3741345983 >> 172.21.15.67:0/3741345983 conn(0x55e9ef535470 msgr2=0x55e9ef535850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920659c640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 0x7f91f00b7970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02a930 tx=0x7f91fc00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 -- 172.21.15.67:0/3741345983 shutdown_connections 2024-09-10T21:01:52.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.270+0000 7f920ebe5740 1 -- 172.21.15.67:0/3741345983 wait complete. 2024-09-10T21:01:52.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.271+0000 7f920ebe5740 1 -- start start 2024-09-10T21:01:52.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.271+0000 7f920ebe5740 1 Processor -- start 2024-09-10T21:01:52.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef549f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef54a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef2fc700 con 0x55e9ef5431f0 2024-09-10T21:01:52.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef436160 con 0x55e9ef542870 2024-09-10T21:01:52.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef54d270 con 0x55e9ef532f50 2024-09-10T21:01:52.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.272+0000 7f920ebe5740 10 client.0 _ll_register_callbacks cb 0x55e9ef44f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:52.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f9206d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef54a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f9206d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef54a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58956/0 (socket says 172.21.15.67:58956) 2024-09-10T21:01:52.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35304/0 (socket says 172.21.15.67:35304) 2024-09-10T21:01:52.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f9206d9d640 1 -- 172.21.15.67:0/371127652 learned_addr learned my addr 172.21.15.67:0/371127652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:52.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f9205d9b640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef549f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 -- 172.21.15.67:0/371127652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 msgr2=0x55e9ef549f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef549f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 -- 172.21.15.67:0/371127652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 msgr2=0x55e9ef54a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef54a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.273+0000 7f920659c640 1 -- 172.21.15.67:0/371127652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ef463c90 con 0x55e9ef532f50 2024-09-10T21:01:52.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f920659c640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009850 tx=0x7f91fc031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9708d4e2ad801916 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f91edffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:52.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc04b070 con 0x55e9ef532f50 2024-09-10T21:01:52.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91fc0325b0 con 0x55e9ef532f50 2024-09-10T21:01:52.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91f80ac270 con 0x55e9ef532f50 2024-09-10T21:01:52.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91fc057050 con 0x55e9ef532f50 2024-09-10T21:01:52.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f920ebe5740 10 client.26302 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:52.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.274+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e9ef558c40 con 0x55e9ef532f50 2024-09-10T21:01:52.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f80ac270 con 0x55e9ef532f50 2024-09-10T21:01:52.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91fc043070 con 0x55e9ef532f50 2024-09-10T21:01:52.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 10 client.26302 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:52.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 10 client.26302 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:01:52.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 20 client.26302 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:52.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef55a1e0 0x55e9ef55c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 4 client.26302 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:52.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9ef4addf0 con 0x55e9ef55a1e0 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f9205d9b640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef55a1e0 0x55e9ef55c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.275+0000 7f91edffb640 10 client.26302 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.276+0000 7f9205d9b640 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef55a1e0 0x55e9ef55c5d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32e93cd2918c03de server_cookie=3844be0bf11fd07c in_seq=0 out_seq=0 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.277+0000 7f91edffb640 1 -- 172.21.15.67:0/371127652 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9ef4addf0 con 0x55e9ef55a1e0 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.277+0000 7f91edffb640 10 client.26302 handle_command_reply: tid=0 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 client.26302 shutdown 2024-09-10T21:01:52.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 msgr2=0x55e9ef54cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009850 tx=0x7f91fc031400 comp rx=0 tx=0).stop 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 shutdown_connections 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef55a1e0 0x55e9ef55c5d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef54a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef549f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 --2- 172.21.15.67:0/371127652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef54cae0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 >> 172.21.15.67:0/371127652 conn(0x55e9ef535470 msgr2=0x55e9ef544130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f91edffb640 0 client.26302 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:52.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 shutdown_connections 2024-09-10T21:01:52.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 1 -- 172.21.15.67:0/371127652 wait complete. 2024-09-10T21:01:52.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.278+0000 7f920ebe5740 20 client.26302 trim_cache size 0 max 16384 2024-09-10T21:01:52.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.300+0000 7f920ebe5740 1 Processor -- start 2024-09-10T21:01:52.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 -- start start 2024-09-10T21:01:52.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef556460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92081aeaa0 con 0x55e9ef5431f0 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92081ac370 con 0x55e9ef542870 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920ebe5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92081aa1c0 con 0x55e9ef532f50 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef556460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f9205d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f9205d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50464/0 (socket says 172.21.15.67:50464) 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef556460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35310/0 (socket says 172.21.15.67:35310) 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.301+0000 7f9205d9b640 1 -- 172.21.15.67:0/664304421 learned_addr learned my addr 172.21.15.67:0/664304421 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 -- 172.21.15.67:0/664304421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 msgr2=0x55e9ef556460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef556460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 -- 172.21.15.67:0/664304421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 msgr2=0x55e9ef544810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 -- 172.21.15.67:0/664304421 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef52ebb0 con 0x55e9ef542870 2024-09-10T21:01:52.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f9205d9b640 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91f80a8d30 tx=0x7f91f800e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1e5f7c7fa51281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f91effff640 1 -- 172.21.15.67:0/664304421 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80a6e60 con 0x55e9ef542870 2024-09-10T21:01:52.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f91effff640 1 -- 172.21.15.67:0/664304421 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f80ac270 con 0x55e9ef542870 2024-09-10T21:01:52.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.302+0000 7f91effff640 1 -- 172.21.15.67:0/664304421 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80a4620 con 0x55e9ef542870 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 -- 172.21.15.67:0/664304421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 msgr2=0x55e9ef5479b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f91f80a8d30 tx=0x7f91f800e940 comp rx=0 tx=0).stop 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 -- 172.21.15.67:0/664304421 shutdown_connections 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef5479b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 --2- 172.21.15.67:0/664304421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef556460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 -- 172.21.15.67:0/664304421 >> 172.21.15.67:0/664304421 conn(0x55e9ef535470 msgr2=0x55e9ef5347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.303+0000 7f920ebe5740 1 -- 172.21.15.67:0/664304421 shutdown_connections 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.304+0000 7f920ebe5740 1 -- 172.21.15.67:0/664304421 wait complete. 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.305+0000 7f920ebe5740 1 -- start start 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.305+0000 7f920ebe5740 1 Processor -- start 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.305+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef5524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.305+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef552a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.305+0000 7f920ebe5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920ebe5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f92081aa830 con 0x55e9ef5431f0 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920ebe5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92081abca0 con 0x55e9ef542870 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920ebe5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92081aaf00 con 0x55e9ef532f50 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920ebe5740 10 client.0 _ll_register_callbacks cb 0x7f91f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef5524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef5524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35314/0 (socket says 172.21.15.67:35314) 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f920659c640 1 -- 172.21.15.67:0/3192911946 learned_addr learned my addr 172.21.15.67:0/3192911946 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef552a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9206d9d640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 -- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 msgr2=0x55e9ef5524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef5524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 -- 172.21.15.67:0/3192911946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 msgr2=0x55e9ef544690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.306+0000 7f9205d9b640 1 -- 172.21.15.67:0/3192911946 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ef553040 con 0x55e9ef542870 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f9205d9b640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef552a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91f80a99d0 tx=0x7f91f80a45f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ed375a51e70cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f91edffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80a6e60 con 0x55e9ef542870 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91f80abbd0 con 0x55e9ef542870 2024-09-10T21:01:52.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91f80ac270 con 0x55e9ef542870 2024-09-10T21:01:52.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f91f80b5cf0 con 0x55e9ef542870 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f920ebe5740 10 client.26363 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.307+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e9ef5c73a0 con 0x55e9ef542870 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.308+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91f80a89d0 con 0x55e9ef542870 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f91f80ada90 con 0x55e9ef542870 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 10 client.26363 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 10 client.26363 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 20 client.26363 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef5c7620 0x55e9ef5c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 4 client.26363 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:52.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.309+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f91f80ac270 con 0x55e9ef5c7620 2024-09-10T21:01:52.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.317+0000 7f920659c640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef5c7620 0x55e9ef5c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.325+0000 7f91edffb640 10 client.26363 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:52.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.325+0000 7f920659c640 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef5c7620 0x55e9ef5c9a10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2ca6b61037915bf server_cookie=7c521d21f4a8653 in_seq=0 out_seq=0 2024-09-10T21:01:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.325+0000 7f91edffb640 1 -- 172.21.15.67:0/3192911946 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f91f80ac270 con 0x55e9ef5c7620 2024-09-10T21:01:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.325+0000 7f91edffb640 10 client.26363 handle_command_reply: tid=0 2024-09-10T21:01:52.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.325+0000 7f920ebe5740 1 client.26363 shutdown 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.332+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 msgr2=0x55e9ef552a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.332+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef552a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91f80a99d0 tx=0x7f91f80a45f0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 shutdown_connections 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55e9ef5c7620 0x55e9ef5c9a10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f91edffb640 0 client.26363 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:01:52.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e9ef5431f0 0x55e9ef544690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.339 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:52 smithi067 ceph-mon[30891]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 596 op/s 2024-09-10T21:01:52.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e9ef542870 0x55e9ef552a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 --2- 172.21.15.67:0/3192911946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e9ef532f50 0x55e9ef5524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 >> 172.21.15.67:0/3192911946 conn(0x55e9ef535470 msgr2=0x55e9ef54b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 shutdown_connections 2024-09-10T21:01:52.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 1 -- 172.21.15.67:0/3192911946 wait complete. 2024-09-10T21:01:52.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.334+0000 7f920ebe5740 20 client.26363 trim_cache size 0 max 16384 2024-09-10T21:01:52.341 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:52.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 msgr2=0x7f91f00b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 0x7f91f00b7970 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f91fc02a930 tx=0x7f91fc00b040 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 msgr2=0x7f9208197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91f800e9f0 tx=0x7f91f800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 shutdown_connections 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9208108060 0x7f920819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f91f00b54b0 0x7f91f00b7970 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92081076e0 0x7f9208197450 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 --2- 172.21.15.67:0/2242524087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9208101cd0 0x7f9208196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 >> 172.21.15.67:0/2242524087 conn(0x7f92080fd740 msgr2=0x7f9208100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 shutdown_connections 2024-09-10T21:01:52.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:52.341+0000 7f920c810640 1 -- 172.21.15.67:0/2242524087 wait complete. 2024-09-10T21:01:52.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:52 smithi083 ceph-mon[35058]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 596 op/s 2024-09-10T21:01:52.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:52 smithi172 ceph-mon[35265]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 596 op/s 2024-09-10T21:01:53.103 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:01:53.480 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 620.0 s, 2492.6 tps, lat 39.932 ms stddev 46.586 2024-09-10T21:01:54.136 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 -- 172.21.15.67:0/1563691801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37411c0a0 msgr2=0x7ff37411e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 --2- 172.21.15.67:0/1563691801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37411c0a0 0x7ff37411e490 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009ca0 tx=0x7ff36c02a960 comp rx=0 tx=0).stop 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 -- 172.21.15.67:0/1563691801 shutdown_connections 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 --2- 172.21.15.67:0/1563691801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37411c0a0 0x7ff37411e490 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 --2- 172.21.15.67:0/1563691801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37410a530 0x7ff37410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 --2- 172.21.15.67:0/1563691801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.063+0000 7ff37b759640 1 -- 172.21.15.67:0/1563691801 >> 172.21.15.67:0/1563691801 conn(0x7ff37406dfc0 msgr2=0x7ff37406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.064+0000 7ff37b759640 1 -- 172.21.15.67:0/1563691801 shutdown_connections 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.064+0000 7ff37b759640 1 -- 172.21.15.67:0/1563691801 wait complete. 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.065+0000 7ff37b759640 1 Processor -- start 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.065+0000 7ff37b759640 1 -- start start 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37410a530 0x7ff3741a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37411c0a0 0x7ff3741ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff374121bc0 con 0x7ff37410a150 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff374121a40 con 0x7ff37411c0a0 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff37b759640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff374121d40 con 0x7ff37410a530 2024-09-10T21:01:54.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff3794f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff3794f5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58990/0 (socket says 172.21.15.67:58990) 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff3794f5640 1 -- 172.21.15.67:0/1234169272 learned_addr learned my addr 172.21.15.67:0/1234169272 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.066+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37411c0a0 0x7ff3741ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 -- 172.21.15.67:0/1234169272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37410a530 msgr2=0x7ff3741a8610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37410a530 0x7ff3741a8610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 -- 172.21.15.67:0/1234169272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37411c0a0 msgr2=0x7ff3741ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37411c0a0 0x7ff3741ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 -- 172.21.15.67:0/1234169272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3741ae180 con 0x7ff37410a150 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff3794f5640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff37000b450 tx=0x7ff37000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.067+0000 7ff36a7fc640 1 -- 172.21.15.67:0/1234169272 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370015020 con 0x7ff37410a150 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.068+0000 7ff36a7fc640 1 -- 172.21.15.67:0/1234169272 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff370011d40 con 0x7ff37410a150 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.068+0000 7ff36a7fc640 1 -- 172.21.15.67:0/1234169272 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37000f340 con 0x7ff37410a150 2024-09-10T21:01:54.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.069+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3741ae470 con 0x7ff37410a150 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.069+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3741b4b30 con 0x7ff37410a150 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.074+0000 7ff37db2e740 1 Processor -- start 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 -- start start 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b0278a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b02780cea0 con 0x55b0278a2d80 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b0277fc2d0 con 0x55b0278964d0 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff37db2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0278000e0 con 0x55b027896df0 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff378cf4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50510/0 (socket says 172.21.15.67:50510) 2024-09-10T21:01:54.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff379cf6640 1 -- 172.21.15.67:0/3490116948 learned_addr learned my addr 172.21.15.67:0/3490116948 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.076+0000 7ff378cf4640 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59004/0 (socket says 172.21.15.67:59004) 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 -- 172.21.15.67:0/3490116948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 msgr2=0x55b0278a2840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b0278a2840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 -- 172.21.15.67:0/3490116948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 msgr2=0x55b0278a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 -- 172.21.15.67:0/3490116948 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02755a650 con 0x55b0278964d0 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff378cf4640 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.077+0000 7ff379cf6640 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02f4f0 tx=0x7ff36c02f520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=391a8ece18c16f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.079+0000 7ff36a7fc640 1 -- 172.21.15.67:0/1234169272 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff370011890 con 0x7ff37410a150 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.079+0000 7ff35f7fe640 1 -- 172.21.15.67:0/3490116948 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c047070 con 0x55b0278964d0 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.079+0000 7ff35f7fe640 1 -- 172.21.15.67:0/3490116948 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff36c02f700 con 0x55b0278964d0 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.080+0000 7ff35f7fe640 1 -- 172.21.15.67:0/3490116948 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c034050 con 0x55b0278964d0 2024-09-10T21:01:54.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.080+0000 7ff36a7fc640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 0x7ff3600b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff36a7fc640 1 -- 172.21.15.67:0/1234169272 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff3700e5830 con 0x7ff37410a150 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff3794f5640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 0x7ff3600b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- 172.21.15.67:0/3490116948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 msgr2=0x55b0278968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02f4f0 tx=0x7ff36c02f520 comp rx=0 tx=0).stop 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- 172.21.15.67:0/3490116948 shutdown_connections 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b0278a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 --2- 172.21.15.67:0/3490116948 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278968b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- 172.21.15.67:0/3490116948 >> 172.21.15.67:0/3490116948 conn(0x55b027894300 msgr2=0x55b0278954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- 172.21.15.67:0/3490116948 shutdown_connections 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff3794f5640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 0x7ff3600b7930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff37000be10 tx=0x7ff3700cf040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- 172.21.15.67:0/3490116948 wait complete. 2024-09-10T21:01:54.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.081+0000 7ff37db2e740 1 -- start start 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 Processor -- start 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b02789faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50524/0 (socket says 172.21.15.67:50524) 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff379cf6640 1 -- 172.21.15.67:0/1460777404 learned_addr learned my addr 172.21.15.67:0/1460777404 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b02765d700 con 0x55b0278a2d80 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b027797160 con 0x55b0278964d0 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.082+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0278a59a0 con 0x55b027896df0 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff37db2e740 10 client.0 _ll_register_callbacks cb 0x55b0277b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:54.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b02789faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 -- 172.21.15.67:0/1460777404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 msgr2=0x55b02789faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b02789faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 -- 172.21.15.67:0/1460777404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 msgr2=0x55b0278a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0277c4c90 con 0x55b0278964d0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02fd40 tx=0x7ff36c02fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1172b6a03e9d3f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.083+0000 7ff35cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c047030 con 0x55b0278964d0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b02780edf0 con 0x55b0278964d0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff36c03f070 con 0x55b0278964d0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff36c059050 con 0x55b0278964d0 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff37db2e740 10 client.26372 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:54.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.084+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b0278b12d0 con 0x55b0278964d0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff36c003e20 con 0x55b0278964d0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff36c004570 con 0x55b0278964d0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 10 client.26372 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 10 client.26372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 20 client.26372 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b0278b27d0 0x55b0278b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 4 client.26372 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.085+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b02780edf0 con 0x55b0278b27d0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.086+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b0278b27d0 0x55b0278b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.086+0000 7ff35cff9640 10 client.26372 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.087+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b0278b27d0 0x55b0278b4be0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae823d3196f8c500 server_cookie=6495260be596913d in_seq=0 out_seq=0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.087+0000 7ff35cff9640 1 -- 172.21.15.67:0/1460777404 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b02780edf0 con 0x55b0278b27d0 2024-09-10T21:01:54.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.087+0000 7ff35cff9640 10 client.26372 handle_command_reply: tid=0 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.087+0000 7ff37db2e740 1 client.26372 shutdown 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 msgr2=0x55b0278a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff36c02fd40 tx=0x7ff36c02fda0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 shutdown_connections 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b0278b27d0 0x55b0278b4be0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b027896df0 0x55b02789faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1460777404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b0278964d0 0x55b0278a2650 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 >> 172.21.15.67:0/1460777404 conn(0x55b027894300 msgr2=0x55b027899e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff35cff9640 0 client.26372 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 shutdown_connections 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.088+0000 7ff37db2e740 1 -- 172.21.15.67:0/1460777404 wait complete. 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.089+0000 7ff37db2e740 20 client.26372 trim_cache size 0 max 16384 2024-09-10T21:01:54.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.108+0000 7ff37db2e740 1 Processor -- start 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.108+0000 7ff37db2e740 1 -- start start 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b027893c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b027895900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bfba0 con 0x55b0278a2d80 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bd470 con 0x55b027896df0 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff37db2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bb2c0 con 0x55b0278964d0 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b027895900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b027895900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59024/0 (socket says 172.21.15.67:59024) 2024-09-10T21:01:54.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff378cf4640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 -- 172.21.15.67:0/35779313 learned_addr learned my addr 172.21.15.67:0/35779313 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b027893c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 -- 172.21.15.67:0/35779313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 msgr2=0x55b0278953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.109+0000 7ff379cf6640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff379cf6640 1 -- 172.21.15.67:0/35779313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 msgr2=0x55b027895900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff379cf6640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b027895900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff379cf6640 1 -- 172.21.15.67:0/35779313 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b027896c20 con 0x55b0278964d0 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff378cf4640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:54.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff379cf6640 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b027893c10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0398c0 tx=0x7ff36c000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3a940c6cb29757 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff35effd640 1 -- 172.21.15.67:0/35779313 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c047030 con 0x55b0278964d0 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff35effd640 1 -- 172.21.15.67:0/35779313 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff36c02f440 con 0x55b0278964d0 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.110+0000 7ff35effd640 1 -- 172.21.15.67:0/35779313 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c034040 con 0x55b0278964d0 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.111+0000 7ff37db2e740 1 -- 172.21.15.67:0/35779313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 msgr2=0x55b027893c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.111+0000 7ff37db2e740 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b027893c10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0398c0 tx=0x7ff36c000f40 comp rx=0 tx=0).stop 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 -- 172.21.15.67:0/35779313 shutdown_connections 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b027895900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 --2- 172.21.15.67:0/35779313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b027893c10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 -- 172.21.15.67:0/35779313 >> 172.21.15.67:0/35779313 conn(0x55b027894300 msgr2=0x55b02789acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 -- 172.21.15.67:0/35779313 shutdown_connections 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 -- 172.21.15.67:0/35779313 wait complete. 2024-09-10T21:01:54.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.112+0000 7ff37db2e740 1 -- start start 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 Processor -- start 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b0278ab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bb930 con 0x55b0278a2d80 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bcda0 con 0x55b027896df0 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3741bc000 con 0x55b0278964d0 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff37db2e740 10 client.0 _ll_register_callbacks cb 0x7ff36c045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:54.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.113+0000 7ff379cf6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59032/0 (socket says 172.21.15.67:59032) 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff379cf6640 1 -- 172.21.15.67:0/1342395105 learned_addr learned my addr 172.21.15.67:0/1342395105 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278a6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b0278ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 -- 172.21.15.67:0/1342395105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 msgr2=0x55b0278ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b0278ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 -- 172.21.15.67:0/1342395105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 msgr2=0x55b0278a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 -- 172.21.15.67:0/1342395105 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02791e6f0 con 0x55b027896df0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff378cf4640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278a6ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55b0278b5430 tx=0x7ff364013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea6644a016e5043 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.114+0000 7ff35cff9640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.115+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364004220 con 0x55b027896df0 2024-09-10T21:01:54.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.115+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff3640043c0 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36c02f440 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff3640035f0 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff37db2e740 10 client.26378 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b02791f940 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff364003c40 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff36402c860 con 0x55b027896df0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff37db2e740 10 client.26378 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.116+0000 7ff37db2e740 10 client.26378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff37db2e740 20 client.26378 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b02791fff0 0x55b027922410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff37db2e740 4 client.26378 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff36c02f440 con 0x55b02791fff0 2024-09-10T21:01:54.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b02791fff0 0x55b027922410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff379cf6640 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b02791fff0 0x55b027922410 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9b6462874bcad2 server_cookie=2835a29e91b8c9dc in_seq=0 out_seq=0 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff35cff9640 10 client.26378 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff35cff9640 1 -- 172.21.15.67:0/1342395105 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff36c02f440 con 0x55b02791fff0 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff35cff9640 10 client.26378 handle_command_reply: tid=0 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.117+0000 7ff37db2e740 1 client.26378 shutdown 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 msgr2=0x55b0278a6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278a6ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55b0278b5430 tx=0x7ff364013830 comp rx=0 tx=0).stop 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 shutdown_connections 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b02791fff0 0x55b027922410 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b0278a2d80 0x55b0278a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff35cff9640 0 client.26378 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b027896df0 0x55b0278a6ba0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 --2- 172.21.15.67:0/1342395105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0278964d0 0x55b0278ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 >> 172.21.15.67:0/1342395105 conn(0x55b027894300 msgr2=0x55b0278953c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 shutdown_connections 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 1 -- 172.21.15.67:0/1342395105 wait complete. 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37db2e740 20 client.26378 trim_cache size 0 max 16384 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 msgr2=0x7ff3600b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 0x7ff3600b7930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff37000be10 tx=0x7ff3700cf040 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 msgr2=0x7ff3741a80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.118+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff37000b450 tx=0x7ff37000b910 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 shutdown_connections 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff37411c0a0 0x7ff3741ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3600b5470 0x7ff3600b7930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff37410a530 0x7ff3741a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 --2- 172.21.15.67:0/1234169272 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff37410a150 0x7ff3741a80d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 >> 172.21.15.67:0/1234169272 conn(0x7ff37406dfc0 msgr2=0x7ff37411c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:54.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 shutdown_connections 2024-09-10T21:01:54.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:54.119+0000 7ff37b759640 1 -- 172.21.15.67:0/1234169272 wait complete. 2024-09-10T21:01:54.297 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:54 smithi067 ceph-mon[30891]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-09-10T21:01:54.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:54 smithi083 ceph-mon[35058]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-09-10T21:01:54.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:54 smithi172 ceph-mon[35265]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-09-10T21:01:55.862 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:01:55.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:01:56.296 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:56 smithi067 ceph-mon[30891]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 674 op/s 2024-09-10T21:01:56.299 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:56.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:56 smithi083 ceph-mon[35058]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 674 op/s 2024-09-10T21:01:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:56 smithi172 ceph-mon[35265]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 674 op/s 2024-09-10T21:01:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.952+0000 7ff97624b640 1 -- 172.21.15.67:0/1020780341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 msgr2=0x7ff970116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:56.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.952+0000 7ff97624b640 1 --2- 172.21.15.67:0/1020780341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 0x7ff970116750 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff968009ca0 tx=0x7ff96802a8f0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.954+0000 7ff97624b640 1 -- 172.21.15.67:0/1020780341 shutdown_connections 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.954+0000 7ff97624b640 1 --2- 172.21.15.67:0/1020780341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 0x7ff970116750 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.954+0000 7ff97624b640 1 --2- 172.21.15.67:0/1020780341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97010ad20 0x7ff97010f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.954+0000 7ff97624b640 1 --2- 172.21.15.67:0/1020780341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97006aa40 0x7ff97010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.954+0000 7ff97624b640 1 -- 172.21.15.67:0/1020780341 >> 172.21.15.67:0/1020780341 conn(0x7ff97006e2e0 msgr2=0x7ff97006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:56.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.955+0000 7ff97624b640 1 -- 172.21.15.67:0/1020780341 shutdown_connections 2024-09-10T21:01:56.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.959+0000 7ff97624b640 1 -- 172.21.15.67:0/1020780341 wait complete. 2024-09-10T21:01:56.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.959+0000 7ff97624b640 1 Processor -- start 2024-09-10T21:01:56.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.959+0000 7ff97624b640 1 -- start start 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97010ad20 0x7ff9701a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 0x7ff9701ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701193e0 con 0x7ff970114360 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff970119260 con 0x7ff97010ad20 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.960+0000 7ff97624b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff970119560 con 0x7ff97006aa40 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.963+0000 7ff96f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.963+0000 7ff96f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35376/0 (socket says 172.21.15.67:35376) 2024-09-10T21:01:56.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.963+0000 7ff96f7fe640 1 -- 172.21.15.67:0/300652745 learned_addr learned my addr 172.21.15.67:0/300652745 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.964+0000 7ff96f7fe640 1 -- 172.21.15.67:0/300652745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97010ad20 msgr2=0x7ff9701a8590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:01:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.964+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97010ad20 0x7ff9701a8590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.964+0000 7ff96f7fe640 1 -- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 msgr2=0x7ff9701ad930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:01:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.964+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 0x7ff9701ad930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.964+0000 7ff96f7fe640 1 -- 172.21.15.67:0/300652745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9701ae100 con 0x7ff97006aa40 2024-09-10T21:01:56.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.972+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c890 tx=0x7ff95800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.976+0000 7ff96d7fa640 1 -- 172.21.15.67:0/300652745 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958004220 con 0x7ff97006aa40 2024-09-10T21:01:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.976+0000 7ff96d7fa640 1 -- 172.21.15.67:0/300652745 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9580043c0 con 0x7ff97006aa40 2024-09-10T21:01:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.976+0000 7ff96d7fa640 1 -- 172.21.15.67:0/300652745 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958004a00 con 0x7ff97006aa40 2024-09-10T21:01:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.976+0000 7ff97624b640 1 -- 172.21.15.67:0/300652745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9701ae3f0 con 0x7ff97006aa40 2024-09-10T21:01:56.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.977+0000 7ff97624b640 1 -- 172.21.15.67:0/300652745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9701b4ab0 con 0x7ff97006aa40 2024-09-10T21:01:56.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.981+0000 7ff978620740 1 Processor -- start 2024-09-10T21:01:56.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.981+0000 7ff978620740 1 -- start start 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e49f0 0x560f232f0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560f2325ae60 con 0x560f232e40d0 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560f2324a290 con 0x560f232e49f0 2024-09-10T21:01:56.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff978620740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560f2324e0a0 con 0x560f232f0980 2024-09-10T21:01:56.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35386/0 (socket says 172.21.15.67:35386) 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.982+0000 7ff966ffd640 1 -- 172.21.15.67:0/2770157413 learned_addr learned my addr 172.21.15.67:0/2770157413 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 -- 172.21.15.67:0/2770157413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e49f0 msgr2=0x560f232f0440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e49f0 0x560f232f0440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 -- 172.21.15.67:0/2770157413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 msgr2=0x560f232e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 -- 172.21.15.67:0/2770157413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f22fa8930 con 0x560f232f0980 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff96000a950 tx=0x7ff96000ae10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de2e4919e8ee3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:56.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.983+0000 7ff97624b640 1 -- 172.21.15.67:0/2770157413 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96000cd80 con 0x560f232f0980 2024-09-10T21:01:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.984+0000 7ff97624b640 1 -- 172.21.15.67:0/2770157413 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff96000f900 con 0x560f232f0980 2024-09-10T21:01:56.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.984+0000 7ff97624b640 1 -- 172.21.15.67:0/2770157413 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960018870 con 0x560f232f0980 2024-09-10T21:01:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.985+0000 7ff978620740 1 -- 172.21.15.67:0/2770157413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 msgr2=0x560f232f2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.985+0000 7ff978620740 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff96000a950 tx=0x7ff96000ae10 comp rx=0 tx=0).stop 2024-09-10T21:01:56.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.986+0000 7ff96d7fa640 1 -- 172.21.15.67:0/300652745 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff9580079b0 con 0x7ff97006aa40 2024-09-10T21:01:56.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.987+0000 7ff978620740 1 -- 172.21.15.67:0/2770157413 shutdown_connections 2024-09-10T21:01:56.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.987+0000 7ff978620740 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232f2d70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.987+0000 7ff978620740 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e49f0 0x560f232f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.987+0000 7ff978620740 1 --2- 172.21.15.67:0/2770157413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.987+0000 7ff978620740 1 -- 172.21.15.67:0/2770157413 >> 172.21.15.67:0/2770157413 conn(0x560f232e1f00 msgr2=0x560f232e30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.988+0000 7ff978620740 1 -- 172.21.15.67:0/2770157413 shutdown_connections 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.988+0000 7ff978620740 1 -- 172.21.15.67:0/2770157413 wait complete. 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.988+0000 7ff978620740 1 -- start start 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.988+0000 7ff978620740 1 Processor -- start 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e49f0 0x560f232edf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560f230ab890 con 0x560f232e40d0 2024-09-10T21:01:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560f231e4d40 con 0x560f232f0980 2024-09-10T21:01:56.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560f232f34f0 con 0x560f232e49f0 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.989+0000 7ff978620740 10 client.0 _ll_register_callbacks cb 0x560f23248c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.990+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.992+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.992+0000 7ff96ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59044/0 (socket says 172.21.15.67:59044) 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.992+0000 7ff96ffff640 1 -- 172.21.15.67:0/2773662974 learned_addr learned my addr 172.21.15.67:0/2773662974 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:56.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.993+0000 7ff96d7fa640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 0x7ff95c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.994+0000 7ff96d7fa640 1 -- 172.21.15.67:0/300652745 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff9580e58b0 con 0x7ff97006aa40 2024-09-10T21:01:56.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.994+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e49f0 0x560f232edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff96ffff640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 0x7ff95c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 -- 172.21.15.67:0/2773662974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e49f0 msgr2=0x560f232edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e49f0 0x560f232edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 -- 172.21.15.67:0/2773662974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 msgr2=0x560f232ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:56.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 -- 172.21.15.67:0/2773662974 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f232fc910 con 0x560f232f0980 2024-09-10T21:01:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.995+0000 7ff966ffd640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232ee450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff96000a2a0 tx=0x7ff96000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9678b18ac1bfd912 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.996+0000 7ff94effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.996+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960028060 con 0x560f232f0980 2024-09-10T21:01:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.996+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff96000f900 con 0x560f232f0980 2024-09-10T21:01:57.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.996+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff960005040 con 0x560f232f0980 2024-09-10T21:01:57.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.998+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff960005240 con 0x560f232f0980 2024-09-10T21:01:57.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.998+0000 7ff978620740 10 client.26381 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:57.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.998+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560f232ff2c0 con 0x560f232f0980 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff96000f900 con 0x560f232f0980 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff960020070 con 0x560f232f0980 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff96ffff640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 0x7ff95c0b78e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff96802aee0 tx=0x7ff96802a8f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 10 client.26381 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 10 client.26381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 20 client.26381 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:57.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f23300720 0x560f23302b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 4 client.26381 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:57.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:56.999+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f2325cdb0 con 0x560f23300720 2024-09-10T21:01:57.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.000+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f23300720 0x560f23302b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.002+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f23300720 0x560f23302b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0219bd8dc7a7db5 server_cookie=cd20701f64c3ea81 in_seq=0 out_seq=0 2024-09-10T21:01:57.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.002+0000 7ff94effd640 10 client.26381 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.003+0000 7ff94effd640 1 -- 172.21.15.67:0/2773662974 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f2325cdb0 con 0x560f23300720 2024-09-10T21:01:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.003+0000 7ff94effd640 10 client.26381 handle_command_reply: tid=0 2024-09-10T21:01:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.003+0000 7ff978620740 1 client.26381 shutdown 2024-09-10T21:01:57.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.003+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 msgr2=0x560f232ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:57.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.003+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232ee450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff96000a2a0 tx=0x7ff96000ce20 comp rx=0 tx=0).stop 2024-09-10T21:01:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 shutdown_connections 2024-09-10T21:01:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f23300720 0x560f23302b10 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232ee450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e49f0 0x560f232edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 --2- 172.21.15.67:0/2773662974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e40d0 0x560f232ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 >> 172.21.15.67:0/2773662974 conn(0x560f232e1f00 msgr2=0x560f232e7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.006+0000 7ff94effd640 0 client.26381 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.007+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 shutdown_connections 2024-09-10T21:01:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.007+0000 7ff978620740 1 -- 172.21.15.67:0/2773662974 wait complete. 2024-09-10T21:01:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.007+0000 7ff978620740 20 client.26381 trim_cache size 0 max 16384 2024-09-10T21:01:57.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 Processor -- start 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 -- start start 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 0x560f232e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bfb60 con 0x560f232e49f0 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bd430 con 0x560f232e40d0 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff978620740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bb280 con 0x560f232f0980 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff966ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59050/0 (socket says 172.21.15.67:59050) 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff966ffd640 1 -- 172.21.15.67:0/1328204530 learned_addr learned my addr 172.21.15.67:0/1328204530 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.040+0000 7ff96ffff640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 0x560f232e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 -- 172.21.15.67:0/1328204530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 msgr2=0x560f232ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 -- 172.21.15.67:0/1328204530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 msgr2=0x560f232e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 0x560f232e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 -- 172.21.15.67:0/1328204530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f232e8eb0 con 0x560f232e49f0 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 0x560f232e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff966ffd640 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff960018670 tx=0x7ff96000ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c7860125410058 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff9657fa640 1 -- 172.21.15.67:0/1328204530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960028040 con 0x560f232e49f0 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff9657fa640 1 -- 172.21.15.67:0/1328204530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff960018400 con 0x560f232e49f0 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.041+0000 7ff9657fa640 1 -- 172.21.15.67:0/1328204530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960005640 con 0x560f232e49f0 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 -- 172.21.15.67:0/1328204530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 msgr2=0x560f232eb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff960018670 tx=0x7ff96000ae10 comp rx=0 tx=0).stop 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 -- 172.21.15.67:0/1328204530 shutdown_connections 2024-09-10T21:01:57.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232f0980 0x560f232ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232eb460 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 --2- 172.21.15.67:0/1328204530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232e40d0 0x560f232e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.042+0000 7ff978620740 1 -- 172.21.15.67:0/1328204530 >> 172.21.15.67:0/1328204530 conn(0x560f232e1f00 msgr2=0x560f232ef000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.043+0000 7ff978620740 1 -- 172.21.15.67:0/1328204530 shutdown_connections 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.043+0000 7ff978620740 1 -- 172.21.15.67:0/1328204530 wait complete. 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.043+0000 7ff978620740 1 -- start start 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.044+0000 7ff978620740 1 Processor -- start 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.044+0000 7ff978620740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff978620740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff978620740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff96f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff96f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35406/0 (socket says 172.21.15.67:35406) 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff96f7fe640 1 -- 172.21.15.67:0/3215798445 learned_addr learned my addr 172.21.15.67:0/3215798445 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff966ffd640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff978620740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bb8f0 con 0x560f232e49f0 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bcd60 con 0x560f232f0980 2024-09-10T21:01:57.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.045+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9701bbfc0 con 0x560f232e40d0 2024-09-10T21:01:57.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 -- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 msgr2=0x560f232f53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232f53b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 -- 172.21.15.67:0/3215798445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 msgr2=0x560f232f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2336c660 con 0x560f232e40d0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff978620740 10 client.0 _ll_register_callbacks cb 0x7ff96000a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff960018400 con 0x560f232e40d0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.046+0000 7ff96f7fe640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9580a8610 tx=0x7ff958005390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb4755cf8394780 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff94effd640 10 client.26335 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff94effd640 1 -- 172.21.15.67:0/3215798445 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95801d040 con 0x560f232e40d0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff94effd640 1 -- 172.21.15.67:0/3215798445 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff9580c1bc0 con 0x560f232e40d0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff94effd640 1 -- 172.21.15.67:0/3215798445 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff9580c1de0 con 0x560f232e40d0 2024-09-10T21:01:57.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff978620740 10 client.26335 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:57.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.047+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=34}) -- 0x560f2336d8e0 con 0x560f232e40d0 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.049+0000 7ff94effd640 1 -- 172.21.15.67:0/3215798445 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff958097100 con 0x560f232e40d0 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 10 client.26335 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 10 client.26335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 20 client.26335 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f2336de80 0x560f233702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:57.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 4 client.26335 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:01:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f23258860 con 0x560f2336de80 2024-09-10T21:01:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff966ffd640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f2336de80 0x560f233702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.050+0000 7ff966ffd640 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f2336de80 0x560f233702c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99aa19c3765ce62d server_cookie=60edc269af37daaa in_seq=0 out_seq=0 2024-09-10T21:01:57.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.051+0000 7ff94effd640 10 client.26335 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.052+0000 7ff94effd640 1 -- 172.21.15.67:0/3215798445 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f23258860 con 0x560f2336de80 2024-09-10T21:01:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.052+0000 7ff94effd640 10 client.26335 handle_command_reply: tid=0 2024-09-10T21:01:57.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.052+0000 7ff978620740 1 client.26335 shutdown 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 msgr2=0x560f232f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9580a8610 tx=0x7ff958005390 comp rx=0 tx=0).stop 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 shutdown_connections 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560f2336de80 0x560f233702c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560f232f0980 0x560f232f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560f232e49f0 0x560f232f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 --2- 172.21.15.67:0/3215798445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f232e40d0 0x560f232f4930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 >> 172.21.15.67:0/3215798445 conn(0x560f232e1f00 msgr2=0x560f232ef000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.053+0000 7ff94effd640 0 client.26335 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.054+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 shutdown_connections 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.054+0000 7ff978620740 1 -- 172.21.15.67:0/3215798445 wait complete. 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.054+0000 7ff978620740 20 client.26335 trim_cache size 0 max 16384 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c", 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:01:57.059 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 msgr2=0x7ff95c0b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:57.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 0x7ff95c0b78e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff96802aee0 tx=0x7ff96802a8f0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 msgr2=0x7ff9701a8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c890 tx=0x7ff95800cd50 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 shutdown_connections 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970114360 0x7ff9701ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97010ad20 0x7ff9701a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff95c0b5420 0x7ff95c0b78e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 --2- 172.21.15.67:0/300652745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff97006aa40 0x7ff9701a8050 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.055+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 >> 172.21.15.67:0/300652745 conn(0x7ff97006e2e0 msgr2=0x7ff97010b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.056+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 shutdown_connections 2024-09-10T21:01:57.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:57.056+0000 7ff9667fc640 1 -- 172.21.15.67:0/300652745 wait complete. 2024-09-10T21:01:57.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:01:58.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 666 op/s 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:01:58.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.312 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:01:58.441 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 666 op/s 2024-09-10T21:01:58.441 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:01:58.441 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:58.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:58.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:01:58.442 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 666 op/s 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:01:58.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 -- 172.21.15.67:0/2280746476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 msgr2=0x7f686c117e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 --2- 172.21.15.67:0/2280746476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c117e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6864009ca0 tx=0x7f686402a960 comp rx=0 tx=0).stop 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 -- 172.21.15.67:0/2280746476 shutdown_connections 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 --2- 172.21.15.67:0/2280746476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c117e00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 --2- 172.21.15.67:0/2280746476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 0x7f686c1154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 --2- 172.21.15.67:0/2280746476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c10a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.885+0000 7f6871532640 1 -- 172.21.15.67:0/2280746476 >> 172.21.15.67:0/2280746476 conn(0x7f686c06dfc0 msgr2=0x7f686c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.886+0000 7f6871532640 1 -- 172.21.15.67:0/2280746476 shutdown_connections 2024-09-10T21:01:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.886+0000 7f6871532640 1 -- 172.21.15.67:0/2280746476 wait complete. 2024-09-10T21:01:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.886+0000 7f6871532640 1 Processor -- start 2024-09-10T21:01:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.886+0000 7f6871532640 1 -- start start 2024-09-10T21:01:58.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c11a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 0x7f686c11ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c120260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f686c1193a0 con 0x7f686c10a150 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f686c119220 con 0x7f686c10aa70 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6871532640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686c119520 con 0x7f686c115a10 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c120260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c120260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35426/0 (socket says 172.21.15.67:35426) 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f686b7fe640 1 -- 172.21.15.67:0/664720683 learned_addr learned my addr 172.21.15.67:0/664720683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.887+0000 7f6863fff640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 0x7f686c11ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.888+0000 7f686affd640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c11a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.890+0000 7f686affd640 1 -- 172.21.15.67:0/664720683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 msgr2=0x7f686c120260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.890+0000 7f686affd640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c120260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.890+0000 7f686affd640 1 -- 172.21.15.67:0/664720683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 msgr2=0x7f686c11ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.890+0000 7f686affd640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 0x7f686c11ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.890+0000 7f686affd640 1 -- 172.21.15.67:0/664720683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c120820 con 0x7f686c10a150 2024-09-10T21:01:58.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.891+0000 7f686affd640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c11a850 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b420 tx=0x7f685c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.892+0000 7f6868ff9640 1 -- 172.21.15.67:0/664720683 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c011830 con 0x7f686c10a150 2024-09-10T21:01:58.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.892+0000 7f6868ff9640 1 -- 172.21.15.67:0/664720683 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c016070 con 0x7f686c10a150 2024-09-10T21:01:58.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.892+0000 7f6868ff9640 1 -- 172.21.15.67:0/664720683 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c010dd0 con 0x7f686c10a150 2024-09-10T21:01:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.892+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c120b10 con 0x7f686c10a150 2024-09-10T21:01:58.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.892+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c121080 con 0x7f686c10a150 2024-09-10T21:01:58.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.899+0000 7f6868ff9640 1 -- 172.21.15.67:0/664720683 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f685c0119d0 con 0x7f686c10a150 2024-09-10T21:01:58.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.904+0000 7f6873907740 1 Processor -- start 2024-09-10T21:01:58.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.905+0000 7f6868ff9640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 0x7f68580b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.905+0000 7f6868ff9640 1 -- 172.21.15.67:0/664720683 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f685c0e4f80 con 0x7f686c10a150 2024-09-10T21:01:58.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f6873907740 1 -- start start 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f686b7fe640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 0x7f68580b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f686b7fe640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 0x7f68580b7860 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6864009620 tx=0x7f6864005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f6873907740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f6873907740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b48627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.906+0000 7f6873907740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4865120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f6873907740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5640b47cce50 con 0x5640b4862d30 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35428/0 (socket says 172.21.15.67:35428) 2024-09-10T21:01:58.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 -- 172.21.15.67:0/1572806783 learned_addr learned my addr 172.21.15.67:0/1572806783 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f6873907740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5640b47bc280 con 0x5640b4856da0 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5640b47c0090 con 0x5640b4856480 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686b7fe640 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4865120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 -- 172.21.15.67:0/1572806783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 msgr2=0x5640b48627f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b48627f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 -- 172.21.15.67:0/1572806783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 msgr2=0x5640b4865120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4865120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.907+0000 7f686affd640 1 -- 172.21.15.67:0/1572806783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b451a650 con 0x5640b4856480 2024-09-10T21:01:58.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.910+0000 7f686affd640 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7de0 tx=0x7f685c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c5e02e78eaeee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.913+0000 7f68617fa640 1 -- 172.21.15.67:0/1572806783 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0abf10 con 0x5640b4856480 2024-09-10T21:01:58.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.913+0000 7f68617fa640 1 -- 172.21.15.67:0/1572806783 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c0ab810 con 0x5640b4856480 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.913+0000 7f68617fa640 1 -- 172.21.15.67:0/1572806783 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0a7160 con 0x5640b4856480 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 msgr2=0x5640b4856860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f685c0a7de0 tx=0x7f685c0046c0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 shutdown_connections 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4865120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b48627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 --2- 172.21.15.67:0/1572806783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856480 0x5640b4856860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 >> 172.21.15.67:0/1572806783 conn(0x5640b48542b0 msgr2=0x5640b4855450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.914+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 shutdown_connections 2024-09-10T21:01:58.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.915+0000 7f6873907740 1 -- 172.21.15.67:0/1572806783 wait complete. 2024-09-10T21:01:58.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.915+0000 7f6873907740 1 -- start start 2024-09-10T21:01:58.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.915+0000 7f6873907740 1 Processor -- start 2024-09-10T21:01:58.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 0x5640b485fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4860300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5640b461d700 con 0x5640b4862d30 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5640b4757110 con 0x5640b4856480 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5640b4865950 con 0x5640b4856da0 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6873907740 10 client.0 _ll_register_callbacks cb 0x5640b4770990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f686affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f686affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50604/0 (socket says 172.21.15.67:50604) 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f686affd640 1 -- 172.21.15.67:0/1471388966 learned_addr learned my addr 172.21.15.67:0/1471388966 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:58.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.916+0000 7f6863fff640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 0x5640b485fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 -- 172.21.15.67:0/1471388966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 msgr2=0x5640b485fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 0x5640b485fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 -- 172.21.15.67:0/1471388966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 msgr2=0x5640b4860300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4860300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 -- 172.21.15.67:0/1471388966 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b4784c40 con 0x5640b4856480 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f6863fff640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 0x5640b485fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f686affd640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b0260 tx=0x7f685c0e2b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dced82cde69aaca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f68527fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:01:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b0040 con 0x5640b4856480 2024-09-10T21:01:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f685c0ab810 con 0x5640b4856480 2024-09-10T21:01:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.917+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f685c0ced60 con 0x5640b4856480 2024-09-10T21:01:58.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.919+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f685c0b02f0 con 0x5640b4856480 2024-09-10T21:01:58.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.922+0000 7f6873907740 10 client.26393 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:58.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.922+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5640b4871380 con 0x5640b4856480 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.923+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c0ab810 con 0x5640b4856480 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.923+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f685c0a7160 con 0x5640b4856480 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 10 client.26393 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 10 client.26393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 20 client.26393 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48726d0 0x5640b4874b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 4 client.26393 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:01:58.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.924+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b47ceda0 con 0x5640b48726d0 2024-09-10T21:01:58.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.927+0000 7f6863fff640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48726d0 0x5640b4874b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.927+0000 7f6863fff640 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48726d0 0x5640b4874b30 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9dd311faa170337 server_cookie=ec9bc6261b707dd2 in_seq=0 out_seq=0 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.928+0000 7f68527fc640 10 client.26393 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.928+0000 7f68527fc640 1 -- 172.21.15.67:0/1471388966 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640b47ceda0 con 0x5640b48726d0 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.928+0000 7f68527fc640 10 client.26393 handle_command_reply: tid=0 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.928+0000 7f6873907740 1 client.26393 shutdown 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 msgr2=0x5640b4862720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685c0b0260 tx=0x7f685c0e2b30 comp rx=0 tx=0).stop 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 shutdown_connections 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48726d0 0x5640b4874b30 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4862d30 0x5640b4860300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4856da0 0x5640b485fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 --2- 172.21.15.67:0/1471388966 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b4862720 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 >> 172.21.15.67:0/1471388966 conn(0x5640b48542b0 msgr2=0x5640b4859e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f68527fc640 0 client.26393 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 shutdown_connections 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 1 -- 172.21.15.67:0/1471388966 wait complete. 2024-09-10T21:01:58.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.929+0000 7f6873907740 20 client.26393 trim_cache size 0 max 16384 2024-09-10T21:01:58.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 Processor -- start 2024-09-10T21:01:58.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 -- start start 2024-09-10T21:01:58.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856da0 0x5640b4853bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b485e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f686affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f686c1326e0 con 0x5640b4856da0 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f686c12ffb0 con 0x5640b4856480 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f6873907740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686c12de00 con 0x5640b4862d30 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f686affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50614/0 (socket says 172.21.15.67:50614) 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.951+0000 7f686affd640 1 -- 172.21.15.67:0/370641871 learned_addr learned my addr 172.21.15.67:0/370641871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686b7fe640 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b485e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 -- 172.21.15.67:0/370641871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 msgr2=0x5640b485e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b485e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 -- 172.21.15.67:0/370641871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856da0 msgr2=0x5640b4853bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856da0 0x5640b4853bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 -- 172.21.15.67:0/370641871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b4862a90 con 0x5640b4856480 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f686affd640 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ab510 tx=0x7f685c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbfb1e6577281b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f6860ff9640 1 -- 172.21.15.67:0/370641871 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0b0050 con 0x5640b4856480 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f6860ff9640 1 -- 172.21.15.67:0/370641871 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c0abf10 con 0x5640b4856480 2024-09-10T21:01:58.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.952+0000 7f6860ff9640 1 -- 172.21.15.67:0/370641871 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c009180 con 0x5640b4856480 2024-09-10T21:01:58.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.953+0000 7f6873907740 1 -- 172.21.15.67:0/370641871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 msgr2=0x5640b48746e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.953+0000 7f6873907740 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f685c0ab510 tx=0x7f685c0046c0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 -- 172.21.15.67:0/370641871 shutdown_connections 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b485e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856da0 0x5640b4853bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 --2- 172.21.15.67:0/370641871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856480 0x5640b48746e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 -- 172.21.15.67:0/370641871 >> 172.21.15.67:0/370641871 conn(0x5640b48542b0 msgr2=0x5640b485ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 -- 172.21.15.67:0/370641871 shutdown_connections 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 -- 172.21.15.67:0/370641871 wait complete. 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 -- start start 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.954+0000 7f6873907740 1 Processor -- start 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856480 0x5640b485d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b486b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f686c12e470 con 0x5640b4856480 2024-09-10T21:01:58.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6863fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6863fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:50624/0 (socket says 172.21.15.67:50624) 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6863fff640 1 -- 172.21.15.67:0/1241027223 learned_addr learned my addr 172.21.15.67:0/1241027223 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f686c12f8e0 con 0x5640b4856da0 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f686c12eb40 con 0x5640b4862d30 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f6873907740 10 client.0 _ll_register_callbacks cb 0x7f6864009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.955+0000 7f686affd640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856480 0x5640b485d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b486b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 -- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 msgr2=0x5640b486abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 -- 172.21.15.67:0/1241027223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856480 msgr2=0x5640b485d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856480 0x5640b485d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 -- 172.21.15.67:0/1241027223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b486b950 con 0x5640b4862d30 2024-09-10T21:01:58.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f6863fff640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f686b7fe640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b486b120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5640b47ccfa0 tx=0x7f686402fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f855ae86a11758e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.956+0000 7f68527fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864034040 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6864040030 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f685c0abf10 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f686402feb0 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 10 client.26353 fetch_fsmap learned FSMap version 34 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5640b48df760 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f685c0abf10 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6864051420 con 0x5640b4862d30 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 10 client.26353 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 10 client.26353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 20 client.26353 populate_metadata read hostname 'smithi067' 2024-09-10T21:01:58.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48dff10 0x5640b48e2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:01:58.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 4 client.26353 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:01:58.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.957+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640b47ca850 con 0x5640b48dff10 2024-09-10T21:01:58.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.958+0000 7f686affd640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48dff10 0x5640b48e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:01:58.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.959+0000 7f686affd640 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48dff10 0x5640b48e2330 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88ee18b56ba0d44 server_cookie=25110fb7f1fa5c82 in_seq=0 out_seq=0 2024-09-10T21:01:58.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.959+0000 7f68527fc640 10 client.26353 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.959+0000 7f68527fc640 1 -- 172.21.15.67:0/1241027223 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x5640b47ca850 con 0x5640b48dff10 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.959+0000 7f68527fc640 10 client.26353 handle_command_reply: tid=0 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.959+0000 7f6873907740 1 client.26353 shutdown 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 msgr2=0x5640b486b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b486b120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5640b47ccfa0 tx=0x7f686402fcc0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 shutdown_connections 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5640b48dff10 0x5640b48e2330 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5640b4862d30 0x5640b486b120 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b4856da0 0x5640b486abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 --2- 172.21.15.67:0/1241027223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5640b4856480 0x5640b485d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 >> 172.21.15.67:0/1241027223 conn(0x5640b48542b0 msgr2=0x5640b485e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f68527fc640 0 client.26353 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 shutdown_connections 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 1 -- 172.21.15.67:0/1241027223 wait complete. 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.960+0000 7f6873907740 20 client.26353 trim_cache size 0 max 16384 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:01:58.968 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c", 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.969 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:01:58.970 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.971 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.972 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.973 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.974 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.975 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:01:58.976 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.977 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:01:58.978 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:01:58.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 msgr2=0x7f68580b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 0x7f68580b7860 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6864009620 tx=0x7f6864005d80 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 msgr2=0x7f686c11a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c11a850 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b420 tx=0x7f685c00b8e0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 shutdown_connections 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f68580b53a0 0x7f68580b7860 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f686c115a10 0x7f686c120260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f686c10aa70 0x7f686c11ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 --2- 172.21.15.67:0/664720683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f686c10a150 0x7f686c11a850 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.961+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 >> 172.21.15.67:0/664720683 conn(0x7f686c06dfc0 msgr2=0x7f686c0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.962+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 shutdown_connections 2024-09-10T21:01:58.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:01:58.962+0000 7f6871532640 1 -- 172.21.15.67:0/664720683 wait complete. 2024-09-10T21:01:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 625.0 s, 2961.2 tps, lat 34.086 ms stddev 40.273 2024-09-10T21:01:59.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:01:59 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:59.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:01:59 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:59.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:01:59 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:01:59.821 INFO:tasks.cephfs.filesystem:scrub status for tag:62ef957c-4a5c-44c5-966a-de0ff7bc5a0c - {'path': '/', 'tag': '62ef957c-4a5c-44c5-966a-de0ff7bc5a0c', 'options': 'recursive,force'} 2024-09-10T21:02:00.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:00 smithi083 ceph-mon[35058]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 637 op/s 2024-09-10T21:02:00.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:00 smithi172 ceph-mon[35265]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 637 op/s 2024-09-10T21:02:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:00 smithi067 ceph-mon[30891]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 637 op/s 2024-09-10T21:02:02.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:02 smithi083 ceph-mon[35058]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 652 op/s 2024-09-10T21:02:02.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:02 smithi172 ceph-mon[35265]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 652 op/s 2024-09-10T21:02:02.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:02 smithi067 ceph-mon[30891]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 652 op/s 2024-09-10T21:02:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 630.0 s, 3093.0 tps, lat 32.203 ms stddev 39.142 2024-09-10T21:02:04.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:04 smithi083 ceph-mon[35058]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 809 op/s 2024-09-10T21:02:04.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:04 smithi172 ceph-mon[35265]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 809 op/s 2024-09-10T21:02:04.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:04 smithi067 ceph-mon[30891]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 809 op/s 2024-09-10T21:02:06.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:06 smithi083 ceph-mon[35058]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2024-09-10T21:02:06.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:06 smithi172 ceph-mon[35265]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2024-09-10T21:02:06.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:06 smithi067 ceph-mon[30891]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 755 op/s 2024-09-10T21:02:08.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:08 smithi083 ceph-mon[35058]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 736 op/s 2024-09-10T21:02:08.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:08 smithi172 ceph-mon[35265]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 736 op/s 2024-09-10T21:02:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:08 smithi067 ceph-mon[30891]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 MiB/s wr, 736 op/s 2024-09-10T21:02:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 635.0 s, 1563.2 tps, lat 63.396 ms stddev 73.502 2024-09-10T21:02:10.391 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:10 smithi083 ceph-mon[35058]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-09-10T21:02:10.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:10 smithi172 ceph-mon[35265]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-09-10T21:02:10.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:10 smithi067 ceph-mon[30891]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 762 op/s 2024-09-10T21:02:11.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:11.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:12 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:12.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:12 smithi172 ceph-mon[35265]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 752 op/s 2024-09-10T21:02:12.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:12 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:12.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:12 smithi067 ceph-mon[30891]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 752 op/s 2024-09-10T21:02:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:12 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:12 smithi083 ceph-mon[35058]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 13 MiB/s wr, 752 op/s 2024-09-10T21:02:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 640.0 s, 1772.4 tps, lat 57.001 ms stddev 70.681 2024-09-10T21:02:14.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:14 smithi172 ceph-mon[35265]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 836 op/s 2024-09-10T21:02:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:14 smithi067 ceph-mon[30891]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 836 op/s 2024-09-10T21:02:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:14 smithi083 ceph-mon[35058]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 836 op/s 2024-09-10T21:02:16.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:16 smithi172 ceph-mon[35265]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 732 op/s 2024-09-10T21:02:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:16 smithi067 ceph-mon[30891]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 732 op/s 2024-09-10T21:02:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:16 smithi083 ceph-mon[35058]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 732 op/s 2024-09-10T21:02:18.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:18 smithi172 ceph-mon[35265]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 19 MiB/s wr, 780 op/s 2024-09-10T21:02:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:18 smithi067 ceph-mon[30891]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 19 MiB/s wr, 780 op/s 2024-09-10T21:02:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:18 smithi083 ceph-mon[35058]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 19 MiB/s wr, 780 op/s 2024-09-10T21:02:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 645.0 s, 2178.8 tps, lat 45.454 ms stddev 54.010 2024-09-10T21:02:20.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:20 smithi172 ceph-mon[35265]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 763 op/s 2024-09-10T21:02:20.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:20 smithi067 ceph-mon[30891]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 763 op/s 2024-09-10T21:02:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:20 smithi083 ceph-mon[35058]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 763 op/s 2024-09-10T21:02:22.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:22 smithi172 ceph-mon[35265]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-10T21:02:22.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:22 smithi067 ceph-mon[30891]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-10T21:02:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:22 smithi083 ceph-mon[35058]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 17 MiB/s wr, 647 op/s 2024-09-10T21:02:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 650.0 s, 2046.2 tps, lat 49.229 ms stddev 63.019 2024-09-10T21:02:24.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:24 smithi172 ceph-mon[35265]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 18 MiB/s wr, 731 op/s 2024-09-10T21:02:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:24 smithi067 ceph-mon[30891]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 18 MiB/s wr, 731 op/s 2024-09-10T21:02:24.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:24 smithi083 ceph-mon[35058]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 18 MiB/s wr, 731 op/s 2024-09-10T21:02:26.443 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:26 smithi083 ceph-mon[35058]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 16 MiB/s wr, 655 op/s 2024-09-10T21:02:26.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:26 smithi172 ceph-mon[35265]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 16 MiB/s wr, 655 op/s 2024-09-10T21:02:26.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:26 smithi067 ceph-mon[30891]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 16 MiB/s wr, 655 op/s 2024-09-10T21:02:28.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:28 smithi172 ceph-mon[35265]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 687 op/s 2024-09-10T21:02:28.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:28 smithi067 ceph-mon[30891]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 687 op/s 2024-09-10T21:02:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:28 smithi083 ceph-mon[35058]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 16 MiB/s wr, 687 op/s 2024-09-10T21:02:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 655.0 s, 2091.2 tps, lat 47.359 ms stddev 51.371 2024-09-10T21:02:29.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:02:30.245 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:30.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:30 smithi172 ceph-mon[35265]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-09-10T21:02:30.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:30 smithi067 ceph-mon[30891]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-09-10T21:02:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:30 smithi083 ceph-mon[35058]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 -- 172.21.15.67:0/2891678280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470108020 msgr2=0x7f247010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 --2- 172.21.15.67:0/2891678280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470108020 0x7f247010e820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2468009be0 tx=0x7f246802c650 comp rx=0 tx=0).stop 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 -- 172.21.15.67:0/2891678280 shutdown_connections 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 --2- 172.21.15.67:0/2891678280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470108020 0x7f247010e820 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 --2- 172.21.15.67:0/2891678280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 0x7f2470107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 --2- 172.21.15.67:0/2891678280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470101c90 0x7f2470102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 -- 172.21.15.67:0/2891678280 >> 172.21.15.67:0/2891678280 conn(0x7f24700fd700 msgr2=0x7f24700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 -- 172.21.15.67:0/2891678280 shutdown_connections 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.267+0000 7f2476230640 1 -- 172.21.15.67:0/2891678280 wait complete. 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.268+0000 7f2476230640 1 Processor -- start 2024-09-10T21:02:31.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.268+0000 7f2476230640 1 -- start start 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 0x7f2470197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470108020 0x7f247019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110be0 con 0x7f2470108020 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110a60 con 0x7f2470101c90 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2476230640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2470110d60 con 0x7f24701076a0 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51666/0 (socket says 172.21.15.67:51666) 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f246f7fe640 1 -- 172.21.15.67:0/2002676393 learned_addr learned my addr 172.21.15.67:0/2002676393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f246ffff640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470108020 0x7f247019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.269+0000 7f2467fff640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 0x7f2470197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 -- 172.21.15.67:0/2002676393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 msgr2=0x7f2470197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 0x7f2470197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 -- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470108020 msgr2=0x7f247019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470108020 0x7f247019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 -- 172.21.15.67:0/2002676393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247019d0a0 con 0x7f2470101c90 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f246000e9c0 tx=0x7f246000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246d7fa640 1 -- 172.21.15.67:0/2002676393 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246000ccc0 con 0x7f2470101c90 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246d7fa640 1 -- 172.21.15.67:0/2002676393 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24600054d0 con 0x7f2470101c90 2024-09-10T21:02:31.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f246d7fa640 1 -- 172.21.15.67:0/2002676393 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2460010430 con 0x7f2470101c90 2024-09-10T21:02:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247019d390 con 0x7f2470101c90 2024-09-10T21:02:31.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.270+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24701a7e60 con 0x7f2470101c90 2024-09-10T21:02:31.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.274+0000 7f2478605740 1 Processor -- start 2024-09-10T21:02:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.274+0000 7f2478605740 1 -- start start 2024-09-10T21:02:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.275+0000 7f2478605740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 0x55825e2cb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.275+0000 7f246d7fa640 1 -- 172.21.15.67:0/2002676393 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2460004f80 con 0x7f2470101c90 2024-09-10T21:02:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2478605740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2478605740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 0x55825e2d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51672/0 (socket says 172.21.15.67:51672) 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f246f7fe640 1 -- 172.21.15.67:0/443340401 learned_addr learned my addr 172.21.15.67:0/443340401 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55825e241e50 con 0x55825e2d7950 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55825e231280 con 0x55825e2cb9c0 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55825e235090 con 0x55825e2cb0a0 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f2467fff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 0x55825e2d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.276+0000 7f246ffff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 0x55825e2cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 -- 172.21.15.67:0/443340401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 msgr2=0x55825e2cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f246d7fa640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 0x7f245c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 0x55825e2cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 -- 172.21.15.67:0/443340401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 msgr2=0x55825e2d7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 -- 172.21.15.67:0/443340401 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825df8f650 con 0x55825e2d7950 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f246f7fe640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2467fff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 0x55825e2d9d40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f24580058c0 tx=0x7f245800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2877c45efc4828d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f246d7fa640 1 -- 172.21.15.67:0/2002676393 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f24600e5f90 con 0x7f2470101c90 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2465ffb640 1 -- 172.21.15.67:0/443340401 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458004020 con 0x55825e2d7950 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f246ffff640 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 0x55825e2cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2465ffb640 1 -- 172.21.15.67:0/443340401 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24580041c0 con 0x55825e2d7950 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.277+0000 7f2465ffb640 1 -- 172.21.15.67:0/443340401 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2458018740 con 0x55825e2d7950 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f246ffff640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 0x7f245c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 msgr2=0x55825e2d9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 0x55825e2d9d40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f24580058c0 tx=0x7f245800f3c0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f246ffff640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 0x7f245c0b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2468006010 tx=0x7f2468009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 shutdown_connections 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2d7950 0x55825e2d9d40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2cb9c0 0x55825e2d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 --2- 172.21.15.67:0/443340401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb0a0 0x55825e2cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.278+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 >> 172.21.15.67:0/443340401 conn(0x55825e2c8ed0 msgr2=0x55825e2ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.279+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 shutdown_connections 2024-09-10T21:02:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.279+0000 7f2478605740 1 -- 172.21.15.67:0/443340401 wait complete. 2024-09-10T21:02:31.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.279+0000 7f2478605740 1 -- start start 2024-09-10T21:02:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.279+0000 7f2478605740 1 Processor -- start 2024-09-10T21:02:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38664/0 (socket says 172.21.15.67:38664) 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55825e092700 con 0x55825e2cb0a0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f246f7fe640 1 -- 172.21.15.67:0/2112322927 learned_addr learned my addr 172.21.15.67:0/2112322927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55825e1cc110 con 0x55825e2d7950 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55825e2da5d0 con 0x55825e2cb9c0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2478605740 10 client.0 _ll_register_callbacks cb 0x55825e1e5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f246ffff640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.280+0000 7f2467fff640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 -- 172.21.15.67:0/2112322927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 msgr2=0x55825e2d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2d46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 -- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 msgr2=0x55825e2d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2d4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55825e1f9c40 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f2467fff640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2460009230 tx=0x7f24600a8e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692072367dd49b55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f244effd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24600abef0 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24580041c0 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f24600ab9e0 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f246000ce60 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f2478605740 10 client.16683 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.281+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55825e2e5f60 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24580041c0 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f24600cfad0 con 0x55825e2cb0a0 2024-09-10T21:02:31.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 10 client.16683 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 20 client.16683 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e2e7320 0x55825e2e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 4 client.16683 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55825e243da0 con 0x55825e2e7320 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.282+0000 7f2467fff640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e2e7320 0x55825e2e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f244effd640 10 client.16683 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f2467fff640 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e2e7320 0x55825e2e97e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc25deb543ec0f26 server_cookie=a3794ad7d25e9daa in_seq=0 out_seq=0 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f244effd640 1 -- 172.21.15.67:0/2112322927 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55825e243da0 con 0x55825e2e7320 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f244effd640 10 client.16683 handle_command_reply: tid=0 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f2478605740 1 client.16683 shutdown 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 msgr2=0x55825e2d72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.283+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2460009230 tx=0x7f24600a8e50 comp rx=0 tx=0).stop 2024-09-10T21:02:31.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 shutdown_connections 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e2e7320 0x55825e2e97e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 --2- 172.21.15.67:0/2112322927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2cb0a0 0x55825e2d72a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 >> 172.21.15.67:0/2112322927 conn(0x55825e2c8ed0 msgr2=0x55825e2cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f244effd640 0 client.16683 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.284+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 shutdown_connections 2024-09-10T21:02:31.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.287+0000 7f2478605740 1 -- 172.21.15.67:0/2112322927 wait complete. 2024-09-10T21:02:31.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.287+0000 7f2478605740 20 client.16683 trim_cache size 0 max 16384 2024-09-10T21:02:31.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.319+0000 7f2478605740 1 Processor -- start 2024-09-10T21:02:31.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.323+0000 7f2478605740 1 -- start start 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.323+0000 7f2478605740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.323+0000 7f2478605740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.323+0000 7f2478605740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.323+0000 7f2478605740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24701b2d80 con 0x55825e2c3f10 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.324+0000 7f2478605740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f24701b0650 con 0x55825e2d7950 2024-09-10T21:02:31.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.324+0000 7f2478605740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24701ae4a0 con 0x55825e2cb9c0 2024-09-10T21:02:31.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.327+0000 7f246ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.327+0000 7f246ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38680/0 (socket says 172.21.15.67:38680) 2024-09-10T21:02:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.327+0000 7f246ffff640 1 -- 172.21.15.67:0/2042963122 learned_addr learned my addr 172.21.15.67:0/2042963122 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.328+0000 7f246f7fe640 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f2467fff640 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f246ffff640 1 -- 172.21.15.67:0/2042963122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 msgr2=0x55825e2e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f246ffff640 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f246ffff640 1 -- 172.21.15.67:0/2042963122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 msgr2=0x55825e2ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f246ffff640 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.331+0000 7f246ffff640 1 -- 172.21.15.67:0/2042963122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55825e2cb7f0 con 0x55825e2c3f10 2024-09-10T21:02:31.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.335+0000 7f246ffff640 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2468009be0 tx=0x7f2468040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0598a00abbb420 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.340+0000 7f24657fa640 1 -- 172.21.15.67:0/2042963122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468038040 con 0x55825e2c3f10 2024-09-10T21:02:31.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.340+0000 7f24657fa640 1 -- 172.21.15.67:0/2042963122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2468052070 con 0x55825e2c3f10 2024-09-10T21:02:31.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.340+0000 7f24657fa640 1 -- 172.21.15.67:0/2042963122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24680406d0 con 0x55825e2c3f10 2024-09-10T21:02:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.342+0000 7f2478605740 1 -- 172.21.15.67:0/2042963122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 msgr2=0x55825e2d8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.342+0000 7f2478605740 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2468009be0 tx=0x7f2468040000 comp rx=0 tx=0).stop 2024-09-10T21:02:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.346+0000 7f2478605740 1 -- 172.21.15.67:0/2042963122 shutdown_connections 2024-09-10T21:02:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.346+0000 7f2478605740 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2d8d40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.346+0000 7f2478605740 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.346+0000 7f2478605740 1 --2- 172.21.15.67:0/2042963122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.346+0000 7f2478605740 1 -- 172.21.15.67:0/2042963122 >> 172.21.15.67:0/2042963122 conn(0x55825e2c8ed0 msgr2=0x55825e2c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.349+0000 7f2478605740 1 -- 172.21.15.67:0/2042963122 shutdown_connections 2024-09-10T21:02:31.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.350+0000 7f2478605740 1 -- 172.21.15.67:0/2042963122 wait complete. 2024-09-10T21:02:31.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.351+0000 7f2478605740 1 -- start start 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.352+0000 7f2478605740 1 Processor -- start 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.352+0000 7f2478605740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2df870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2478605740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2478605740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2478605740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f24701aeb10 con 0x55825e2c3f10 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2478605740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f24701aff80 con 0x55825e2d7950 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f246ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f246ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51716/0 (socket says 172.21.15.67:51716) 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f246ffff640 1 -- 172.21.15.67:0/395435737 learned_addr learned my addr 172.21.15.67:0/395435737 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24701af1e0 con 0x55825e2cb9c0 2024-09-10T21:02:31.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.353+0000 7f2467fff640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.354+0000 7f2478605740 10 client.0 _ll_register_callbacks cb 0x7f2460005680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.355+0000 7f246ffff640 1 -- 172.21.15.67:0/395435737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 msgr2=0x55825e2dfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.355+0000 7f246ffff640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2dfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.355+0000 7f246ffff640 1 -- 172.21.15.67:0/395435737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 msgr2=0x55825e2df870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.355+0000 7f246ffff640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2df870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.355+0000 7f246ffff640 1 -- 172.21.15.67:0/395435737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55825e2dad60 con 0x55825e2d7950 2024-09-10T21:02:31.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.356+0000 7f246ffff640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f246802cb70 tx=0x7f246800d3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96da4d6b50bac9db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:31.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.356+0000 7f244effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:02:31.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.359+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468038040 con 0x55825e2d7950 2024-09-10T21:02:31.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.359+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2468040670 con 0x55825e2d7950 2024-09-10T21:02:31.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.359+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2468052070 con 0x55825e2d7950 2024-09-10T21:02:31.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.360+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2468066070 con 0x55825e2d7950 2024-09-10T21:02:31.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.360+0000 7f2478605740 10 client.26414 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:31.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.360+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55825e3549b0 con 0x55825e2d7950 2024-09-10T21:02:31.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.363+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f246802ce50 con 0x55825e2d7950 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.363+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f246803e040 con 0x55825e2d7950 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.364+0000 7f2478605740 10 client.26414 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.364+0000 7f2478605740 10 client.26414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.364+0000 7f2478605740 20 client.26414 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.364+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e354fb0 0x55825e3573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.364+0000 7f2478605740 4 client.26414 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:02:31.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.365+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f2468052070 con 0x55825e354fb0 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.365+0000 7f246f7fe640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e354fb0 0x55825e3573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.366+0000 7f246f7fe640 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e354fb0 0x55825e3573d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6d4e4dc4ae64b0 server_cookie=1e89fa5d6f009881 in_seq=0 out_seq=0 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.366+0000 7f244effd640 10 client.26414 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f244effd640 1 -- 172.21.15.67:0/395435737 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x7f2468052070 con 0x55825e354fb0 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f244effd640 10 client.26414 handle_command_reply: tid=0 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 client.26414 shutdown 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 msgr2=0x55825e2da820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f246802cb70 tx=0x7f246800d3a0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 shutdown_connections 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55825e354fb0 0x55825e3573d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55825e2d7950 0x55825e2da820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f244effd640 0 client.26414 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55825e2cb9c0 0x55825e2dfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 --2- 172.21.15.67:0/395435737 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55825e2c3f10 0x55825e2df870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.367+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 >> 172.21.15.67:0/395435737 conn(0x55825e2c8ed0 msgr2=0x55825e2d5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.368+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 shutdown_connections 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.368+0000 7f2478605740 1 -- 172.21.15.67:0/395435737 wait complete. 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.368+0000 7f2478605740 20 client.26414 trim_cache size 0 max 16384 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:02:31.374 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:02:31.375 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:02:31.377 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.378 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.379 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.380 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:02:31.381 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.382 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:02:31.383 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:02:31.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 msgr2=0x7f245c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 0x7f245c0b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2468006010 tx=0x7f2468009500 comp rx=0 tx=0).stop 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 msgr2=0x7f2470196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f246000e9c0 tx=0x7f246000ee80 comp rx=0 tx=0).stop 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 shutdown_connections 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2470108020 0x7f247019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f245c0b52e0 0x7f245c0b77a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24701076a0 0x7f2470197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 --2- 172.21.15.67:0/2002676393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2470101c90 0x7f2470196ff0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.369+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 >> 172.21.15.67:0/2002676393 conn(0x7f24700fd700 msgr2=0x7f24700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.370+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 shutdown_connections 2024-09-10T21:02:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:31.370+0000 7f2476230640 1 -- 172.21.15.67:0/2002676393 wait complete. 2024-09-10T21:02:32.302 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:02:32.302 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:02:32.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:32 smithi172 ceph-mon[35265]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 646 op/s 2024-09-10T21:02:32.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:32 smithi067 ceph-mon[30891]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 646 op/s 2024-09-10T21:02:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:32 smithi083 ceph-mon[35058]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 15 MiB/s wr, 646 op/s 2024-09-10T21:02:32.738 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:33.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 -- 172.21.15.67:0/1141552035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 msgr2=0x7f0ee8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:33.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/1141552035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8102070 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00d910 tx=0x7f0edc02c370 comp rx=0 tx=0).stop 2024-09-10T21:02:33.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 -- 172.21.15.67:0/1141552035 shutdown_connections 2024-09-10T21:02:33.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/1141552035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 0x7f0ee810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/1141552035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/1141552035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8102070 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 -- 172.21.15.67:0/1141552035 >> 172.21.15.67:0/1141552035 conn(0x7f0ee80fd700 msgr2=0x7f0ee80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:33.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 -- 172.21.15.67:0/1141552035 shutdown_connections 2024-09-10T21:02:33.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.374+0000 7f0eeef2b640 1 -- 172.21.15.67:0/1141552035 wait complete. 2024-09-10T21:02:33.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.375+0000 7f0eeef2b640 1 Processor -- start 2024-09-10T21:02:33.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.376+0000 7f0eeef2b640 1 -- start start 2024-09-10T21:02:33.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.376+0000 7f0eeef2b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeef2b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee81975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeef2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 0x7f0ee819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeef2b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8110be0 con 0x7f0ee8101c90 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeef2b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8110a60 con 0x7f0ee81076a0 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeef2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee8110d60 con 0x7f0ee8108020 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0ee7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee81975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:33.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52754/0 (socket says 172.21.15.67:52754) 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 -- 172.21.15.67:0/2975771667 learned_addr learned my addr 172.21.15.67:0/2975771667 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eed4c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 0x7f0ee819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 -- 172.21.15.67:0/2975771667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 msgr2=0x7f0ee819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 0x7f0ee819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 -- 172.21.15.67:0/2975771667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 msgr2=0x7f0ee81975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.377+0000 7f0eeccc7640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee81975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0eeccc7640 1 -- 172.21.15.67:0/2975771667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee819d120 con 0x7f0ee8101c90 2024-09-10T21:02:33.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0ee7fff640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee81975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0eeccc7640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc0346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc042070 con 0x7f0ee8101c90 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee819d3b0 con 0x7f0ee8101c90 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.378+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0edc02eeb0 con 0x7f0ee8101c90 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.379+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc003b00 con 0x7f0ee8101c90 2024-09-10T21:02:33.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.379+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee81a7ee0 con 0x7f0ee8101c90 2024-09-10T21:02:33.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.380+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee8102070 con 0x7f0ee8101c90 2024-09-10T21:02:33.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.382+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0edc003ca0 con 0x7f0ee8101c90 2024-09-10T21:02:33.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.383+0000 7f0ee5ffb640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:33.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.383+0000 7f0ee7fff640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:33.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.383+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0edc1057e0 con 0x7f0ee8101c90 2024-09-10T21:02:33.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.384+0000 7f0ee7fff640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8100f70 tx=0x7f0ed400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:33.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.389+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0edc0cc020 con 0x7f0ee8101c90 2024-09-10T21:02:33.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.750+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee802e5c0 con 0x7f0ee8101c90 2024-09-10T21:02:33.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.751+0000 7f0ee5ffb640 1 -- 172.21.15.67:0/2975771667 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f0edc0d0a50 con 0x7f0ee8101c90 2024-09-10T21:02:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:02:33.756 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:02:33.756 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:02:33.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 msgr2=0x7f0ed80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:33.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8100f70 tx=0x7f0ed400b410 comp rx=0 tx=0).stop 2024-09-10T21:02:33.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 msgr2=0x7f0ee8197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:33.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc0346d0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 shutdown_connections 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f0ed80b52e0 0x7f0ed80b77a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ee8108020 0x7f0ee819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ee81076a0 0x7f0ee81975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 --2- 172.21.15.67:0/2975771667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0ee8101c90 0x7f0ee8197070 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 >> 172.21.15.67:0/2975771667 conn(0x7f0ee80fd700 msgr2=0x7f0ee80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 shutdown_connections 2024-09-10T21:02:33.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:33.754+0000 7f0eeef2b640 1 -- 172.21.15.67:0/2975771667 wait complete. 2024-09-10T21:02:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 660.0 s, 2042.4 tps, lat 49.659 ms stddev 59.421 2024-09-10T21:02:34.410 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:34 smithi067 ceph-mon[30891]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 743 op/s 2024-09-10T21:02:34.411 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2975771667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:02:34.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:02:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:34 smithi172 ceph-mon[35265]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 743 op/s 2024-09-10T21:02:34.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:34 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2975771667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:02:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:34 smithi083 ceph-mon[35058]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 743 op/s 2024-09-10T21:02:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:34 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2975771667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:02:34.837 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:35.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.396+0000 7fc58759e640 1 -- 172.21.15.67:0/3225706810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588102220 msgr2=0x7fc5881066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.396+0000 7fc58759e640 1 --2- 172.21.15.67:0/3225706810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588102220 0x7fc5881066f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc57001a910 tx=0x7fc57003b470 comp rx=0 tx=0).stop 2024-09-10T21:02:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.404+0000 7fc58759e640 1 -- 172.21.15.67:0/3225706810 shutdown_connections 2024-09-10T21:02:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.404+0000 7fc58759e640 1 --2- 172.21.15.67:0/3225706810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588106d40 0x7fc588107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.404+0000 7fc58759e640 1 --2- 172.21.15.67:0/3225706810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588102220 0x7fc5881066f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.404+0000 7fc58759e640 1 --2- 172.21.15.67:0/3225706810 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc588101900 0x7fc588101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.404+0000 7fc58759e640 1 -- 172.21.15.67:0/3225706810 >> 172.21.15.67:0/3225706810 conn(0x7fc5880fd5b0 msgr2=0x7fc5880ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.406+0000 7fc58759e640 1 -- 172.21.15.67:0/3225706810 shutdown_connections 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.410+0000 7fc58759e640 1 -- 172.21.15.67:0/3225706810 wait complete. 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 Processor -- start 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 -- start start 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc588101900 0x7fc588111bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588106d40 0x7fc58819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810a590 con 0x7fc588101900 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810a410 con 0x7fc588102220 2024-09-10T21:02:35.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.411+0000 7fc58759e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810a710 con 0x7fc588106d40 2024-09-10T21:02:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.412+0000 7fc57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.412+0000 7fc57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:33356/0 (socket says 172.21.15.67:33356) 2024-09-10T21:02:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.412+0000 7fc57ffff640 1 -- 172.21.15.67:0/2073507538 learned_addr learned my addr 172.21.15.67:0/2073507538 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.413+0000 7fc57ffff640 1 -- 172.21.15.67:0/2073507538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588106d40 msgr2=0x7fc58819c6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:02:35.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.413+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588106d40 0x7fc58819c6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.414+0000 7fc57ffff640 1 -- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc588101900 msgr2=0x7fc588111bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.414+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc588101900 0x7fc588111bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.414+0000 7fc57ffff640 1 -- 172.21.15.67:0/2073507538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58819ceb0 con 0x7fc588102220 2024-09-10T21:02:35.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.415+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc570006010 tx=0x7fc5700048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.415+0000 7fc57f7fe640 1 -- 172.21.15.67:0/2073507538 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570052020 con 0x7fc588102220 2024-09-10T21:02:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.416+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58819d140 con 0x7fc588102220 2024-09-10T21:02:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.416+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58806cb70 con 0x7fc588102220 2024-09-10T21:02:35.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.416+0000 7fc57f7fe640 1 -- 172.21.15.67:0/2073507538 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc570040bd0 con 0x7fc588102220 2024-09-10T21:02:35.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.417+0000 7fc57f7fe640 1 -- 172.21.15.67:0/2073507538 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57004ecb0 con 0x7fc588102220 2024-09-10T21:02:35.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.421+0000 7fc58ef2f740 1 Processor -- start 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.421+0000 7fc58ef2f740 1 -- start start 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca18fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca1900340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557ca1867ea0 con 0x557ca18f16a0 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557ca18572d0 con 0x557ca18fdf50 2024-09-10T21:02:35.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ca185b0e0 con 0x557ca18f1fc0 2024-09-10T21:02:35.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52794/0 (socket says 172.21.15.67:52794) 2024-09-10T21:02:35.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.422+0000 7fc586d9d640 1 -- 172.21.15.67:0/2526865405 learned_addr learned my addr 172.21.15.67:0/2526865405 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc57f7fe640 1 -- 172.21.15.67:0/2073507538 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc570042440 con 0x7fc588102220 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc586d9d640 1 -- 172.21.15.67:0/2526865405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 msgr2=0x557ca18fda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca18fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc586d9d640 1 -- 172.21.15.67:0/2526865405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 msgr2=0x557ca1900340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca1900340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca1900340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc586d9d640 1 -- 172.21.15.67:0/2526865405 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ca15b5650 con 0x557ca18f16a0 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.423+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca1900340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:02:35.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.424+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e30 tx=0x7fc58000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a679719a4466571 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.424+0000 7fc57cff9640 1 -- 172.21.15.67:0/2526865405 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580004d20 con 0x557ca18f16a0 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.424+0000 7fc57cff9640 1 -- 172.21.15.67:0/2526865405 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc58000ee70 con 0x557ca18f16a0 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc57cff9640 1 -- 172.21.15.67:0/2526865405 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580010760 con 0x557ca18f16a0 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc57f7fe640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 0x7fc5740b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58659c640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 0x7fc5740b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2526865405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 msgr2=0x557ca18f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e30 tx=0x7fc58000e720 comp rx=0 tx=0).stop 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2526865405 shutdown_connections 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca1900340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca18fda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2526865405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f1a80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.425+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2526865405 >> 172.21.15.67:0/2526865405 conn(0x557ca18ef4d0 msgr2=0x557ca18f0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.426+0000 7fc57f7fe640 1 -- 172.21.15.67:0/2073507538 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc570117760 con 0x7fc588102220 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.426+0000 7fc58659c640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 0x7fc5740b79e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x557ca18f03b0 tx=0x7fc578005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.426+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2526865405 shutdown_connections 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.426+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2526865405 wait complete. 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.426+0000 7fc58ef2f740 1 -- start start 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 Processor -- start 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18fd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18fab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557ca16b8700 con 0x557ca18f16a0 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557ca17f2160 con 0x557ca18f1fc0 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ca1900c70 con 0x557ca18fdf50 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc58ef2f740 10 client.0 _ll_register_callbacks cb 0x557ca180b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36842/0 (socket says 172.21.15.67:36842) 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.427+0000 7fc586d9d640 1 -- 172.21.15.67:0/2527265233 learned_addr learned my addr 172.21.15.67:0/2527265233 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 -- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 msgr2=0x557ca18fab70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18fab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 -- 172.21.15.67:0/2527265233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 msgr2=0x557ca18fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 -- 172.21.15.67:0/2527265233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ca181fc90 con 0x557ca18fdf50 2024-09-10T21:02:35.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.428+0000 7fc586d9d640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc580006010 tx=0x7fc5800052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e1d1bddd9ad6b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.429+0000 7fc56dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.429+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58001d040 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.429+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc58000ee70 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.429+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc5800056c0 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc580003970 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 10 client.26377 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ca190c4b0 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc58000ee70 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc58002a030 con 0x557ca18fdf50 2024-09-10T21:02:35.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 10 client.26377 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 10 client.26377 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 20 client.26377 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.430+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca190dca0 0x557ca1910140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.431+0000 7fc58ef2f740 4 client.26377 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.431+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ca1869df0 con 0x557ca190dca0 2024-09-10T21:02:35.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.431+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca190dca0 0x557ca1910140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.432+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca190dca0 0x557ca1910140 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7119630a2f067b25 server_cookie=be30fe108c2ef432 in_seq=0 out_seq=0 2024-09-10T21:02:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.433+0000 7fc56dffb640 10 client.26377 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:02:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.433+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527265233 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ca1869df0 con 0x557ca190dca0 2024-09-10T21:02:35.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.433+0000 7fc56dffb640 10 client.26377 handle_command_reply: tid=0 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.433+0000 7fc58ef2f740 1 client.26377 shutdown 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 msgr2=0x557ca18fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc580006010 tx=0x7fc5800052d0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 shutdown_connections 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca190dca0 0x557ca1910140 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18fb0b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18fab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527265233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18fd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 >> 172.21.15.67:0/2527265233 conn(0x557ca18ef4d0 msgr2=0x557ca18f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc56dffb640 0 client.26377 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 shutdown_connections 2024-09-10T21:02:35.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527265233 wait complete. 2024-09-10T21:02:35.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.434+0000 7fc58ef2f740 20 client.26377 trim_cache size 0 max 16384 2024-09-10T21:02:35.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.458+0000 7fc58ef2f740 1 Processor -- start 2024-09-10T21:02:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.458+0000 7fc58ef2f740 1 -- start start 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18faae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc568010d20 con 0x557ca18f16a0 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc56800e5f0 con 0x557ca18f1fc0 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc56800c440 con 0x557ca18fdf50 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:33372/0 (socket says 172.21.15.67:33372) 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 -- 172.21.15.67:0/1354738845 learned_addr learned my addr 172.21.15.67:0/1354738845 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc58659c640 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 -- 172.21.15.67:0/1354738845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 msgr2=0x557ca18faae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18faae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 -- 172.21.15.67:0/1354738845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 msgr2=0x557ca18f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.459+0000 7fc57ffff640 1 -- 172.21.15.67:0/1354738845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ca18f1df0 con 0x557ca18f1fc0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.460+0000 7fc57ffff640 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5700db7f0 tx=0x7fc5700de410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d83e5d986bef85e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.460+0000 7fc56ffff640 1 -- 172.21.15.67:0/1354738845 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700e7290 con 0x557ca18f1fc0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.460+0000 7fc56ffff640 1 -- 172.21.15.67:0/1354738845 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5700de090 con 0x557ca18f1fc0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.460+0000 7fc56ffff640 1 -- 172.21.15.67:0/1354738845 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5700dda40 con 0x557ca18f1fc0 2024-09-10T21:02:35.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 -- 172.21.15.67:0/1354738845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 msgr2=0x557ca18f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc5700db7f0 tx=0x7fc5700de410 comp rx=0 tx=0).stop 2024-09-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 -- 172.21.15.67:0/1354738845 shutdown_connections 2024-09-10T21:02:35.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18fdf50 0x557ca18faae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18f1fc0 0x557ca18f6330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/1354738845 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca18f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 -- 172.21.15.67:0/1354738845 >> 172.21.15.67:0/1354738845 conn(0x557ca18ef4d0 msgr2=0x557ca190fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 -- 172.21.15.67:0/1354738845 shutdown_connections 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.461+0000 7fc58ef2f740 1 -- 172.21.15.67:0/1354738845 wait complete. 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 -- start start 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 Processor -- start 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca1906850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca18f4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc56800cab0 con 0x557ca18f16a0 2024-09-10T21:02:35.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc56800df20 con 0x557ca18fdf50 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.462+0000 7fc58ef2f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc56800d180 con 0x557ca18f1fc0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58ef2f740 10 client.0 _ll_register_callbacks cb 0x7fc580009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc586d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca18f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc57ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca1906850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52816/0 (socket says 172.21.15.67:52816) 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 -- 172.21.15.67:0/2527835060 learned_addr learned my addr 172.21.15.67:0/2527835060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 -- 172.21.15.67:0/2527835060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 msgr2=0x557ca1906850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca1906850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 -- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 msgr2=0x557ca18f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca18f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.463+0000 7fc58659c640 1 -- 172.21.15.67:0/2527835060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ca18f49b0 con 0x557ca18f16a0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc58659c640 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc57800b370 tx=0x7fc578010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd4ea86298fb224 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:35.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc56dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578019040 con 0x557ca18f16a0 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc578020840 con 0x557ca18f16a0 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5700de090 con 0x557ca18f16a0 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc578036070 con 0x557ca18f16a0 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc58ef2f740 10 client.16707 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:35.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557ca1905be0 con 0x557ca18f16a0 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.464+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5700de090 con 0x557ca18f16a0 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc57800fb50 con 0x557ca18f16a0 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 10 client.16707 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 10 client.16707 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 20 client.16707 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca199cf70 0x557ca199f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 4 client.16707 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ca18658a0 con 0x557ca199cf70 2024-09-10T21:02:35.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.465+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca199cf70 0x557ca199f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.467+0000 7fc57ffff640 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca199cf70 0x557ca199f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=677b7b0c19aa67dc server_cookie=2999c71db7591a0 in_seq=0 out_seq=0 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.468+0000 7fc56dffb640 10 client.16707 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.468+0000 7fc56dffb640 1 -- 172.21.15.67:0/2527835060 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ca18658a0 con 0x557ca199cf70 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.468+0000 7fc56dffb640 10 client.16707 handle_command_reply: tid=0 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.468+0000 7fc58ef2f740 1 client.16707 shutdown 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 msgr2=0x557ca19062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc57800b370 tx=0x7fc578010000 comp rx=0 tx=0).stop 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 shutdown_connections 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x557ca199cf70 0x557ca199f390 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557ca18fdf50 0x557ca18f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ca18f1fc0 0x557ca1906850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 --2- 172.21.15.67:0/2527835060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557ca18f16a0 0x557ca19062d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 >> 172.21.15.67:0/2527835060 conn(0x557ca18ef4d0 msgr2=0x557ca18f5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc56dffb640 0 client.16707 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:02:35.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 shutdown_connections 2024-09-10T21:02:35.475 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 1 -- 172.21.15.67:0/2527835060 wait complete. 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.469+0000 7fc58ef2f740 20 client.16707 trim_cache size 0 max 16384 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 msgr2=0x7fc5740b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 0x7fc5740b79e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x557ca18f03b0 tx=0x7fc578005e50 comp rx=0 tx=0).stop 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 msgr2=0x7fc588112100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:35.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc570006010 tx=0x7fc5700048f0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 shutdown_connections 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc5740b5520 0x7fc5740b79e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc588106d40 0x7fc58819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc588102220 0x7fc588112100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 --2- 172.21.15.67:0/2073507538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc588101900 0x7fc588111bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 >> 172.21.15.67:0/2073507538 conn(0x7fc5880fd5b0 msgr2=0x7fc588104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 shutdown_connections 2024-09-10T21:02:35.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:35.470+0000 7fc58759e640 1 -- 172.21.15.67:0/2073507538 wait complete. 2024-09-10T21:02:36.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:02:36.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:36 smithi067 ceph-mon[30891]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-09-10T21:02:36.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:36 smithi083 ceph-mon[35058]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-09-10T21:02:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:36 smithi172 ceph-mon[35265]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-09-10T21:02:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 -- 172.21.15.67:0/3141696080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 msgr2=0x7f3b701069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3141696080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b701069e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009900 tx=0x7f3b6002a410 comp rx=0 tx=0).stop 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 -- 172.21.15.67:0/3141696080 shutdown_connections 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3141696080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70106f20 0x7f3b701073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3141696080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b701069e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3141696080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70100fd0 0x7f3b701013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 -- 172.21.15.67:0/3141696080 >> 172.21.15.67:0/3141696080 conn(0x7f3b700fca20 msgr2=0x7f3b700fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 -- 172.21.15.67:0/3141696080 shutdown_connections 2024-09-10T21:02:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.393+0000 7f3b783b1640 1 -- 172.21.15.67:0/3141696080 wait complete. 2024-09-10T21:02:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.394+0000 7f3b783b1640 1 Processor -- start 2024-09-10T21:02:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.394+0000 7f3b783b1640 1 -- start start 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.394+0000 7f3b783b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.394+0000 7f3b783b1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b70074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b783b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70106f20 0x7f3b7006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b783b1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70112d50 con 0x7f3b701018f0 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b783b1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70112bd0 con 0x7f3b70106f20 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b783b1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70112ed0 con 0x7f3b70100fd0 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36874/0 (socket says 172.21.15.67:36874) 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 -- 172.21.15.67:0/3077758658 learned_addr learned my addr 172.21.15.67:0/3077758658 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7594c640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b70074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7694e640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70106f20 0x7f3b7006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 -- 172.21.15.67:0/3077758658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70106f20 msgr2=0x7f3b7006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70106f20 0x7f3b7006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 -- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 msgr2=0x7f3b70074cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b70074cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 -- 172.21.15.67:0/3077758658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7006e390 con 0x7f3b70100fd0 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b7614d640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e9f0 tx=0x7f3b6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.395+0000 7f3b677fe640 1 -- 172.21.15.67:0/3077758658 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cd80 con 0x7f3b70100fd0 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.396+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7006e680 con 0x7f3b70100fd0 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.396+0000 7f3b677fe640 1 -- 172.21.15.67:0/3077758658 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b6c0108e0 con 0x7f3b70100fd0 2024-09-10T21:02:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.396+0000 7f3b677fe640 1 -- 172.21.15.67:0/3077758658 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c018860 con 0x7f3b70100fd0 2024-09-10T21:02:37.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.396+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b700735c0 con 0x7f3b70100fd0 2024-09-10T21:02:37.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.399+0000 7f3b7a786740 1 Processor -- start 2024-09-10T21:02:37.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 -- start start 2024-09-10T21:02:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341720a10 0x556341730870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341730db0 0x5563417331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556341696ea0 con 0x556341730db0 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5563416862d0 con 0x556341720a10 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7a786740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55634168a0e0 con 0x5563417200f0 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36880/0 (socket says 172.21.15.67:36880) 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7694e640 1 -- 172.21.15.67:0/2993351277 learned_addr learned my addr 172.21.15.67:0/2993351277 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b7594c640 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341730db0 0x5563417331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.400+0000 7f3b677fe640 1 -- 172.21.15.67:0/3077758658 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3b6c010430 con 0x7f3b70100fd0 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.401+0000 7f3b7694e640 1 -- 172.21.15.67:0/2993351277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341720a10 msgr2=0x556341730870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.401+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341720a10 0x556341730870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.401+0000 7f3b7694e640 1 -- 172.21.15.67:0/2993351277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341730db0 msgr2=0x5563417331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.401+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341730db0 0x5563417331a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.401+0000 7f3b7694e640 1 -- 172.21.15.67:0/2993351277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563413e4650 con 0x5563417200f0 2024-09-10T21:02:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.402+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b68011440 tx=0x7f3b68011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7555fdb8edf172 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.402+0000 7f3b677fe640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 0x7f3b5c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.402+0000 7f3b64de6640 1 -- 172.21.15.67:0/2993351277 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68004d20 con 0x5563417200f0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.402+0000 7f3b64de6640 1 -- 172.21.15.67:0/2993351277 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b68004050 con 0x5563417200f0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.402+0000 7f3b64de6640 1 -- 172.21.15.67:0/2993351277 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800f7a0 con 0x5563417200f0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b677fe640 1 -- 172.21.15.67:0/3077758658 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3b6c0e5f30 con 0x7f3b70100fd0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7614d640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 0x7f3b5c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 -- 172.21.15.67:0/2993351277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 msgr2=0x5563417204d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b68011440 tx=0x7f3b68011900 comp rx=0 tx=0).stop 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7614d640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 0x7f3b5c0b7820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c6a0 tx=0x7f3b6c009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 -- 172.21.15.67:0/2993351277 shutdown_connections 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341730db0 0x5563417331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341720a10 0x556341730870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2993351277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x5563417204d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.403+0000 7f3b7a786740 1 -- 172.21.15.67:0/2993351277 >> 172.21.15.67:0/2993351277 conn(0x55634171df20 msgr2=0x55634171f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.404+0000 7f3b7a786740 1 -- 172.21.15.67:0/2993351277 shutdown_connections 2024-09-10T21:02:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.404+0000 7f3b7a786740 1 -- 172.21.15.67:0/2993351277 wait complete. 2024-09-10T21:02:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.405+0000 7f3b7a786740 1 -- start start 2024-09-10T21:02:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.405+0000 7f3b7a786740 1 Processor -- start 2024-09-10T21:02:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 0x556341729cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341730db0 0x55634172a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5563414e7700 con 0x556341720a10 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556341621160 con 0x5563417200f0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556341726660 con 0x556341730db0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7a786740 10 client.0 _ll_register_callbacks cb 0x55634163a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 0x556341729cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 0x556341729cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:33408/0 (socket says 172.21.15.67:33408) 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52860/0 (socket says 172.21.15.67:52860) 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 -- 172.21.15.67:0/2825954715 learned_addr learned my addr 172.21.15.67:0/2825954715 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341730db0 0x55634172a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 -- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341730db0 msgr2=0x55634172a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341730db0 0x55634172a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 -- 172.21.15.67:0/2825954715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 msgr2=0x556341729cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 0x556341729cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.406+0000 7f3b7594c640 1 -- 172.21.15.67:0/2825954715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634164ec90 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7594c640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3b6002a930 tx=0x7f3b60041f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45b624a65ba55d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60035040 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b68004050 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3b60032db0 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b600314a0 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 10 client.16719 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55634173b0e0 con 0x556341720a10 2024-09-10T21:02:37.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b68004050 con 0x556341720a10 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3b60005330 con 0x556341720a10 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 10 client.16719 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 10 client.16719 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 20 client.16719 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.407+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55634173c960 0x55634173ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.408+0000 7f3b7a786740 4 client.16719 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.408+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556341698df0 con 0x55634173c960 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.408+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55634173c960 0x55634173ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.408+0000 7f3b7694e640 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55634173c960 0x55634173ede0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c73b983516238f0 server_cookie=ec2b991993f61242 in_seq=0 out_seq=0 2024-09-10T21:02:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.408+0000 7f3b59ffb640 10 client.16719 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:02:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b59ffb640 1 -- 172.21.15.67:0/2825954715 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556341698df0 con 0x55634173c960 2024-09-10T21:02:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b59ffb640 10 client.16719 handle_command_reply: tid=0 2024-09-10T21:02:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 client.16719 shutdown 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 msgr2=0x55634172a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3b6002a930 tx=0x7f3b60041f40 comp rx=0 tx=0).stop 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 shutdown_connections 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55634173c960 0x55634173ede0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341730db0 0x55634172a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x55634172a230 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 --2- 172.21.15.67:0/2825954715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5563417200f0 0x556341729cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 >> 172.21.15.67:0/2825954715 conn(0x55634171df20 msgr2=0x556341723ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b59ffb640 0 client.16719 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 shutdown_connections 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 1 -- 172.21.15.67:0/2825954715 wait complete. 2024-09-10T21:02:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.409+0000 7f3b7a786740 20 client.16719 trim_cache size 0 max 16384 2024-09-10T21:02:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 Processor -- start 2024-09-10T21:02:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 -- start start 2024-09-10T21:02:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 0x5563417446b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x556341744bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b70b0 con 0x5563417200f0 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b4980 con 0x556341730db0 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7a786740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b27d0 con 0x556341720a10 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x556341744bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52874/0 (socket says 172.21.15.67:52874) 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.430+0000 7f3b7694e640 1 -- 172.21.15.67:0/1389230895 learned_addr learned my addr 172.21.15.67:0/1389230895 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:37.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 0x5563417446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 -- 172.21.15.67:0/1389230895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 msgr2=0x556341744bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x556341744bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 -- 172.21.15.67:0/1389230895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 msgr2=0x55634171d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7594c640 1 -- 172.21.15.67:0/1389230895 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563417281f0 con 0x556341720a10 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.431+0000 7f3b7694e640 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.432+0000 7f3b7594c640 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 0x5563417446b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b6002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cabe4c07fc06945 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.432+0000 7f3b5bfff640 1 -- 172.21.15.67:0/1389230895 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6005b030 con 0x556341720a10 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.432+0000 7f3b5bfff640 1 -- 172.21.15.67:0/1389230895 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b60031640 con 0x556341720a10 2024-09-10T21:02:37.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.432+0000 7f3b5bfff640 1 -- 172.21.15.67:0/1389230895 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60035030 con 0x556341720a10 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- 172.21.15.67:0/1389230895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 msgr2=0x5563417446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 0x5563417446b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b60000c00 tx=0x7f3b6002a410 comp rx=0 tx=0).stop 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- 172.21.15.67:0/1389230895 shutdown_connections 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x556341744bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556341720a10 0x5563417446b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 --2- 172.21.15.67:0/1389230895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5563417200f0 0x55634171d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- 172.21.15.67:0/1389230895 >> 172.21.15.67:0/1389230895 conn(0x55634171df20 msgr2=0x556341728570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- 172.21.15.67:0/1389230895 shutdown_connections 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- 172.21.15.67:0/1389230895 wait complete. 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 -- start start 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.433+0000 7f3b7a786740 1 Processor -- start 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x556341738d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x5563417357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b2e40 con 0x556341720a10 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b42b0 con 0x556341730db0 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b3510 con 0x5563417200f0 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7a786740 10 client.0 _ll_register_callbacks cb 0x7f3b60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36902/0 (socket says 172.21.15.67:36902) 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 -- 172.21.15.67:0/3143306506 learned_addr learned my addr 172.21.15.67:0/3143306506 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x5563417357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7594c640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x556341738d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 -- 172.21.15.67:0/3143306506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 msgr2=0x5563417357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x5563417357d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 -- 172.21.15.67:0/3143306506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 msgr2=0x556341738d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x556341738d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7694e640 1 -- 172.21.15.67:0/3143306506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556341735d10 con 0x5563417200f0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.434+0000 7f3b7594c640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x556341738d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.435+0000 7f3b7694e640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b68006010 tx=0x7f3b68011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11fbe75c1a3548b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.435+0000 7f3b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.435+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68047030 con 0x5563417200f0 2024-09-10T21:02:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.435+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3b68003e90 con 0x5563417200f0 2024-09-10T21:02:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b60031640 con 0x5563417200f0 2024-09-10T21:02:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b6801d040 con 0x5563417200f0 2024-09-10T21:02:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b7a786740 10 client.26398 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5563417a9fc0 con 0x5563417200f0 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b68004540 con 0x5563417200f0 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.436+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3b68023040 con 0x5563417200f0 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 10 client.26398 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 10 client.26398 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 20 client.26398 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5563417aa510 0x5563417ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 4 client.26398 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3b60031640 con 0x5563417aa510 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b7594c640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5563417aa510 0x5563417ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.437+0000 7f3b59ffb640 10 client.26398 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7594c640 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5563417aa510 0x5563417ac930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3100bef80bf0d140 server_cookie=372375f7159e3a5 in_seq=0 out_seq=0 2024-09-10T21:02:37.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b59ffb640 1 -- 172.21.15.67:0/3143306506 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3b60031640 con 0x5563417aa510 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b59ffb640 10 client.26398 handle_command_reply: tid=0 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 client.26398 shutdown 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 msgr2=0x556341738800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b68006010 tx=0x7f3b68011900 comp rx=0 tx=0).stop 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 shutdown_connections 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5563417aa510 0x5563417ac930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556341730db0 0x5563417357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556341720a10 0x556341738d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 --2- 172.21.15.67:0/3143306506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563417200f0 0x556341738800 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b59ffb640 0 client.26398 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 >> 172.21.15.67:0/3143306506 conn(0x55634171df20 msgr2=0x55634172b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.438+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 shutdown_connections 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b7a786740 1 -- 172.21.15.67:0/3143306506 wait complete. 2024-09-10T21:02:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b7a786740 20 client.26398 trim_cache size 0 max 16384 2024-09-10T21:02:37.447 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:02:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 msgr2=0x7f3b5c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 0x7f3b5c0b7820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c6a0 tx=0x7f3b6c009590 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 msgr2=0x7f3b70074770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e9f0 tx=0x7f3b6c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 shutdown_connections 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b70106f20 0x7f3b7006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b701018f0 0x7f3b70074cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3b5c0b5360 0x7f3b5c0b7820 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 --2- 172.21.15.67:0/3077758658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b70100fd0 0x7f3b70074770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 >> 172.21.15.67:0/3077758658 conn(0x7f3b700fca20 msgr2=0x7f3b701047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 shutdown_connections 2024-09-10T21:02:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:37.439+0000 7f3b783b1640 1 -- 172.21.15.67:0/3077758658 wait complete. 2024-09-10T21:02:38.374 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:38 smithi067 ceph-mon[30891]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-10T21:02:38.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:02:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:38 smithi083 ceph-mon[35058]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-10T21:02:38.661 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:38 smithi172 ceph-mon[35265]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 740 op/s 2024-09-10T21:02:39.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 665.0 s, 1309.2 tps, lat 53.706 ms stddev 95.508 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 -- 172.21.15.67:0/1306484732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4714108020 msgr2=0x7f471410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 --2- 172.21.15.67:0/1306484732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4714108020 0x7f471410e820 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f470c009ca0 tx=0x7f470c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 -- 172.21.15.67:0/1306484732 shutdown_connections 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 --2- 172.21.15.67:0/1306484732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4714108020 0x7f471410e820 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 --2- 172.21.15.67:0/1306484732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47141076a0 0x7f4714107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 --2- 172.21.15.67:0/1306484732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714101c90 0x7f4714102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.192+0000 7f4718953640 1 -- 172.21.15.67:0/1306484732 >> 172.21.15.67:0/1306484732 conn(0x7f47140fd700 msgr2=0x7f47140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 -- 172.21.15.67:0/1306484732 shutdown_connections 2024-09-10T21:02:39.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 -- 172.21.15.67:0/1306484732 wait complete. 2024-09-10T21:02:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 Processor -- start 2024-09-10T21:02:39.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 -- start start 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 0x7f47140fded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.193+0000 7f4718953640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4718953640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714108020 0x7f47140fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4718953640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111ca0 con 0x7f47141076a0 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4718953640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111b20 con 0x7f4714108020 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4718953640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111e20 con 0x7f4714101c90 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 0x7f47140fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52898/0 (socket says 172.21.15.67:52898) 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470bfff640 1 -- 172.21.15.67:0/3433688210 learned_addr learned my addr 172.21.15.67:0/3433688210 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4712d9d640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714108020 0x7f47140fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 -- 172.21.15.67:0/3433688210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714108020 msgr2=0x7f47140fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714108020 0x7f47140fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 -- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 msgr2=0x7f47140fe410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 -- 172.21.15.67:0/3433688210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141a7660 con 0x7f4714101c90 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470bfff640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f471259c640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 0x7f47140fded0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9f0 tx=0x7f470400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470b7fe640 1 -- 172.21.15.67:0/3433688210 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470400ccc0 con 0x7f4714101c90 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f470b7fe640 1 -- 172.21.15.67:0/3433688210 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47040108e0 con 0x7f4714101c90 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.194+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141a7950 con 0x7f4714101c90 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.195+0000 7f470b7fe640 1 -- 172.21.15.67:0/3433688210 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704018880 con 0x7f4714101c90 2024-09-10T21:02:39.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.195+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a7e90 con 0x7f4714101c90 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 Processor -- start 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f470b7fe640 1 -- 172.21.15.67:0/3433688210 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f4704010430 con 0x7f4714101c90 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 -- start start 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x5564647404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646474c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5564646b6ea0 con 0x55646474c9a0 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5564646a62d0 con 0x5564647400f0 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.197+0000 7f471ad28740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5564646aa0e0 con 0x556464740a10 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x5564647404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52904/0 (socket says 172.21.15.67:52904) 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f470bfff640 1 -- 172.21.15.67:0/829863958 learned_addr learned my addr 172.21.15.67:0/829863958 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f471259c640 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646474c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 -- 172.21.15.67:0/829863958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 msgr2=0x55646474c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646474c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 -- 172.21.15.67:0/829863958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 msgr2=0x55646474ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 -- 172.21.15.67:0/829863958 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556464404650 con 0x5564647400f0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f470bfff640 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f470b7fe640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 0x7f47000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f471259c640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 0x7f47000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.198+0000 7f4712d9d640 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x5564647404d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47140fff90 tx=0x7f470c005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35e982cc13acfc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f4708ff9640 1 -- 172.21.15.67:0/829863958 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c031cf0 con 0x5564647400f0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f470b7fe640 1 -- 172.21.15.67:0/3433688210 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f47040e5ec0 con 0x7f4714101c90 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f4708ff9640 1 -- 172.21.15.67:0/829863958 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c036030 con 0x5564647400f0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f4708ff9640 1 -- 172.21.15.67:0/829863958 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c004240 con 0x5564647400f0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f471ad28740 1 -- 172.21.15.67:0/829863958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 msgr2=0x5564647404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f471259c640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 0x7f47000b77a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f47040e3d60 tx=0x7f47040e99a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.199+0000 7f471ad28740 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x5564647404d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47140fff90 tx=0x7f470c005ef0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- 172.21.15.67:0/829863958 shutdown_connections 2024-09-10T21:02:39.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646474c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- 172.21.15.67:0/829863958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x5564647404d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- 172.21.15.67:0/829863958 >> 172.21.15.67:0/829863958 conn(0x55646473df20 msgr2=0x55646473f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- 172.21.15.67:0/829863958 shutdown_connections 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- 172.21.15.67:0/829863958 wait complete. 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- start start 2024-09-10T21:02:39.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 Processor -- start 2024-09-10T21:02:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x5564647496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55646474c9a0 0x556464749ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556464507700 con 0x556464740a10 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556464641160 con 0x5564647400f0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.200+0000 7f471ad28740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55646474f440 con 0x55646474c9a0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f471ad28740 10 client.0 _ll_register_callbacks cb 0x55646465a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x5564647496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:33454/0 (socket says 172.21.15.67:33454) 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 -- 172.21.15.67:0/61322880 learned_addr learned my addr 172.21.15.67:0/61322880 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55646474c9a0 0x556464749ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 -- 172.21.15.67:0/61322880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55646474c9a0 msgr2=0x556464749ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55646474c9a0 0x556464749ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 -- 172.21.15.67:0/61322880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 msgr2=0x5564647496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x5564647496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 -- 172.21.15.67:0/61322880 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646466ec90 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f4712d9d640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f470c005c90 tx=0x7f470c0095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f4886a867e9677 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f46f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c059060 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f470c0045e0 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f470c036030 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.201+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f470c0047e0 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 10 client.26459 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55646475ad50 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c036030 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f470c043070 con 0x5564647400f0 2024-09-10T21:02:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 10 client.26459 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 10 client.26459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 20 client.26459 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55646475c0a0 0x55646475e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 4 client.26459 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564646b8df0 con 0x55646475c0a0 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.202+0000 7f470bfff640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55646475c0a0 0x55646475e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.203+0000 7f46f9ffb640 10 client.26459 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.203+0000 7f470bfff640 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55646475c0a0 0x55646475e490 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f6f537e4e25692 server_cookie=e771afee93e7a5fb in_seq=0 out_seq=0 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.203+0000 7f46f9ffb640 1 -- 172.21.15.67:0/61322880 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564646b8df0 con 0x55646475c0a0 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.203+0000 7f46f9ffb640 10 client.26459 handle_command_reply: tid=0 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.203+0000 7f471ad28740 1 client.26459 shutdown 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 msgr2=0x55646474c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f470c005c90 tx=0x7f470c0095e0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 shutdown_connections 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55646475c0a0 0x55646475e490 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55646474c9a0 0x556464749ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x5564647496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 --2- 172.21.15.67:0/61322880 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x55646474c270 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f46f9ffb640 0 client.26459 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 >> 172.21.15.67:0/61322880 conn(0x55646473df20 msgr2=0x556464743a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 shutdown_connections 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 1 -- 172.21.15.67:0/61322880 wait complete. 2024-09-10T21:02:39.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.204+0000 7f471ad28740 20 client.26459 trim_cache size 0 max 16384 2024-09-10T21:02:39.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.217+0000 7f471ad28740 1 Processor -- start 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.217+0000 7f471ad28740 1 -- start start 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x556464758670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646473f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47141b2cd0 con 0x55646474c9a0 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47141b05a0 con 0x5564647400f0 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f471ad28740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ae3f0 con 0x556464740a10 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x556464758670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52926/0 (socket says 172.21.15.67:52926) 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 -- 172.21.15.67:0/1551129060 learned_addr learned my addr 172.21.15.67:0/1551129060 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f470bfff640 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646473f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 -- 172.21.15.67:0/1551129060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 msgr2=0x55646473f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646473f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 -- 172.21.15.67:0/1551129060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 msgr2=0x556464758670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x556464758670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 -- 172.21.15.67:0/1551129060 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556464740840 con 0x55646474c9a0 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f470c003d90 tx=0x7f470c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828bcc3d46102b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f46fbfff640 1 -- 172.21.15.67:0/1551129060 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c065070 con 0x55646474c9a0 2024-09-10T21:02:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f46fbfff640 1 -- 172.21.15.67:0/1551129060 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c036040 con 0x55646474c9a0 2024-09-10T21:02:39.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.218+0000 7f46fbfff640 1 -- 172.21.15.67:0/1551129060 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c02f780 con 0x55646474c9a0 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 -- 172.21.15.67:0/1551129060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 msgr2=0x55646474dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f470c003d90 tx=0x7f470c000f40 comp rx=0 tx=0).stop 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 -- 172.21.15.67:0/1551129060 shutdown_connections 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55646474c9a0 0x55646474dd90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556464740a10 0x55646473f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 --2- 172.21.15.67:0/1551129060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5564647400f0 0x556464758670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 -- 172.21.15.67:0/1551129060 >> 172.21.15.67:0/1551129060 conn(0x55646473df20 msgr2=0x55646474b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 -- 172.21.15.67:0/1551129060 shutdown_connections 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.219+0000 7f471ad28740 1 -- 172.21.15.67:0/1551129060 wait complete. 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 -- start start 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 Processor -- start 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 0x5564647548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646474c9a0 0x55646474f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f47141aea60 con 0x556464740a10 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47141afed0 con 0x55646474c9a0 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47141af130 con 0x5564647400f0 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f471ad28740 10 client.0 _ll_register_callbacks cb 0x7f46fc009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f470bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52938/0 (socket says 172.21.15.67:52938) 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f470bfff640 1 -- 172.21.15.67:0/1746546719 learned_addr learned my addr 172.21.15.67:0/1746546719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646474c9a0 0x55646474f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.220+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 0x5564647548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 -- 172.21.15.67:0/1746546719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 msgr2=0x5564647548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 0x5564647548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 -- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646474c9a0 msgr2=0x55646474f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646474c9a0 0x55646474f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 -- 172.21.15.67:0/1746546719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55646474fe20 con 0x556464740a10 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 0x5564647548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f470bfff640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55646475eaf0 tx=0x7f46fc012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7296bbabc19d0181 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f46f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc004250 con 0x556464740a10 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f46fc0043f0 con 0x556464740a10 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f470c036040 con 0x556464740a10 2024-09-10T21:02:39.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f46fc0108e0 con 0x556464740a10 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f471ad28740 10 client.16740 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5564647c9860 con 0x556464740a10 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.221+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f470c036040 con 0x556464740a10 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f46fc003b20 con 0x556464740a10 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 10 client.16740 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 20 client.16740 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5564647ca040 0x5564647cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 4 client.16740 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564646b48a0 con 0x5564647ca040 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5564647ca040 0x5564647cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:39.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f46f9ffb640 10 client.16740 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f4712d9d640 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5564647ca040 0x5564647cc430 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe29000472e025a4 server_cookie=47e376dcad948193 in_seq=0 out_seq=0 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f46f9ffb640 1 -- 172.21.15.67:0/1746546719 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564646b48a0 con 0x5564647ca040 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f46f9ffb640 10 client.16740 handle_command_reply: tid=0 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.222+0000 7f471ad28740 1 client.16740 shutdown 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 msgr2=0x556464754e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55646475eaf0 tx=0x7f46fc012ba0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 shutdown_connections 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5564647ca040 0x5564647cc430 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55646474c9a0 0x55646474f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556464740a10 0x556464754e20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f46f9ffb640 0 client.16740 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 --2- 172.21.15.67:0/1746546719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564647400f0 0x5564647548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 >> 172.21.15.67:0/1746546719 conn(0x55646473df20 msgr2=0x55646473c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 shutdown_connections 2024-09-10T21:02:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 1 -- 172.21.15.67:0/1746546719 wait complete. 2024-09-10T21:02:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f471ad28740 20 client.16740 trim_cache size 0 max 16384 2024-09-10T21:02:39.233 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:02:39.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 msgr2=0x7f47000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 0x7f47000b77a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f47040e3d60 tx=0x7f47040e99a0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 msgr2=0x7f47140fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.223+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 0x7f47140fded0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f470400e9f0 tx=0x7f470400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 shutdown_connections 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4714108020 0x7f47140fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47141076a0 0x7f47140fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f47000b52e0 0x7f47000b77a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 --2- 172.21.15.67:0/3433688210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714101c90 0x7f47140fded0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 >> 172.21.15.67:0/3433688210 conn(0x7f47140fd700 msgr2=0x7f471406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 shutdown_connections 2024-09-10T21:02:39.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:39.224+0000 7f4718953640 1 -- 172.21.15.67:0/3433688210 wait complete. 2024-09-10T21:02:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:40 smithi067 ceph-mon[30891]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 764 op/s 2024-09-10T21:02:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:40 smithi083 ceph-mon[35058]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 764 op/s 2024-09-10T21:02:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:40 smithi172 ceph-mon[35265]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 764 op/s 2024-09-10T21:02:40.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:02:40.989 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:02:41.251 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:41.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 -- 172.21.15.67:0/691916876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 msgr2=0x7facb410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 --2- 172.21.15.67:0/691916876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb410f550 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7facac009ca0 tx=0x7facac02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 -- 172.21.15.67:0/691916876 shutdown_connections 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 --2- 172.21.15.67:0/691916876 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb410f550 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 --2- 172.21.15.67:0/691916876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4104530 0x7facb410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 --2- 172.21.15.67:0/691916876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4103b30 0x7facb4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 -- 172.21.15.67:0/691916876 >> 172.21.15.67:0/691916876 conn(0x7facb40fd700 msgr2=0x7facb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 -- 172.21.15.67:0/691916876 shutdown_connections 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.750+0000 7facbab05640 1 -- 172.21.15.67:0/691916876 wait complete. 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 Processor -- start 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 -- start start 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4103b30 0x7facb41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4104530 0x7facb4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facb4112d60 con 0x7facb410d0e0 2024-09-10T21:02:41.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facb4112be0 con 0x7facb4103b30 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facbab05640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb4112ee0 con 0x7facb4104530 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facb90a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facb90a2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52942/0 (socket says 172.21.15.67:52942) 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facb90a2640 1 -- 172.21.15.67:0/2719907293 learned_addr learned my addr 172.21.15.67:0/2719907293 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facb88a1640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4103b30 0x7facb41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.751+0000 7facb3fff640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4104530 0x7facb4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 -- 172.21.15.67:0/2719907293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4104530 msgr2=0x7facb4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4104530 0x7facb4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 -- 172.21.15.67:0/2719907293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4103b30 msgr2=0x7facb41991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4103b30 0x7facb41991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 -- 172.21.15.67:0/2719907293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb419f280 con 0x7facb410d0e0 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb90a2640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7facac0098d0 tx=0x7facac0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb1ffb640 1 -- 172.21.15.67:0/2719907293 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac003b70 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb1ffb640 1 -- 172.21.15.67:0/2719907293 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facac003d10 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb419f510 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facb1ffb640 1 -- 172.21.15.67:0/2719907293 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac02f9d0 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.752+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb41a5c30 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facb1ffb640 1 -- 172.21.15.67:0/2719907293 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7facac02fb90 con 0x7facb410d0e0 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 Processor -- start 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 -- start start 2024-09-10T21:02:41.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d117250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d119b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a0d081e60 con 0x559a0d10aee0 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559a0d071290 con 0x559a0d10b800 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facbceda740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a0d0750a0 con 0x559a0d117790 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.755+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52956/0 (socket says 172.21.15.67:52956) 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb88a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d117250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 -- 172.21.15.67:0/2300799492 learned_addr learned my addr 172.21.15.67:0/2300799492 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 -- 172.21.15.67:0/2300799492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 msgr2=0x559a0d119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d119b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 -- 172.21.15.67:0/2300799492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 msgr2=0x559a0d117250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d117250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb1ffb640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 0x7faca40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 -- 172.21.15.67:0/2300799492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0cdcf930 con 0x559a0d10aee0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb88a1640 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d117250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb90a2640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 0x7faca40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb3fff640 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faca0014940 tx=0x7faca000a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62d48295507e726 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7facb1ffb640 1 -- 172.21.15.67:0/2719907293 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7facac106d20 con 0x7facb410d0e0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7fac9effd640 1 -- 172.21.15.67:0/2300799492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca00142d0 con 0x559a0d10aee0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7fac9effd640 1 -- 172.21.15.67:0/2300799492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca000fe20 con 0x559a0d10aee0 2024-09-10T21:02:41.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.756+0000 7fac9effd640 1 -- 172.21.15.67:0/2300799492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca00049c0 con 0x559a0d10aee0 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- 172.21.15.67:0/2300799492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 msgr2=0x559a0d10b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faca0014940 tx=0x7faca000a6d0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facb90a2640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 0x7faca40b7820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7facac0ca780 tx=0x7facac0967c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- 172.21.15.67:0/2300799492 shutdown_connections 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d117250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 --2- 172.21.15.67:0/2300799492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d10b2c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- 172.21.15.67:0/2300799492 >> 172.21.15.67:0/2300799492 conn(0x559a0d108d10 msgr2=0x559a0d109eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- 172.21.15.67:0/2300799492 shutdown_connections 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- 172.21.15.67:0/2300799492 wait complete. 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.757+0000 7facbceda740 1 -- start start 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 Processor -- start 2024-09-10T21:02:41.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d1147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d114d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d115240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x559a0ced2890 con 0x559a0d10aee0 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559a0d00bd40 con 0x559a0d10b800 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a0d11a440 con 0x559a0d117790 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facbceda740 10 client.0 _ll_register_callbacks cb 0x559a0d06fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d1147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d1147c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52962/0 (socket says 172.21.15.67:52962) 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facb3fff640 1 -- 172.21.15.67:0/4182478096 learned_addr learned my addr 172.21.15.67:0/4182478096 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facb88a1640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d114d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.758+0000 7facb3fff640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d115240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 -- 172.21.15.67:0/4182478096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 msgr2=0x559a0d115240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d115240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 -- 172.21.15.67:0/4182478096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 msgr2=0x559a0d1147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d1147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 -- 172.21.15.67:0/4182478096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0d1238a0 con 0x559a0d10b800 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb3fff640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d115240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facb88a1640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d114d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faca8009a00 tx=0x7faca8009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad961a4cfcdbc081 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7fac93fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8023060 con 0x559a0d10b800 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca000fe20 con 0x559a0d10b800 2024-09-10T21:02:41.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7faca800e970 con 0x559a0d10b800 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faca800eb70 con 0x559a0d10b800 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facbceda740 10 client.26474 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559a0d126290 con 0x559a0d10b800 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.759+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca000fe20 con 0x559a0d10b800 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7faca80293b0 con 0x559a0d10b800 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 10 client.26474 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 10 client.26474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 20 client.26474 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d127750 0x559a0d129ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 4 client.26474 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a0d083db0 con 0x559a0d127750 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facb3fff640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d127750 0x559a0d129ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7fac93fff640 10 client.26474 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.760+0000 7facb3fff640 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d127750 0x559a0d129ba0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edd981608e178d81 server_cookie=230c820808285590 in_seq=0 out_seq=0 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7fac93fff640 1 -- 172.21.15.67:0/4182478096 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a0d083db0 con 0x559a0d127750 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7fac93fff640 10 client.26474 handle_command_reply: tid=0 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 client.26474 shutdown 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 msgr2=0x559a0d114d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d114d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faca8009a00 tx=0x7faca8009ec0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 shutdown_connections 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d127750 0x559a0d129ba0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d117790 0x559a0d115240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10b800 0x559a0d114d00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 --2- 172.21.15.67:0/4182478096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d10aee0 0x559a0d1147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 >> 172.21.15.67:0/4182478096 conn(0x559a0d108d10 msgr2=0x559a0d107f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7fac93fff640 0 client.26474 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:41.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 shutdown_connections 2024-09-10T21:02:41.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 1 -- 172.21.15.67:0/4182478096 wait complete. 2024-09-10T21:02:41.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.761+0000 7facbceda740 20 client.26474 trim_cache size 0 max 16384 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 Processor -- start 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 -- start start 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d116500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facb41ae8a0 con 0x559a0d117790 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facb41ac170 con 0x559a0d10aee0 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.779+0000 7facbceda740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb41a9fc0 con 0x559a0d10b800 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb88a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52970/0 (socket says 172.21.15.67:52970) 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb88a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:36984/0 (socket says 172.21.15.67:36984) 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 -- 172.21.15.67:0/503553238 learned_addr learned my addr 172.21.15.67:0/503553238 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d116500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 -- 172.21.15.67:0/503553238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 msgr2=0x559a0d1119d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 -- 172.21.15.67:0/503553238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 msgr2=0x559a0d116500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d116500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 -- 172.21.15.67:0/503553238 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0d12a220 con 0x559a0d117790 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb88a1640 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7facb3fff640 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7faca0014720 tx=0x7faca000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28129d609bea8bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7fac9e7fc640 1 -- 172.21.15.67:0/503553238 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0014280 con 0x559a0d117790 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7fac9e7fc640 1 -- 172.21.15.67:0/503553238 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca000fe20 con 0x559a0d117790 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.780+0000 7fac9e7fc640 1 -- 172.21.15.67:0/503553238 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca002dba0 con 0x559a0d117790 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 -- 172.21.15.67:0/503553238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 msgr2=0x559a0d111f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7faca0014720 tx=0x7faca000ffd0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 -- 172.21.15.67:0/503553238 shutdown_connections 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d111f10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 --2- 172.21.15.67:0/503553238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d116500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 -- 172.21.15.67:0/503553238 >> 172.21.15.67:0/503553238 conn(0x559a0d108d10 msgr2=0x559a0d115df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 -- 172.21.15.67:0/503553238 shutdown_connections 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.781+0000 7facbceda740 1 -- 172.21.15.67:0/503553238 wait complete. 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 -- start start 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 Processor -- start 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d11fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d11d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d11dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7facb41aa630 con 0x559a0d117790 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facb41abaa0 con 0x559a0d10aee0 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb41aad00 con 0x559a0d10b800 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facbceda740 10 client.0 _ll_register_callbacks cb 0x7faca8013960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:41.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d11dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facb3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d11dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52976/0 (socket says 172.21.15.67:52976) 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facb3fff640 1 -- 172.21.15.67:0/2378789791 learned_addr learned my addr 172.21.15.67:0/2378789791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facb88a1640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.782+0000 7facb3fff640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d11fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 -- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 msgr2=0x559a0d11fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d11fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 -- 172.21.15.67:0/2378789791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 msgr2=0x559a0d11dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d11dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 -- 172.21.15.67:0/2378789791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0d108b40 con 0x559a0d10b800 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facb88a1640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d11d700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faca8029850 tx=0x7faca8013ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259b9c4cfff73f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7fac93fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8037060 con 0x559a0d10b800 2024-09-10T21:02:41.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7faca80293b0 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca000fe20 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faca802e040 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.783+0000 7facbceda740 10 client.26431 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559a0d195350 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca000fe20 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7faca8031030 con 0x559a0d10b800 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 10 client.26431 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 10 client.26431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 20 client.26431 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d195ac0 0x559a0d197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 4 client.26431 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:02:41.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559a0d07f860 con 0x559a0d195ac0 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facb3fff640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d195ac0 0x559a0d197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7facb3fff640 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d195ac0 0x559a0d197ee0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67893ae1a6ce1c21 server_cookie=8be2f25991a03567 in_seq=0 out_seq=0 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.784+0000 7fac93fff640 10 client.26431 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7fac93fff640 1 -- 172.21.15.67:0/2378789791 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559a0d07f860 con 0x559a0d195ac0 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7fac93fff640 10 client.26431 handle_command_reply: tid=0 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 client.26431 shutdown 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 msgr2=0x559a0d11d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d11d700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faca8029850 tx=0x7faca8013ef0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 shutdown_connections 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x559a0d195ac0 0x559a0d197ee0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x559a0d117790 0x559a0d11dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a0d10b800 0x559a0d11d700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7fac93fff640 0 client.26431 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 --2- 172.21.15.67:0/2378789791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559a0d10aee0 0x559a0d11fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 >> 172.21.15.67:0/2378789791 conn(0x559a0d108d10 msgr2=0x559a0d114f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 shutdown_connections 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 1 -- 172.21.15.67:0/2378789791 wait complete. 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.786+0000 7facbceda740 20 client.26431 trim_cache size 0 max 16384 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "dce5d13a-8bd9-49f2-a2e0-59003826ab2e", 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:02:41.803 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 msgr2=0x7faca40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 0x7faca40b7820 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7facac0ca780 tx=0x7facac0967c0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 msgr2=0x7facb419eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7facac0098d0 tx=0x7facac0317b0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 shutdown_connections 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7facb410d0e0 0x7facb419eab0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7faca40b5360 0x7faca40b7820 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb4104530 0x7facb4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 --2- 172.21.15.67:0/2719907293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facb4103b30 0x7facb41991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:41.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 >> 172.21.15.67:0/2719907293 conn(0x7facb40fd700 msgr2=0x7facb40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:41.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 shutdown_connections 2024-09-10T21:02:41.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:41.787+0000 7facbab05640 1 -- 172.21.15.67:0/2719907293 wait complete. 2024-09-10T21:02:42.511 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:42 smithi067 ceph-mon[30891]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 846 op/s 2024-09-10T21:02:42.544 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:02:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:42 smithi083 ceph-mon[35058]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 846 op/s 2024-09-10T21:02:42.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:42 smithi172 ceph-mon[35265]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 846 op/s 2024-09-10T21:02:42.808 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:02:43.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 -- 172.21.15.67:0/3479607843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 msgr2=0x7f698c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3479607843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c107ae0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6974009900 tx=0x7f697402a410 comp rx=0 tx=0).stop 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 -- 172.21.15.67:0/3479607843 shutdown_connections 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3479607843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3479607843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c107ae0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3479607843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 -- 172.21.15.67:0/3479607843 >> 172.21.15.67:0/3479607843 conn(0x7f698c0fd700 msgr2=0x7f698c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 -- 172.21.15.67:0/3479607843 shutdown_connections 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.307+0000 7f6990ad6640 1 -- 172.21.15.67:0/3479607843 wait complete. 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 Processor -- start 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 -- start start 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f698c111ca0 con 0x7f698c1076a0 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f698c111b20 con 0x7f698c108020 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6990ad6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f698c111e20 con 0x7f698c101c90 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56174/0 (socket says 172.21.15.67:56174) 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 -- 172.21.15.67:0/3745007650 learned_addr learned my addr 172.21.15.67:0/3745007650 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f698a59c640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 -- 172.21.15.67:0/3745007650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 msgr2=0x7f698c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 -- 172.21.15.67:0/3745007650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 msgr2=0x7f698c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f6983fff640 1 -- 172.21.15.67:0/3745007650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c19f390 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.308+0000 7f698a59c640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f6983fff640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6974005940 tx=0x7f69740040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f69837fe640 1 -- 172.21.15.67:0/3745007650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697403f030 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c19f620 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f69837fe640 1 -- 172.21.15.67:0/3745007650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69740044c0 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f69837fe640 1 -- 172.21.15.67:0/3745007650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974035070 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.309+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c1a5d40 con 0x7f698c1076a0 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 Processor -- start 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 -- start start 2024-09-10T21:02:43.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f69837fe640 1 -- 172.21.15.67:0/3745007650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f697403ba20 con 0x7f698c1076a0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf11a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf12d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560fdf090e50 con 0x560fdf12ad60 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560fdf080280 con 0x560fdf11a9c0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6992eab740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fdf084090 con 0x560fdf11a0a0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf12d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f698a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f698a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:35826/0 (socket says 172.21.15.67:35826) 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f698a59c640 1 -- 172.21.15.67:0/3706512856 learned_addr learned my addr 172.21.15.67:0/3706512856 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf12d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56176/0 (socket says 172.21.15.67:56176) 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.312+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf11a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 -- 172.21.15.67:0/3706512856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 msgr2=0x560fdf11a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf11a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 -- 172.21.15.67:0/3706512856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 msgr2=0x560fdf12d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf12d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 -- 172.21.15.67:0/3706512856 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdedde650 con 0x560fdf11a9c0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698a59c640 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f697c0115c0 tx=0x7f697c011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bfaf1e96056c520 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f6980ff9640 1 -- 172.21.15.67:0/3706512856 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c00f640 con 0x560fdf11a9c0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f6980ff9640 1 -- 172.21.15.67:0/3706512856 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f697c00fc90 con 0x560fdf11a9c0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f6980ff9640 1 -- 172.21.15.67:0/3706512856 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c019ce0 con 0x560fdf11a9c0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f69837fe640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 0x7f69780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 0x7f69780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.313+0000 7f69837fe640 1 -- 172.21.15.67:0/3745007650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6974106120 con 0x7f698c1076a0 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- 172.21.15.67:0/3706512856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 msgr2=0x560fdf12a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f697c0115c0 tx=0x7f697c011a80 comp rx=0 tx=0).stop 2024-09-10T21:02:43.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 0x7f69780b7820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6984009fd0 tx=0x7f6984009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- 172.21.15.67:0/3706512856 shutdown_connections 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf12d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf12a820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 --2- 172.21.15.67:0/3706512856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf11a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- 172.21.15.67:0/3706512856 >> 172.21.15.67:0/3706512856 conn(0x560fdf117ed0 msgr2=0x560fdf119070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- 172.21.15.67:0/3706512856 shutdown_connections 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- 172.21.15.67:0/3706512856 wait complete. 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 -- start start 2024-09-10T21:02:43.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.314+0000 7f6992eab740 1 Processor -- start 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf12a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf128050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x560fdeee1700 con 0x560fdf12ad60 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560fdf01b110 con 0x560fdf11a9c0 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fdf12da10 con 0x560fdf11a0a0 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6992eab740 10 client.0 _ll_register_callbacks cb 0x560fdf034990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f698ad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf128050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:35838/0 (socket says 172.21.15.67:35838) 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 -- 172.21.15.67:0/3196906393 learned_addr learned my addr 172.21.15.67:0/3196906393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f698a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf12a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 -- 172.21.15.67:0/3196906393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 msgr2=0x560fdf12a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf12a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 -- 172.21.15.67:0/3196906393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 msgr2=0x560fdf128050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf128050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 -- 172.21.15.67:0/3196906393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdf048c40 con 0x560fdf11a9c0 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf128050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f698a59c640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf12a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6983fff640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f69740c9c30 tx=0x7f6974009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39711b8f7c03401 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.315+0000 7f6971ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974049040 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f69740c8c30 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f697c00fc90 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f69740cc790 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 10 client.26492 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560fdf139340 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f697c00fc90 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f69740ef030 con 0x560fdf11a9c0 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 10 client.26492 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 10 client.26492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 20 client.26492 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf13a840 0x560fdf13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 4 client.26492 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fdf092da0 con 0x560fdf13a840 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.316+0000 7f698a59c640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf13a840 0x560fdf13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.317+0000 7f698a59c640 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf13a840 0x560fdf13cc70 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44537192733fe42 server_cookie=5863ddf527742abb in_seq=0 out_seq=0 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.317+0000 7f6971ffb640 10 client.26492 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.317+0000 7f6971ffb640 1 -- 172.21.15.67:0/3196906393 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fdf092da0 con 0x560fdf13a840 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.317+0000 7f6971ffb640 10 client.26492 handle_command_reply: tid=0 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.317+0000 7f6992eab740 1 client.26492 shutdown 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 msgr2=0x560fdf127a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f69740c9c30 tx=0x7f6974009620 comp rx=0 tx=0).stop 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 shutdown_connections 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf13a840 0x560fdf13cc70 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf12ad60 0x560fdf128050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf127a70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 --2- 172.21.15.67:0/3196906393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf11a0a0 0x560fdf12a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6971ffb640 0 client.26492 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 >> 172.21.15.67:0/3196906393 conn(0x560fdf117ed0 msgr2=0x560fdf11da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 shutdown_connections 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 1 -- 172.21.15.67:0/3196906393 wait complete. 2024-09-10T21:02:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.318+0000 7f6992eab740 20 client.26492 trim_cache size 0 max 16384 2024-09-10T21:02:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 Processor -- start 2024-09-10T21:02:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 -- start start 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a0a0 0x560fdf136c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf1297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1ae920 con 0x560fdf11a9c0 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1ac1f0 con 0x560fdf11a0a0 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6992eab740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1aa040 con 0x560fdf12ad60 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56188/0 (socket says 172.21.15.67:56188) 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 -- 172.21.15.67:0/3876575708 learned_addr learned my addr 172.21.15.67:0/3876575708 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f698a59c640 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a0a0 0x560fdf136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf1297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 -- 172.21.15.67:0/3876575708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 msgr2=0x560fdf1297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf1297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 -- 172.21.15.67:0/3876575708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a0a0 msgr2=0x560fdf136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.336+0000 7f6983fff640 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a0a0 0x560fdf136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.337+0000 7f6983fff640 1 -- 172.21.15.67:0/3876575708 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fdf12b6e0 con 0x560fdf11a9c0 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.337+0000 7f6983fff640 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f69740cc6c0 tx=0x7f697403b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21d6534a74c7647 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.337+0000 7f6973fff640 1 -- 172.21.15.67:0/3876575708 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974049040 con 0x560fdf11a9c0 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.337+0000 7f6973fff640 1 -- 172.21.15.67:0/3876575708 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69740cc4d0 con 0x560fdf11a9c0 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.337+0000 7f6973fff640 1 -- 172.21.15.67:0/3876575708 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69740cc130 con 0x560fdf11a9c0 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- 172.21.15.67:0/3876575708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 msgr2=0x560fdf112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f69740cc6c0 tx=0x7f697403b4f0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- 172.21.15.67:0/3876575708 shutdown_connections 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf1297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a9c0 0x560fdf112ef0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 --2- 172.21.15.67:0/3876575708 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a0a0 0x560fdf136c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- 172.21.15.67:0/3876575708 >> 172.21.15.67:0/3876575708 conn(0x560fdf117ed0 msgr2=0x560fdf1290a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- 172.21.15.67:0/3876575708 shutdown_connections 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- 172.21.15.67:0/3876575708 wait complete. 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 -- start start 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.338+0000 7f6992eab740 1 Processor -- start 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf133210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf12fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1aa6b0 con 0x560fdf11a0a0 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1abb20 con 0x560fdf11a9c0 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f698c1aad80 con 0x560fdf12ad60 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 10 client.0 _ll_register_callbacks cb 0x7f69741098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f698a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f698a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56192/0 (socket says 172.21.15.67:56192) 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f698a59c640 1 -- 172.21.15.67:0/3939253300 learned_addr learned my addr 172.21.15.67:0/3939253300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f698ad9d640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf12fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 -- 172.21.15.67:0/3939253300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 msgr2=0x560fdf12fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf12fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 -- 172.21.15.67:0/3939253300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 msgr2=0x560fdf132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 -- 172.21.15.67:0/3939253300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fdf1339f0 con 0x560fdf11a9c0 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f698a59c640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6983fff640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf133210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f697402a450 tx=0x7f6974103ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1326892e417e462 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6971ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:02:43.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974049050 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f69740ccc20 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.339+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69740cc4d0 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f69740cc310 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 10 client.26498 fetch_fsmap learned FSMap version 34 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560fdf1339f0 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69740cc4d0 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f69740ef070 con 0x560fdf11a9c0 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 10 client.26498 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 20 client.26498 populate_metadata read hostname 'smithi067' 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf1a8070 0x560fdf1aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 4 client.26498 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:02:43.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560fdf08e850 con 0x560fdf1a8070 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.340+0000 7f698a59c640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf1a8070 0x560fdf1aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f698a59c640 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf1a8070 0x560fdf1aa490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1241b384e5dc902 server_cookie=c47fad62a2a4e005 in_seq=0 out_seq=0 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6971ffb640 10 client.26498 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6971ffb640 1 -- 172.21.15.67:0/3939253300 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4836 (crc 0 0 0) 0x560fdf08e850 con 0x560fdf1a8070 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6971ffb640 10 client.26498 handle_command_reply: tid=0 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 client.26498 shutdown 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 msgr2=0x560fdf133210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf133210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f697402a450 tx=0x7f6974103ca0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 shutdown_connections 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560fdf1a8070 0x560fdf1aa490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fdf12ad60 0x560fdf12fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560fdf11a9c0 0x560fdf133210 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6971ffb640 0 client.26498 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 --2- 172.21.15.67:0/3939253300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560fdf11a0a0 0x560fdf132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 >> 172.21.15.67:0/3939253300 conn(0x560fdf117ed0 msgr2=0x560fdf118bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 shutdown_connections 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 1 -- 172.21.15.67:0/3939253300 wait complete. 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.341+0000 7f6992eab740 20 client.26498 trim_cache size 0 max 16384 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "scrub active (0 inodes in the stack)", 2024-09-10T21:02:43.355 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "dce5d13a-8bd9-49f2-a2e0-59003826ab2e", 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.356 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:02:43.357 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.358 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.359 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:02:43.360 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:02:43.362 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.363 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.364 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:02:43.366 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 msgr2=0x7f69780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 0x7f69780b7820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6984009fd0 tx=0x7f6984009500 comp rx=0 tx=0).stop 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 msgr2=0x7f698c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6974005940 tx=0x7f69740040c0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 shutdown_connections 2024-09-10T21:02:43.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f698c108020 0x7f698c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f698c1076a0 0x7f698c199820 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f69780b5360 0x7f69780b7820 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 --2- 172.21.15.67:0/3745007650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c101c90 0x7f698c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 >> 172.21.15.67:0/3745007650 conn(0x7f698c0fd700 msgr2=0x7f698c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 shutdown_connections 2024-09-10T21:02:43.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:02:43.342+0000 7f6990ad6640 1 -- 172.21.15.67:0/3745007650 wait complete. 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:02:43.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:43 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:02:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:02:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:02:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:02:43.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:43 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:02:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:43.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:02:43.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:02:43.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:02:43.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:43 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:44.037 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 670.0 s, 2.2 tps, lat 5219.443 ms stddev 54.695 2024-09-10T21:02:44.074 INFO:tasks.cephfs.filesystem:scrub status for tag:dce5d13a-8bd9-49f2-a2e0-59003826ab2e - {'path': '/', 'tag': 'dce5d13a-8bd9-49f2-a2e0-59003826ab2e', 'options': 'recursive,force'} 2024-09-10T21:02:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:44 smithi067 ceph-mon[30891]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 MiB/s wr, 1.30k op/s 2024-09-10T21:02:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:44 smithi083 ceph-mon[35058]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 MiB/s wr, 1.30k op/s 2024-09-10T21:02:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:44 smithi172 ceph-mon[35265]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 31 MiB/s wr, 1.30k op/s 2024-09-10T21:02:45.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:45 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:45.547 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:45 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:45.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:45 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:45.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:45 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:45.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:45 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:45.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:45 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:02:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:46 smithi067 ceph-mon[30891]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 1.28k op/s 2024-09-10T21:02:46.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:46 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:02:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:46 smithi083 ceph-mon[35058]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 1.28k op/s 2024-09-10T21:02:46.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:46 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:02:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:46 smithi172 ceph-mon[35265]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 33 MiB/s wr, 1.28k op/s 2024-09-10T21:02:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:46 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:02:47.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:02:47.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:02:47.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:02:47.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:02:47.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:47.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:02:47.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:02:47.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:02:48.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:48 smithi067 ceph-mon[30891]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.31k op/s 2024-09-10T21:02:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:48 smithi083 ceph-mon[35058]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.31k op/s 2024-09-10T21:02:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:48 smithi172 ceph-mon[35265]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.31k op/s 2024-09-10T21:02:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 675.0 s, 1761.9 tps, lat 123.667 ms stddev 687.635 2024-09-10T21:02:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:50 smithi067 ceph-mon[30891]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.24k op/s 2024-09-10T21:02:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:50 smithi083 ceph-mon[35058]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.24k op/s 2024-09-10T21:02:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:50 smithi172 ceph-mon[35265]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.24k op/s 2024-09-10T21:02:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:52 smithi067 ceph-mon[30891]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 31 MiB/s wr, 1.13k op/s 2024-09-10T21:02:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:52 smithi083 ceph-mon[35058]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 31 MiB/s wr, 1.13k op/s 2024-09-10T21:02:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:52 smithi172 ceph-mon[35265]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 31 MiB/s wr, 1.13k op/s 2024-09-10T21:02:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 680.0 s, 2144.6 tps, lat 46.574 ms stddev 52.842 2024-09-10T21:02:54.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:54 smithi067 ceph-mon[30891]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-09-10T21:02:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:54 smithi083 ceph-mon[35058]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-09-10T21:02:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:54 smithi172 ceph-mon[35265]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-09-10T21:02:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:56 smithi067 ceph-mon[30891]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-10T21:02:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:02:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:56 smithi083 ceph-mon[35058]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-10T21:02:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:02:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:56 smithi172 ceph-mon[35265]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 14 MiB/s wr, 656 op/s 2024-09-10T21:02:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:02:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:02:58 smithi083 ceph-mon[35058]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 659 op/s 2024-09-10T21:02:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:02:58 smithi172 ceph-mon[35265]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 659 op/s 2024-09-10T21:02:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 685.0 s, 1949.4 tps, lat 51.345 ms stddev 57.441 2024-09-10T21:02:59.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:02:58 smithi067 ceph-mon[30891]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 12 MiB/s wr, 659 op/s 2024-09-10T21:03:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:00 smithi083 ceph-mon[35058]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.9 MiB/s wr, 662 op/s 2024-09-10T21:03:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:00 smithi172 ceph-mon[35265]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.9 MiB/s wr, 662 op/s 2024-09-10T21:03:01.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:00 smithi067 ceph-mon[30891]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.9 MiB/s wr, 662 op/s 2024-09-10T21:03:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:02 smithi083 ceph-mon[35058]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.3 MiB/s wr, 621 op/s 2024-09-10T21:03:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:02 smithi172 ceph-mon[35265]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.3 MiB/s wr, 621 op/s 2024-09-10T21:03:03.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:02 smithi067 ceph-mon[30891]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.3 MiB/s wr, 621 op/s 2024-09-10T21:03:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 690.0 s, 2335.4 tps, lat 42.584 ms stddev 52.751 2024-09-10T21:03:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:04 smithi083 ceph-mon[35058]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-10T21:03:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:04 smithi172 ceph-mon[35265]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-10T21:03:05.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:04 smithi067 ceph-mon[30891]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 11 MiB/s wr, 766 op/s 2024-09-10T21:03:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:06 smithi083 ceph-mon[35058]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 655 op/s 2024-09-10T21:03:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:06 smithi172 ceph-mon[35265]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 655 op/s 2024-09-10T21:03:07.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:06 smithi067 ceph-mon[30891]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 655 op/s 2024-09-10T21:03:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:08 smithi083 ceph-mon[35058]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-10T21:03:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:08 smithi172 ceph-mon[35265]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-10T21:03:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 695.0 s, 2100.2 tps, lat 47.874 ms stddev 50.443 2024-09-10T21:03:09.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:08 smithi067 ceph-mon[30891]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-09-10T21:03:10.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:10 smithi083 ceph-mon[35058]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 672 op/s 2024-09-10T21:03:10.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:10 smithi172 ceph-mon[35265]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 672 op/s 2024-09-10T21:03:11.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:10 smithi067 ceph-mon[30891]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.4 MiB/s wr, 672 op/s 2024-09-10T21:03:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:12 smithi083 ceph-mon[35058]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 584 op/s 2024-09-10T21:03:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:12 smithi172 ceph-mon[35265]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 584 op/s 2024-09-10T21:03:13.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:12 smithi067 ceph-mon[30891]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.8 MiB/s wr, 584 op/s 2024-09-10T21:03:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 700.0 s, 2189.0 tps, lat 45.297 ms stddev 53.859 2024-09-10T21:03:14.076 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:03:14.475 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:14.862 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:14 smithi067 ceph-mon[30891]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T21:03:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:14 smithi083 ceph-mon[35058]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T21:03:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:14 smithi172 ceph-mon[35265]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 11 MiB/s wr, 768 op/s 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 -- 172.21.15.67:0/1670033463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754101a90 msgr2=0x7f8754101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 --2- 172.21.15.67:0/1670033463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754101a90 0x7f8754101e70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8744009860 tx=0x7f874402a340 comp rx=0 tx=0).stop 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 -- 172.21.15.67:0/1670033463 shutdown_connections 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 --2- 172.21.15.67:0/1670033463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8754106ed0 0x7f8754107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 --2- 172.21.15.67:0/1670033463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87541023b0 0x7f8754106880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 --2- 172.21.15.67:0/1670033463 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754101a90 0x7f8754101e70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 -- 172.21.15.67:0/1670033463 >> 172.21.15.67:0/1670033463 conn(0x7f87540fd700 msgr2=0x7f87540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:14.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 -- 172.21.15.67:0/1670033463 shutdown_connections 2024-09-10T21:03:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.975+0000 7f875a040640 1 -- 172.21.15.67:0/1670033463 wait complete. 2024-09-10T21:03:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.976+0000 7f875a040640 1 Processor -- start 2024-09-10T21:03:14.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.976+0000 7f875a040640 1 -- start start 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 0x7f875419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87541023b0 0x7f875419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 0x7f87541a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8754119340 con 0x7f8754106ed0 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f87541191c0 con 0x7f87541023b0 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.977+0000 7f875a040640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87541194c0 con 0x7f8754101a90 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.978+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 0x7f875419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.978+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 0x7f875419f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34900/0 (socket says 172.21.15.67:34900) 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.978+0000 7f87537fe640 1 -- 172.21.15.67:0/3430314893 learned_addr learned my addr 172.21.15.67:0/3430314893 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.978+0000 7f8752ffd640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87541023b0 0x7f875419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.978+0000 7f8753fff640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 0x7f87541a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 -- 172.21.15.67:0/3430314893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 msgr2=0x7f875419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 0x7f875419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 -- 172.21.15.67:0/3430314893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87541023b0 msgr2=0x7f875419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87541023b0 0x7f875419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 -- 172.21.15.67:0/3430314893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87541a5940 con 0x7f8754106ed0 2024-09-10T21:03:14.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.979+0000 7f8753fff640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 0x7f87541a5170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f874c009fd0 tx=0x7f874c01ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.980+0000 7f8750ff9640 1 -- 172.21.15.67:0/3430314893 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c01de50 con 0x7f8754106ed0 2024-09-10T21:03:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.980+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87541a5c30 con 0x7f8754106ed0 2024-09-10T21:03:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.980+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8754107e50 con 0x7f8754106ed0 2024-09-10T21:03:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.980+0000 7f8750ff9640 1 -- 172.21.15.67:0/3430314893 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f874c01de50 con 0x7f8754106ed0 2024-09-10T21:03:14.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.981+0000 7f8750ff9640 1 -- 172.21.15.67:0/3430314893 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c0059c0 con 0x7f8754106ed0 2024-09-10T21:03:14.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.982+0000 7f875c415740 1 Processor -- start 2024-09-10T21:03:14.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f8750ff9640 1 -- 172.21.15.67:0/3430314893 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f874c004a40 con 0x7f8754106ed0 2024-09-10T21:03:14.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 -- start start 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x5602047f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x560204804120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56020476be50 con 0x560204801d30 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56020475b280 con 0x5602047f5480 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f875c415740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56020475f090 con 0x5602047f5da0 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34910/0 (socket says 172.21.15.67:34910) 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f87537fe640 1 -- 172.21.15.67:0/2813430012 learned_addr learned my addr 172.21.15.67:0/2813430012 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f8752ffd640 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x5602047f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.984+0000 7f8752ffd640 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x560204804120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 -- 172.21.15.67:0/2813430012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 msgr2=0x5602047f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x5602047f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 -- 172.21.15.67:0/2813430012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 msgr2=0x560204804120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x560204804120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 -- 172.21.15.67:0/2813430012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602044b9650 con 0x5602047f5da0 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8750ff9640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 0x7f873c0b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8752ffd640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 0x7f873c0b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8750ff9640 1 -- 172.21.15.67:0/3430314893 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f874c0f6db0 con 0x7f8754106ed0 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f87537fe640 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3db972a3bd6e568 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:14.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8739ffb640 1 -- 172.21.15.67:0/2813430012 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744037040 con 0x5602047f5da0 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8739ffb640 1 -- 172.21.15.67:0/2813430012 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8744030e50 con 0x5602047f5da0 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.985+0000 7f8739ffb640 1 -- 172.21.15.67:0/2813430012 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744003850 con 0x5602047f5da0 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.986+0000 7f875c415740 1 -- 172.21.15.67:0/2813430012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 msgr2=0x5602048017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.986+0000 7f875c415740 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744005b20 comp rx=0 tx=0).stop 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.987+0000 7f8752ffd640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 0x7f873c0b7b40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87480058c0 tx=0x7f8748009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:14.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 -- 172.21.15.67:0/2813430012 shutdown_connections 2024-09-10T21:03:14.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x560204804120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602048017f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 --2- 172.21.15.67:0/2813430012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x5602047f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 -- 172.21.15.67:0/2813430012 >> 172.21.15.67:0/2813430012 conn(0x5602047f32b0 msgr2=0x5602047f4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 -- 172.21.15.67:0/2813430012 shutdown_connections 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.988+0000 7f875c415740 1 -- 172.21.15.67:0/2813430012 wait complete. 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 -- start start 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 Processor -- start 2024-09-10T21:03:14.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5da0 0x5602047fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x5602047fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5602045bc700 con 0x560204801d30 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5602046f6110 con 0x5602047f5da0 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.989+0000 7f875c415740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560204804950 con 0x5602047f5480 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f875c415740 10 client.0 _ll_register_callbacks cb 0x56020470f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34918/0 (socket says 172.21.15.67:34918) 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 -- 172.21.15.67:0/2960902477 learned_addr learned my addr 172.21.15.67:0/2960902477 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f8753fff640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x5602047fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f8752ffd640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5da0 0x5602047fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:14.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 -- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5da0 msgr2=0x5602047fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5da0 0x5602047fea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 -- 172.21.15.67:0/2960902477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 msgr2=0x5602047fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x5602047fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:14.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.990+0000 7f87537fe640 1 -- 172.21.15.67:0/2960902477 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560204723c40 con 0x5602047f5480 2024-09-10T21:03:14.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f87537fe640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8744035040 tx=0x7f874403d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9401757d87c993e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:14.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f8732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:14.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874404d070 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f874403dac0 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8744030e50 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8744037030 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f875c415740 10 client.26461 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.991+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5602048102b0 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8744030e50 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8744050030 con 0x5602047f5480 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 10 client.26461 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 10 client.26461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 20 client.26461 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x5602048139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 4 client.26461 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:14.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56020476dda0 con 0x560204811600 2024-09-10T21:03:15.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.992+0000 7f8752ffd640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x5602048139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.993+0000 7f8752ffd640 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x5602048139f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3753e023edf331 server_cookie=f231c0a577fa2ae8 in_seq=0 out_seq=0 2024-09-10T21:03:15.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.993+0000 7f8732ffd640 10 client.26461 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:15.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.994+0000 7f8732ffd640 1 -- 172.21.15.67:0/2960902477 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56020476dda0 con 0x560204811600 2024-09-10T21:03:15.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.994+0000 7f8732ffd640 10 client.26461 handle_command_reply: tid=0 2024-09-10T21:03:15.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.994+0000 7f875c415740 1 client.26461 shutdown 2024-09-10T21:03:15.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 msgr2=0x5602048015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8744035040 tx=0x7f874403d8d0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 shutdown_connections 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x5602048139f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x560204801d30 0x5602047fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f8732ffd640 0 client.26461 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5da0 0x5602047fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 --2- 172.21.15.67:0/2960902477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5480 0x5602048015c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.995+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 >> 172.21.15.67:0/2960902477 conn(0x5602047f32b0 msgr2=0x5602047f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.996+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 shutdown_connections 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.996+0000 7f875c415740 1 -- 172.21.15.67:0/2960902477 wait complete. 2024-09-10T21:03:15.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:14.996+0000 7f875c415740 20 client.26461 trim_cache size 0 max 16384 2024-09-10T21:03:15.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.028+0000 7f875c415740 1 Processor -- start 2024-09-10T21:03:15.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 -- start start 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5480 0x5602047ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602047fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8740010c70 con 0x5602047f5480 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f874000e540 con 0x560204801d30 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.032+0000 7f875c415740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f874000c390 con 0x5602047f5da0 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.033+0000 7f8753fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.033+0000 7f8753fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51494/0 (socket says 172.21.15.67:51494) 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.033+0000 7f8753fff640 1 -- 172.21.15.67:0/1739458361 learned_addr learned my addr 172.21.15.67:0/1739458361 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:15.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.033+0000 7f87537fe640 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5480 0x5602047ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.034+0000 7f8753fff640 1 -- 172.21.15.67:0/1739458361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 msgr2=0x5602047fbc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:03:15.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.034+0000 7f8753fff640 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602047fbc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.034+0000 7f8753fff640 1 -- 172.21.15.67:0/1739458361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5480 msgr2=0x5602047ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:15.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.034+0000 7f8753fff640 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5480 0x5602047ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.034+0000 7f8753fff640 1 -- 172.21.15.67:0/1739458361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602047f5bd0 con 0x560204801d30 2024-09-10T21:03:15.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.040+0000 7f8753fff640 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f874c01d770 tx=0x7f874c0bcdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9205c2eba86b3be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.045+0000 7f87397fa640 1 -- 172.21.15.67:0/1739458361 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c0c2080 con 0x560204801d30 2024-09-10T21:03:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.045+0000 7f87397fa640 1 -- 172.21.15.67:0/1739458361 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f874c0c6b30 con 0x560204801d30 2024-09-10T21:03:15.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.045+0000 7f87397fa640 1 -- 172.21.15.67:0/1739458361 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c0b8ef0 con 0x560204801d30 2024-09-10T21:03:15.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.047+0000 7f875c415740 1 -- 172.21.15.67:0/1739458361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 msgr2=0x5602047fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:15.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f874c01d770 tx=0x7f874c0bcdd0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 -- 172.21.15.67:0/1739458361 shutdown_connections 2024-09-10T21:03:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x560204801d30 0x5602047fc160 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5602047f5da0 0x5602047fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 --2- 172.21.15.67:0/1739458361 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5480 0x5602047ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.048+0000 7f875c415740 1 -- 172.21.15.67:0/1739458361 >> 172.21.15.67:0/1739458361 conn(0x5602047f32b0 msgr2=0x5602047fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:15.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.053+0000 7f875c415740 1 -- 172.21.15.67:0/1739458361 shutdown_connections 2024-09-10T21:03:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.053+0000 7f875c415740 1 -- 172.21.15.67:0/1739458361 wait complete. 2024-09-10T21:03:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.053+0000 7f875c415740 1 -- start start 2024-09-10T21:03:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.054+0000 7f875c415740 1 Processor -- start 2024-09-10T21:03:15.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.055+0000 7f875c415740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x560204809c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.055+0000 7f875c415740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.055+0000 7f875c415740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560204801d30 0x5602047f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.055+0000 7f875c415740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f874000ca00 con 0x5602047f5da0 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.055+0000 7f875c415740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f874000de70 con 0x5602047f5480 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.056+0000 7f875c415740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f874000d0d0 con 0x560204801d30 2024-09-10T21:03:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.056+0000 7f875c415740 10 client.0 _ll_register_callbacks cb 0x7f8748009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.056+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.056+0000 7f8752ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35020/0 (socket says 172.21.15.67:35020) 2024-09-10T21:03:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.056+0000 7f8752ffd640 1 -- 172.21.15.67:0/1615329048 learned_addr learned my addr 172.21.15.67:0/1615329048 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8753fff640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560204801d30 0x5602047f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f87537fe640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x560204809c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8752ffd640 1 -- 172.21.15.67:0/1615329048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560204801d30 msgr2=0x5602047f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8752ffd640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560204801d30 0x5602047f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8752ffd640 1 -- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 msgr2=0x560204809c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8752ffd640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x560204809c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.057+0000 7f8752ffd640 1 -- 172.21.15.67:0/1615329048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020480a8f0 con 0x5602047f5da0 2024-09-10T21:03:15.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.059+0000 7f8752ffd640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8748004010 tx=0x7f87480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af733b132e8c8da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:15.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.059+0000 7f8732ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:03:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.060+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748011a80 con 0x5602047f5da0 2024-09-10T21:03:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.060+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8748011c20 con 0x5602047f5da0 2024-09-10T21:03:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.060+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f874c0c6b30 con 0x5602047f5da0 2024-09-10T21:03:15.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.061+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8748011e20 con 0x5602047f5da0 2024-09-10T21:03:15.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.062+0000 7f875c415740 10 client.16794 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:15.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.062+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56020488f850 con 0x5602047f5da0 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.062+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8748038070 con 0x5602047f5da0 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.063+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f874802e410 con 0x5602047f5da0 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.063+0000 7f875c415740 10 client.16794 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.063+0000 7f875c415740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.063+0000 7f875c415740 20 client.16794 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:15.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.063+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x560204892040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.064+0000 7f875c415740 4 client.16794 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:03:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.064+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f874c0c6b30 con 0x560204811600 2024-09-10T21:03:15.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.065+0000 7f87537fe640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x560204892040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:15.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.074+0000 7f8732ffd640 10 client.16794 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:15.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.074+0000 7f87537fe640 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x560204892040 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d732dbf83b472c90 server_cookie=8add0f9f42e73af1 in_seq=0 out_seq=0 2024-09-10T21:03:15.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.077+0000 7f8732ffd640 1 -- 172.21.15.67:0/1615329048 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x7f874c0c6b30 con 0x560204811600 2024-09-10T21:03:15.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.077+0000 7f8732ffd640 10 client.16794 handle_command_reply: tid=0 2024-09-10T21:03:15.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.078+0000 7f875c415740 1 client.16794 shutdown 2024-09-10T21:03:15.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.078+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 msgr2=0x56020480a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:15.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.078+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8748004010 tx=0x7f87480046c0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 shutdown_connections 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x560204811600 0x560204892040 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560204801d30 0x5602047f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f8732ffd640 0 client.16794 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5602047f5da0 0x56020480a1b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 --2- 172.21.15.67:0/1615329048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5602047f5480 0x560204809c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.079+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 >> 172.21.15.67:0/1615329048 conn(0x5602047f32b0 msgr2=0x5602047f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:15.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.081+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 shutdown_connections 2024-09-10T21:03:15.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.081+0000 7f875c415740 1 -- 172.21.15.67:0/1615329048 wait complete. 2024-09-10T21:03:15.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.081+0000 7f875c415740 20 client.16794 trim_cache size 0 max 16384 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:03:15.090 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.091 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.092 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:03:15.093 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.094 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.095 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.096 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.097 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.098 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:03:15.099 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:03:15.100 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:03:15.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.086+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 msgr2=0x7f873c0b7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.086+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 0x7f873c0b7b40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87480058c0 tx=0x7f8748009260 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.086+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 msgr2=0x7f87541a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.086+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 0x7f87541a5170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f874c009fd0 tx=0x7f874c01ff20 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 shutdown_connections 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8754106ed0 0x7f87541a5170 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87541023b0 0x7f875419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f873c0b5680 0x7f873c0b7b40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 --2- 172.21.15.67:0/3430314893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8754101a90 0x7f875419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 >> 172.21.15.67:0/3430314893 conn(0x7f87540fd700 msgr2=0x7f8754104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 shutdown_connections 2024-09-10T21:03:15.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:15.087+0000 7f875a040640 1 -- 172.21.15.67:0/3430314893 wait complete. 2024-09-10T21:03:15.949 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:03:15.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:03:16.365 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:16.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:16 smithi067 ceph-mon[30891]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.6 MiB/s wr, 622 op/s 2024-09-10T21:03:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:16 smithi083 ceph-mon[35058]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.6 MiB/s wr, 622 op/s 2024-09-10T21:03:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:16 smithi172 ceph-mon[35265]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.6 MiB/s wr, 622 op/s 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.966+0000 7f7a63fff640 1 -- 172.21.15.67:0/3532366091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410f520 msgr2=0x7f7a64115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.966+0000 7f7a63fff640 1 --2- 172.21.15.67:0/3532366091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410f520 0x7f7a64115d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009be0 tx=0x7f7a5c02a710 comp rx=0 tx=0).stop 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 -- 172.21.15.67:0/3532366091 shutdown_connections 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 --2- 172.21.15.67:0/3532366091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410f520 0x7f7a64115d70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 --2- 172.21.15.67:0/3532366091 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410eba0 0x7f7a6410efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 --2- 172.21.15.67:0/3532366091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a641095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 -- 172.21.15.67:0/3532366091 >> 172.21.15.67:0/3532366091 conn(0x7f7a64078830 msgr2=0x7f7a6407ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:16.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 -- 172.21.15.67:0/3532366091 shutdown_connections 2024-09-10T21:03:16.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.967+0000 7f7a63fff640 1 -- 172.21.15.67:0/3532366091 wait complete. 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 Processor -- start 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 -- start start 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a640835d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 0x7f7a64083b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410f520 0x7f7a6407c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:16.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64119190 con 0x7f7a6410f520 2024-09-10T21:03:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64119010 con 0x7f7a641091e0 2024-09-10T21:03:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.969+0000 7f7a63fff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64119310 con 0x7f7a6410eba0 2024-09-10T21:03:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.970+0000 7f7a62ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a640835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.970+0000 7f7a627fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 0x7f7a64083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:16.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.970+0000 7f7a627fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 0x7f7a64083b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34938/0 (socket says 172.21.15.67:34938) 2024-09-10T21:03:16.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.970+0000 7f7a627fc640 1 -- 172.21.15.67:0/501654757 learned_addr learned my addr 172.21.15.67:0/501654757 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a637fe640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410f520 0x7f7a6407c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a62ffd640 1 -- 172.21.15.67:0/501654757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 msgr2=0x7f7a64083b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a62ffd640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 0x7f7a64083b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a62ffd640 1 -- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410f520 msgr2=0x7f7a6407c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a62ffd640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410f520 0x7f7a6407c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.973+0000 7f7a62ffd640 1 -- 172.21.15.67:0/501654757 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6407d210 con 0x7f7a641091e0 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a62ffd640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a640835d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:16.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400ccc0 con 0x7f7a641091e0 2024-09-10T21:03:16.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a540108e0 con 0x7f7a641091e0 2024-09-10T21:03:16.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54018880 con 0x7f7a641091e0 2024-09-10T21:03:16.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a63fff640 1 -- 172.21.15.67:0/501654757 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6407d500 con 0x7f7a641091e0 2024-09-10T21:03:16.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.974+0000 7f7a63fff640 1 -- 172.21.15.67:0/501654757 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a64082470 con 0x7f7a641091e0 2024-09-10T21:03:16.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.977+0000 7f7a63fff640 1 -- 172.21.15.67:0/501654757 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6410a490 con 0x7f7a641091e0 2024-09-10T21:03:16.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.980+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7a54010430 con 0x7f7a641091e0 2024-09-10T21:03:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.981+0000 7f7a4bfff640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 0x7f7a4c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:16.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.982+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7a540e6780 con 0x7f7a641091e0 2024-09-10T21:03:16.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.983+0000 7f7a627fc640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 0x7f7a4c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:16.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.983+0000 7f7a627fc640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 0x7f7a4c0c8930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7a64108bd0 tx=0x7f7a58009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:16.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:16.986+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7a54026070 con 0x7f7a641091e0 2024-09-10T21:03:17.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.328+0000 7f7a63fff640 1 -- 172.21.15.67:0/501654757 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a641095c0 con 0x7f7a641091e0 2024-09-10T21:03:17.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.335+0000 7f7a4bfff640 1 -- 172.21.15.67:0/501654757 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f7a641095c0 con 0x7f7a641091e0 2024-09-10T21:03:17.342 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:03:17.343 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 msgr2=0x7f7a4c0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 0x7f7a4c0c8930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7a64108bd0 tx=0x7f7a58009260 comp rx=0 tx=0).stop 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 msgr2=0x7f7a640835d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a640835d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9f0 tx=0x7f7a5400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:03:17.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 shutdown_connections 2024-09-10T21:03:17.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a6410f520 0x7f7a6407c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:17.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7a4c0c6470 0x7f7a4c0c8930 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:17.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a6410eba0 0x7f7a64083b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:17.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 --2- 172.21.15.67:0/501654757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a641091e0 0x7f7a640835d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:17.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.339+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 >> 172.21.15.67:0/501654757 conn(0x7f7a64078830 msgr2=0x7f7a6407ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.344+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 shutdown_connections 2024-09-10T21:03:17.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:17.344+0000 7f7a49ffb640 1 -- 172.21.15.67:0/501654757 wait complete. 2024-09-10T21:03:17.868 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:17 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/501654757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:03:17.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:17 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/501654757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:03:17.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:17 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/501654757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:03:18.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:03:18.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:18 smithi067 ceph-mon[30891]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 637 op/s 2024-09-10T21:03:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:18 smithi083 ceph-mon[35058]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 637 op/s 2024-09-10T21:03:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:18 smithi172 ceph-mon[35265]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.3 MiB/s wr, 637 op/s 2024-09-10T21:03:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 705.0 s, 1800.6 tps, lat 55.758 ms stddev 65.501 2024-09-10T21:03:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.621+0000 7f895c5a1640 1 -- 172.21.15.67:0/1242043628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f895410d150 msgr2=0x7f895410f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.621+0000 7f895c5a1640 1 --2- 172.21.15.67:0/1242043628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f895410d150 0x7f895410f580 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ca0 tx=0x7f894c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 -- 172.21.15.67:0/1242043628 shutdown_connections 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 --2- 172.21.15.67:0/1242043628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f895410d150 0x7f895410f580 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 --2- 172.21.15.67:0/1242043628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f89541045a0 0x7f895410cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 --2- 172.21.15.67:0/1242043628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8954103ba0 0x7f8954103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 -- 172.21.15.67:0/1242043628 >> 172.21.15.67:0/1242043628 conn(0x7f89540fd770 msgr2=0x7f89540ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 -- 172.21.15.67:0/1242043628 shutdown_connections 2024-09-10T21:03:19.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.623+0000 7f895c5a1640 1 -- 172.21.15.67:0/1242043628 wait complete. 2024-09-10T21:03:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 Processor -- start 2024-09-10T21:03:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 -- start start 2024-09-10T21:03:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 0x7f8954199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f895410d150 0x7f895419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8954112d90 con 0x7f8954103ba0 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8954112c10 con 0x7f895410d150 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.624+0000 7f895c5a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8954112f10 con 0x7f89541045a0 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f895a33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 0x7f8954199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f895a33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 0x7f8954199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35054/0 (socket says 172.21.15.67:35054) 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f895a33d640 1 -- 172.21.15.67:0/4111958954 learned_addr learned my addr 172.21.15.67:0/4111958954 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34952/0 (socket says 172.21.15.67:34952) 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f895ab3e640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f895410d150 0x7f895419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 -- 172.21.15.67:0/4111958954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f895410d150 msgr2=0x7f895419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f895410d150 0x7f895419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 -- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 msgr2=0x7f8954199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 0x7f8954199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 -- 172.21.15.67:0/4111958954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895419f2f0 con 0x7f89541045a0 2024-09-10T21:03:19.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.625+0000 7f8959b3c640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f894400e9f0 tx=0x7f894400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.626+0000 7f894b7fe640 1 -- 172.21.15.67:0/4111958954 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894400ccc0 con 0x7f89541045a0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.626+0000 7f894b7fe640 1 -- 172.21.15.67:0/4111958954 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89440108e0 con 0x7f89541045a0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.626+0000 7f894b7fe640 1 -- 172.21.15.67:0/4111958954 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944018880 con 0x7f89541045a0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.626+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895419f5e0 con 0x7f89541045a0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.626+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89541a5ca0 con 0x7f89541045a0 2024-09-10T21:03:19.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.628+0000 7f895e976740 1 Processor -- start 2024-09-10T21:03:19.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 -- start start 2024-09-10T21:03:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a0d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f894b7fe640 1 -- 172.21.15.67:0/4111958954 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8944010430 con 0x7f89541045a0 2024-09-10T21:03:19.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5632c7977ea0 con 0x5632c7a0dd80 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5632c79672d0 con 0x5632c7a014d0 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895e976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5632c796b0e0 con 0x5632c7a01df0 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895ab3e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895ab3e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51554/0 (socket says 172.21.15.67:51554) 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895ab3e640 1 -- 172.21.15.67:0/2661693300 learned_addr learned my addr 172.21.15.67:0/2661693300 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.629+0000 7f895a33d640 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a0d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.630+0000 7f895a33d640 1 -- 172.21.15.67:0/2661693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 msgr2=0x5632c7a018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.630+0000 7f895a33d640 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.630+0000 7f895a33d640 1 -- 172.21.15.67:0/2661693300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 msgr2=0x5632c7a10170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.630+0000 7f895a33d640 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.630+0000 7f895a33d640 1 -- 172.21.15.67:0/2661693300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c76c5650 con 0x5632c7a01df0 2024-09-10T21:03:19.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.631+0000 7f895a33d640 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a0d840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cf0 tx=0x7f8950011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9131020a0c60583 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f8948ff9640 1 -- 172.21.15.67:0/2661693300 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950005220 con 0x5632c7a01df0 2024-09-10T21:03:19.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f8948ff9640 1 -- 172.21.15.67:0/2661693300 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8950004c50 con 0x5632c7a01df0 2024-09-10T21:03:19.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f8948ff9640 1 -- 172.21.15.67:0/2661693300 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500167c0 con 0x5632c7a01df0 2024-09-10T21:03:19.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f894b7fe640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 0x7f89400c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f894b7fe640 1 -- 172.21.15.67:0/4111958954 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f89440e5f60 con 0x7f89541045a0 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.632+0000 7f895ab3e640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 0x7f89400c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 -- 172.21.15.67:0/2661693300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 msgr2=0x5632c7a0d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a0d840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cf0 tx=0x7f8950011810 comp rx=0 tx=0).stop 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 -- 172.21.15.67:0/2661693300 shutdown_connections 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a0d840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 --2- 172.21.15.67:0/2661693300 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 -- 172.21.15.67:0/2661693300 >> 172.21.15.67:0/2661693300 conn(0x5632c79ff300 msgr2=0x5632c7a004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895ab3e640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 0x7f89400c0030 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f894c005e30 tx=0x7f894c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 -- 172.21.15.67:0/2661693300 shutdown_connections 2024-09-10T21:03:19.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.633+0000 7f895e976740 1 -- 172.21.15.67:0/2661693300 wait complete. 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 -- start start 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 Processor -- start 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 0x5632c7a0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5632c77c8700 con 0x5632c7a01df0 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5632c7902160 con 0x5632c7a0dd80 2024-09-10T21:03:19.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.634+0000 7f895e976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5632c7a10a00 con 0x5632c7a014d0 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895e976740 10 client.0 _ll_register_callbacks cb 0x5632c791b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895ab3e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34974/0 (socket says 172.21.15.67:34974) 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895ab3e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51568/0 (socket says 172.21.15.67:51568) 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 -- 172.21.15.67:0/1462819575 learned_addr learned my addr 172.21.15.67:0/1462819575 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f8959b3c640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 0x5632c7a0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 -- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 msgr2=0x5632c7a0b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 -- 172.21.15.67:0/1462819575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 msgr2=0x5632c7a0ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 0x5632c7a0ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 -- 172.21.15.67:0/1462819575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c792fc90 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f8959b3c640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 0x5632c7a0ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895a33d640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cc0 tx=0x7f8950004e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9683eae903598849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f893dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950005000 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f89500051a0 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.635+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8950004c50 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89500053c0 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 10 client.26482 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632c7a1c3a0 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8950004c50 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8950027590 con 0x5632c7a014d0 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 10 client.26482 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:19.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 10 client.26482 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 20 client.26482 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a1d7a0 0x5632c7a1fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 4 client.26482 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632c7979df0 con 0x5632c7a1d7a0 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.636+0000 7f8959b3c640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a1d7a0 0x5632c7a1fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.637+0000 7f8959b3c640 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a1d7a0 0x5632c7a1fb90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2debc760ed696f5 server_cookie=c0c72511a18c01ca in_seq=0 out_seq=0 2024-09-10T21:03:19.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.637+0000 7f893dffb640 10 client.26482 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:03:19.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.637+0000 7f893dffb640 1 -- 172.21.15.67:0/1462819575 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632c7979df0 con 0x5632c7a1d7a0 2024-09-10T21:03:19.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.637+0000 7f893dffb640 10 client.26482 handle_command_reply: tid=0 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.638+0000 7f895e976740 1 client.26482 shutdown 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.638+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 msgr2=0x5632c7a0d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.638+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cc0 tx=0x7f8950004e70 comp rx=0 tx=0).stop 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 shutdown_connections 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a1d7a0 0x5632c7a1fb90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a01df0 0x5632c7a0ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 --2- 172.21.15.67:0/1462819575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a014d0 0x5632c7a0d6b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 >> 172.21.15.67:0/1462819575 conn(0x5632c79ff300 msgr2=0x5632c7a04e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.639+0000 7f893dffb640 0 client.26482 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.640+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 shutdown_connections 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.640+0000 7f895e976740 1 -- 172.21.15.67:0/1462819575 wait complete. 2024-09-10T21:03:19.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.641+0000 7f895e976740 20 client.26482 trim_cache size 0 max 16384 2024-09-10T21:03:19.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.658+0000 7f895e976740 1 Processor -- start 2024-09-10T21:03:19.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 -- start start 2024-09-10T21:03:19.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c79fec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89541ae9a0 con 0x5632c7a014d0 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f89541ac270 con 0x5632c7a0dd80 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895e976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89541aa0c0 con 0x5632c7a01df0 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35094/0 (socket says 172.21.15.67:35094) 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 -- 172.21.15.67:0/983992867 learned_addr learned my addr 172.21.15.67:0/983992867 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895ab3e640 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f8959b3c640 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c79fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 -- 172.21.15.67:0/983992867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 msgr2=0x5632c79fec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c79fec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 -- 172.21.15.67:0/983992867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 msgr2=0x5632c7a0f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 -- 172.21.15.67:0/983992867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c79ffd80 con 0x5632c7a014d0 2024-09-10T21:03:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.659+0000 7f895a33d640 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cf0 tx=0x7f8950005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9cd897722ddaf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f893ffff640 1 -- 172.21.15.67:0/983992867 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950040070 con 0x5632c7a014d0 2024-09-10T21:03:19.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f893ffff640 1 -- 172.21.15.67:0/983992867 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f895002c070 con 0x5632c7a014d0 2024-09-10T21:03:19.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f893ffff640 1 -- 172.21.15.67:0/983992867 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500048d0 con 0x5632c7a014d0 2024-09-10T21:03:19.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f895e976740 1 -- 172.21.15.67:0/983992867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 msgr2=0x5632c7a00b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f895e976740 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8950009cf0 tx=0x7f8950005970 comp rx=0 tx=0).stop 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.660+0000 7f895e976740 1 -- 172.21.15.67:0/983992867 shutdown_connections 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a0dd80 0x5632c7a0f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c79fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- 172.21.15.67:0/983992867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a014d0 0x5632c7a00b40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 -- 172.21.15.67:0/983992867 >> 172.21.15.67:0/983992867 conn(0x5632c79ff300 msgr2=0x5632c7a00430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 -- 172.21.15.67:0/983992867 shutdown_connections 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 -- 172.21.15.67:0/983992867 wait complete. 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 -- start start 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 Processor -- start 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a15f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.661+0000 7f895e976740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895e976740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f89541aa730 con 0x5632c7a0dd80 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895e976740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f89541abba0 con 0x5632c7a014d0 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895e976740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89541aae00 con 0x5632c7a01df0 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895a33d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a15f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895e976740 10 client.0 _ll_register_callbacks cb 0x7f8944005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895a33d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a15f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51586/0 (socket says 172.21.15.67:51586) 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895a33d640 1 -- 172.21.15.67:0/86615558 learned_addr learned my addr 172.21.15.67:0/86615558 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f8959b3c640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 -- 172.21.15.67:0/86615558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 msgr2=0x5632c7a164e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a164e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 -- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 msgr2=0x5632c7a15f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a15f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.662+0000 7f895ab3e640 1 -- 172.21.15.67:0/86615558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c7a114f0 con 0x5632c7a0dd80 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f895ab3e640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10cc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ca0 tx=0x7f894c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b8dbeb3dfb7cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f893dffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c059060 con 0x5632c7a0dd80 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f894c02f870 con 0x5632c7a0dd80 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895002c070 con 0x5632c7a0dd80 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f894c0318d0 con 0x5632c7a0dd80 2024-09-10T21:03:19.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f895e976740 10 client.16815 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.663+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5632c7a8afb0 con 0x5632c7a0dd80 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f895002c070 con 0x5632c7a0dd80 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f894c030c90 con 0x5632c7a0dd80 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 10 client.16815 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 10 client.16815 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 20 client.16815 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a8b680 0x5632c7a8daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 4 client.16815 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.664+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632c79758a0 con 0x5632c7a8b680 2024-09-10T21:03:19.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.665+0000 7f895a33d640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a8b680 0x5632c7a8daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:19.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f895a33d640 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a8b680 0x5632c7a8daa0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=605bfa73ebc12af8 server_cookie=ba790ae85794ed2c in_seq=0 out_seq=0 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f893dffb640 10 client.16815 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f893dffb640 1 -- 172.21.15.67:0/86615558 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632c79758a0 con 0x5632c7a8b680 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f893dffb640 10 client.16815 handle_command_reply: tid=0 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f895e976740 1 client.16815 shutdown 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 msgr2=0x5632c7a10cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.666+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10cc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ca0 tx=0x7f894c041000 comp rx=0 tx=0).stop 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 shutdown_connections 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x5632c7a8b680 0x5632c7a8daa0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5632c7a0dd80 0x5632c7a10cc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632c7a01df0 0x5632c7a164e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f893dffb640 0 client.16815 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 --2- 172.21.15.67:0/86615558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5632c7a014d0 0x5632c7a15f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 >> 172.21.15.67:0/86615558 conn(0x5632c79ff300 msgr2=0x5632c7a00910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 shutdown_connections 2024-09-10T21:03:19.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 1 -- 172.21.15.67:0/86615558 wait complete. 2024-09-10T21:03:19.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.667+0000 7f895e976740 20 client.16815 trim_cache size 0 max 16384 2024-09-10T21:03:19.674 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:03:19.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 msgr2=0x7f89400c0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 0x7f89400c0030 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f894c005e30 tx=0x7f894c005c30 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 msgr2=0x7f8954199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f894400e9f0 tx=0x7f894400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 shutdown_connections 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f895410d150 0x7f895419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f89400bdb70 0x7f89400c0030 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89541045a0 0x7f8954199780 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 --2- 172.21.15.67:0/4111958954 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8954103ba0 0x7f8954199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 >> 172.21.15.67:0/4111958954 conn(0x7f89540fd770 msgr2=0x7f895410f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 shutdown_connections 2024-09-10T21:03:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:19.668+0000 7f895c5a1640 1 -- 172.21.15.67:0/4111958954 wait complete. 2024-09-10T21:03:20.442 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:03:20.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:20 smithi067 ceph-mon[30891]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 604 op/s 2024-09-10T21:03:20.857 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:20 smithi083 ceph-mon[35058]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 604 op/s 2024-09-10T21:03:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:20 smithi172 ceph-mon[35265]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 604 op/s 2024-09-10T21:03:21.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 -- 172.21.15.67:0/1307256897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 msgr2=0x7f3f68104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 --2- 172.21.15.67:0/1307256897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68104080 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009900 tx=0x7f3f6402a410 comp rx=0 tx=0).stop 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 -- 172.21.15.67:0/1307256897 shutdown_connections 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 --2- 172.21.15.67:0/1307256897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 --2- 172.21.15.67:0/1307256897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f6810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 --2- 172.21.15.67:0/1307256897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68104080 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 -- 172.21.15.67:0/1307256897 >> 172.21.15.67:0/1307256897 conn(0x7f3f680fd700 msgr2=0x7f3f680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.377+0000 7f3f70541640 1 -- 172.21.15.67:0/1307256897 shutdown_connections 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.378+0000 7f3f70541640 1 -- 172.21.15.67:0/1307256897 wait complete. 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.379+0000 7f3f70541640 1 Processor -- start 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.379+0000 7f3f70541640 1 -- start start 2024-09-10T21:03:21.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.379+0000 7f3f70541640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f70541640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f70541640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f70541640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68112d70 con 0x7f3f68103ca0 2024-09-10T21:03:21.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f70541640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68112bf0 con 0x7f3f6810d100 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f6eade640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f6eade640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51614/0 (socket says 172.21.15.67:51614) 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f6eade640 1 -- 172.21.15.67:0/2729215192 learned_addr learned my addr 172.21.15.67:0/2729215192 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35016/0 (socket says 172.21.15.67:35016) 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.380+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f68112ef0 con 0x7f3f681045c0 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 -- 172.21.15.67:0/2729215192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 msgr2=0x7f3f68199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 -- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 msgr2=0x7f3f68199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 -- 172.21.15.67:0/2729215192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6819f3f0 con 0x7f3f6810d100 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:03:21.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.381+0000 7f3f6eade640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000efd0 tx=0x7f3f6000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.382+0000 7f3f5f7fe640 1 -- 172.21.15.67:0/2729215192 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60017dd0 con 0x7f3f6810d100 2024-09-10T21:03:21.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.382+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6819f6e0 con 0x7f3f6810d100 2024-09-10T21:03:21.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.382+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f68101830 con 0x7f3f6810d100 2024-09-10T21:03:21.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.382+0000 7f3f5f7fe640 1 -- 172.21.15.67:0/2729215192 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f60003e20 con 0x7f3f6810d100 2024-09-10T21:03:21.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.382+0000 7f3f5f7fe640 1 -- 172.21.15.67:0/2729215192 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6001e400 con 0x7f3f6810d100 2024-09-10T21:03:21.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.385+0000 7f3f72916740 1 Processor -- start 2024-09-10T21:03:21.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.386+0000 7f3f5f7fe640 1 -- 172.21.15.67:0/2729215192 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3f60003970 con 0x7f3f6810d100 2024-09-10T21:03:21.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.387+0000 7f3f5f7fe640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 0x7f3f540b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.388+0000 7f3f5f7fe640 1 -- 172.21.15.67:0/2729215192 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3f600ee7d0 con 0x7f3f6810d100 2024-09-10T21:03:21.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.389+0000 7f3f72916740 1 -- start start 2024-09-10T21:03:21.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.390+0000 7f3f72916740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.392+0000 7f3f72916740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe09d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.392+0000 7f3f72916740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.392+0000 7f3f72916740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55cfbe007ea0 con 0x55cfbe0914d0 2024-09-10T21:03:21.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.392+0000 7f3f72916740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55cfbdff72d0 con 0x55cfbe091df0 2024-09-10T21:03:21.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.392+0000 7f3f72916740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cfbdffb0e0 con 0x55cfbe09dd80 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.393+0000 7f3f6e2dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.393+0000 7f3f6e2dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35128/0 (socket says 172.21.15.67:35128) 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.393+0000 7f3f6e2dd640 1 -- 172.21.15.67:0/1997118022 learned_addr learned my addr 172.21.15.67:0/1997118022 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.394+0000 7f3f6e2dd640 1 -- 172.21.15.67:0/1997118022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 msgr2=0x55cfbe0a0170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.394+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a0170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.394+0000 7f3f6e2dd640 1 -- 172.21.15.67:0/1997118022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 msgr2=0x55cfbe09d840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.394+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe09d840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.394+0000 7f3f6e2dd640 1 -- 172.21.15.67:0/1997118022 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbdd55650 con 0x55cfbe0914d0 2024-09-10T21:03:21.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.395+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009900 tx=0x7f3f64005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c96dbc13619874 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.396+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 0x7f3f540b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.411+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 0x7f3f540b78a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55cfbe0901e0 tx=0x7f3f580092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.414+0000 7f3f5cff9640 1 -- 172.21.15.67:0/1997118022 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64035070 con 0x55cfbe0914d0 2024-09-10T21:03:21.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.414+0000 7f3f5cff9640 1 -- 172.21.15.67:0/1997118022 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f64032e20 con 0x55cfbe0914d0 2024-09-10T21:03:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.414+0000 7f3f5cff9640 1 -- 172.21.15.67:0/1997118022 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f640053c0 con 0x55cfbe0914d0 2024-09-10T21:03:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.415+0000 7f3f72916740 1 -- 172.21.15.67:0/1997118022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 msgr2=0x55cfbe0918b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.415+0000 7f3f72916740 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009900 tx=0x7f3f64005bf0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.415+0000 7f3f72916740 1 -- 172.21.15.67:0/1997118022 shutdown_connections 2024-09-10T21:03:21.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.415+0000 7f3f72916740 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.416+0000 7f3f72916740 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe09d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.416+0000 7f3f72916740 1 --2- 172.21.15.67:0/1997118022 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0918b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.416+0000 7f3f72916740 1 -- 172.21.15.67:0/1997118022 >> 172.21.15.67:0/1997118022 conn(0x55cfbe08f300 msgr2=0x55cfbe0904a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.418+0000 7f3f72916740 1 -- 172.21.15.67:0/1997118022 shutdown_connections 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.418+0000 7f3f72916740 1 -- 172.21.15.67:0/1997118022 wait complete. 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.419+0000 7f3f72916740 1 -- start start 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.419+0000 7f3f72916740 1 Processor -- start 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.419+0000 7f3f72916740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe09d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f72916740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f72916740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe09b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f72916740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55cfbde58700 con 0x55cfbe09dd80 2024-09-10T21:03:21.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f72916740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55cfbdf92160 con 0x55cfbe0914d0 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f72916740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cfbe0a09a0 con 0x55cfbe091df0 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f6e2dd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe09d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35032/0 (socket says 172.21.15.67:35032) 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.420+0000 7f3f6dadc640 1 -- 172.21.15.67:0/350381102 learned_addr learned my addr 172.21.15.67:0/350381102 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.421+0000 7f3f6eade640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe09b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.421+0000 7f3f72916740 10 client.0 _ll_register_callbacks cb 0x55cfbdfab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:21.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.423+0000 7f3f6dadc640 1 -- 172.21.15.67:0/350381102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 msgr2=0x55cfbe09d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.423+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe09d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.423+0000 7f3f6dadc640 1 -- 172.21.15.67:0/350381102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 msgr2=0x55cfbe09b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.423+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe09b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.423+0000 7f3f6dadc640 1 -- 172.21.15.67:0/350381102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbdfbfc90 con 0x55cfbe091df0 2024-09-10T21:03:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.425+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011720 tx=0x7f3f580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c4d8ae79c7fa038 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.425+0000 7f3f51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.425+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58022020 con 0x55cfbe091df0 2024-09-10T21:03:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.425+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3f58010690 con 0x55cfbe091df0 2024-09-10T21:03:21.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.426+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f64032e20 con 0x55cfbe091df0 2024-09-10T21:03:21.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.429+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3f58010890 con 0x55cfbe091df0 2024-09-10T21:03:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.430+0000 7f3f72916740 10 client.26494 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:21.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.430+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cfbe0ac370 con 0x55cfbe091df0 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.432+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f58017030 con 0x55cfbe091df0 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.432+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3f5800f040 con 0x55cfbe091df0 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 10 client.26494 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 10 client.26494 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 20 client.26494 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe0ad780 0x55cfbe0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 4 client.26494 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:21.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.435+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3f64032e20 con 0x55cfbe0ad780 2024-09-10T21:03:21.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.436+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe0ad780 0x55cfbe0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.438+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe0ad780 0x55cfbe0afb70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=91ca0db6096e79b2 server_cookie=90e43569294e8b84 in_seq=0 out_seq=0 2024-09-10T21:03:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f51ffb640 10 client.26494 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:03:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f51ffb640 1 -- 172.21.15.67:0/350381102 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3f64032e20 con 0x55cfbe0ad780 2024-09-10T21:03:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f51ffb640 10 client.26494 handle_command_reply: tid=0 2024-09-10T21:03:21.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f72916740 1 client.26494 shutdown 2024-09-10T21:03:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 msgr2=0x55cfbe09aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011720 tx=0x7f3f580046c0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 shutdown_connections 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.440+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe0ad780 0x55cfbe0afb70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe09b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe09aaa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 --2- 172.21.15.67:0/350381102 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe09d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 >> 172.21.15.67:0/350381102 conn(0x55cfbe08f300 msgr2=0x55cfbe094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f51ffb640 0 client.26494 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 shutdown_connections 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 1 -- 172.21.15.67:0/350381102 wait complete. 2024-09-10T21:03:21.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.441+0000 7f3f72916740 20 client.26494 trim_cache size 0 max 16384 2024-09-10T21:03:21.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.470+0000 7f3f72916740 1 Processor -- start 2024-09-10T21:03:21.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.470+0000 7f3f72916740 1 -- start start 2024-09-10T21:03:21.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe099320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681aeb60 con 0x55cfbe0914d0 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681ac430 con 0x55cfbe091df0 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f72916740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681aa2a0 con 0x55cfbe09dd80 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6e2dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51634/0 (socket says 172.21.15.67:51634) 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6e2dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35134/0 (socket says 172.21.15.67:35134) 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 -- 172.21.15.67:0/3628676557 learned_addr learned my addr 172.21.15.67:0/3628676557 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6eade640 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 -- 172.21.15.67:0/3628676557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 msgr2=0x55cfbe099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 -- 172.21.15.67:0/3628676557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 msgr2=0x55cfbe0a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.471+0000 7f3f6dadc640 1 -- 172.21.15.67:0/3628676557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbe08fd80 con 0x55cfbe091df0 2024-09-10T21:03:21.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.473+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f58000c00 tx=0x7f3f5800e8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef8921186996e26c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.473+0000 7f3f53fff640 1 -- 172.21.15.67:0/3628676557 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58033070 con 0x55cfbe091df0 2024-09-10T21:03:21.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.474+0000 7f3f53fff640 1 -- 172.21.15.67:0/3628676557 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f58017040 con 0x55cfbe091df0 2024-09-10T21:03:21.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.474+0000 7f3f53fff640 1 -- 172.21.15.67:0/3628676557 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58026790 con 0x55cfbe091df0 2024-09-10T21:03:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.474+0000 7f3f72916740 1 -- 172.21.15.67:0/3628676557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 msgr2=0x55cfbe099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3f58000c00 tx=0x7f3f5800e8a0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 -- 172.21.15.67:0/3628676557 shutdown_connections 2024-09-10T21:03:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe09dd80 0x55cfbe099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe091df0 0x55cfbe099f90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 --2- 172.21.15.67:0/3628676557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 -- 172.21.15.67:0/3628676557 >> 172.21.15.67:0/3628676557 conn(0x55cfbe08f300 msgr2=0x55cfbe090430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 -- 172.21.15.67:0/3628676557 shutdown_connections 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.475+0000 7f3f72916740 1 -- 172.21.15.67:0/3628676557 wait complete. 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.476+0000 7f3f72916740 1 -- start start 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.476+0000 7f3f72916740 1 Processor -- start 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.476+0000 7f3f72916740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.476+0000 7f3f72916740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f72916740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f72916740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681aa8f0 con 0x55cfbe09dd80 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f72916740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681abd60 con 0x55cfbe0914d0 2024-09-10T21:03:21.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f72916740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f681aafc0 con 0x55cfbe091df0 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f72916740 10 client.0 _ll_register_callbacks cb 0x7f3f6806bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:35054/0 (socket says 172.21.15.67:35054) 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 -- 172.21.15.67:0/4088516161 learned_addr learned my addr 172.21.15.67:0/4088516161 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6eade640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 -- 172.21.15.67:0/4088516161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 msgr2=0x55cfbe0a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 -- 172.21.15.67:0/4088516161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 msgr2=0x55cfbe0a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.477+0000 7f3f6dadc640 1 -- 172.21.15.67:0/4088516161 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbe0957e0 con 0x55cfbe091df0 2024-09-10T21:03:21.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f6dadc640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005fe0 tx=0x7f3f580048b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52abaa0abda42394 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5803e070 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f58017040 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3f58026990 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3f58033040 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f72916740 10 client.26500 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cfbe11a9c0 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.478+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f58017040 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3f58026cf0 con 0x55cfbe091df0 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 10 client.26500 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 10 client.26500 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 20 client.26500 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe11b030 0x55cfbe11d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:21.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 4 client.26500 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:03:21.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfbe009df0 con 0x55cfbe11b030 2024-09-10T21:03:21.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe11b030 0x55cfbe11d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f6e2dd640 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe11b030 0x55cfbe11d450 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f785fe951e1f095 server_cookie=b360c0f1dcb66124 in_seq=0 out_seq=0 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.479+0000 7f3f51ffb640 10 client.26500 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f51ffb640 1 -- 172.21.15.67:0/4088516161 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfbe009df0 con 0x55cfbe11b030 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f51ffb640 10 client.26500 handle_command_reply: tid=0 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 client.26500 shutdown 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 msgr2=0x55cfbe0a2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005fe0 tx=0x7f3f580048b0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 shutdown_connections 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55cfbe11b030 0x55cfbe11d450 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f51ffb640 0 client.26500 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:03:21.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55cfbe09dd80 0x55cfbe0a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfbe091df0 0x55cfbe0a2360 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 --2- 172.21.15.67:0/4088516161 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cfbe0914d0 0x55cfbe0a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 >> 172.21.15.67:0/4088516161 conn(0x55cfbe08f300 msgr2=0x55cfbe098f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 shutdown_connections 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.480+0000 7f3f72916740 1 -- 172.21.15.67:0/4088516161 wait complete. 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.481+0000 7f3f72916740 20 client.26500 trim_cache size 0 max 16384 2024-09-10T21:03:21.489 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.481+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 msgr2=0x7f3f540b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.481+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 0x7f3f540b78a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55cfbe0901e0 tx=0x7f3f580092a0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.481+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 msgr2=0x7f3f6819ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.481+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000efd0 tx=0x7f3f6000c6a0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 shutdown_connections 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f6810d100 0x7f3f6819ec20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f3f540b53e0 0x7f3f540b78a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f681045c0 0x7f3f68199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 --2- 172.21.15.67:0/2729215192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3f68103ca0 0x7f3f68199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:21.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 >> 172.21.15.67:0/2729215192 conn(0x7f3f680fd700 msgr2=0x7f3f680fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:21.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 shutdown_connections 2024-09-10T21:03:21.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:21.482+0000 7f3f70541640 1 -- 172.21.15.67:0/2729215192 wait complete. 2024-09-10T21:03:22.656 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:03:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:22 smithi083 ceph-mon[35058]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 585 op/s 2024-09-10T21:03:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:22 smithi172 ceph-mon[35265]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 585 op/s 2024-09-10T21:03:23.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:22 smithi067 ceph-mon[30891]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 585 op/s 2024-09-10T21:03:23.057 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:23.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.792+0000 7f45cdffb640 1 -- 172.21.15.67:0/2773798477 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8040770 con 0x7f45d011c0a0 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.792+0000 7f45cffff640 1 -- 172.21.15.67:0/2773798477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d011c0a0 msgr2=0x7f45d011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.792+0000 7f45cffff640 1 --2- 172.21.15.67:0/2773798477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d011c0a0 0x7f45d011e490 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f45c801a910 tx=0x7f45c803b470 comp rx=0 tx=0).stop 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 -- 172.21.15.67:0/2773798477 shutdown_connections 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 --2- 172.21.15.67:0/2773798477 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d011c0a0 0x7f45d011e490 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 --2- 172.21.15.67:0/2773798477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d010a530 0x7f45d010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 --2- 172.21.15.67:0/2773798477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a150 0x7f45d01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 -- 172.21.15.67:0/2773798477 >> 172.21.15.67:0/2773798477 conn(0x7f45d006cb30 msgr2=0x7f45d006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.793+0000 7f45cffff640 1 -- 172.21.15.67:0/2773798477 shutdown_connections 2024-09-10T21:03:23.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.794+0000 7f45cffff640 1 -- 172.21.15.67:0/2773798477 wait complete. 2024-09-10T21:03:23.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 Processor -- start 2024-09-10T21:03:23.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 -- start start 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 0x7f45d0117d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d011c0a0 0x7f45d01a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0114110 con 0x7f45d010a150 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0113f90 con 0x7f45d011c0a0 2024-09-10T21:03:23.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.795+0000 7f45cffff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0114290 con 0x7f45d010a530 2024-09-10T21:03:23.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.799+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 0x7f45d0117d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.799+0000 7f45ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.799+0000 7f45ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38246/0 (socket says 172.21.15.67:38246) 2024-09-10T21:03:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.799+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 0x7f45d0117d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47850/0 (socket says 172.21.15.67:47850) 2024-09-10T21:03:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.799+0000 7f45ceffd640 1 -- 172.21.15.67:0/2147487393 learned_addr learned my addr 172.21.15.67:0/2147487393 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:23.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d011c0a0 0x7f45d01a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45ceffd640 1 -- 172.21.15.67:0/2147487393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 msgr2=0x7f45d0117d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 0x7f45d0117d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45ceffd640 1 -- 172.21.15.67:0/2147487393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d011c0a0 msgr2=0x7f45d01a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d011c0a0 0x7f45d01a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.800+0000 7f45ceffd640 1 -- 172.21.15.67:0/2147487393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d01a5770 con 0x7f45d010a150 2024-09-10T21:03:23.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.801+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45c000ebc0 tx=0x7f45c000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.802+0000 7f45c7fff640 1 -- 172.21.15.67:0/2147487393 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0010630 con 0x7f45d010a150 2024-09-10T21:03:23.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.802+0000 7f45c7fff640 1 -- 172.21.15.67:0/2147487393 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c000ce50 con 0x7f45d010a150 2024-09-10T21:03:23.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.802+0000 7f45c7fff640 1 -- 172.21.15.67:0/2147487393 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0018ad0 con 0x7f45d010a150 2024-09-10T21:03:23.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.802+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d01a5a60 con 0x7f45d010a150 2024-09-10T21:03:23.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.803+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01ac120 con 0x7f45d010a150 2024-09-10T21:03:23.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.806+0000 7f45d79e7740 1 Processor -- start 2024-09-10T21:03:23.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 -- start start 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e94aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e94d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56349e8b4ea0 con 0x56349e93e6a0 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56349e8a42d0 con 0x56349e94af50 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.807+0000 7f45d79e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56349e8a80e0 con 0x56349e93efc0 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38248/0 (socket says 172.21.15.67:38248) 2024-09-10T21:03:23.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 -- 172.21.15.67:0/4229847624 learned_addr learned my addr 172.21.15.67:0/4229847624 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:23.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e94d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45ceffd640 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e94aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 -- 172.21.15.67:0/4229847624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 msgr2=0x56349e94aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e94aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 -- 172.21.15.67:0/4229847624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 msgr2=0x56349e94d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e94d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.808+0000 7f45cf7fe640 1 -- 172.21.15.67:0/4229847624 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349e602650 con 0x56349e93e6a0 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.809+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f45c801a910 tx=0x7f45c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bfd1b43dc5134f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.810+0000 7f45c57fa640 1 -- 172.21.15.67:0/4229847624 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8046030 con 0x56349e93e6a0 2024-09-10T21:03:23.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.810+0000 7f45c57fa640 1 -- 172.21.15.67:0/4229847624 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c8004e00 con 0x56349e93e6a0 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 -- 172.21.15.67:0/4229847624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 msgr2=0x56349e93ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f45c801a910 tx=0x7f45c8004750 comp rx=0 tx=0).stop 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 -- 172.21.15.67:0/4229847624 shutdown_connections 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e94d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e94aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 --2- 172.21.15.67:0/4229847624 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93ea80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.811+0000 7f45d79e7740 1 -- 172.21.15.67:0/4229847624 >> 172.21.15.67:0/4229847624 conn(0x56349e93c4d0 msgr2=0x56349e93d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.812+0000 7f45c7fff640 1 -- 172.21.15.67:0/2147487393 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f45c0018c70 con 0x7f45d010a150 2024-09-10T21:03:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.813+0000 7f45d79e7740 1 -- 172.21.15.67:0/4229847624 shutdown_connections 2024-09-10T21:03:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.813+0000 7f45d79e7740 1 -- 172.21.15.67:0/4229847624 wait complete. 2024-09-10T21:03:23.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.813+0000 7f45d79e7740 1 -- start start 2024-09-10T21:03:23.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.814+0000 7f45d79e7740 1 Processor -- start 2024-09-10T21:03:23.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.814+0000 7f45c7fff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 0x7f45bc0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.814+0000 7f45c7fff640 1 -- 172.21.15.67:0/2147487393 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f45c00e68f0 con 0x7f45d010a150 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 0x56349e94a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93efc0 0x56349e947bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e948150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56349e705700 con 0x56349e93efc0 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56349e83f160 con 0x56349e94af50 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56349e94dc10 con 0x56349e93e6a0 2024-09-10T21:03:23.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.815+0000 7f45d79e7740 10 client.0 _ll_register_callbacks cb 0x56349e8589e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e948150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 0x7f45bc0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e948150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40162/0 (socket says 172.21.15.67:40162) 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45cf7fe640 1 -- 172.21.15.67:0/3605046534 learned_addr learned my addr 172.21.15.67:0/3605046534 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93efc0 0x56349e947bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 0x56349e94a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 -- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 msgr2=0x56349e948150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e948150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 -- 172.21.15.67:0/3605046534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93efc0 msgr2=0x56349e947bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93efc0 0x56349e947bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 -- 172.21.15.67:0/3605046534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349e86cc90 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45ceffd640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 0x56349e94a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f45c000cba0 tx=0x7f45c0009200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd2950b6f2425cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.817+0000 7f45b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00ad7e0 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f45c00b61e0 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c8004e00 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45c00ad0e0 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45d79e7740 10 client.26512 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56349e9594f0 con 0x56349e93e6a0 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 0x7f45bc0b77e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45c801a6d0 tx=0x7f45c8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c8004e00 con 0x56349e93e6a0 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f45c00a8a30 con 0x56349e93e6a0 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45d79e7740 10 client.26512 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.818+0000 7f45d79e7740 10 client.26512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45d79e7740 20 client.26512 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e95ab60 0x56349e95cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45d79e7740 4 client.26512 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:23.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56349e8b6df0 con 0x56349e95ab60 2024-09-10T21:03:23.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e95ab60 0x56349e95cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45b67fc640 10 client.26512 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:23.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.819+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e95ab60 0x56349e95cf80 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8da488c6246d0a server_cookie=81f9fe057f428ef5 in_seq=0 out_seq=0 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45b67fc640 1 -- 172.21.15.67:0/3605046534 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56349e8b6df0 con 0x56349e95ab60 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45b67fc640 10 client.26512 handle_command_reply: tid=0 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45d79e7740 1 client.26512 shutdown 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 msgr2=0x56349e94a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 0x56349e94a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f45c000cba0 tx=0x7f45c0009200 comp rx=0 tx=0).stop 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.820+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 shutdown_connections 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e95ab60 0x56349e95cf80 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e948150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93efc0 0x56349e947bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 --2- 172.21.15.67:0/3605046534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93e6a0 0x56349e94a7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 >> 172.21.15.67:0/3605046534 conn(0x56349e93c4d0 msgr2=0x56349e942040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45b67fc640 0 client.26512 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 shutdown_connections 2024-09-10T21:03:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 1 -- 172.21.15.67:0/3605046534 wait complete. 2024-09-10T21:03:23.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.821+0000 7f45d79e7740 20 client.26512 trim_cache size 0 max 16384 2024-09-10T21:03:23.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.841+0000 7f45d79e7740 1 Processor -- start 2024-09-10T21:03:23.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.841+0000 7f45d79e7740 1 -- start start 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e945340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b7190 con 0x56349e93e6a0 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b4a60 con 0x56349e94af50 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45d79e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b28b0 con 0x56349e93efc0 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47884/0 (socket says 172.21.15.67:47884) 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 -- 172.21.15.67:0/1158565857 learned_addr learned my addr 172.21.15.67:0/1158565857 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e945340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 -- 172.21.15.67:0/1158565857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 msgr2=0x56349e945340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e945340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 -- 172.21.15.67:0/1158565857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 msgr2=0x56349e93dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ce7fc640 1 -- 172.21.15.67:0/1158565857 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349e9484c0 con 0x56349e93efc0 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.842+0000 7f45ceffd640 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.843+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009dc0 tx=0x7f45b8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421d34048e10a137 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.843+0000 7f45c4ff9640 1 -- 172.21.15.67:0/1158565857 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8025670 con 0x56349e93efc0 2024-09-10T21:03:23.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.843+0000 7f45c4ff9640 1 -- 172.21.15.67:0/1158565857 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45b801e8d0 con 0x56349e93efc0 2024-09-10T21:03:23.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.843+0000 7f45c4ff9640 1 -- 172.21.15.67:0/1158565857 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b801d8e0 con 0x56349e93efc0 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 -- 172.21.15.67:0/1158565857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 msgr2=0x56349e944e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009dc0 tx=0x7f45b8005f90 comp rx=0 tx=0).stop 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 -- 172.21.15.67:0/1158565857 shutdown_connections 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94af50 0x56349e945340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e93efc0 0x56349e944e00 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009dc0 tx=0x7f45b8005f90 comp rx=0 tx=0).stop 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 --2- 172.21.15.67:0/1158565857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e93dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.844+0000 7f45d79e7740 1 -- 172.21.15.67:0/1158565857 >> 172.21.15.67:0/1158565857 conn(0x56349e93c4d0 msgr2=0x56349e93d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.845+0000 7f45d79e7740 1 -- 172.21.15.67:0/1158565857 shutdown_connections 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.845+0000 7f45d79e7740 1 -- 172.21.15.67:0/1158565857 wait complete. 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 -- start start 2024-09-10T21:03:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 Processor -- start 2024-09-10T21:03:23.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e94f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b2f20 con 0x56349e93e6a0 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b4390 con 0x56349e94fe10 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45d79e7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b35f0 con 0x56349e94af50 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.846+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45cf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40186/0 (socket says 172.21.15.67:40186) 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45cf7fe640 1 -- 172.21.15.67:0/2434199964 learned_addr learned my addr 172.21.15.67:0/2434199964 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47900/0 (socket says 172.21.15.67:47900) 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e94f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45d79e7740 10 client.0 _ll_register_callbacks cb 0x7f45c000eb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 -- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 msgr2=0x56349e9c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 -- 172.21.15.67:0/2434199964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 msgr2=0x56349e94f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e94f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 -- 172.21.15.67:0/2434199964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349e95d2f0 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45cf7fe640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45ce7fc640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56349e930ec0 tx=0x7f45b801d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf1bd4cc7c0c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b801e420 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f45b801e5c0 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.847+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b801e8d0 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45b801ea80 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 10 client.26518 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56349e9c8390 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45b801e8d0 con 0x56349e94af50 2024-09-10T21:03:23.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f45b8004790 con 0x56349e94af50 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 10 client.26518 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 10 client.26518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 20 client.26518 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e9c8980 0x56349e9cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 4 client.26518 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56349e8b28a0 con 0x56349e9c8980 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.848+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e9c8980 0x56349e9cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:23.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45b67fc640 10 client.26518 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:23.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45ceffd640 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e9c8980 0x56349e9cada0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=185b31233481b966 server_cookie=fe83ba8a7a8ca2bd in_seq=0 out_seq=0 2024-09-10T21:03:23.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45b67fc640 1 -- 172.21.15.67:0/2434199964 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56349e8b28a0 con 0x56349e9c8980 2024-09-10T21:03:23.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45b67fc640 10 client.26518 handle_command_reply: tid=0 2024-09-10T21:03:23.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45d79e7740 1 client.26518 shutdown 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 msgr2=0x56349e94f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.849+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56349e930ec0 tx=0x7f45b801d430 comp rx=0 tx=0).stop 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 shutdown_connections 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56349e9c8980 0x56349e9cada0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56349e94fe10 0x56349e9c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56349e94af50 0x56349e94f720 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 --2- 172.21.15.67:0/2434199964 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56349e93e6a0 0x56349e94f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.857 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:03:23.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 >> 172.21.15.67:0/2434199964 conn(0x56349e93c4d0 msgr2=0x56349e93ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45b67fc640 0 client.26518 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 shutdown_connections 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 1 -- 172.21.15.67:0/2434199964 wait complete. 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.850+0000 7f45d79e7740 20 client.26518 trim_cache size 0 max 16384 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.851+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 msgr2=0x7f45bc0b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.851+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 0x7f45bc0b77e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45c801a6d0 tx=0x7f45c8005fd0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.851+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 msgr2=0x7f45d0117840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.851+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45c000ebc0 tx=0x7f45c000c6a0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 shutdown_connections 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45d011c0a0 0x7f45d01a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f45bc0b5320 0x7f45bc0b77e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d010a530 0x7f45d0117d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 --2- 172.21.15.67:0/2147487393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45d010a150 0x7f45d0117840 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 >> 172.21.15.67:0/2147487393 conn(0x7f45d006cb30 msgr2=0x7f45d00727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 shutdown_connections 2024-09-10T21:03:23.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:23.852+0000 7f45cffff640 1 -- 172.21.15.67:0/2147487393 wait complete. 2024-09-10T21:03:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 710.0 s, 1682.2 tps, lat 59.667 ms stddev 64.730 2024-09-10T21:03:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:24 smithi083 ceph-mon[35058]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-10T21:03:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:24 smithi172 ceph-mon[35265]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-10T21:03:25.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:24 smithi067 ceph-mon[30891]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 9.5 MiB/s wr, 755 op/s 2024-09-10T21:03:25.561 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:03:25.561 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:03:25.928 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:26.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/1704354636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 msgr2=0x7fe1cc1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/1704354636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc1111b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009860 tx=0x7fe1b402a3d0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/1704354636 shutdown_connections 2024-09-10T21:03:26.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/1704354636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/1704354636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc10a530 0x7fe1cc10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/1704354636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc1111b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.502+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/1704354636 >> 172.21.15.67:0/1704354636 conn(0x7fe1cc06dfc0 msgr2=0x7fe1cc06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.504+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/1704354636 shutdown_connections 2024-09-10T21:03:26.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.505+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/1704354636 wait complete. 2024-09-10T21:03:26.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.506+0000 7fe1d0ccc640 1 Processor -- start 2024-09-10T21:03:26.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 -- start start 2024-09-10T21:03:26.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1cc10a530 0x7fe1cc1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc1127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc121bf0 con 0x7fe1cc11c0a0 2024-09-10T21:03:26.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc121a70 con 0x7fe1cc10a530 2024-09-10T21:03:26.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.507+0000 7fe1d0ccc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc121d70 con 0x7fe1cc10a150 2024-09-10T21:03:26.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.508+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc1127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.508+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc1127d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38302/0 (socket says 172.21.15.67:38302) 2024-09-10T21:03:26.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.508+0000 7fe1cad9d640 1 -- 172.21.15.67:0/2772195375 learned_addr learned my addr 172.21.15.67:0/2772195375 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:26.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 -- 172.21.15.67:0/2772195375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1cc10a530 msgr2=0x7fe1cc1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1cc10a530 0x7fe1cc1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 -- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 msgr2=0x7fe1cc1127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc1127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.509+0000 7fe1ca59c640 1 -- 172.21.15.67:0/2772195375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc113090 con 0x7fe1cc10a150 2024-09-10T21:03:26.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.511+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc119480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009780 tx=0x7fe1b4005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.512+0000 7fe1c3fff640 1 -- 172.21.15.67:0/2772195375 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4040070 con 0x7fe1cc10a150 2024-09-10T21:03:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.512+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc113320 con 0x7fe1cc10a150 2024-09-10T21:03:26.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.512+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc118340 con 0x7fe1cc10a150 2024-09-10T21:03:26.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.516+0000 7fe1d30a1740 1 Processor -- start 2024-09-10T21:03:26.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.516+0000 7fe1d30a1740 1 -- start start 2024-09-10T21:03:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd292250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40216/0 (socket says 172.21.15.67:40216) 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1cad9d640 1 -- 172.21.15.67:0/504590696 learned_addr learned my addr 172.21.15.67:0/504590696 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd294b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5598cd1fce60 con 0x5598cd286800 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5598cd1ec290 con 0x5598cd285ee0 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598cd1f00a0 con 0x5598cd292790 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.517+0000 7fe1c3fff640 1 -- 172.21.15.67:0/2772195375 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1b40318b0 con 0x7fe1cc10a150 2024-09-10T21:03:26.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.518+0000 7fe1c3fff640 1 -- 172.21.15.67:0/2772195375 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4004e40 con 0x7fe1cc10a150 2024-09-10T21:03:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.522+0000 7fe1cad9d640 1 -- 172.21.15.67:0/504590696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 msgr2=0x5598cd294b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.522+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd294b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.522+0000 7fe1cad9d640 1 -- 172.21.15.67:0/504590696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 msgr2=0x5598cd292250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.522+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd292250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.522+0000 7fe1cad9d640 1 -- 172.21.15.67:0/504590696 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598ccf4a930 con 0x5598cd285ee0 2024-09-10T21:03:26.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.526+0000 7fe1c3fff640 1 -- 172.21.15.67:0/2772195375 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe1b40046c0 con 0x7fe1cc10a150 2024-09-10T21:03:26.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.527+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010440 tx=0x7fe1c4010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f2b2fc15c16634 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.527+0000 7fe1c3fff640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 0x7fe1b80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.527+0000 7fe1c0d99640 1 -- 172.21.15.67:0/504590696 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4003b70 con 0x5598cd285ee0 2024-09-10T21:03:26.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.528+0000 7fe1c0d99640 1 -- 172.21.15.67:0/504590696 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c400ebd0 con 0x5598cd285ee0 2024-09-10T21:03:26.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.528+0000 7fe1c0d99640 1 -- 172.21.15.67:0/504590696 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400cc40 con 0x5598cd285ee0 2024-09-10T21:03:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.528+0000 7fe1c3fff640 1 -- 172.21.15.67:0/2772195375 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1b4107170 con 0x7fe1cc10a150 2024-09-10T21:03:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.529+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 msgr2=0x5598cd2862c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.529+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010440 tx=0x7fe1c4010900 comp rx=0 tx=0).stop 2024-09-10T21:03:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.532+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 shutdown_connections 2024-09-10T21:03:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.532+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd294b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.532+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd292250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.532+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/504590696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd2862c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.532+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 >> 172.21.15.67:0/504590696 conn(0x5598cd283d10 msgr2=0x5598cd284eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.536+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 0x7fe1b80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.536+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 shutdown_connections 2024-09-10T21:03:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.536+0000 7fe1d30a1740 1 -- 172.21.15.67:0/504590696 wait complete. 2024-09-10T21:03:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.537+0000 7fe1ca59c640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 0x7fe1b80b78e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40cd890 tx=0x7fe1b402a3d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.537+0000 7fe1d30a1740 1 -- start start 2024-09-10T21:03:26.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.537+0000 7fe1d30a1740 1 Processor -- start 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.538+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd28f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.538+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.538+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd290150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5598cd04d890 con 0x5598cd286800 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5598cd186d40 con 0x5598cd285ee0 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38320/0 (socket says 172.21.15.67:38320) 2024-09-10T21:03:26.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3971173056 learned_addr learned my addr 172.21.15.67:0/3971173056 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598cd295440 con 0x5598cd292790 2024-09-10T21:03:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd28f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.539+0000 7fe1d30a1740 10 client.0 _ll_register_callbacks cb 0x5598cd1eac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd290150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3971173056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 msgr2=0x5598cd290150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd290150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 msgr2=0x5598cd28f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd28f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3971173056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598cd29e830 con 0x5598cd286800 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.540+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd290150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.541+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009e20 tx=0x7fe1bc00b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a50fefc4e1e55f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.541+0000 7fe1b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:03:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.542+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc015020 con 0x5598cd286800 2024-09-10T21:03:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.542+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1bc011620 con 0x5598cd286800 2024-09-10T21:03:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.546+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c400ebd0 con 0x5598cd286800 2024-09-10T21:03:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.546+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc00be30 con 0x5598cd286800 2024-09-10T21:03:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.547+0000 7fe1d30a1740 10 client.16857 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:26.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.547+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5598cd2a1270 con 0x5598cd286800 2024-09-10T21:03:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.548+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c400ebd0 con 0x5598cd286800 2024-09-10T21:03:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.548+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe1bc019a20 con 0x5598cd286800 2024-09-10T21:03:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 10 client.16857 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 10 client.16857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 20 client.16857 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd2a26d0 0x5598cd2a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 4 client.16857 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:26.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.549+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598cd1fedb0 con 0x5598cd2a26d0 2024-09-10T21:03:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.551+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd2a26d0 0x5598cd2a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.552+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd2a26d0 0x5598cd2a4b10 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57efb6bf95d032a7 server_cookie=1c41e801e4c67537 in_seq=0 out_seq=0 2024-09-10T21:03:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.552+0000 7fe1b1ffb640 10 client.16857 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.553+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3971173056 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598cd1fedb0 con 0x5598cd2a26d0 2024-09-10T21:03:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.553+0000 7fe1b1ffb640 10 client.16857 handle_command_reply: tid=0 2024-09-10T21:03:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.553+0000 7fe1d30a1740 1 client.16857 shutdown 2024-09-10T21:03:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 msgr2=0x5598cd28fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009e20 tx=0x7fe1bc00b4b0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 shutdown_connections 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd2a26d0 0x5598cd2a4b10 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd290150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd28fc10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3971173056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd285ee0 0x5598cd28f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 >> 172.21.15.67:0/3971173056 conn(0x5598cd283d10 msgr2=0x5598cd282f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.554+0000 7fe1b1ffb640 0 client.16857 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:26.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.555+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 shutdown_connections 2024-09-10T21:03:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.556+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3971173056 wait complete. 2024-09-10T21:03:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.556+0000 7fe1d30a1740 20 client.16857 trim_cache size 0 max 16384 2024-09-10T21:03:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 Processor -- start 2024-09-10T21:03:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 -- start start 2024-09-10T21:03:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd28c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac010d50 con 0x5598cd285ee0 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac00e620 con 0x5598cd286800 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.584+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac00c470 con 0x5598cd292790 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40232/0 (socket says 172.21.15.67:40232) 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/342429562 learned_addr learned my addr 172.21.15.67:0/342429562 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38322/0 (socket says 172.21.15.67:38322) 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd28c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 -- 172.21.15.67:0/342429562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 msgr2=0x5598cd28c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd28c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 -- 172.21.15.67:0/342429562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 msgr2=0x5598cd291410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 -- 172.21.15.67:0/342429562 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598cd284790 con 0x5598cd285ee0 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010e00 tx=0x7fe1c400c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb2fb76226d2281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1b3fff640 1 -- 172.21.15.67:0/342429562 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4034020 con 0x5598cd285ee0 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.585+0000 7fe1b3fff640 1 -- 172.21.15.67:0/342429562 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c4003e20 con 0x5598cd285ee0 2024-09-10T21:03:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1b3fff640 1 -- 172.21.15.67:0/342429562 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400e9a0 con 0x5598cd285ee0 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 -- 172.21.15.67:0/342429562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 msgr2=0x5598cd285290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010e00 tx=0x7fe1c400c4f0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 -- 172.21.15.67:0/342429562 shutdown_connections 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd292790 0x5598cd28c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd286800 0x5598cd291410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/342429562 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd285ee0 0x5598cd285290 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.586+0000 7fe1d30a1740 1 -- 172.21.15.67:0/342429562 >> 172.21.15.67:0/342429562 conn(0x5598cd283d10 msgr2=0x5598cd290d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- 172.21.15.67:0/342429562 shutdown_connections 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- 172.21.15.67:0/342429562 wait complete. 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- start start 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 Processor -- start 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 0x5598cd29aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd292790 0x5598cd295760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac00cae0 con 0x5598cd286800 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac00df50 con 0x5598cd292790 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac00d1b0 con 0x5598cd285ee0 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1d30a1740 10 client.0 _ll_register_callbacks cb 0x7fe1bc006ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:26.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 0x5598cd29aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38334/0 (socket says 172.21.15.67:38334) 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1cad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 0x5598cd29aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47944/0 (socket says 172.21.15.67:47944) 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.587+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3653395655 learned_addr learned my addr 172.21.15.67:0/3653395655 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd292790 0x5598cd295760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3653395655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 msgr2=0x5598cd29aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 0x5598cd29aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd292790 msgr2=0x5598cd295760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd292790 0x5598cd295760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 -- 172.21.15.67:0/3653395655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598cd295f90 con 0x5598cd286800 2024-09-10T21:03:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1c1d9b640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc010680 tx=0x7fe1bc0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948f2c1934f62fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc027020 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1c4003e20 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1bc010ce0 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc015070 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1d30a1740 10 client.16863 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.588+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5598cd310220 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1c4003e20 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe1bc023460 con 0x5598cd286800 2024-09-10T21:03:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 10 client.16863 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 20 client.16863 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd3109d0 0x5598cd312df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 4 client.16863 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5598cd1fa860 con 0x5598cd3109d0 2024-09-10T21:03:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.589+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd3109d0 0x5598cd312df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.591+0000 7fe1b1ffb640 10 client.16863 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.591+0000 7fe1cad9d640 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd3109d0 0x5598cd312df0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7990f7a6553ab6 server_cookie=dae2d27bd749bcdb in_seq=0 out_seq=0 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.592+0000 7fe1b1ffb640 1 -- 172.21.15.67:0/3653395655 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5598cd1fa860 con 0x5598cd3109d0 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.592+0000 7fe1b1ffb640 10 client.16863 handle_command_reply: tid=0 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.592+0000 7fe1d30a1740 1 client.16863 shutdown 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 msgr2=0x5598cd29af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc010680 tx=0x7fe1bc0106b0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 shutdown_connections 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5598cd3109d0 0x5598cd312df0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5598cd292790 0x5598cd295760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5598cd286800 0x5598cd29af80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 --2- 172.21.15.67:0/3653395655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598cd285ee0 0x5598cd29aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 >> 172.21.15.67:0/3653395655 conn(0x5598cd283d10 msgr2=0x5598cd291520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1b1ffb640 0 client.16863 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 shutdown_connections 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 1 -- 172.21.15.67:0/3653395655 wait complete. 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.593+0000 7fe1d30a1740 20 client.16863 trim_cache size 0 max 16384 2024-09-10T21:03:26.600 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:03:26.601 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:03:26.601 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "a5fc1e9b-49b6-4d79-9338-dac38d5d982c", 2024-09-10T21:03:26.601 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:03:26.601 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 msgr2=0x7fe1b80b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 0x7fe1b80b78e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40cd890 tx=0x7fe1b402a3d0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 msgr2=0x7fe1cc119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc119480 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009780 tx=0x7fe1b4005270 comp rx=0 tx=0).stop 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 shutdown_connections 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1cc11c0a0 0x7fe1cc1127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1cc10a530 0x7fe1cc1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1b80b5420 0x7fe1b80b78e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 --2- 172.21.15.67:0/2772195375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1cc10a150 0x7fe1cc119480 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 >> 172.21.15.67:0/2772195375 conn(0x7fe1cc06dfc0 msgr2=0x7fe1cc11c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 shutdown_connections 2024-09-10T21:03:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:26.594+0000 7fe1d0ccc640 1 -- 172.21.15.67:0/2772195375 wait complete. 2024-09-10T21:03:26.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:26 smithi067 ceph-mon[30891]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.7 MiB/s wr, 599 op/s 2024-09-10T21:03:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:26 smithi083 ceph-mon[35058]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.7 MiB/s wr, 599 op/s 2024-09-10T21:03:26.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:26 smithi172 ceph-mon[35265]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.7 MiB/s wr, 599 op/s 2024-09-10T21:03:27.615 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:03:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:03:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:03:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:03:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:03:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:03:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:27.987 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:03:28.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:28.047 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:28.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 -- 172.21.15.67:0/3350497521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a530 msgr2=0x7f7ef810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 --2- 172.21.15.67:0/3350497521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a530 0x7f7ef810a930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009860 tx=0x7f7ee802a410 comp rx=0 tx=0).stop 2024-09-10T21:03:28.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 -- 172.21.15.67:0/3350497521 shutdown_connections 2024-09-10T21:03:28.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 --2- 172.21.15.67:0/3350497521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef811c0a0 0x7f7ef811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 --2- 172.21.15.67:0/3350497521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a530 0x7f7ef810a930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 --2- 172.21.15.67:0/3350497521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef810a150 0x7f7ef81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.603+0000 7f7f00094640 1 -- 172.21.15.67:0/3350497521 >> 172.21.15.67:0/3350497521 conn(0x7f7ef806dfc0 msgr2=0x7f7ef806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.606+0000 7f7f00094640 1 -- 172.21.15.67:0/3350497521 shutdown_connections 2024-09-10T21:03:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.606+0000 7f7f00094640 1 -- 172.21.15.67:0/3350497521 wait complete. 2024-09-10T21:03:28.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 Processor -- start 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 -- start start 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef810a530 0x7f7ef8119a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef811c0a0 0x7f7ef8112950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8121c10 con 0x7f7ef810a530 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8121a90 con 0x7f7ef810a150 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7f00094640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef8121d90 con 0x7f7ef811c0a0 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7efde30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7efde30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40264/0 (socket says 172.21.15.67:40264) 2024-09-10T21:03:28.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.607+0000 7f7efde30640 1 -- 172.21.15.67:0/3440374333 learned_addr learned my addr 172.21.15.67:0/3440374333 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:28.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efd62f640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef810a530 0x7f7ef8119a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efde30640 1 -- 172.21.15.67:0/3440374333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef811c0a0 msgr2=0x7f7ef8112950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:03:28.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efde30640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef811c0a0 0x7f7ef8112950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efde30640 1 -- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef810a530 msgr2=0x7f7ef8119a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efde30640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef810a530 0x7f7ef8119a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.613+0000 7f7efde30640 1 -- 172.21.15.67:0/3440374333 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef8113210 con 0x7f7ef810a150 2024-09-10T21:03:28.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.617+0000 7f7efde30640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9c0 tx=0x7f7ef400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.621+0000 7f7eeeffd640 1 -- 172.21.15.67:0/3440374333 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400ccc0 con 0x7f7ef810a150 2024-09-10T21:03:28.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.622+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef8113500 con 0x7f7ef810a150 2024-09-10T21:03:28.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.622+0000 7f7eeeffd640 1 -- 172.21.15.67:0/3440374333 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef40054d0 con 0x7f7ef810a150 2024-09-10T21:03:28.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.622+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef81184c0 con 0x7f7ef810a150 2024-09-10T21:03:28.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.622+0000 7f7eeeffd640 1 -- 172.21.15.67:0/3440374333 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4010430 con 0x7f7ef810a150 2024-09-10T21:03:28.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.626+0000 7f7f02469740 1 Processor -- start 2024-09-10T21:03:28.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.628+0000 7f7f02469740 1 -- start start 2024-09-10T21:03:28.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.628+0000 7f7f02469740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efdb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.628+0000 7f7f02469740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7f02469740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7f02469740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56465ef51e50 con 0x56465efdbda0 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7f02469740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56465ef41280 con 0x56465efdb480 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7f02469740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56465ef45090 con 0x56465efe7d30 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:47978/0 (socket says 172.21.15.67:47978) 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 -- 172.21.15.67:0/4073746971 learned_addr learned my addr 172.21.15.67:0/4073746971 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:28.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7eeeffd640 1 -- 172.21.15.67:0/3440374333 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7ef40105d0 con 0x7f7ef810a150 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 -- 172.21.15.67:0/4073746971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 msgr2=0x56465efdb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efdb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 -- 172.21.15.67:0/4073746971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 msgr2=0x56465efe77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.629+0000 7f7efd62f640 1 -- 172.21.15.67:0/4073746971 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465ec9f650 con 0x56465efe7d30 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.630+0000 7f7efd62f640 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8031000 tx=0x7f7ee8005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73138fabc62e4a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.631+0000 7f7eeeffd640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 0x7f7ee40b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.631+0000 7f7ee3fff640 1 -- 172.21.15.67:0/4073746971 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8004250 con 0x56465efe7d30 2024-09-10T21:03:28.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.631+0000 7f7ee3fff640 1 -- 172.21.15.67:0/4073746971 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee8041030 con 0x56465efe7d30 2024-09-10T21:03:28.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.633+0000 7f7f02469740 1 -- 172.21.15.67:0/4073746971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 msgr2=0x56465efea120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.633+0000 7f7f02469740 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8031000 tx=0x7f7ee8005cd0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.633+0000 7f7eeeffd640 1 -- 172.21.15.67:0/3440374333 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7ef40e61e0 con 0x7f7ef810a150 2024-09-10T21:03:28.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.633+0000 7f7efe631640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 0x7f7ee40b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.636+0000 7f7efe631640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 0x7f7ee40b7850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000aa90 tx=0x7f7ef0009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 -- 172.21.15.67:0/4073746971 shutdown_connections 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efea120 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 --2- 172.21.15.67:0/4073746971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efdb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 -- 172.21.15.67:0/4073746971 >> 172.21.15.67:0/4073746971 conn(0x56465efd92b0 msgr2=0x56465efda450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 -- 172.21.15.67:0/4073746971 shutdown_connections 2024-09-10T21:03:28.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.638+0000 7f7f02469740 1 -- 172.21.15.67:0/4073746971 wait complete. 2024-09-10T21:03:28.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.639+0000 7f7f02469740 1 -- start start 2024-09-10T21:03:28.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.639+0000 7f7f02469740 1 Processor -- start 2024-09-10T21:03:28.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.640+0000 7f7f02469740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efe7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.640+0000 7f7f02469740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.641+0000 7f7efde30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efe7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.641+0000 7f7efde30640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efe7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:40288/0 (socket says 172.21.15.67:40288) 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.641+0000 7f7efde30640 1 -- 172.21.15.67:0/588965497 learned_addr learned my addr 172.21.15.67:0/588965497 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.641+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.641+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56465eda2700 con 0x56465efdbda0 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.642+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56465eedc110 con 0x56465efdb480 2024-09-10T21:03:28.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.642+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56465efea9a0 con 0x56465efe7d30 2024-09-10T21:03:28.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.642+0000 7f7f02469740 10 client.0 _ll_register_callbacks cb 0x56465eef5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:28.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.643+0000 7f7efe631640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.644+0000 7f7efd62f640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.644+0000 7f7efe631640 1 -- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 msgr2=0x56465efe7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.644+0000 7f7efe631640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efe7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.644+0000 7f7efe631640 1 -- 172.21.15.67:0/588965497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 msgr2=0x56465efe4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.645+0000 7f7efe631640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.645+0000 7f7efe631640 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465ef09c40 con 0x56465efe7d30 2024-09-10T21:03:28.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.645+0000 7f7efe631640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000afd0 tx=0x7f7ef0004b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd7e7b54ffea31f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.645+0000 7f7ee17fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:03:28.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.646+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0018990 con 0x56465efe7d30 2024-09-10T21:03:28.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.647+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee8041030 con 0x56465efe7d30 2024-09-10T21:03:28.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.647+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7ef0018b30 con 0x56465efe7d30 2024-09-10T21:03:28.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.648+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7ef002a070 con 0x56465efe7d30 2024-09-10T21:03:28.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.648+0000 7f7f02469740 10 client.26539 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:28.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.648+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56465eff6400 con 0x56465efe7d30 2024-09-10T21:03:28.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.648+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee8041030 con 0x56465efe7d30 2024-09-10T21:03:28.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.649+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7ef001a420 con 0x56465efe7d30 2024-09-10T21:03:28.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 10 client.26539 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:28.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 10 client.26539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 20 client.26539 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465eff7c90 0x56465effa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 4 client.26539 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.650+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56465ef53da0 con 0x56465eff7c90 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.651+0000 7f7efde30640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465eff7c90 0x56465effa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.651+0000 7f7efde30640 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465eff7c90 0x56465effa0b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=157a99ad72148c56 server_cookie=6f4e5114c022a7d7 in_seq=0 out_seq=0 2024-09-10T21:03:28.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.652+0000 7f7ee17fa640 10 client.26539 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:28.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.652+0000 7f7ee17fa640 1 -- 172.21.15.67:0/588965497 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56465ef53da0 con 0x56465eff7c90 2024-09-10T21:03:28.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.653+0000 7f7ee17fa640 10 client.26539 handle_command_reply: tid=0 2024-09-10T21:03:28.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.653+0000 7f7f02469740 1 client.26539 shutdown 2024-09-10T21:03:28.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.653+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 msgr2=0x56465efe50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.653+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe50d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000afd0 tx=0x7f7ef0004b60 comp rx=0 tx=0).stop 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 shutdown_connections 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465eff7c90 0x56465effa0b0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe50d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efe4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 --2- 172.21.15.67:0/588965497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdb480 0x56465efe7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7ee17fa640 0 client.26539 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:28.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 >> 172.21.15.67:0/588965497 conn(0x56465efd92b0 msgr2=0x56465efdee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 shutdown_connections 2024-09-10T21:03:28.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.654+0000 7f7f02469740 1 -- 172.21.15.67:0/588965497 wait complete. 2024-09-10T21:03:28.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.657+0000 7f7f02469740 20 client.26539 trim_cache size 0 max 16384 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 Processor -- start 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 -- start start 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 0x56465efe4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efe7d30 0x56465efe01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c82b0 con 0x56465efdbda0 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c5b80 con 0x56465efe7d30 2024-09-10T21:03:28.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7f02469740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c39d0 con 0x56465efdb480 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.688+0000 7f7efd62f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efde30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 0x56465efe4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38384/0 (socket says 172.21.15.67:38384) 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 -- 172.21.15.67:0/1168163171 learned_addr learned my addr 172.21.15.67:0/1168163171 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efe631640 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efe7d30 0x56465efe01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 -- 172.21.15.67:0/1168163171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 msgr2=0x56465efe4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 0x56465efe4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 -- 172.21.15.67:0/1168163171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efe7d30 msgr2=0x56465efe01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efe7d30 0x56465efe01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 -- 172.21.15.67:0/1168163171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465efe2fa0 con 0x56465efdbda0 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efde30640 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 0x56465efe4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:03:28.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7efd62f640 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009860 tx=0x7f7ee8004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec4a5d465bb6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7ee37fe640 1 -- 172.21.15.67:0/1168163171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80046c0 con 0x56465efdbda0 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7ee37fe640 1 -- 172.21.15.67:0/1168163171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee8041070 con 0x56465efdbda0 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.689+0000 7f7ee37fe640 1 -- 172.21.15.67:0/1168163171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8030600 con 0x56465efdbda0 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 -- 172.21.15.67:0/1168163171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 msgr2=0x56465efdfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009860 tx=0x7f7ee8004950 comp rx=0 tx=0).stop 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 -- 172.21.15.67:0/1168163171 shutdown_connections 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efe7d30 0x56465efe01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdbda0 0x56465efdfca0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 --2- 172.21.15.67:0/1168163171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efdb480 0x56465efe4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 -- 172.21.15.67:0/1168163171 >> 172.21.15.67:0/1168163171 conn(0x56465efd92b0 msgr2=0x56465efda370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 -- 172.21.15.67:0/1168163171 shutdown_connections 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.690+0000 7f7f02469740 1 -- 172.21.15.67:0/1168163171 wait complete. 2024-09-10T21:03:28.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 -- start start 2024-09-10T21:03:28.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 Processor -- start 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 0x56465eff0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 0x56465efe9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c4040 con 0x56465efdb480 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c54b0 con 0x56465efdbda0 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef81c4710 con 0x56465efe7d30 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7f02469740 10 client.0 _ll_register_callbacks cb 0x7f7ef000a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7efde30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 0x56465eff0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7efd62f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 0x56465efe9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.691+0000 7f7efde30640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 0x56465eff0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38386/0 (socket says 172.21.15.67:38386) 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efde30640 1 -- 172.21.15.67:0/2003625292 learned_addr learned my addr 172.21.15.67:0/2003625292 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efe631640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 -- 172.21.15.67:0/2003625292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 msgr2=0x56465efe9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 -- 172.21.15.67:0/2003625292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 msgr2=0x56465eff0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 0x56465eff0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 -- 172.21.15.67:0/2003625292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465efe9e40 con 0x56465efdbda0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efe631640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7efd62f640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 0x56465efe9090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ee802a980 tx=0x7f7ee8005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c776232d1c4e7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7ee17fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.692+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8009430 con 0x56465efdbda0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.693+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee8041070 con 0x56465efdbda0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.693+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7ee80305b0 con 0x56465efdbda0 2024-09-10T21:03:28.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.693+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7ee80307d0 con 0x56465efdbda0 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.693+0000 7f7f02469740 10 client.26597 fetch_fsmap learned FSMap version 34 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.693+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56465f064c80 con 0x56465efdbda0 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee8041070 con 0x56465efdbda0 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7ee805a030 con 0x56465efdbda0 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 10 client.26597 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 10 client.26597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 20 client.26597 populate_metadata read hostname 'smithi067' 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465f064f00 0x56465f0672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 4 client.26597 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56465ef4f850 con 0x56465f064f00 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.694+0000 7f7efde30640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465f064f00 0x56465f0672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7ee17fa640 10 client.26597 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7efde30640 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465f064f00 0x56465f0672f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24583781a612cbd server_cookie=6369a593cc46055a in_seq=0 out_seq=0 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7ee17fa640 1 -- 172.21.15.67:0/2003625292 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x56465ef4f850 con 0x56465f064f00 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7ee17fa640 10 client.26597 handle_command_reply: tid=0 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7f02469740 1 client.26597 shutdown 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 msgr2=0x56465efe9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.695+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 0x56465efe9090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ee802a980 tx=0x7f7ee8005dc0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 shutdown_connections 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x56465f064f00 0x56465f0672f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56465efe7d30 0x56465efe9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56465efdbda0 0x56465efe9090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7ee17fa640 0 client.26597 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 --2- 172.21.15.67:0/2003625292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56465efdb480 0x56465eff0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 >> 172.21.15.67:0/2003625292 conn(0x56465efd92b0 msgr2=0x56465efdfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 shutdown_connections 2024-09-10T21:03:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 1 -- 172.21.15.67:0/2003625292 wait complete. 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.696+0000 7f7f02469740 20 client.26597 trim_cache size 0 max 16384 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "a5fc1e9b-49b6-4d79-9338-dac38d5d982c", 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:03:28.706 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.707 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.708 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.709 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.710 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:03:28.711 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.713 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:03:28.714 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.715 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:03:28.716 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 msgr2=0x7f7ee40b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 0x7f7ee40b7850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000aa90 tx=0x7f7ef0009230 comp rx=0 tx=0).stop 2024-09-10T21:03:28.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 msgr2=0x7f7ef81194f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9c0 tx=0x7f7ef400ee80 comp rx=0 tx=0).stop 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 shutdown_connections 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7ee40b5390 0x7f7ee40b7850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ef811c0a0 0x7f7ef8112950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ef810a530 0x7f7ef8119a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 --2- 172.21.15.67:0/3440374333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7ef810a150 0x7f7ef81194f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 >> 172.21.15.67:0/3440374333 conn(0x7f7ef806dfc0 msgr2=0x7f7ef811c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 shutdown_connections 2024-09-10T21:03:28.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:03:28.697+0000 7f7f00094640 1 -- 172.21.15.67:0/3440374333 wait complete. 2024-09-10T21:03:28.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:28 smithi067 ceph-mon[30891]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-10T21:03:28.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:28 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:28 smithi083 ceph-mon[35058]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-10T21:03:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:28 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:28 smithi172 ceph-mon[35265]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-10T21:03:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:28 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:03:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 715.0 s, 1551.4 tps, lat 64.296 ms stddev 71.136 2024-09-10T21:03:29.634 INFO:tasks.cephfs.filesystem:scrub status for tag:a5fc1e9b-49b6-4d79-9338-dac38d5d982c - {'path': '/', 'tag': 'a5fc1e9b-49b6-4d79-9338-dac38d5d982c', 'options': 'recursive,force'} 2024-09-10T21:03:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:30 smithi083 ceph-mon[35058]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 714 op/s 2024-09-10T21:03:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:30 smithi172 ceph-mon[35265]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 714 op/s 2024-09-10T21:03:31.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:30 smithi067 ceph-mon[30891]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 714 op/s 2024-09-10T21:03:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:32 smithi083 ceph-mon[35058]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 633 op/s 2024-09-10T21:03:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:32 smithi172 ceph-mon[35265]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 633 op/s 2024-09-10T21:03:33.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:32 smithi067 ceph-mon[30891]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 633 op/s 2024-09-10T21:03:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 720.0 s, 2497.2 tps, lat 40.043 ms stddev 45.997 2024-09-10T21:03:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:34 smithi083 ceph-mon[35058]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 752 op/s 2024-09-10T21:03:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:34 smithi172 ceph-mon[35265]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 752 op/s 2024-09-10T21:03:35.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:34 smithi067 ceph-mon[30891]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 752 op/s 2024-09-10T21:03:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:36 smithi083 ceph-mon[35058]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.2 MiB/s wr, 601 op/s 2024-09-10T21:03:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:36 smithi172 ceph-mon[35265]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.2 MiB/s wr, 601 op/s 2024-09-10T21:03:37.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:36 smithi067 ceph-mon[30891]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.2 MiB/s wr, 601 op/s 2024-09-10T21:03:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:38 smithi083 ceph-mon[35058]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-10T21:03:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:38 smithi172 ceph-mon[35265]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-10T21:03:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 725.0 s, 1913.8 tps, lat 52.311 ms stddev 61.275 2024-09-10T21:03:39.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:38 smithi067 ceph-mon[30891]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.3 MiB/s wr, 683 op/s 2024-09-10T21:03:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:40 smithi083 ceph-mon[35058]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 699 op/s 2024-09-10T21:03:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:40 smithi172 ceph-mon[35265]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 699 op/s 2024-09-10T21:03:41.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:40 smithi067 ceph-mon[30891]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 699 op/s 2024-09-10T21:03:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:03:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:03:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:03:42.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:03:42.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:03:42.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:03:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:03:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:03:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:03:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:42 smithi172 ceph-mon[35265]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-10T21:03:43.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:42 smithi067 ceph-mon[30891]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-10T21:03:43.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:42 smithi083 ceph-mon[35058]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 563 op/s 2024-09-10T21:03:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 730.0 s, 2183.8 tps, lat 45.832 ms stddev 54.552 2024-09-10T21:03:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:44 smithi172 ceph-mon[35265]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 712 op/s 2024-09-10T21:03:45.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:44 smithi067 ceph-mon[30891]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 712 op/s 2024-09-10T21:03:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:44 smithi083 ceph-mon[35058]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 712 op/s 2024-09-10T21:03:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:46 smithi172 ceph-mon[35265]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-09-10T21:03:47.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:46 smithi067 ceph-mon[30891]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-09-10T21:03:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:46 smithi083 ceph-mon[35058]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 MiB/s wr, 611 op/s 2024-09-10T21:03:47.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:47 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:03:48.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:47 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:03:48.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:47 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:03:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2024-09-10T21:03:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:48.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:48.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:03:48.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:03:48.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:48 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 735.0 s, 1908.8 tps, lat 52.168 ms stddev 55.242 2024-09-10T21:03:49.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2024-09-10T21:03:49.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:03:49.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:03:49.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:48 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 MiB/s wr, 682 op/s 2024-09-10T21:03:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:49.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:03:49.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:03:49.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:48 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:03:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:50 smithi172 ceph-mon[35265]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-09-10T21:03:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:50 smithi067 ceph-mon[30891]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-09-10T21:03:51.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:50 smithi083 ceph-mon[35058]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-09-10T21:03:53.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:52 smithi067 ceph-mon[30891]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-09-10T21:03:53.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:52 smithi083 ceph-mon[35058]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-09-10T21:03:53.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:52 smithi172 ceph-mon[35265]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 MiB/s wr, 569 op/s 2024-09-10T21:03:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 740.0 s, 1648.4 tps, lat 60.718 ms stddev 65.461 2024-09-10T21:03:55.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:54 smithi067 ceph-mon[30891]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.4 MiB/s wr, 694 op/s 2024-09-10T21:03:55.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:54 smithi083 ceph-mon[35058]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.4 MiB/s wr, 694 op/s 2024-09-10T21:03:55.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:54 smithi172 ceph-mon[35265]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 7.4 MiB/s wr, 694 op/s 2024-09-10T21:03:57.001 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:56 smithi172 ceph-mon[35265]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.5 MiB/s wr, 592 op/s 2024-09-10T21:03:57.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:56 smithi067 ceph-mon[30891]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.5 MiB/s wr, 592 op/s 2024-09-10T21:03:57.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:56 smithi083 ceph-mon[35058]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 6.5 MiB/s wr, 592 op/s 2024-09-10T21:03:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 745.0 s, 1957.8 tps, lat 51.199 ms stddev 64.679 2024-09-10T21:03:59.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:03:58 smithi067 ceph-mon[30891]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 612 op/s 2024-09-10T21:03:59.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:03:58 smithi083 ceph-mon[35058]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 612 op/s 2024-09-10T21:03:59.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:03:58 smithi172 ceph-mon[35265]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.4 MiB/s wr, 612 op/s 2024-09-10T21:03:59.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:04:00.070 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:00.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.687+0000 7f76f6b15640 1 -- 172.21.15.67:0/1027347886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f011c0a0 msgr2=0x7f76f011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.687+0000 7f76f6b15640 1 --2- 172.21.15.67:0/1027347886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f011c0a0 0x7f76f011e490 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009ca0 tx=0x7f76e802a980 comp rx=0 tx=0).stop 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 -- 172.21.15.67:0/1027347886 shutdown_connections 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 --2- 172.21.15.67:0/1027347886 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f011c0a0 0x7f76f011e490 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 --2- 172.21.15.67:0/1027347886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f010a530 0x7f76f010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 --2- 172.21.15.67:0/1027347886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 0x7f76f01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 -- 172.21.15.67:0/1027347886 >> 172.21.15.67:0/1027347886 conn(0x7f76f006dfc0 msgr2=0x7f76f006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.688+0000 7f76f6b15640 1 -- 172.21.15.67:0/1027347886 shutdown_connections 2024-09-10T21:04:00.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.689+0000 7f76f6b15640 1 -- 172.21.15.67:0/1027347886 wait complete. 2024-09-10T21:04:00.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.689+0000 7f76f6b15640 1 Processor -- start 2024-09-10T21:04:00.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 -- start start 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 0x7f76f0115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 0x7f76f01157a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 0x7f76f011aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0111d50 con 0x7f76f010a530 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0111bd0 con 0x7f76f010a150 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.690+0000 7f76f6b15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0111ed0 con 0x7f76f011c0a0 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.691+0000 7f76f48b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 0x7f76f0115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.691+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 0x7f76f01157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.692+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 0x7f76f01157a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39654/0 (socket says 172.21.15.67:39654) 2024-09-10T21:04:00.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.692+0000 7f76e7fff640 1 -- 172.21.15.67:0/3975771864 learned_addr learned my addr 172.21.15.67:0/3975771864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:00.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 0x7f76f011aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 -- 172.21.15.67:0/3975771864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 msgr2=0x7f76f0115260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 0x7f76f0115260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 -- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 msgr2=0x7f76f01157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 0x7f76f01157a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.693+0000 7f76f50b2640 1 -- 172.21.15.67:0/3975771864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f011b260 con 0x7f76f011c0a0 2024-09-10T21:04:00.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.694+0000 7f76f50b2640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 0x7f76f011aca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76e802aef0 tx=0x7f76e8030c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.699+0000 7f76e5ffb640 1 -- 172.21.15.67:0/3975771864 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8034050 con 0x7f76f011c0a0 2024-09-10T21:04:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.699+0000 7f76e5ffb640 1 -- 172.21.15.67:0/3975771864 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e802fe80 con 0x7f76f011c0a0 2024-09-10T21:04:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.699+0000 7f76e5ffb640 1 -- 172.21.15.67:0/3975771864 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e802e910 con 0x7f76f011c0a0 2024-09-10T21:04:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.699+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f011b4f0 con 0x7f76f011c0a0 2024-09-10T21:04:00.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.702+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f011ba00 con 0x7f76f011c0a0 2024-09-10T21:04:00.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.707+0000 7f76f8eea740 1 Processor -- start 2024-09-10T21:04:00.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.712+0000 7f76e5ffb640 1 -- 172.21.15.67:0/3975771864 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f76e8041070 con 0x7f76f011c0a0 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.713+0000 7f76e5ffb640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 0x7f76d80b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.713+0000 7f76e5ffb640 1 -- 172.21.15.67:0/3975771864 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76e8106d20 con 0x7f76f011c0a0 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 -- start start 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382da0 0x55e28f38e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f391120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e28f2f8e50 con 0x55e28f38ed30 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e28f2e8280 con 0x55e28f382da0 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.714+0000 7f76f8eea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e28f2ec090 con 0x55e28f382480 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51902/0 (socket says 172.21.15.67:51902) 2024-09-10T21:04:00.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 -- 172.21.15.67:0/4062123335 learned_addr learned my addr 172.21.15.67:0/4062123335 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76e7fff640 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382da0 0x55e28f38e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76e7fff640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 0x7f76d80b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f50b2640 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f391120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 -- 172.21.15.67:0/4062123335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382da0 msgr2=0x55e28f38e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382da0 0x55e28f38e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 -- 172.21.15.67:0/4062123335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 msgr2=0x55e28f391120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.715+0000 7f76f48b1640 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f391120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.716+0000 7f76f48b1640 1 -- 172.21.15.67:0/4062123335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e28f046650 con 0x55e28f382480 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.716+0000 7f76f48b1640 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b820 tx=0x7f76e000bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7352075e4fb3159 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.718+0000 7f76d6ffd640 1 -- 172.21.15.67:0/4062123335 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000d950 con 0x55e28f382480 2024-09-10T21:04:00.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.718+0000 7f76d6ffd640 1 -- 172.21.15.67:0/4062123335 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e0019070 con 0x55e28f382480 2024-09-10T21:04:00.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.718+0000 7f76d6ffd640 1 -- 172.21.15.67:0/4062123335 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00123e0 con 0x55e28f382480 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76e7fff640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 0x7f76d80b79a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55e28f381190 tx=0x7f76ec009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 -- 172.21.15.67:0/4062123335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 msgr2=0x55e28f382860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f76e000b820 tx=0x7f76e000bce0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 -- 172.21.15.67:0/4062123335 shutdown_connections 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f391120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382da0 0x55e28f38e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 --2- 172.21.15.67:0/4062123335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f382860 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.719+0000 7f76f8eea740 1 -- 172.21.15.67:0/4062123335 >> 172.21.15.67:0/4062123335 conn(0x55e28f3802b0 msgr2=0x55e28f381450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.720+0000 7f76f8eea740 1 -- 172.21.15.67:0/4062123335 shutdown_connections 2024-09-10T21:04:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.720+0000 7f76f8eea740 1 -- 172.21.15.67:0/4062123335 wait complete. 2024-09-10T21:04:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.720+0000 7f76f8eea740 1 -- start start 2024-09-10T21:04:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.720+0000 7f76f8eea740 1 Processor -- start 2024-09-10T21:04:00.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.721+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.722+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f38ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.722+0000 7f76f48b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.722+0000 7f76f48b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56720/0 (socket says 172.21.15.67:56720) 2024-09-10T21:04:00.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.722+0000 7f76f48b1640 1 -- 172.21.15.67:0/2205421368 learned_addr learned my addr 172.21.15.67:0/2205421368 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.722+0000 7f76e7fff640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f38ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e28f149700 con 0x55e28f38ed30 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e28f283110 con 0x55e28f382480 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e28f3919b0 con 0x55e28f382da0 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f50b2640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f48b1640 1 -- 172.21.15.67:0/2205421368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 msgr2=0x55e28f38ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f48b1640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f38ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f48b1640 1 -- 172.21.15.67:0/2205421368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 msgr2=0x55e28f38c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f48b1640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.723+0000 7f76f48b1640 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e28f2b0c40 con 0x55e28f382480 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.724+0000 7f76f48b1640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76e0014d60 tx=0x7f76e0014d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452b4385220fe0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.725+0000 7f76cffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.725+0000 7f76cffff640 1 -- 172.21.15.67:0/2205421368 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0023070 con 0x55e28f382480 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.725+0000 7f76cffff640 1 -- 172.21.15.67:0/2205421368 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76e000dd60 con 0x55e28f382480 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.725+0000 7f76cffff640 10 client.0 inactive, discarding osd_map(75..75 src has 1..75) 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.726+0000 7f76f8eea740 10 client.0 _ll_register_callbacks cb 0x55e28f29c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:00.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.726+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e0019070 con 0x55e28f382480 2024-09-10T21:04:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.726+0000 7f76cffff640 1 -- 172.21.15.67:0/2205421368 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f76e002d050 con 0x55e28f382480 2024-09-10T21:04:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.727+0000 7f76f8eea740 10 client.26606 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:00.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.727+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55e28f39d030 con 0x55e28f382480 2024-09-10T21:04:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.728+0000 7f76cffff640 1 -- 172.21.15.67:0/2205421368 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f76e0013070 con 0x55e28f382480 2024-09-10T21:04:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 10 client.26606 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:00.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 10 client.26606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 20 client.26606 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f3a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 4 client.26606 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f76e0019070 con 0x55e28f39e380 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76e7fff640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f3a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76cffff640 10 client.26606 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:00.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.729+0000 7f76e7fff640 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f3a0770 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842a3880cf2069c1 server_cookie=a926079b5ae53e7f in_seq=0 out_seq=0 2024-09-10T21:04:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76cffff640 1 -- 172.21.15.67:0/2205421368 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f76e0019070 con 0x55e28f39e380 2024-09-10T21:04:00.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76cffff640 10 client.26606 handle_command_reply: tid=0 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 client.26606 shutdown 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 msgr2=0x55e28f38e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76e0014d60 tx=0x7f76e0014d90 comp rx=0 tx=0).stop 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 shutdown_connections 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f3a0770 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76cffff640 0 client.26606 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f38ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 --2- 172.21.15.67:0/2205421368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38e610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.730+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 >> 172.21.15.67:0/2205421368 conn(0x55e28f3802b0 msgr2=0x55e28f385e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.731+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 shutdown_connections 2024-09-10T21:04:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.731+0000 7f76f8eea740 1 -- 172.21.15.67:0/2205421368 wait complete. 2024-09-10T21:04:00.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.731+0000 7f76f8eea740 20 client.26606 trim_cache size 0 max 16384 2024-09-10T21:04:00.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.754+0000 7f76f8eea740 1 Processor -- start 2024-09-10T21:04:00.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.754+0000 7f76f8eea740 1 -- start start 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.754+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.754+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f8eea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0085fd0 con 0x55e28f38ed30 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f8eea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00838e0 con 0x55e28f382480 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f8eea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0116560 con 0x55e28f382da0 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f50b2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:51922/0 (socket says 172.21.15.67:51922) 2024-09-10T21:04:00.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 -- 172.21.15.67:0/3838407392 learned_addr learned my addr 172.21.15.67:0/3838407392 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:00.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f48b1640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 -- 172.21.15.67:0/3838407392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 msgr2=0x55e28f38c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 -- 172.21.15.67:0/3838407392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 msgr2=0x55e28f38d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 -- 172.21.15.67:0/3838407392 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e28f02d9e0 con 0x55e28f382da0 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f48b1640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76f50b2640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76e7fff640 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a10 tx=0x7f76ec009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddad92c4e64aafd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.755+0000 7f76d67fc640 1 -- 172.21.15.67:0/3838407392 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec01a0d0 con 0x55e28f382da0 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76d67fc640 1 -- 172.21.15.67:0/3838407392 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76ec01a270 con 0x55e28f382da0 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76d67fc640 1 -- 172.21.15.67:0/3838407392 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec02d630 con 0x55e28f382da0 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 -- 172.21.15.67:0/3838407392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 msgr2=0x55e28f3861a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a10 tx=0x7f76ec009520 comp rx=0 tx=0).stop 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 -- 172.21.15.67:0/3838407392 shutdown_connections 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f38ed30 0x55e28f38d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382da0 0x55e28f3861a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 --2- 172.21.15.67:0/3838407392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f382480 0x55e28f38c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 -- 172.21.15.67:0/3838407392 >> 172.21.15.67:0/3838407392 conn(0x55e28f3802b0 msgr2=0x55e28f38d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 -- 172.21.15.67:0/3838407392 shutdown_connections 2024-09-10T21:04:00.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.756+0000 7f76f8eea740 1 -- 172.21.15.67:0/3838407392 wait complete. 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 -- start start 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 Processor -- start 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f3972b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f38ed30 0x55e28f3921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0081dc0 con 0x55e28f382da0 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0083210 con 0x55e28f38ed30 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76f0082470 con 0x55e28f382480 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f8eea740 10 client.0 _ll_register_callbacks cb 0x7f76ec009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76e7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39694/0 (socket says 172.21.15.67:39694) 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76e7fff640 1 -- 172.21.15.67:0/125138276 learned_addr learned my addr 172.21.15.67:0/125138276 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f50b2640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f38ed30 0x55e28f3921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.757+0000 7f76f48b1640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f3972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 -- 172.21.15.67:0/125138276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 msgr2=0x55e28f3972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f3972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 -- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f38ed30 msgr2=0x55e28f3921c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f38ed30 0x55e28f3921c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 -- 172.21.15.67:0/125138276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e28f392800 con 0x55e28f382da0 2024-09-10T21:04:00.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76e7fff640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098a0 tx=0x7f76ec0098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a05bd649593daf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76cffff640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec03c060 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76ec018850 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76ec01a270 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f76ec018a50 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76f8eea740 10 client.16893 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.758+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e28f40bf30 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76ec018bf0 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f76ec003ae0 con 0x55e28f382da0 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 10 client.16893 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 20 client.16893 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:00.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f40e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 4 client.16893 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f76ec01a270 con 0x55e28f39e380 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.759+0000 7f76f48b1640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f40e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.760+0000 7f76cffff640 10 client.16893 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.760+0000 7f76f48b1640 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f40e5b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970495197fa18c52 server_cookie=592e1960de515b1d in_seq=0 out_seq=0 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.760+0000 7f76cffff640 1 -- 172.21.15.67:0/125138276 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x7f76ec01a270 con 0x55e28f39e380 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.760+0000 7f76cffff640 10 client.16893 handle_command_reply: tid=0 2024-09-10T21:04:00.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 client.16893 shutdown 2024-09-10T21:04:00.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 msgr2=0x55e28f391c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098a0 tx=0x7f76ec0098d0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 shutdown_connections 2024-09-10T21:04:00.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55e28f39e380 0x55e28f40e5b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e28f38ed30 0x55e28f3921c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e28f382da0 0x55e28f391c80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 --2- 172.21.15.67:0/125138276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e28f382480 0x55e28f3972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 >> 172.21.15.67:0/125138276 conn(0x55e28f3802b0 msgr2=0x55e28f38d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76cffff640 0 client.16893 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 shutdown_connections 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 1 -- 172.21.15.67:0/125138276 wait complete. 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.761+0000 7f76f8eea740 20 client.16893 trim_cache size 0 max 16384 2024-09-10T21:04:00.776 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.777 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:04:00.778 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.779 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.780 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:04:00.781 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.782 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.783 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:04:00.784 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.785 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.786 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.787 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:00.788 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:00.789 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 msgr2=0x7f76d80b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 0x7f76d80b79a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55e28f381190 tx=0x7f76ec009190 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 msgr2=0x7f76f011aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 0x7f76f011aca0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f76e802aef0 tx=0x7f76e8030c20 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 shutdown_connections 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f76d80b54e0 0x7f76d80b79a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f011c0a0 0x7f76f011aca0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76f010a530 0x7f76f01157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 --2- 172.21.15.67:0/3975771864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76f010a150 0x7f76f0115260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 >> 172.21.15.67:0/3975771864 conn(0x7f76f006dfc0 msgr2=0x7f76f0072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 shutdown_connections 2024-09-10T21:04:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:00.762+0000 7f76f6b15640 1 -- 172.21.15.67:0/3975771864 wait complete. 2024-09-10T21:04:00.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:00 smithi067 ceph-mon[30891]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-09-10T21:04:01.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:00 smithi083 ceph-mon[35058]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-09-10T21:04:01.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:00 smithi172 ceph-mon[35265]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-09-10T21:04:01.824 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:04:01.824 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:04:02.238 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:02.939 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:02 smithi067 ceph-mon[30891]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.4 MiB/s wr, 602 op/s 2024-09-10T21:04:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 -- 172.21.15.67:0/4272088346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c1045c0 msgr2=0x7f567c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 --2- 172.21.15.67:0/4272088346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c1045c0 0x7f567c10cab0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f566c009900 tx=0x7f566c02a410 comp rx=0 tx=0).stop 2024-09-10T21:04:02.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 -- 172.21.15.67:0/4272088346 shutdown_connections 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 --2- 172.21.15.67:0/4272088346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f567c10d100 0x7f567c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 --2- 172.21.15.67:0/4272088346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c1045c0 0x7f567c10cab0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 --2- 172.21.15.67:0/4272088346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c103ca0 0x7f567c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 -- 172.21.15.67:0/4272088346 >> 172.21.15.67:0/4272088346 conn(0x7f567c0fd700 msgr2=0x7f567c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 -- 172.21.15.67:0/4272088346 shutdown_connections 2024-09-10T21:04:02.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.935+0000 7f568403c640 1 -- 172.21.15.67:0/4272088346 wait complete. 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 Processor -- start 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 -- start start 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f567c103ca0 0x7f567c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c10d100 0x7f567c1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f567c112d70 con 0x7f567c10d100 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f567c112bf0 con 0x7f567c103ca0 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.936+0000 7f568403c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f567c112ef0 con 0x7f567c1045c0 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.937+0000 7f56815d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.937+0000 7f56815d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59450/0 (socket says 172.21.15.67:59450) 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.937+0000 7f56815d7640 1 -- 172.21.15.67:0/2223271430 learned_addr learned my addr 172.21.15.67:0/2223271430 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 -- 172.21.15.67:0/2223271430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f567c103ca0 msgr2=0x7f567c101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f567c103ca0 0x7f567c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 -- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c10d100 msgr2=0x7f567c1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c10d100 0x7f567c1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:02.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 -- 172.21.15.67:0/2223271430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c1a7740 con 0x7f567c1045c0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f56815d7640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f566c032fd0 tx=0x7f566c031970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c03f030 con 0x7f567c1045c0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f566c004410 con 0x7f567c1045c0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566c035070 con 0x7f567c1045c0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567c1a79d0 con 0x7f567c1045c0 2024-09-10T21:04:02.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.938+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567c1a7e60 con 0x7f567c1045c0 2024-09-10T21:04:02.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.940+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567c104080 con 0x7f567c1045c0 2024-09-10T21:04:02.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.941+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f566c003c10 con 0x7f567c1045c0 2024-09-10T21:04:02.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.942+0000 7f5672ffd640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 0x7f56680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:02.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.943+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f566c106930 con 0x7f567c1045c0 2024-09-10T21:04:02.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.943+0000 7f5681dd8640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 0x7f56680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:02.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.944+0000 7f5681dd8640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 0x7f56680b7820 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5678005c40 tx=0x7f5678005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:02.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:02.945+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f566c049020 con 0x7f567c1045c0 2024-09-10T21:04:03.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:02 smithi083 ceph-mon[35058]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.4 MiB/s wr, 602 op/s 2024-09-10T21:04:03.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:02 smithi172 ceph-mon[35265]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.4 MiB/s wr, 602 op/s 2024-09-10T21:04:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.316+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f567c102c50 con 0x7f567c1045c0 2024-09-10T21:04:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.317+0000 7f5672ffd640 1 -- 172.21.15.67:0/2223271430 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f566c0cd7c0 con 0x7f567c1045c0 2024-09-10T21:04:03.323 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:04:03.323 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:04:03.323 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 msgr2=0x7f56680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 0x7f56680b7820 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5678005c40 tx=0x7f5678005bd0 comp rx=0 tx=0).stop 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 msgr2=0x7f567c101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f566c032fd0 tx=0x7f566c031970 comp rx=0 tx=0).stop 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 shutdown_connections 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f567c10d100 0x7f567c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f56680b5360 0x7f56680b7820 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f567c1045c0 0x7f567c101e90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 --2- 172.21.15.67:0/2223271430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f567c103ca0 0x7f567c101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 >> 172.21.15.67:0/2223271430 conn(0x7f567c0fd700 msgr2=0x7f567c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 shutdown_connections 2024-09-10T21:04:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:03.321+0000 7f568403c640 1 -- 172.21.15.67:0/2223271430 wait complete. 2024-09-10T21:04:03.944 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:03 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2223271430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:03.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:04:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 750.0 s, 2135.0 tps, lat 46.580 ms stddev 60.686 2024-09-10T21:04:04.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:03 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2223271430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:04.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:03 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2223271430' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:04.401 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:04.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:04 smithi067 ceph-mon[30891]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- 172.21.15.67:0/3584375446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4101045b0 msgr2=0x7fc41010cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 --2- 172.21.15.67:0/3584375446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4101045b0 0x7fc41010cb90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc400009900 tx=0x7fc40002a400 comp rx=0 tx=0).stop 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- 172.21.15.67:0/3584375446 shutdown_connections 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 --2- 172.21.15.67:0/3584375446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc41010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 --2- 172.21.15.67:0/3584375446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4101045b0 0x7fc41010cb90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 --2- 172.21.15.67:0/3584375446 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc410103bb0 0x7fc410103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- 172.21.15.67:0/3584375446 >> 172.21.15.67:0/3584375446 conn(0x7fc4100fd700 msgr2=0x7fc4100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- 172.21.15.67:0/3584375446 shutdown_connections 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- 172.21.15.67:0/3584375446 wait complete. 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 Processor -- start 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.008+0000 7fc41827d640 1 -- start start 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc410103bb0 0x7fc410101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 0x7fc410101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc4101024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112dd0 con 0x7fc41010d160 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112c50 con 0x7fc4101045b0 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41827d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc410112f50 con 0x7fc410103bb0 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41681a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc4101024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc416019640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc410103bb0 0x7fc410101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41681a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc4101024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55570/0 (socket says 172.21.15.67:55570) 2024-09-10T21:04:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc41681a640 1 -- 172.21.15.67:0/2905528906 learned_addr learned my addr 172.21.15.67:0/2905528906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 0x7fc410101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 -- 172.21.15.67:0/2905528906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc410103bb0 msgr2=0x7fc410101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc410103bb0 0x7fc410101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 -- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 msgr2=0x7fc4101024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc4101024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.009+0000 7fc415818640 1 -- 172.21.15.67:0/2905528906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101a76e0 con 0x7fc4101045b0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.010+0000 7fc415818640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 0x7fc410101f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc40002a9f0 tx=0x7fc400003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.010+0000 7fc4077fe640 1 -- 172.21.15.67:0/2905528906 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40003f070 con 0x7fc4101045b0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.010+0000 7fc4077fe640 1 -- 172.21.15.67:0/2905528906 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc400031b50 con 0x7fc4101045b0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.010+0000 7fc4077fe640 1 -- 172.21.15.67:0/2905528906 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400035030 con 0x7fc4101045b0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.010+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4101a7970 con 0x7fc4101045b0 2024-09-10T21:04:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.011+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101a7dd0 con 0x7fc4101045b0 2024-09-10T21:04:05.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.014+0000 7fc4077fe640 1 -- 172.21.15.67:0/2905528906 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc40003bbd0 con 0x7fc4101045b0 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.014+0000 7fc41a652740 1 Processor -- start 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 -- start start 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459994d0 0x55e4459998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e44590fea0 con 0x55e445999df0 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e4458ff2d0 con 0x55e4459a5d80 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41a652740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e4459030e0 con 0x55e4459994d0 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55572/0 (socket says 172.21.15.67:55572) 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc416019640 1 -- 172.21.15.67:0/381085497 learned_addr learned my addr 172.21.15.67:0/381085497 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc41681a640 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459994d0 0x55e4459998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.015+0000 7fc415818640 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 -- 172.21.15.67:0/381085497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459994d0 msgr2=0x55e4459998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459994d0 0x55e4459998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 -- 172.21.15.67:0/381085497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 msgr2=0x55e4459a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 -- 172.21.15.67:0/381085497 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44565d650 con 0x55e445999df0 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc416019640 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009cf0 tx=0x7fc40c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc28f61fda591d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc404de6640 1 -- 172.21.15.67:0/381085497 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c004230 con 0x55e445999df0 2024-09-10T21:04:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc404de6640 1 -- 172.21.15.67:0/381085497 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c0043d0 con 0x55e445999df0 2024-09-10T21:04:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc4077fe640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 0x7fc3fc0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc404de6640 1 -- 172.21.15.67:0/381085497 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c019880 con 0x55e445999df0 2024-09-10T21:04:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc41681a640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 0x7fc3fc0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.016+0000 7fc4077fe640 1 -- 172.21.15.67:0/2905528906 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc400107220 con 0x7fc4101045b0 2024-09-10T21:04:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 -- 172.21.15.67:0/381085497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 msgr2=0x55e4459a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41681a640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 0x7fc3fc0b78f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc410103af0 tx=0x7fc408009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009cf0 tx=0x7fc40c011810 comp rx=0 tx=0).stop 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 -- 172.21.15.67:0/381085497 shutdown_connections 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e445999df0 0x55e4459a5840 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 --2- 172.21.15.67:0/381085497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459994d0 0x55e4459998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 -- 172.21.15.67:0/381085497 >> 172.21.15.67:0/381085497 conn(0x55e445997300 msgr2=0x55e4459984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 -- 172.21.15.67:0/381085497 shutdown_connections 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.017+0000 7fc41a652740 1 -- 172.21.15.67:0/381085497 wait complete. 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 -- start start 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 Processor -- start 2024-09-10T21:04:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 0x55e4459a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e445760700 con 0x55e4459994d0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e44589a160 con 0x55e4459a5d80 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e4459a8a00 con 0x55e445999df0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41a652740 10 client.0 _ll_register_callbacks cb 0x55e4458b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55576/0 (socket says 172.21.15.67:55576) 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc416019640 1 -- 172.21.15.67:0/1416541136 learned_addr learned my addr 172.21.15.67:0/1416541136 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.018+0000 7fc41681a640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 -- 172.21.15.67:0/1416541136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 msgr2=0x55e4459a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc415818640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 0x55e4459a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 0x55e4459a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 -- 172.21.15.67:0/1416541136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 msgr2=0x55e4459a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 -- 172.21.15.67:0/1416541136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4458c7c90 con 0x55e4459a5d80 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc415818640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 0x55e4459a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc41681a640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a2f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc408011eb0 tx=0x7fc408004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc721be95d486314 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.019+0000 7fc3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408004b20 con 0x55e4459a5d80 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc408004cc0 con 0x55e4459a5d80 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c0043d0 con 0x55e4459a5d80 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc40800f810 con 0x55e4459a5d80 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc41a652740 10 client.26627 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.020+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e4459b4330 con 0x55e4459a5d80 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40c0043d0 con 0x55e4459a5d80 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc408026070 con 0x55e4459a5d80 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 10 client.26627 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 10 client.26627 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 20 client.26627 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e4459b5a20 0x55e4459b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 4 client.26627 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e445911df0 con 0x55e4459b5a20 2024-09-10T21:04:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.021+0000 7fc416019640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e4459b5a20 0x55e4459b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.022+0000 7fc416019640 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e4459b5a20 0x55e4459b7e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5393d2e5cda804d0 server_cookie=c4e3d70d80eb6cda in_seq=0 out_seq=0 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.022+0000 7fc3f9ffb640 10 client.26627 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.022+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/1416541136 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e445911df0 con 0x55e4459b5a20 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc3f9ffb640 10 client.26627 handle_command_reply: tid=0 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 client.26627 shutdown 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 msgr2=0x55e4459a2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a2f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc408011eb0 tx=0x7fc408004ab0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 shutdown_connections 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e4459b5a20 0x55e4459b7e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e4459a5d80 0x55e4459a2f10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e445999df0 0x55e4459a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc3f9ffb640 0 client.26627 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 --2- 172.21.15.67:0/1416541136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 >> 172.21.15.67:0/1416541136 conn(0x55e445997300 msgr2=0x55e44599ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 shutdown_connections 2024-09-10T21:04:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.023+0000 7fc41a652740 1 -- 172.21.15.67:0/1416541136 wait complete. 2024-09-10T21:04:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.024+0000 7fc41a652740 20 client.26627 trim_cache size 0 max 16384 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 Processor -- start 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 -- start start 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e44599fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4010d70 con 0x55e4459994d0 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f400e640 con 0x55e445999df0 2024-09-10T21:04:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41a652740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f400c490 con 0x55e4459a5d80 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc416019640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55578/0 (socket says 172.21.15.67:55578) 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc415818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e44599fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc416019640 1 -- 172.21.15.67:0/1962252801 learned_addr learned my addr 172.21.15.67:0/1962252801 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.041+0000 7fc41681a640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 -- 172.21.15.67:0/1962252801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 msgr2=0x55e4459a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 -- 172.21.15.67:0/1962252801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 msgr2=0x55e445996c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 -- 172.21.15.67:0/1962252801 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e445997d80 con 0x55e445999df0 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc41681a640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc416019640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc415818640 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e44599fbe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc40002a920 tx=0x7fc40002a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd567b2e9c0bca0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc3fbfff640 1 -- 172.21.15.67:0/1962252801 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400049040 con 0x55e445999df0 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc3fbfff640 1 -- 172.21.15.67:0/1962252801 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4000cd5d0 con 0x55e445999df0 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.042+0000 7fc3fbfff640 1 -- 172.21.15.67:0/1962252801 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4000d6fa0 con 0x55e445999df0 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.043+0000 7fc41a652740 1 -- 172.21.15.67:0/1962252801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 msgr2=0x55e44599fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.043+0000 7fc41a652740 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e44599fbe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc40002a920 tx=0x7fc40002a400 comp rx=0 tx=0).stop 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.044+0000 7fc41a652740 1 -- 172.21.15.67:0/1962252801 shutdown_connections 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.044+0000 7fc41a652740 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.044+0000 7fc41a652740 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e44599fbe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.044+0000 7fc41a652740 1 --2- 172.21.15.67:0/1962252801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e445996c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.044+0000 7fc41a652740 1 -- 172.21.15.67:0/1962252801 >> 172.21.15.67:0/1962252801 conn(0x55e445997300 msgr2=0x55e4459a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.045+0000 7fc41a652740 1 -- 172.21.15.67:0/1962252801 shutdown_connections 2024-09-10T21:04:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.045+0000 7fc41a652740 1 -- 172.21.15.67:0/1962252801 wait complete. 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.045+0000 7fc41a652740 1 -- start start 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.046+0000 7fc41a652740 1 Processor -- start 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.046+0000 7fc41a652740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.046+0000 7fc41a652740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.046+0000 7fc41a652740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459aa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.046+0000 7fc41a652740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f400cb00 con 0x55e4459994d0 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.047+0000 7fc41a652740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f400df70 con 0x55e445999df0 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.047+0000 7fc41a652740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f400d1d0 con 0x55e4459a5d80 2024-09-10T21:04:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.047+0000 7fc41a652740 10 client.0 _ll_register_callbacks cb 0x7fc408009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.050+0000 7fc415818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.050+0000 7fc41681a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.050+0000 7fc415818640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51074/0 (socket says 172.21.15.67:51074) 2024-09-10T21:04:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.050+0000 7fc415818640 1 -- 172.21.15.67:0/749980557 learned_addr learned my addr 172.21.15.67:0/749980557 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.053+0000 7fc416019640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 -- 172.21.15.67:0/749980557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 msgr2=0x55e4459aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 -- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 msgr2=0x55e4459aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 -- 172.21.15.67:0/749980557 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e445a21a60 con 0x55e4459994d0 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.054+0000 7fc416019640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a9d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc40c011d10 tx=0x7fc40c019490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de66e5e3f1659486 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.055+0000 7fc415818640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:04:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.056+0000 7fc3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.058+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c005450 con 0x55e4459994d0 2024-09-10T21:04:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.058+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc40c0055f0 con 0x55e4459994d0 2024-09-10T21:04:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.060+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4000cd5d0 con 0x55e4459994d0 2024-09-10T21:04:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.063+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc40c0035f0 con 0x55e4459994d0 2024-09-10T21:04:05.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.064+0000 7fc41a652740 10 client.16914 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:05.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.064+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e445a22d60 con 0x55e4459994d0 2024-09-10T21:04:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.064+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4000cd5d0 con 0x55e4459994d0 2024-09-10T21:04:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.065+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc40c0198c0 con 0x55e4459994d0 2024-09-10T21:04:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 10 client.16914 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 10 client.16914 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:04:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 20 client.16914 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e445a23270 0x55e445a25690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 4 client.16914 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e44590d8a0 con 0x55e445a23270 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc415818640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e445a23270 0x55e445a25690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.066+0000 7fc415818640 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e445a23270 0x55e445a25690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=883d9393e453bc13 server_cookie=3ca0a5993b2e2c5c in_seq=0 out_seq=0 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.067+0000 7fc3f9ffb640 10 client.16914 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.067+0000 7fc3f9ffb640 1 -- 172.21.15.67:0/749980557 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e44590d8a0 con 0x55e445a23270 2024-09-10T21:04:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.067+0000 7fc3f9ffb640 10 client.16914 handle_command_reply: tid=0 2024-09-10T21:04:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.067+0000 7fc41a652740 1 client.16914 shutdown 2024-09-10T21:04:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.069+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 msgr2=0x55e4459a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.069+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a9d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc40c011d10 tx=0x7fc40c019490 comp rx=0 tx=0).stop 2024-09-10T21:04:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 shutdown_connections 2024-09-10T21:04:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e445a23270 0x55e445a25690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e4459a5d80 0x55e4459aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e445999df0 0x55e4459aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 --2- 172.21.15.67:0/749980557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e4459994d0 0x55e4459a9d00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 >> 172.21.15.67:0/749980557 conn(0x55e445997300 msgr2=0x55e4459a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc3f9ffb640 0 client.16914 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 shutdown_connections 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 1 -- 172.21.15.67:0/749980557 wait complete. 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.077+0000 7fc41a652740 20 client.16914 trim_cache size 0 max 16384 2024-09-10T21:04:05.083 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 msgr2=0x7fc3fc0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 0x7fc3fc0b78f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc410103af0 tx=0x7fc408009500 comp rx=0 tx=0).stop 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 msgr2=0x7fc410101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 0x7fc410101f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc40002a9f0 tx=0x7fc400003b90 comp rx=0 tx=0).stop 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 shutdown_connections 2024-09-10T21:04:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41010d160 0x7fc4101024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4101045b0 0x7fc410101f70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc3fc0b5430 0x7fc3fc0b78f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 --2- 172.21.15.67:0/2905528906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc410103bb0 0x7fc410101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.080+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 >> 172.21.15.67:0/2905528906 conn(0x7fc4100fd700 msgr2=0x7fc4100fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.081+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 shutdown_connections 2024-09-10T21:04:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:05.081+0000 7fc41827d640 1 -- 172.21.15.67:0/2905528906 wait complete. 2024-09-10T21:04:05.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:04 smithi083 ceph-mon[35058]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2024-09-10T21:04:05.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:04 smithi172 ceph-mon[35265]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.0 MiB/s wr, 766 op/s 2024-09-10T21:04:05.982 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:04:06.342 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:06 smithi067 ceph-mon[30891]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 650 op/s 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 -- 172.21.15.67:0/284802032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 msgr2=0x7f097c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 --2- 172.21.15.67:0/284802032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c10cb50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0968009900 tx=0x7f096802a410 comp rx=0 tx=0).stop 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 -- 172.21.15.67:0/284802032 shutdown_connections 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 --2- 172.21.15.67:0/284802032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 0x7f097c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 --2- 172.21.15.67:0/284802032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c10cb50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 --2- 172.21.15.67:0/284802032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 -- 172.21.15.67:0/284802032 >> 172.21.15.67:0/284802032 conn(0x7f097c0fd7e0 msgr2=0x7f097c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 -- 172.21.15.67:0/284802032 shutdown_connections 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.947+0000 7f0982b1b640 1 -- 172.21.15.67:0/284802032 wait complete. 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 Processor -- start 2024-09-10T21:04:06.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 -- start start 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 0x7f097c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f097c112e10 con 0x7f097c104660 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f097c112c90 con 0x7f097c103d40 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f0982b1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f097c112f90 con 0x7f097c10d1a0 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f09808b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55596/0 (socket says 172.21.15.67:55596) 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f09808b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51102/0 (socket says 172.21.15.67:51102) 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 -- 172.21.15.67:0/1229833087 learned_addr learned my addr 172.21.15.67:0/1229833087 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f09810b8640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 0x7f097c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 -- 172.21.15.67:0/1229833087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 msgr2=0x7f097c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 0x7f097c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 -- 172.21.15.67:0/1229833087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 msgr2=0x7f097c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.948+0000 7f097bfff640 1 -- 172.21.15.67:0/1229833087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c19f3f0 con 0x7f097c104660 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.949+0000 7f097bfff640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0968032fd0 tx=0x7f0968031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:06.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.950+0000 7f0979ffb640 1 -- 172.21.15.67:0/1229833087 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096803f030 con 0x7f097c104660 2024-09-10T21:04:06.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.950+0000 7f0979ffb640 1 -- 172.21.15.67:0/1229833087 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0968004410 con 0x7f097c104660 2024-09-10T21:04:06.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.950+0000 7f0979ffb640 1 -- 172.21.15.67:0/1229833087 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968035070 con 0x7f097c104660 2024-09-10T21:04:06.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.950+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c19f680 con 0x7f097c104660 2024-09-10T21:04:06.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.950+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c1018d0 con 0x7f097c104660 2024-09-10T21:04:06.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.953+0000 7f0984ef0740 1 Processor -- start 2024-09-10T21:04:06.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 -- start start 2024-09-10T21:04:06.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0979ffb640 1 -- 172.21.15.67:0/1229833087 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f096803b9c0 con 0x7f097c104660 2024-09-10T21:04:06.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 0x55ee4c9bd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c91eea0 con 0x55ee4c9bd590 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c90e2d0 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f0984ef0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c9120e0 con 0x55ee4c9b1600 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51112/0 (socket says 172.21.15.67:51112) 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 -- 172.21.15.67:0/440928871 learned_addr learned my addr 172.21.15.67:0/440928871 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f097bfff640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09808b7640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 0x55ee4c9bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 -- 172.21.15.67:0/440928871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 msgr2=0x55ee4c9bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 0x55ee4c9bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 -- 172.21.15.67:0/440928871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 msgr2=0x55ee4c9bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:06.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09810b8640 1 -- 172.21.15.67:0/440928871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4c66c650 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.954+0000 7f09808b7640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 0x55ee4c9bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f09810b8640 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0974009fd0 tx=0x7f09740118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6af94f297f94d478 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f0966ffd640 1 -- 172.21.15.67:0/440928871 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974004d20 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f0979ffb640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 0x7f096c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f0966ffd640 1 -- 172.21.15.67:0/440928871 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0974004050 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f0966ffd640 1 -- 172.21.15.67:0/440928871 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974005280 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f09808b7640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 0x7f096c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.955+0000 7f0979ffb640 1 -- 172.21.15.67:0/1229833087 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0968105fc0 con 0x7f097c104660 2024-09-10T21:04:06.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f09808b7640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 0x7f096c0b78f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f09700095f0 tx=0x7f0970005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- 172.21.15.67:0/440928871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 msgr2=0x55ee4c9b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0974009fd0 tx=0x7f09740118d0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- 172.21.15.67:0/440928871 shutdown_connections 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b1600 0x55ee4c9bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 --2- 172.21.15.67:0/440928871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b10c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- 172.21.15.67:0/440928871 >> 172.21.15.67:0/440928871 conn(0x55ee4c9aeb10 msgr2=0x55ee4c9afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- 172.21.15.67:0/440928871 shutdown_connections 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- 172.21.15.67:0/440928871 wait complete. 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.956+0000 7f0984ef0740 1 -- start start 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 Processor -- start 2024-09-10T21:04:06.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9ba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c76f700 con 0x55ee4c9b1600 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c8a9160 con 0x55ee4c9bd590 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f097bfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9ba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f09810b8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f09810b8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51118/0 (socket says 172.21.15.67:51118) 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f09810b8640 1 -- 172.21.15.67:0/1748434071 learned_addr learned my addr 172.21.15.67:0/1748434071 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.957+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee4c9c0240 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 -- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 msgr2=0x55ee4c9bceb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9bceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 -- 172.21.15.67:0/1748434071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 msgr2=0x55ee4c9ba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9ba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 -- 172.21.15.67:0/1748434071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4c8d6c90 con 0x55ee4c9bd590 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f09810b8640 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f097401b040 tx=0x7f09740047f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a596343fbcbb0e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f0984ef0740 10 client.0 _ll_register_callbacks cb 0x55ee4c8c29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f095bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0974004050 con 0x55ee4c9bd590 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.958+0000 7f095bfff640 1 -- 172.21.15.67:0/1748434071 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974043050 con 0x55ee4c9bd590 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.959+0000 7f095bfff640 1 -- 172.21.15.67:0/1748434071 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0974004a40 con 0x55ee4c9bd590 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.959+0000 7f095bfff640 1 -- 172.21.15.67:0/1748434071 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0974039070 con 0x55ee4c9bd590 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.959+0000 7f0984ef0740 10 client.26645 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:06.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.959+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55ee4c9a8180 con 0x55ee4c9bd590 2024-09-10T21:04:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.959+0000 7f095bfff640 1 -- 172.21.15.67:0/1748434071 <== mon.2 v2:172.21.15.83:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0974004c40 con 0x55ee4c9bd590 2024-09-10T21:04:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 10 client.26645 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 10 client.26645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:04:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 20 client.26645 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:06.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4c9a99e0 0x55ee4c9abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 4 client.26645 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0974004050 con 0x55ee4c9a99e0 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.960+0000 7f09808b7640 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4c9a99e0 0x55ee4c9abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.961+0000 7f09808b7640 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4c9a99e0 0x55ee4c9abe80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8cbd8391a91dd877 server_cookie=460ccfcb4e0a4021 in_seq=0 out_seq=0 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.961+0000 7f095bfff640 10 client.26645 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f095bfff640 1 -- 172.21.15.67:0/1748434071 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0974004050 con 0x55ee4c9a99e0 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f095bfff640 10 client.26645 handle_command_reply: tid=0 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 client.26645 shutdown 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 msgr2=0x55ee4c9ba930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f097401b040 tx=0x7f09740047f0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 shutdown_connections 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4c9a99e0 0x55ee4c9abe80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9bd590 0x55ee4c9ba930 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9ba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 --2- 172.21.15.67:0/1748434071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 >> 172.21.15.67:0/1748434071 conn(0x55ee4c9aeb10 msgr2=0x55ee4c9a5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f095bfff640 0 client.26645 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 shutdown_connections 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.962+0000 7f0984ef0740 1 -- 172.21.15.67:0/1748434071 wait complete. 2024-09-10T21:04:06.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.963+0000 7f0984ef0740 20 client.26645 trim_cache size 0 max 16384 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 Processor -- start 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 -- start start 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 0x55ee4c9be980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1ae9b0 con 0x55ee4c9bd590 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1ac280 con 0x55ee4c9b1600 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f0984ef0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1aa0d0 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55626/0 (socket says 172.21.15.67:55626) 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 -- 172.21.15.67:0/4243973354 learned_addr learned my addr 172.21.15.67:0/4243973354 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f097bfff640 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 0x55ee4c9be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 -- 172.21.15.67:0/4243973354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 msgr2=0x55ee4c9b45a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b45a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 -- 172.21.15.67:0/4243973354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 msgr2=0x55ee4c9be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 0x55ee4c9be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f09810b8640 1 -- 172.21.15.67:0/4243973354 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4c9b1430 con 0x55ee4c9bd590 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.980+0000 7f097bfff640 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 0x55ee4c9be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.981+0000 7f09810b8640 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0974009370 tx=0x7f0974034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc35fa58c6b95b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:06.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.981+0000 7f09667fc640 1 -- 172.21.15.67:0/4243973354 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974043040 con 0x55ee4c9bd590 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.981+0000 7f09667fc640 1 -- 172.21.15.67:0/4243973354 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0974004960 con 0x55ee4c9bd590 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.981+0000 7f09667fc640 1 -- 172.21.15.67:0/4243973354 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097400fc20 con 0x55ee4c9bd590 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 -- 172.21.15.67:0/4243973354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 msgr2=0x55ee4c9beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0974009370 tx=0x7f0974034000 comp rx=0 tx=0).stop 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 -- 172.21.15.67:0/4243973354 shutdown_connections 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9bd590 0x55ee4c9beec0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b1600 0x55ee4c9be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 --2- 172.21.15.67:0/4243973354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:06.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 -- 172.21.15.67:0/4243973354 >> 172.21.15.67:0/4243973354 conn(0x55ee4c9aeb10 msgr2=0x55ee4c9b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:06.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.982+0000 7f0984ef0740 1 -- 172.21.15.67:0/4243973354 shutdown_connections 2024-09-10T21:04:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.993+0000 7f0984ef0740 1 -- 172.21.15.67:0/4243973354 wait complete. 2024-09-10T21:04:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.994+0000 7f0984ef0740 1 -- start start 2024-09-10T21:04:06.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.994+0000 7f0984ef0740 1 Processor -- start 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1aa740 con 0x55ee4c9b1600 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1abbb0 con 0x55ee4c9b0ce0 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f097c1aae10 con 0x55ee4c9bd590 2024-09-10T21:04:06.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.995+0000 7f0984ef0740 10 client.0 _ll_register_callbacks cb 0x7f0968109970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.997+0000 7f09810b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.997+0000 7f09808b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.997+0000 7f09810b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59552/0 (socket says 172.21.15.67:59552) 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.997+0000 7f09810b8640 1 -- 172.21.15.67:0/212386292 learned_addr learned my addr 172.21.15.67:0/212386292 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.997+0000 7f097bfff640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 -- 172.21.15.67:0/212386292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 msgr2=0x55ee4c9c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 -- 172.21.15.67:0/212386292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 msgr2=0x55ee4c9c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 -- 172.21.15.67:0/212386292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4c9bd220 con 0x55ee4c9bd590 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f09810b8640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0974011910 tx=0x7f0974003ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cb3f1fe20df94f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:07.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.998+0000 7f095bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.999+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974043040 con 0x55ee4c9bd590 2024-09-10T21:04:07.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:06.999+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0974004960 con 0x55ee4c9bd590 2024-09-10T21:04:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.003+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f097400fbb0 con 0x55ee4c9bd590 2024-09-10T21:04:07.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.003+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f097400f680 con 0x55ee4c9bd590 2024-09-10T21:04:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.006+0000 7f0984ef0740 10 client.26590 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.006+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee4ca31ea0 con 0x55ee4c9bd590 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.011+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0974004960 con 0x55ee4c9bd590 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f097403e440 con 0x55ee4c9bd590 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 10 client.26590 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 10 client.26590 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 20 client.26590 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4ca326c0 0x55ee4ca34ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 4 client.26590 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:07.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.012+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee4c920df0 con 0x55ee4ca326c0 2024-09-10T21:04:07.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.014+0000 7f09808b7640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4ca326c0 0x55ee4ca34ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.032+0000 7f09808b7640 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4ca326c0 0x55ee4ca34ae0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ae7bcf91cb212f0 server_cookie=dcf3018138072710 in_seq=0 out_seq=0 2024-09-10T21:04:07.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.032+0000 7f095bfff640 10 client.26590 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.036+0000 7f095bfff640 1 -- 172.21.15.67:0/212386292 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee4c920df0 con 0x55ee4ca326c0 2024-09-10T21:04:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.036+0000 7f095bfff640 10 client.26590 handle_command_reply: tid=0 2024-09-10T21:04:07.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.036+0000 7f0984ef0740 1 client.26590 shutdown 2024-09-10T21:04:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.037+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 msgr2=0x55ee4ca30790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:07.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.037+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0974011910 tx=0x7f0974003ff0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 shutdown_connections 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee4ca326c0 0x55ee4ca34ae0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee4c9bd590 0x55ee4ca30790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee4c9b1600 0x55ee4c9c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 --2- 172.21.15.67:0/212386292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee4c9b0ce0 0x55ee4c9c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 >> 172.21.15.67:0/212386292 conn(0x55ee4c9aeb10 msgr2=0x55ee4c9b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f095bfff640 0 client.26590 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 shutdown_connections 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 1 -- 172.21.15.67:0/212386292 wait complete. 2024-09-10T21:04:07.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.038+0000 7f0984ef0740 20 client.26590 trim_cache size 0 max 16384 2024-09-10T21:04:07.044 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 msgr2=0x7f096c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 0x7f096c0b78f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f09700095f0 tx=0x7f0970005f90 comp rx=0 tx=0).stop 2024-09-10T21:04:07.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 msgr2=0x7f097c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0968032fd0 tx=0x7f0968031970 comp rx=0 tx=0).stop 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 shutdown_connections 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f096c0b5430 0x7f096c0b78f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f097c10d1a0 0x7f097c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f097c104660 0x7f097c199880 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 --2- 172.21.15.67:0/1229833087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f097c103d40 0x7f097c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.039+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 >> 172.21.15.67:0/1229833087 conn(0x7f097c0fd7e0 msgr2=0x7f097c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.040+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 shutdown_connections 2024-09-10T21:04:07.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:07.040+0000 7f0982b1b640 1 -- 172.21.15.67:0/1229833087 wait complete. 2024-09-10T21:04:07.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:06 smithi083 ceph-mon[35058]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 650 op/s 2024-09-10T21:04:07.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:06 smithi172 ceph-mon[35265]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 6.9 MiB/s wr, 650 op/s 2024-09-10T21:04:07.837 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:04:08.194 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 -- 172.21.15.67:0/2941067129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc107e80 msgr2=0x7f19dc10e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 --2- 172.21.15.67:0/2941067129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc107e80 0x7f19dc10e680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009ca0 tx=0x7f19d402a8b0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 -- 172.21.15.67:0/2941067129 shutdown_connections 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 --2- 172.21.15.67:0/2941067129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc107e80 0x7f19dc10e680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 --2- 172.21.15.67:0/2941067129 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19dc107500 0x7f19dc107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 --2- 172.21.15.67:0/2941067129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc101af0 0x7f19dc101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 -- 172.21.15.67:0/2941067129 >> 172.21.15.67:0/2941067129 conn(0x7f19dc0fd560 msgr2=0x7f19dc0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 -- 172.21.15.67:0/2941067129 shutdown_connections 2024-09-10T21:04:08.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.714+0000 7f19dbfff640 1 -- 172.21.15.67:0/2941067129 wait complete. 2024-09-10T21:04:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.715+0000 7f19dbfff640 1 Processor -- start 2024-09-10T21:04:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 -- start start 2024-09-10T21:04:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19dc107500 0x7f19dc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc107e80 0x7f19dc19d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc111b80 con 0x7f19dc107e80 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc111a00 con 0x7f19dc107500 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19dbfff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc111d00 con 0x7f19dc101af0 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19daffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19daffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59560/0 (socket says 172.21.15.67:59560) 2024-09-10T21:04:08.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19daffd640 1 -- 172.21.15.67:0/1203500901 learned_addr learned my addr 172.21.15.67:0/1203500901 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.716+0000 7f19db7fe640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc107e80 0x7f19dc19d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 -- 172.21.15.67:0/1203500901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19dc107500 msgr2=0x7f19dc198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19dc107500 0x7f19dc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 -- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc107e80 msgr2=0x7f19dc19d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc107e80 0x7f19dc19d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 -- 172.21.15.67:0/1203500901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19dc19e0e0 con 0x7f19dc101af0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19daffd640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00bbc0 tx=0x7f19cc008420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.717+0000 7f19e09c4640 1 -- 172.21.15.67:0/1203500901 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc01d070 con 0x7f19dc101af0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.718+0000 7f19e09c4640 1 -- 172.21.15.67:0/1203500901 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19cc018410 con 0x7f19dc101af0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.718+0000 7f19e09c4640 1 -- 172.21.15.67:0/1203500901 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc017610 con 0x7f19dc101af0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.718+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19dc19e3d0 con 0x7f19dc101af0 2024-09-10T21:04:08.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.718+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19dc06b350 con 0x7f19dc101af0 2024-09-10T21:04:08.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.721+0000 7f19e3d9b740 1 Processor -- start 2024-09-10T21:04:08.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.721+0000 7f19e09c4640 1 -- 172.21.15.67:0/1203500901 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f19cc008ad0 con 0x7f19dc101af0 2024-09-10T21:04:08.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.721+0000 7f19e3d9b740 1 -- start start 2024-09-10T21:04:08.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b5ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556f7b569ea0 con 0x556f7b5f3fc0 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556f7b5592d0 con 0x556f7b5fff50 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556f7b55d0e0 con 0x556f7b5f36a0 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19daffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b5ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59568/0 (socket says 172.21.15.67:59568) 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51154/0 (socket says 172.21.15.67:51154) 2024-09-10T21:04:08.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.722+0000 7f19db7fe640 1 -- 172.21.15.67:0/3886881505 learned_addr learned my addr 172.21.15.67:0/3886881505 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 -- 172.21.15.67:0/3886881505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 msgr2=0x556f7b602340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 -- 172.21.15.67:0/3886881505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 msgr2=0x556f7b5ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b5ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 -- 172.21.15.67:0/3886881505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7b2b7650 con 0x556f7b5f36a0 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19daffd640 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b5ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19da7fc640 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19d4035000 tx=0x7f19d4030550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86000dda431ce402 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19e09c4640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 0x7f19c40b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19c1ffb640 1 -- 172.21.15.67:0/3886881505 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4030a00 con 0x556f7b5f36a0 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.723+0000 7f19c1ffb640 1 -- 172.21.15.67:0/3886881505 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d4036030 con 0x556f7b5f36a0 2024-09-10T21:04:08.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19c1ffb640 1 -- 172.21.15.67:0/3886881505 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4004700 con 0x556f7b5f36a0 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e09c4640 1 -- 172.21.15.67:0/1203500901 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19cc0e90b0 con 0x7f19dc101af0 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19daffd640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 0x7f19c40b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3886881505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 msgr2=0x556f7b5f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19d4035000 tx=0x7f19d4030550 comp rx=0 tx=0).stop 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19daffd640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 0x7f19c40b7920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0106c0 tx=0x7f19cc010400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3886881505 shutdown_connections 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5fff50 0x556f7b602340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b5ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3886881505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5f3a80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.724+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3886881505 >> 172.21.15.67:0/3886881505 conn(0x556f7b5f14d0 msgr2=0x556f7b5f2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3886881505 shutdown_connections 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3886881505 wait complete. 2024-09-10T21:04:08.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- start start 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 Processor -- start 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5ff820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b5fd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556f7b3ba700 con 0x556f7b5fff50 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x556f7b4f4160 con 0x556f7b5f3fc0 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556f7b602c10 con 0x556f7b5f36a0 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.725+0000 7f19e3d9b740 10 client.0 _ll_register_callbacks cb 0x556f7b50d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.726+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.726+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51158/0 (socket says 172.21.15.67:51158) 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.726+0000 7f19da7fc640 1 -- 172.21.15.67:0/1236512591 learned_addr learned my addr 172.21.15.67:0/1236512591 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.726+0000 7f19db7fe640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.726+0000 7f19db7fe640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b5fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.727+0000 7f19da7fc640 1 -- 172.21.15.67:0/1236512591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 msgr2=0x556f7b5ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.727+0000 7f19da7fc640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.727+0000 7f19da7fc640 1 -- 172.21.15.67:0/1236512591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 msgr2=0x556f7b5fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.727+0000 7f19da7fc640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b5fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.727+0000 7f19da7fc640 1 -- 172.21.15.67:0/1236512591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7b521c90 con 0x556f7b5f3fc0 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19da7fc640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e450 tx=0x7f19d000e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b289c9c19e151ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19baffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:08.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0017070 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19d0013680 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19d4036030 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f19d0021050 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19e3d9b740 10 client.26654 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.728+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556f7b60e5b0 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d4036030 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f19d001c910 con 0x556f7b5f3fc0 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 10 client.26654 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 10 client.26654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 20 client.26654 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b60fb60 0x556f7b611f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 4 client.26654 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:08.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f7b56bdf0 con 0x556f7b60fb60 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19db7fe640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b60fb60 0x556f7b611f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.729+0000 7f19baffd640 10 client.26654 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.730+0000 7f19db7fe640 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b60fb60 0x556f7b611f50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81d66a5a40691cbd server_cookie=9a499446402759af in_seq=0 out_seq=0 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.730+0000 7f19baffd640 1 -- 172.21.15.67:0/1236512591 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f7b56bdf0 con 0x556f7b60fb60 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.730+0000 7f19baffd640 10 client.26654 handle_command_reply: tid=0 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.730+0000 7f19e3d9b740 1 client.26654 shutdown 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 msgr2=0x556f7b5fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f19d000e450 tx=0x7f19d000e910 comp rx=0 tx=0).stop 2024-09-10T21:04:08.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 shutdown_connections 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b60fb60 0x556f7b611f50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b5fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f3fc0 0x556f7b5fcc70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/1236512591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f36a0 0x556f7b5ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 >> 172.21.15.67:0/1236512591 conn(0x556f7b5f14d0 msgr2=0x556f7b5f7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19baffd640 0 client.26654 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 shutdown_connections 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.731+0000 7f19e3d9b740 1 -- 172.21.15.67:0/1236512591 wait complete. 2024-09-10T21:04:08.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.732+0000 7f19e3d9b740 20 client.26654 trim_cache size 0 max 16384 2024-09-10T21:04:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 Processor -- start 2024-09-10T21:04:08.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 -- start start 2024-09-10T21:04:08.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f3fc0 0x556f7b601340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b601880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1ae780 con 0x556f7b5fff50 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1ac050 con 0x556f7b5f36a0 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.751+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1a9ea0 con 0x556f7b5f3fc0 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f3fc0 0x556f7b601340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51166/0 (socket says 172.21.15.67:51166) 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 -- 172.21.15.67:0/450026035 learned_addr learned my addr 172.21.15.67:0/450026035 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b601880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 -- 172.21.15.67:0/450026035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f3fc0 msgr2=0x556f7b601340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f3fc0 0x556f7b601340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 -- 172.21.15.67:0/450026035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 msgr2=0x556f7b601880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b601880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 -- 172.21.15.67:0/450026035 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f7b5f3000 con 0x556f7b5f36a0 2024-09-10T21:04:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19db7fe640 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f19d4031040 tx=0x7f19d4030550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10983d6e33715e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19c17fa640 1 -- 172.21.15.67:0/450026035 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d404a040 con 0x556f7b5f36a0 2024-09-10T21:04:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19c17fa640 1 -- 172.21.15.67:0/450026035 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d4036040 con 0x556f7b5f36a0 2024-09-10T21:04:08.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.752+0000 7f19c17fa640 1 -- 172.21.15.67:0/450026035 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40316a0 con 0x556f7b5f36a0 2024-09-10T21:04:08.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- 172.21.15.67:0/450026035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 msgr2=0x556f7b5f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f19d4031040 tx=0x7f19d4030550 comp rx=0 tx=0).stop 2024-09-10T21:04:08.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- 172.21.15.67:0/450026035 shutdown_connections 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5fff50 0x556f7b601880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5f3fc0 0x556f7b601340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/450026035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b5f0e60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- 172.21.15.67:0/450026035 >> 172.21.15.67:0/450026035 conn(0x556f7b5f14d0 msgr2=0x556f7b5feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- 172.21.15.67:0/450026035 shutdown_connections 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- 172.21.15.67:0/450026035 wait complete. 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.753+0000 7f19e3d9b740 1 -- start start 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 Processor -- start 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5fff50 0x556f7b6181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1aa510 con 0x556f7b5f3fc0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1ab980 con 0x556f7b5f36a0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f19dc1aabe0 con 0x556f7b5fff50 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19e3d9b740 10 client.0 _ll_register_callbacks cb 0x7f19d00093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19da7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55694/0 (socket says 172.21.15.67:55694) 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19db7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51170/0 (socket says 172.21.15.67:51170) 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19da7fc640 1 -- 172.21.15.67:0/3512417901 learned_addr learned my addr 172.21.15.67:0/3512417901 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.754+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5fff50 0x556f7b6181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 -- 172.21.15.67:0/3512417901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5fff50 msgr2=0x556f7b6181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5fff50 0x556f7b6181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 -- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 msgr2=0x556f7b617730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 -- 172.21.15.67:0/3512417901 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f7b607660 con 0x556f7b5f3fc0 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19da7fc640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x556f7b5f24f0 tx=0x7f19d001c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edb58422991ec07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.755+0000 7f19baffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.756+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0017070 con 0x556f7b5f3fc0 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.756+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19d0013680 con 0x556f7b5f3fc0 2024-09-10T21:04:08.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.756+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19d4036040 con 0x556f7b5f3fc0 2024-09-10T21:04:08.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.757+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f19d0034050 con 0x556f7b5f3fc0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.757+0000 7f19e3d9b740 10 client.16947 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.757+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556f7b67cdc0 con 0x556f7b5f3fc0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.757+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19d002a070 con 0x556f7b5f3fc0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.757+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f19d002f4e0 con 0x556f7b5f3fc0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 10 client.16947 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 20 client.16947 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b67d5a0 0x556f7b67f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 4 client.16947 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f19d4036040 con 0x556f7b67d5a0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b67d5a0 0x556f7b67f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:08.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19db7fe640 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b67d5a0 0x556f7b67f9c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c548add0b7f74a9f server_cookie=6d7aff79964abe2a in_seq=0 out_seq=0 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19baffd640 10 client.16947 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19baffd640 1 -- 172.21.15.67:0/3512417901 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f19d4036040 con 0x556f7b67d5a0 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19baffd640 10 client.16947 handle_command_reply: tid=0 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.758+0000 7f19e3d9b740 1 client.16947 shutdown 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 msgr2=0x556f7b617c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x556f7b5f24f0 tx=0x7f19d001c670 comp rx=0 tx=0).stop 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 shutdown_connections 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x556f7b67d5a0 0x556f7b67f9c0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556f7b5fff50 0x556f7b6181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19baffd640 0 client.16947 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x556f7b5f3fc0 0x556f7b617c70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 --2- 172.21.15.67:0/3512417901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556f7b5f36a0 0x556f7b617730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 >> 172.21.15.67:0/3512417901 conn(0x556f7b5f14d0 msgr2=0x556f7b5fb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 shutdown_connections 2024-09-10T21:04:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 1 -- 172.21.15.67:0/3512417901 wait complete. 2024-09-10T21:04:08.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19e3d9b740 20 client.16947 trim_cache size 0 max 16384 2024-09-10T21:04:08.768 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 msgr2=0x7f19c40b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 0x7f19c40b7920 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0106c0 tx=0x7f19cc010400 comp rx=0 tx=0).stop 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 msgr2=0x7f19dc198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00bbc0 tx=0x7f19cc008420 comp rx=0 tx=0).stop 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 shutdown_connections 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f19dc107e80 0x7f19dc19d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f19dc107500 0x7f19dc198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f19c40b5460 0x7f19c40b7920 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 --2- 172.21.15.67:0/1203500901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19dc101af0 0x7f19dc198030 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.759+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 >> 172.21.15.67:0/1203500901 conn(0x7f19dc0fd560 msgr2=0x7f19dc0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.760+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 shutdown_connections 2024-09-10T21:04:08.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:08.760+0000 7f19dbfff640 1 -- 172.21.15.67:0/1203500901 wait complete. 2024-09-10T21:04:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 755.0 s, 1985.6 tps, lat 50.795 ms stddev 63.352 2024-09-10T21:04:09.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:08 smithi067 ceph-mon[30891]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-09-10T21:04:09.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:08 smithi083 ceph-mon[35058]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-09-10T21:04:09.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:08 smithi172 ceph-mon[35265]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.0 MiB/s wr, 691 op/s 2024-09-10T21:04:10.488 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:04:10.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:04:10.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:10 smithi067 ceph-mon[30891]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-10T21:04:10.884 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:11.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:10 smithi083 ceph-mon[35058]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-10T21:04:11.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:10 smithi172 ceph-mon[35265]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 MiB/s wr, 690 op/s 2024-09-10T21:04:11.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.493+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/3494311638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac1076a0 msgr2=0x7f1aac107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.493+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/3494311638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac1076a0 0x7f1aac107ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009ca0 tx=0x7f1aa4032dd0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.497+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/3494311638 shutdown_connections 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.497+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/3494311638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac108020 0x7f1aac10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.497+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/3494311638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac1076a0 0x7f1aac107ae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.497+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/3494311638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac101c90 0x7f1aac102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.497+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/3494311638 >> 172.21.15.67:0/3494311638 conn(0x7f1aac0fd700 msgr2=0x7f1aac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.498+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/3494311638 shutdown_connections 2024-09-10T21:04:11.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.498+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/3494311638 wait complete. 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 Processor -- start 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 -- start start 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac101c90 0x7f1aac1a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 0x7f1aac1a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 0x7f1aac1ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac121bb0 con 0x7f1aac1076a0 2024-09-10T21:04:11.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac121a30 con 0x7f1aac108020 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.499+0000 7f1ab1b6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac121d30 con 0x7f1aac101c90 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 0x7f1aac1a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 0x7f1aac1a8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55706/0 (socket says 172.21.15.67:55706) 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aaaffd640 1 -- 172.21.15.67:0/1175129648 learned_addr learned my addr 172.21.15.67:0/1175129648 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 0x7f1aac1ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac101c90 0x7f1aac1a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 -- 172.21.15.67:0/1175129648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac101c90 msgr2=0x7f1aac1a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac101c90 0x7f1aac1a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 -- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 msgr2=0x7f1aac1a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 0x7f1aac1a8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.500+0000 7f1aabfff640 1 -- 172.21.15.67:0/1175129648 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac1ae0d0 con 0x7f1aac108020 2024-09-10T21:04:11.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.501+0000 7f1aabfff640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 0x7f1aac1ad900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00a8f0 tx=0x7f1a9c00adb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.503+0000 7f1aa8ff9640 1 -- 172.21.15.67:0/1175129648 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c019020 con 0x7f1aac108020 2024-09-10T21:04:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.503+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac1ae3c0 con 0x7f1aac108020 2024-09-10T21:04:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.503+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac1b4a80 con 0x7f1aac108020 2024-09-10T21:04:11.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.505+0000 7f1aa8ff9640 1 -- 172.21.15.67:0/1175129648 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a9c0054d0 con 0x7f1aac108020 2024-09-10T21:04:11.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.505+0000 7f1aa8ff9640 1 -- 172.21.15.67:0/1175129648 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004d00 con 0x7f1aac108020 2024-09-10T21:04:11.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.507+0000 7f1ab3f3f740 1 Processor -- start 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 -- start start 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06abb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06abdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fa06a25e60 con 0x55fa06abb790 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fa06a15290 con 0x55fa06aaf800 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.509+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa06a190a0 con 0x55fa06aaeee0 2024-09-10T21:04:11.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.510+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.510+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59624/0 (socket says 172.21.15.67:59624) 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.510+0000 7f1aaaffd640 1 -- 172.21.15.67:0/154451238 learned_addr learned my addr 172.21.15.67:0/154451238 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aa8ff9640 1 -- 172.21.15.67:0/1175129648 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f1a9c007bb0 con 0x7f1aac108020 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 -- 172.21.15.67:0/154451238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 msgr2=0x55fa06abb250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06abb250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 -- 172.21.15.67:0/154451238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 msgr2=0x55fa06abdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06abdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 -- 172.21.15.67:0/154451238 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa06773930 con 0x55fa06aaeee0 2024-09-10T21:04:11.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.512+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1aa403e040 tx=0x7f1aa40099b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4102d8c9bfc31007 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.513+0000 7f1a99ffb640 1 -- 172.21.15.67:0/154451238 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4040030 con 0x55fa06aaeee0 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.514+0000 7f1a99ffb640 1 -- 172.21.15.67:0/154451238 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa4015070 con 0x55fa06aaeee0 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1aa8ff9640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 0x7f1a940b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/154451238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 msgr2=0x55fa06aaf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1aa403e040 tx=0x7f1aa40099b0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/154451238 shutdown_connections 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06abdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06abb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/154451238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaeee0 0x55fa06aaf2c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/154451238 >> 172.21.15.67:0/154451238 conn(0x55fa06aacd10 msgr2=0x55fa06aadeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1aa8ff9640 1 -- 172.21.15.67:0/1175129648 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1a9c0e56f0 con 0x7f1aac108020 2024-09-10T21:04:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.515+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/154451238 shutdown_connections 2024-09-10T21:04:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.516+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 0x7f1a940b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.517+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/154451238 wait complete. 2024-09-10T21:04:11.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.517+0000 7f1ab3f3f740 1 -- start start 2024-09-10T21:04:11.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.517+0000 7f1ab3f3f740 1 Processor -- start 2024-09-10T21:04:11.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06ab8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ab8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fa06876890 con 0x55fa06ab8960 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fa069afd40 con 0x55fa06abb790 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa06abe430 con 0x55fa06aaf800 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1ab3f3f740 10 client.0 _ll_register_callbacks cb 0x55fa06a13c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 0x7f1a940b7920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0005fd0 tx=0x7f1aa0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:59632/0 (socket says 172.21.15.67:59632) 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 -- 172.21.15.67:0/2550235677 learned_addr learned my addr 172.21.15.67:0/2550235677 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06ab8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 -- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 msgr2=0x55fa06ab8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06ab8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 -- 172.21.15.67:0/2550235677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 msgr2=0x55fa06ab8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.518+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ab8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.519+0000 7f1aab7fe640 1 -- 172.21.15.67:0/2550235677 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa06ac7940 con 0x55fa06aaf800 2024-09-10T21:04:11.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.520+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000ff90 tx=0x7f1aa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad4ae25f6991c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.520+0000 7f1a8effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.524+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0022070 con 0x55fa06aaf800 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.524+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa06a27db0 con 0x55fa06aaf800 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1aa001e870 con 0x55fa06aaf800 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1aa002e050 con 0x55fa06aaf800 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 10 client.26620 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fa06aca410 con 0x55fa06aaf800 2024-09-10T21:04:11.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fa06a27db0 con 0x55fa06aaf800 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1aa001db00 con 0x55fa06aaf800 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 10 client.26620 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 10 client.26620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 20 client.26620 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06acb940 0x55fa06acde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 4 client.26620 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:11.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.525+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa06a23860 con 0x55fa06acb940 2024-09-10T21:04:11.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.526+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06acb940 0x55fa06acde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.528+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06acb940 0x55fa06acde00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7faa6af09bfe07dd server_cookie=65473966b8f7bb42 in_seq=0 out_seq=0 2024-09-10T21:04:11.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.528+0000 7f1a8effd640 10 client.26620 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:11.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.529+0000 7f1a8effd640 1 -- 172.21.15.67:0/2550235677 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa06a23860 con 0x55fa06acb940 2024-09-10T21:04:11.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.529+0000 7f1a8effd640 10 client.26620 handle_command_reply: tid=0 2024-09-10T21:04:11.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.529+0000 7f1ab3f3f740 1 client.26620 shutdown 2024-09-10T21:04:11.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.529+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 msgr2=0x55fa06abafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.529+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000ff90 tx=0x7f1aa00046c0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 shutdown_connections 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06acb940 0x55fa06acde00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ab8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06ab8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1a8effd640 0 client.26620 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/2550235677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06abafb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 >> 172.21.15.67:0/2550235677 conn(0x55fa06aacd10 msgr2=0x55fa06aab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 shutdown_connections 2024-09-10T21:04:11.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/2550235677 wait complete. 2024-09-10T21:04:11.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.530+0000 7f1ab3f3f740 20 client.26620 trim_cache size 0 max 16384 2024-09-10T21:04:11.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.556+0000 7f1ab3f3f740 1 Processor -- start 2024-09-10T21:04:11.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.556+0000 7f1ab3f3f740 1 -- start start 2024-09-10T21:04:11.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.556+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.556+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06ab8960 0x55fa06aabe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.556+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06ab5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a90010d50 con 0x55fa06abb790 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9000e620 con 0x55fa06aaf800 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9000c470 con 0x55fa06ab8960 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51202/0 (socket says 172.21.15.67:51202) 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 -- 172.21.15.67:0/4040797669 learned_addr learned my addr 172.21.15.67:0/4040797669 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06ab8960 0x55fa06aabe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aabfff640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06ab5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 -- 172.21.15.67:0/4040797669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06ab8960 msgr2=0x55fa06aabe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06ab8960 0x55fa06aabe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 -- 172.21.15.67:0/4040797669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 msgr2=0x55fa06ab5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06ab5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 -- 172.21.15.67:0/4040797669 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa06aad790 con 0x55fa06aaf800 2024-09-10T21:04:11.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aabfff640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06ab5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:04:11.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000fcb0 tx=0x7f1aa0005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c8a7338d92169f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.557+0000 7f1a997fa640 1 -- 172.21.15.67:0/4040797669 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0037070 con 0x55fa06aaf800 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.558+0000 7f1a997fa640 1 -- 172.21.15.67:0/4040797669 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa0026dd0 con 0x55fa06aaf800 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.558+0000 7f1a997fa640 1 -- 172.21.15.67:0/4040797669 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0022070 con 0x55fa06aaf800 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.558+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/4040797669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 msgr2=0x55fa06ab7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.558+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000fcb0 tx=0x7f1aa0005740 comp rx=0 tx=0).stop 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/4040797669 shutdown_connections 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06abb790 0x55fa06ab5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06ab8960 0x55fa06aabe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/4040797669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06aaf800 0x55fa06ab7cb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/4040797669 >> 172.21.15.67:0/4040797669 conn(0x55fa06aacd10 msgr2=0x55fa06aab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/4040797669 shutdown_connections 2024-09-10T21:04:11.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/4040797669 wait complete. 2024-09-10T21:04:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 -- start start 2024-09-10T21:04:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.559+0000 7f1ab3f3f740 1 Processor -- start 2024-09-10T21:04:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06ac00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ac0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9000cae0 con 0x55fa06ab8960 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9000df50 con 0x55fa06abb790 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9000d1b0 con 0x55fa06aaf800 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1ab3f3f740 10 client.0 _ll_register_callbacks cb 0x7f1aa0015050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:51216/0 (socket says 172.21.15.67:51216) 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 -- 172.21.15.67:0/3127512018 learned_addr learned my addr 172.21.15.67:0/3127512018 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06ac00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aaaffd640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ac0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 -- 172.21.15.67:0/3127512018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 msgr2=0x55fa06ac00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06ac00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 -- 172.21.15.67:0/3127512018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 msgr2=0x55fa06ac0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ac0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.560+0000 7f1aabfff640 1 -- 172.21.15.67:0/3127512018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa06b32020 con 0x55fa06abb790 2024-09-10T21:04:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1aabfff640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c007590 tx=0x7f1a9c0ab980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a08a27d51a53b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1a8effd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c0b51e0 con 0x55fa06abb790 2024-09-10T21:04:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1a9c0ab1d0 con 0x55fa06abb790 2024-09-10T21:04:11.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa0026dd0 con 0x55fa06abb790 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1a9c0ac670 con 0x55fa06abb790 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1ab3f3f740 10 client.26672 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.562+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fa06b38a20 con 0x55fa06abb790 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aa0026dd0 con 0x55fa06abb790 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1a9c0970c0 con 0x55fa06abb790 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 10 client.26672 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 20 client.26672 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06b391c0 0x55fa06b3b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 4 client.26672 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fa06a20c90 con 0x55fa06b391c0 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.563+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06b391c0 0x55fa06b3b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:11.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.564+0000 7f1aab7fe640 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06b391c0 0x55fa06b3b5e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ad7e5cd7d33571 server_cookie=6a87f5a45e01e492 in_seq=0 out_seq=0 2024-09-10T21:04:11.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.564+0000 7f1a8effd640 10 client.26672 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1a8effd640 1 -- 172.21.15.67:0/3127512018 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fa06a20c90 con 0x55fa06b391c0 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1a8effd640 10 client.26672 handle_command_reply: tid=0 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 client.26672 shutdown 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 msgr2=0x55fa06b31910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c007590 tx=0x7f1a9c0ab980 comp rx=0 tx=0).stop 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 shutdown_connections 2024-09-10T21:04:11.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55fa06b391c0 0x55fa06b3b5e0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fa06abb790 0x55fa06b31910 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fa06ab8960 0x55fa06ac0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1a8effd640 0 client.26672 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 --2- 172.21.15.67:0/3127512018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa06aaf800 0x55fa06ac00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.565+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 >> 172.21.15.67:0/3127512018 conn(0x55fa06aacd10 msgr2=0x55fa06ab9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.566+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 shutdown_connections 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.566+0000 7f1ab3f3f740 1 -- 172.21.15.67:0/3127512018 wait complete. 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.566+0000 7f1ab3f3f740 20 client.26672 trim_cache size 0 max 16384 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:11.572 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:04:11.573 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "a6999373-d3de-4c6f-b925-141ef2f2ace5", 2024-09-10T21:04:11.573 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:04:11.573 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 msgr2=0x7f1a940b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 0x7f1a940b7920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0005fd0 tx=0x7f1aa0005850 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 msgr2=0x7f1aac1ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 0x7f1aac1ad900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00a8f0 tx=0x7f1a9c00adb0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 shutdown_connections 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac108020 0x7f1aac1ad900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aac1076a0 0x7f1aac1a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f1a940b5460 0x7f1a940b7920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 --2- 172.21.15.67:0/1175129648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac101c90 0x7f1aac1a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:11.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 >> 172.21.15.67:0/1175129648 conn(0x7f1aac0fd700 msgr2=0x7f1aac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 shutdown_connections 2024-09-10T21:04:11.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:11.568+0000 7f1ab1b6a640 1 -- 172.21.15.67:0/1175129648 wait complete. 2024-09-10T21:04:12.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:11 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:04:12.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:11 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:11 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:12.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:11 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:12.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:11 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:11 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:04:12.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:11 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:11 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:12.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:11 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:12.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:11 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:11 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:04:12.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:11 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:11 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:12.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:11 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:12.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:11 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:12.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:04:12.667 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:13.000 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:12 smithi067 ceph-mon[30891]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-10T21:04:13.000 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:12 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:13.000 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:12 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.000 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:12 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:12 smithi083 ceph-mon[35058]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-10T21:04:13.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:12 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:13.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:12 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:12 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:12 smithi172 ceph-mon[35265]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-10T21:04:13.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:12 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:13.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:12 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:12 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 -- 172.21.15.67:0/2421906341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3508104590 msgr2=0x7f350810cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 --2- 172.21.15.67:0/2421906341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3508104590 0x7f350810cb70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f802a3f0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 -- 172.21.15.67:0/2421906341 shutdown_connections 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 --2- 172.21.15.67:0/2421906341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f350810d140 0x7f350810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 --2- 172.21.15.67:0/2421906341 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3508104590 0x7f350810cb70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 --2- 172.21.15.67:0/2421906341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f3508103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.260+0000 7f350fd73640 1 -- 172.21.15.67:0/2421906341 >> 172.21.15.67:0/2421906341 conn(0x7f35080fd700 msgr2=0x7f35080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.261+0000 7f350fd73640 1 -- 172.21.15.67:0/2421906341 shutdown_connections 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.261+0000 7f350fd73640 1 -- 172.21.15.67:0/2421906341 wait complete. 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.261+0000 7f350fd73640 1 Processor -- start 2024-09-10T21:04:13.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.261+0000 7f350fd73640 1 -- start start 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.261+0000 7f350fd73640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f35081992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350fd73640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3508104590 0x7f3508199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350fd73640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 0x7f350819ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350fd73640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f3508112d80 con 0x7f350810d140 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350fd73640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3508112c00 con 0x7f3508103b90 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350fd73640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3508112f00 con 0x7f3508104590 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350e310640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 0x7f350819ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f35081992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350e310640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 0x7f350819ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45034/0 (socket says 172.21.15.67:45034) 2024-09-10T21:04:13.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350e310640 1 -- 172.21.15.67:0/3926162235 learned_addr learned my addr 172.21.15.67:0/3926162235 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350d30e640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3508104590 0x7f3508199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 -- 172.21.15.67:0/3926162235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3508104590 msgr2=0x7f3508199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3508104590 0x7f3508199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 -- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 msgr2=0x7f350819ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 0x7f350819ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 -- 172.21.15.67:0/3926162235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350819f3a0 con 0x7f3508103b90 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f350db0f640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f35081992f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f350400e9f0 tx=0x7f350400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.262+0000 7f34feffd640 1 -- 172.21.15.67:0/3926162235 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350400cd80 con 0x7f3508103b90 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.263+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350819f690 con 0x7f3508103b90 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.263+0000 7f34feffd640 1 -- 172.21.15.67:0/3926162235 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35040035f0 con 0x7f3508103b90 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.263+0000 7f34feffd640 1 -- 172.21.15.67:0/3926162235 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504010690 con 0x7f3508103b90 2024-09-10T21:04:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.263+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35081a5d50 con 0x7f3508103b90 2024-09-10T21:04:13.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.266+0000 7f3512148740 1 Processor -- start 2024-09-10T21:04:13.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 -- start start 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bcecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d76bc65e50 con 0x55d76bcecb20 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d76bc55280 con 0x55d76bcfcdc0 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.267+0000 7f3512148740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d76bc59090 con 0x55d76bcfc440 2024-09-10T21:04:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350e310640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bcecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46426/0 (socket says 172.21.15.67:46426) 2024-09-10T21:04:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 -- 172.21.15.67:0/3712587855 learned_addr learned my addr 172.21.15.67:0/3712587855 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:13.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 -- 172.21.15.67:0/3712587855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 msgr2=0x55d76bcfc880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:13.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfc880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 -- 172.21.15.67:0/3712587855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 msgr2=0x55d76bcecf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bcecf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 -- 172.21.15.67:0/3712587855 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d76b9b3650 con 0x55d76bcfcdc0 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.268+0000 7f350d30e640 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f8032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24915ced74930df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f34f3fff640 1 -- 172.21.15.67:0/3712587855 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8040070 con 0x55d76bcfcdc0 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f34f3fff640 1 -- 172.21.15.67:0/3712587855 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f8004030 con 0x55d76bcfcdc0 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f34f3fff640 1 -- 172.21.15.67:0/3712587855 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8035040 con 0x55d76bcfcdc0 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f34feffd640 1 -- 172.21.15.67:0/3926162235 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f3504004000 con 0x7f3508103b90 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 -- 172.21.15.67:0/3712587855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 msgr2=0x55d76bd067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009900 tx=0x7f34f8032bd0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 -- 172.21.15.67:0/3712587855 shutdown_connections 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bd067b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 --2- 172.21.15.67:0/3712587855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bcecf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.269+0000 7f3512148740 1 -- 172.21.15.67:0/3712587855 >> 172.21.15.67:0/3712587855 conn(0x55d76bcef040 msgr2=0x55d76bcef420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f3512148740 1 -- 172.21.15.67:0/3712587855 shutdown_connections 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f3512148740 1 -- 172.21.15.67:0/3712587855 wait complete. 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f34feffd640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 0x7f34f40b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f350d30e640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 0x7f34f40b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f34feffd640 1 -- 172.21.15.67:0/3926162235 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f35040e5ec0 con 0x7f3508103b90 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f3512148740 1 -- start start 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f3512148740 1 Processor -- start 2024-09-10T21:04:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.270+0000 7f350d30e640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 0x7f34f40b76b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f34f80096c0 tx=0x7f34f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 0x55d76bd06610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bd03a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55d76bab6700 con 0x55d76bcfcdc0 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55d76bbf0110 con 0x55d76bcecb20 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d76bd06e40 con 0x55d76bcfc440 2024-09-10T21:04:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f3512148740 10 client.0 _ll_register_callbacks cb 0x55d76bc09990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f350db0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 0x55d76bd06610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f350e310640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f350e310640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45058/0 (socket says 172.21.15.67:45058) 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f350e310640 1 -- 172.21.15.67:0/2206007148 learned_addr learned my addr 172.21.15.67:0/2206007148 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.271+0000 7f350d30e640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bd03a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 -- 172.21.15.67:0/2206007148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 msgr2=0x55d76bd03a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bd03a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 -- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 msgr2=0x55d76bd06610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 0x55d76bd06610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 -- 172.21.15.67:0/2206007148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d76bc1dc40 con 0x55d76bcfcdc0 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350d30e640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bd03a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350db0f640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 0x55d76bd06610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f350e310640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3500011710 tx=0x7f3500011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead669de1a2af731 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f34f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500010c20 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f8004030 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3500010dc0 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.272+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3500004b20 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 10 client.16971 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d76bd127c0 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f8004030 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f350001b470 con 0x55d76bcfcdc0 2024-09-10T21:04:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 10 client.16971 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 20 client.16971 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd140f0 0x55d76bd16550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 4 client.16971 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d76bc67da0 con 0x55d76bd140f0 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.273+0000 7f350db0f640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd140f0 0x55d76bd16550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.274+0000 7f34f17fa640 10 client.16971 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.274+0000 7f350db0f640 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd140f0 0x55d76bd16550 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd393b3e1bdf3ceb server_cookie=f12b4501dad5c218 in_seq=0 out_seq=0 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.274+0000 7f34f17fa640 1 -- 172.21.15.67:0/2206007148 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d76bc67da0 con 0x55d76bd140f0 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.274+0000 7f34f17fa640 10 client.16971 handle_command_reply: tid=0 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.274+0000 7f3512148740 1 client.16971 shutdown 2024-09-10T21:04:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 msgr2=0x55d76bd04090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3500011710 tx=0x7f3500011bd0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 shutdown_connections 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd140f0 0x55d76bd16550 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcfcdc0 0x55d76bd04090 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bd03a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 --2- 172.21.15.67:0/2206007148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcecb20 0x55d76bd06610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 >> 172.21.15.67:0/2206007148 conn(0x55d76bcef040 msgr2=0x55d76bcfdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f34f17fa640 0 client.16971 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 shutdown_connections 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 1 -- 172.21.15.67:0/2206007148 wait complete. 2024-09-10T21:04:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.275+0000 7f3512148740 20 client.16971 trim_cache size 0 max 16384 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.301+0000 7f3512148740 1 Processor -- start 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.301+0000 7f3512148740 1 -- start start 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.301+0000 7f3512148740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd10030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.301+0000 7f3512148740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.301+0000 7f3512148740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f3512148740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35081ae990 con 0x55d76bcecb20 2024-09-10T21:04:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f3512148740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35081ac260 con 0x55d76bcfcdc0 2024-09-10T21:04:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f350db0f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd10030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f350e310640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f350e310640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46438/0 (socket says 172.21.15.67:46438) 2024-09-10T21:04:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f350e310640 1 -- 172.21.15.67:0/2830116529 learned_addr learned my addr 172.21.15.67:0/2830116529 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:13.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.302+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35081aa0b0 con 0x55d76bcfc440 2024-09-10T21:04:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.303+0000 7f350e310640 1 -- 172.21.15.67:0/2830116529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 msgr2=0x55d76bcfe3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.303+0000 7f350e310640 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfe3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.303+0000 7f350e310640 1 -- 172.21.15.67:0/2830116529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 msgr2=0x55d76bd10030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.303+0000 7f350e310640 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd10030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.303+0000 7f350e310640 1 -- 172.21.15.67:0/2830116529 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d76bd04670 con 0x55d76bcfcdc0 2024-09-10T21:04:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.304+0000 7f350e310640 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35000116e0 tx=0x7f3500011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63d44d087f16b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.305+0000 7f34f37fe640 1 -- 172.21.15.67:0/2830116529 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350001b470 con 0x55d76bcfcdc0 2024-09-10T21:04:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.305+0000 7f34f37fe640 1 -- 172.21.15.67:0/2830116529 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f350001b610 con 0x55d76bcfcdc0 2024-09-10T21:04:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.305+0000 7f34f37fe640 1 -- 172.21.15.67:0/2830116529 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500030920 con 0x55d76bcfcdc0 2024-09-10T21:04:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.310+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 msgr2=0x55d76bcfe920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.310+0000 7f3512148740 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f35000116e0 tx=0x7f3500011440 comp rx=0 tx=0).stop 2024-09-10T21:04:13.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.315+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 shutdown_connections 2024-09-10T21:04:13.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.315+0000 7f3512148740 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfcdc0 0x55d76bcfe920 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.315+0000 7f3512148740 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfc440 0x55d76bcfe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.315+0000 7f3512148740 1 --2- 172.21.15.67:0/2830116529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd10030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.315+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 >> 172.21.15.67:0/2830116529 conn(0x55d76bcef040 msgr2=0x55d76bcebac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.320+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 shutdown_connections 2024-09-10T21:04:13.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.321+0000 7f3512148740 1 -- 172.21.15.67:0/2830116529 wait complete. 2024-09-10T21:04:13.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.321+0000 7f3512148740 1 -- start start 2024-09-10T21:04:13.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.321+0000 7f3512148740 1 Processor -- start 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.325+0000 7f3512148740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 0x55d76bd0c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 0x55d76bd09060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f35081aa720 con 0x55d76bcecb20 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35081abb90 con 0x55d76bcfc440 2024-09-10T21:04:13.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35081aadf0 con 0x55d76bcfcdc0 2024-09-10T21:04:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f3512148740 10 client.0 _ll_register_callbacks cb 0x7f3500009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f350d30e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 0x55d76bd0c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f350d30e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 0x55d76bd0c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:46452/0 (socket says 172.21.15.67:46452) 2024-09-10T21:04:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f350d30e640 1 -- 172.21.15.67:0/3698209100 learned_addr learned my addr 172.21.15.67:0/3698209100 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.326+0000 7f350e310640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 0x55d76bd09060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.329+0000 7f350e310640 1 -- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 msgr2=0x55d76bd0c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.329+0000 7f350e310640 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 0x55d76bd0c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.329+0000 7f350e310640 1 -- 172.21.15.67:0/3698209100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 msgr2=0x55d76bd0c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.329+0000 7f350e310640 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.329+0000 7f350e310640 1 -- 172.21.15.67:0/3698209100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d76bd0cc40 con 0x55d76bcfcdc0 2024-09-10T21:04:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.332+0000 7f350e310640 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 0x55d76bd09060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f350001ba00 tx=0x7f35000306a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff784f12697db01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.332+0000 7f34f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.332+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350001b470 con 0x55d76bcfcdc0 2024-09-10T21:04:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.332+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f350001b610 con 0x55d76bcfcdc0 2024-09-10T21:04:13.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.332+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f350002c040 con 0x55d76bcfcdc0 2024-09-10T21:04:13.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.340+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3500040050 con 0x55d76bcfcdc0 2024-09-10T21:04:13.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.340+0000 7f3512148740 10 client.26635 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:13.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.340+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d76bd814a0 con 0x55d76bcfcdc0 2024-09-10T21:04:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.347+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3500035070 con 0x55d76bcfcdc0 2024-09-10T21:04:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.347+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3500026970 con 0x55d76bcfcdc0 2024-09-10T21:04:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 10 client.26635 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 10 client.26635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:13.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 20 client.26635 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:13.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd81b10 0x55d76bd83f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:13.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 4 client.26635 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:04:13.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.348+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f350001b610 con 0x55d76bd81b10 2024-09-10T21:04:13.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.350+0000 7f350db0f640 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd81b10 0x55d76bd83f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.354+0000 7f350db0f640 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd81b10 0x55d76bd83f30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21ed3adc33f04ca server_cookie=9ea592a515e9829e in_seq=0 out_seq=0 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.354+0000 7f34f17fa640 10 client.26635 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.354+0000 7f34f17fa640 1 -- 172.21.15.67:0/3698209100 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x7f350001b610 con 0x55d76bd81b10 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.354+0000 7f34f17fa640 10 client.26635 handle_command_reply: tid=0 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.355+0000 7f3512148740 1 client.26635 shutdown 2024-09-10T21:04:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.355+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 msgr2=0x55d76bd09060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.355+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 0x55d76bd09060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f350001ba00 tx=0x7f35000306a0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 shutdown_connections 2024-09-10T21:04:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55d76bd81b10 0x55d76bd83f30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d76bcfcdc0 0x55d76bd09060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f34f17fa640 0 client.26635 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d76bcfc440 0x55d76bd0c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 --2- 172.21.15.67:0/3698209100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55d76bcecb20 0x55d76bd0c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.359+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 >> 172.21.15.67:0/3698209100 conn(0x55d76bcef040 msgr2=0x55d76bcfb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.360+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 shutdown_connections 2024-09-10T21:04:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.360+0000 7f3512148740 1 -- 172.21.15.67:0/3698209100 wait complete. 2024-09-10T21:04:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.361+0000 7f3512148740 20 client.26635 trim_cache size 0 max 16384 2024-09-10T21:04:13.365 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "a6999373-d3de-4c6f-b925-141ef2f2ace5", 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:04:13.366 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.367 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.369 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.371 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.373 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:04:13.374 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.375 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:13.376 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 msgr2=0x7f34f40b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 0x7f34f40b76b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f34f80096c0 tx=0x7f34f8000bc0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 msgr2=0x7f35081992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f35081992f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f350400e9f0 tx=0x7f350400eeb0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 shutdown_connections 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f350810d140 0x7f350819ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f34f40b51f0 0x7f34f40b76b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3508104590 0x7f3508199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 --2- 172.21.15.67:0/3926162235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3508103b90 0x7f35081992f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 >> 172.21.15.67:0/3926162235 conn(0x7f35080fd700 msgr2=0x7f35080fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.362+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 shutdown_connections 2024-09-10T21:04:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:13.363+0000 7f350fd73640 1 -- 172.21.15.67:0/3926162235 wait complete. 2024-09-10T21:04:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 760.0 s, 1675.4 tps, lat 59.529 ms stddev 67.764 2024-09-10T21:04:14.136 INFO:tasks.cephfs.filesystem:scrub status for tag:a6999373-d3de-4c6f-b925-141ef2f2ace5 - {'path': '/', 'tag': 'a6999373-d3de-4c6f-b925-141ef2f2ace5', 'options': 'recursive,force'} 2024-09-10T21:04:15.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:14 smithi067 ceph-mon[30891]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 MiB/s wr, 727 op/s 2024-09-10T21:04:15.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:14 smithi083 ceph-mon[35058]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 MiB/s wr, 727 op/s 2024-09-10T21:04:15.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:14 smithi172 ceph-mon[35265]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 MiB/s wr, 727 op/s 2024-09-10T21:04:17.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:16 smithi067 ceph-mon[30891]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T21:04:17.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:16 smithi083 ceph-mon[35058]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T21:04:17.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:16 smithi172 ceph-mon[35265]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T21:04:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 765.0 s, 1781.8 tps, lat 55.811 ms stddev 59.116 2024-09-10T21:04:19.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:18 smithi067 ceph-mon[30891]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:04:19.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:18 smithi083 ceph-mon[35058]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:04:19.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:18 smithi172 ceph-mon[35265]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:04:21.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:20 smithi067 ceph-mon[30891]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 612 op/s 2024-09-10T21:04:21.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:20 smithi083 ceph-mon[35058]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 612 op/s 2024-09-10T21:04:21.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:20 smithi172 ceph-mon[35265]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 612 op/s 2024-09-10T21:04:23.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:22 smithi067 ceph-mon[30891]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-09-10T21:04:23.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:22 smithi083 ceph-mon[35058]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-09-10T21:04:23.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:22 smithi172 ceph-mon[35265]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-09-10T21:04:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 770.0 s, 1829.0 tps, lat 54.553 ms stddev 58.435 2024-09-10T21:04:25.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:24 smithi067 ceph-mon[30891]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 728 op/s 2024-09-10T21:04:25.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:24 smithi083 ceph-mon[35058]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 728 op/s 2024-09-10T21:04:25.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:24 smithi172 ceph-mon[35265]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 728 op/s 2024-09-10T21:04:25.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:25 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:04:25.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:25 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:04:26.042 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:25 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:04:26.042 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:25 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:04:26.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:25 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:04:26.100 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:25 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:04:27.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:26 smithi067 ceph-mon[30891]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-09-10T21:04:27.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:26 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:04:27.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:26 smithi083 ceph-mon[35058]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-09-10T21:04:27.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:26 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:04:27.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:26 smithi172 ceph-mon[35265]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-09-10T21:04:27.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:26 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:04:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 775.0 s, 2000.2 tps, lat 50.391 ms stddev 55.987 2024-09-10T21:04:29.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:28 smithi067 ceph-mon[30891]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-10T21:04:29.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:28 smithi083 ceph-mon[35058]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-10T21:04:29.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:28 smithi172 ceph-mon[35265]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7.3 MiB/s wr, 685 op/s 2024-09-10T21:04:31.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:30 smithi067 ceph-mon[30891]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-09-10T21:04:31.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:30 smithi083 ceph-mon[35058]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-09-10T21:04:31.200 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:30 smithi172 ceph-mon[35265]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-09-10T21:04:33.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:32 smithi067 ceph-mon[30891]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.2 MiB/s wr, 602 op/s 2024-09-10T21:04:33.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:32 smithi083 ceph-mon[35058]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.2 MiB/s wr, 602 op/s 2024-09-10T21:04:33.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:32 smithi172 ceph-mon[35265]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6.2 MiB/s wr, 602 op/s 2024-09-10T21:04:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 780.0 s, 1974.0 tps, lat 50.611 ms stddev 58.291 2024-09-10T21:04:35.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:34 smithi067 ceph-mon[30891]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 762 op/s 2024-09-10T21:04:35.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:34 smithi083 ceph-mon[35058]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 762 op/s 2024-09-10T21:04:35.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:34 smithi172 ceph-mon[35265]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 7.8 MiB/s wr, 762 op/s 2024-09-10T21:04:37.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:36 smithi067 ceph-mon[30891]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-09-10T21:04:37.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:36 smithi083 ceph-mon[35058]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-09-10T21:04:37.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:36 smithi172 ceph-mon[35265]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-09-10T21:04:38.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:37 smithi083 ceph-mon[35058]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-10T21:04:38.199 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:37 smithi172 ceph-mon[35265]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-10T21:04:38.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:37 smithi067 ceph-mon[30891]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-10T21:04:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 785.0 s, 1964.8 tps, lat 50.646 ms stddev 57.578 2024-09-10T21:04:40.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:40 smithi172 ceph-mon[35265]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 625 op/s 2024-09-10T21:04:40.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:40 smithi067 ceph-mon[30891]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 625 op/s 2024-09-10T21:04:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:40 smithi083 ceph-mon[35058]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 625 op/s 2024-09-10T21:04:42.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:42 smithi172 ceph-mon[35265]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:04:42.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:42 smithi067 ceph-mon[30891]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:04:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:42 smithi083 ceph-mon[35058]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:04:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 790.0 s, 1629.6 tps, lat 61.087 ms stddev 68.803 2024-09-10T21:04:44.137 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:04:44.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:44 smithi172 ceph-mon[35265]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-09-10T21:04:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:44 smithi067 ceph-mon[30891]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-09-10T21:04:44.559 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:44 smithi083 ceph-mon[35058]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 724 op/s 2024-09-10T21:04:45.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.178+0000 7f6099ffb640 1 -- 172.21.15.67:0/1373440324 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090034bb0 con 0x7f609c1076a0 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 -- 172.21.15.67:0/1373440324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 msgr2=0x7f609c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 --2- 172.21.15.67:0/1373440324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c107ae0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6090009860 tx=0x7f609002e770 comp rx=0 tx=0).stop 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 -- 172.21.15.67:0/1373440324 shutdown_connections 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 --2- 172.21.15.67:0/1373440324 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 --2- 172.21.15.67:0/1373440324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c107ae0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 --2- 172.21.15.67:0/1373440324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 0x7f609c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 -- 172.21.15.67:0/1373440324 >> 172.21.15.67:0/1373440324 conn(0x7f609c0fd700 msgr2=0x7f609c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 -- 172.21.15.67:0/1373440324 shutdown_connections 2024-09-10T21:04:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.179+0000 7f60a1562640 1 -- 172.21.15.67:0/1373440324 wait complete. 2024-09-10T21:04:45.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.180+0000 7f60a1562640 1 Processor -- start 2024-09-10T21:04:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 -- start start 2024-09-10T21:04:45.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 0x7f609c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f609c110ba0 con 0x7f609c108020 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f609c110a20 con 0x7f609c1076a0 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.181+0000 7f60a1562640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f609c110d20 con 0x7f609c101c90 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.182+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.182+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51286/0 (socket says 172.21.15.67:51286) 2024-09-10T21:04:45.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.182+0000 7f609b7fe640 1 -- 172.21.15.67:0/4194457152 learned_addr learned my addr 172.21.15.67:0/4194457152 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.182+0000 7f609affd640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 0x7f609c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609a7fc640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 -- 172.21.15.67:0/4194457152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 msgr2=0x7f609c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 0x7f609c19f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 -- 172.21.15.67:0/4194457152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 msgr2=0x7f609c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 -- 172.21.15.67:0/4194457152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c1a58f0 con 0x7f609c108020 2024-09-10T21:04:45.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609a7fc640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f609b7fe640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f609400da90 tx=0x7f609400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f6083fff640 1 -- 172.21.15.67:0/4194457152 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609401b020 con 0x7f609c108020 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c1a5be0 con 0x7f609c108020 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.183+0000 7f6083fff640 1 -- 172.21.15.67:0/4194457152 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f609400bc30 con 0x7f609c108020 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.184+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c1ac2a0 con 0x7f609c108020 2024-09-10T21:04:45.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.184+0000 7f6083fff640 1 -- 172.21.15.67:0/4194457152 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094005920 con 0x7f609c108020 2024-09-10T21:04:45.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.187+0000 7f60a3937740 1 Processor -- start 2024-09-10T21:04:45.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.188+0000 7f6083fff640 1 -- 172.21.15.67:0/4194457152 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6094016070 con 0x7f609c108020 2024-09-10T21:04:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.189+0000 7f6083fff640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 0x7f60840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.190+0000 7f609a7fc640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 0x7f60840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.190+0000 7f6083fff640 1 -- 172.21.15.67:0/4194457152 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f60940e3440 con 0x7f609c108020 2024-09-10T21:04:45.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.190+0000 7f60a3937740 1 -- start start 2024-09-10T21:04:45.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a817d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644a80f3e50 con 0x5644a817d0a0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644a80e3280 con 0x5644a8189950 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f60a3937740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644a80e7090 con 0x5644a817d9c0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609a7fc640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 0x7f60840b77a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6090005e00 tx=0x7f6090000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60778/0 (socket says 172.21.15.67:60778) 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609a7fc640 1 -- 172.21.15.67:0/1269463358 learned_addr learned my addr 172.21.15.67:0/1269463358 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609affd640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a817d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.191+0000 7f609b7fe640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 -- 172.21.15.67:0/1269463358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 msgr2=0x5644a818bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 -- 172.21.15.67:0/1269463358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 msgr2=0x5644a817d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a817d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 -- 172.21.15.67:0/1269463358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a7e41650 con 0x5644a817d9c0 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609b7fe640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f609a7fc640 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6090037000 tx=0x7f609003b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c64d2414cbeb766 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f60817fa640 1 -- 172.21.15.67:0/1269463358 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609003a040 con 0x5644a817d9c0 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f60817fa640 1 -- 172.21.15.67:0/1269463358 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6090004c30 con 0x5644a817d9c0 2024-09-10T21:04:45.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.192+0000 7f60817fa640 1 -- 172.21.15.67:0/1269463358 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090034c50 con 0x5644a817d9c0 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 -- 172.21.15.67:0/1269463358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 msgr2=0x5644a8189410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6090037000 tx=0x7f609003b000 comp rx=0 tx=0).stop 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 -- 172.21.15.67:0/1269463358 shutdown_connections 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d9c0 0x5644a8189410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 --2- 172.21.15.67:0/1269463358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a817d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 -- 172.21.15.67:0/1269463358 >> 172.21.15.67:0/1269463358 conn(0x5644a817aed0 msgr2=0x5644a817c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 -- 172.21.15.67:0/1269463358 shutdown_connections 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.193+0000 7f60a3937740 1 -- 172.21.15.67:0/1269463358 wait complete. 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 -- start start 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 Processor -- start 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8186720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a8186df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5644a7f44700 con 0x5644a817d9c0 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5644a807e110 con 0x5644a817d0a0 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644a818c510 con 0x5644a8189950 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.194+0000 7f60a3937740 10 client.0 _ll_register_callbacks cb 0x5644a8097990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:45.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48046/0 (socket says 172.21.15.67:48046) 2024-09-10T21:04:45.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 -- 172.21.15.67:0/220647251 learned_addr learned my addr 172.21.15.67:0/220647251 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:45.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609b7fe640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a8186df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 -- 172.21.15.67:0/220647251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 msgr2=0x5644a8186df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a8186df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 -- 172.21.15.67:0/220647251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 msgr2=0x5644a8186720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8186720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.195+0000 7f609affd640 1 -- 172.21.15.67:0/220647251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a80abc40 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.196+0000 7f609affd640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f608c00baa0 tx=0x7f608c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5925ec39acd958cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.196+0000 7f607eff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c011440 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f608c0115e0 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6090004c30 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f608c0117e0 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f60a3937740 10 client.26696 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.197+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5644a8197eb0 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6090004c30 con 0x5644a817d0a0 2024-09-10T21:04:45.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f608c02c980 con 0x5644a817d0a0 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 10 client.26696 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 10 client.26696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 20 client.26696 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 4 client.26696 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644a80f5da0 con 0x5644a8199460 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f609a7fc640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.198+0000 7f607eff5640 10 client.26696 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f609a7fc640 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a819b8e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a268348645027483 server_cookie=a791b22e7e4e0604 in_seq=0 out_seq=0 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f607eff5640 1 -- 172.21.15.67:0/220647251 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644a80f5da0 con 0x5644a8199460 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f607eff5640 10 client.26696 handle_command_reply: tid=0 2024-09-10T21:04:45.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f60a3937740 1 client.26696 shutdown 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 msgr2=0x5644a81892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f608c00baa0 tx=0x7f608c00bf60 comp rx=0 tx=0).stop 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 shutdown_connections 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.199+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a819b8e0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a8186df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8186720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 --2- 172.21.15.67:0/220647251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d0a0 0x5644a81892d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f607eff5640 0 client.26696 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 >> 172.21.15.67:0/220647251 conn(0x5644a817aed0 msgr2=0x5644a8180a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 shutdown_connections 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 1 -- 172.21.15.67:0/220647251 wait complete. 2024-09-10T21:04:45.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.200+0000 7f60a3937740 20 client.26696 trim_cache size 0 max 16384 2024-09-10T21:04:45.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 Processor -- start 2024-09-10T21:04:45.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 -- start start 2024-09-10T21:04:45.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8195740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1ae980 con 0x5644a817d9c0 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f609c075060 con 0x5644a8189950 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.228+0000 7f60a3937740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f609c072eb0 con 0x5644a817d0a0 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60802/0 (socket says 172.21.15.67:60802) 2024-09-10T21:04:45.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 -- 172.21.15.67:0/1347009444 learned_addr learned my addr 172.21.15.67:0/1347009444 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609b7fe640 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609a7fc640 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 -- 172.21.15.67:0/1347009444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 msgr2=0x5644a818ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 -- 172.21.15.67:0/1347009444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 msgr2=0x5644a8195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.229+0000 7f609affd640 1 -- 172.21.15.67:0/1347009444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a817b950 con 0x5644a817d0a0 2024-09-10T21:04:45.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.233+0000 7f609affd640 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d80 tx=0x7f608c003a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1f7f0d5d1f6673 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.236+0000 7f6080ff9640 1 -- 172.21.15.67:0/1347009444 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c045070 con 0x5644a817d0a0 2024-09-10T21:04:45.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.236+0000 7f6080ff9640 1 -- 172.21.15.67:0/1347009444 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f608c011e30 con 0x5644a817d0a0 2024-09-10T21:04:45.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.237+0000 7f60a3937740 1 -- 172.21.15.67:0/1347009444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 msgr2=0x5644a81866f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.237+0000 7f60a3937740 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d80 tx=0x7f608c003a80 comp rx=0 tx=0).stop 2024-09-10T21:04:45.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.241+0000 7f60a3937740 1 -- 172.21.15.67:0/1347009444 shutdown_connections 2024-09-10T21:04:45.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.241+0000 7f60a3937740 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a8189950 0x5644a818ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.241+0000 7f60a3937740 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d9c0 0x5644a8195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.241+0000 7f60a3937740 1 --2- 172.21.15.67:0/1347009444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a817d0a0 0x5644a81866f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.241+0000 7f60a3937740 1 -- 172.21.15.67:0/1347009444 >> 172.21.15.67:0/1347009444 conn(0x5644a817aed0 msgr2=0x5644a81819a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.252+0000 7f60a3937740 1 -- 172.21.15.67:0/1347009444 shutdown_connections 2024-09-10T21:04:45.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.253+0000 7f60a3937740 1 -- 172.21.15.67:0/1347009444 wait complete. 2024-09-10T21:04:45.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.253+0000 7f60a3937740 1 -- start start 2024-09-10T21:04:45.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.253+0000 7f60a3937740 1 Processor -- start 2024-09-10T21:04:45.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a81a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d9c0 0x5644a81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f609c073520 con 0x5644a817d0a0 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f609c074990 con 0x5644a817d9c0 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f609c073bf0 con 0x5644a8189950 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f60a3937740 10 client.0 _ll_register_callbacks cb 0x7f608c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f609b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60808/0 (socket says 172.21.15.67:60808) 2024-09-10T21:04:45.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.254+0000 7f609b7fe640 1 -- 172.21.15.67:0/2909621429 learned_addr learned my addr 172.21.15.67:0/2909621429 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:45.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.256+0000 7f609b7fe640 1 -- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d9c0 msgr2=0x5644a81a1600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:45.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.256+0000 7f609b7fe640 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d9c0 0x5644a81a1600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.256+0000 7f609b7fe640 1 -- 172.21.15.67:0/2909621429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 msgr2=0x5644a81a10c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:45.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.256+0000 7f609b7fe640 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a81a10c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.256+0000 7f609b7fe640 1 -- 172.21.15.67:0/2909621429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a8190f20 con 0x5644a8189950 2024-09-10T21:04:45.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.263+0000 7f609b7fe640 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60940a8650 tx=0x7f60940b3de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23c258584963396a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:45.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.263+0000 7f607eff5640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:45.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.267+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60940a8870 con 0x5644a8189950 2024-09-10T21:04:45.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.267+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644a80f1850 con 0x5644a8189950 2024-09-10T21:04:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.267+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6094004c40 con 0x5644a8189950 2024-09-10T21:04:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.268+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f60940a8a10 con 0x5644a8189950 2024-09-10T21:04:45.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.268+0000 7f60a3937740 10 client.26653 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.268+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5644a8206850 con 0x5644a8189950 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5644a80f1850 con 0x5644a8189950 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6094016070 con 0x5644a8189950 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 10 client.26653 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 10 client.26653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:45.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 20 client.26653 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a8209010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 4 client.26653 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:04:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.269+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644a80eec80 con 0x5644a8199460 2024-09-10T21:04:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.270+0000 7f609affd640 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a8209010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:45.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.271+0000 7f607eff5640 10 client.26653 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:45.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.271+0000 7f609affd640 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a8209010 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f39a2e785073757 server_cookie=5d4f93d031a5d215 in_seq=0 out_seq=0 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f607eff5640 1 -- 172.21.15.67:0/2909621429 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x5644a80eec80 con 0x5644a8199460 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f607eff5640 10 client.26653 handle_command_reply: tid=0 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 client.26653 shutdown 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 msgr2=0x5644a81a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60940a8650 tx=0x7f60940b3de0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 shutdown_connections 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5644a8199460 0x5644a8209010 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644a8189950 0x5644a81a1b40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5644a817d9c0 0x5644a81a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 --2- 172.21.15.67:0/2909621429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5644a817d0a0 0x5644a81a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 >> 172.21.15.67:0/2909621429 conn(0x5644a817aed0 msgr2=0x5644a8179700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f607eff5640 0 client.26653 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:45.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 shutdown_connections 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.272+0000 7f60a3937740 1 -- 172.21.15.67:0/2909621429 wait complete. 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.273+0000 7f60a3937740 20 client.26653 trim_cache size 0 max 16384 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.278 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.279 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.280 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.281 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.282 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.284 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:04:45.285 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.286 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.287 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:45.288 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:45.289 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:45.289 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 msgr2=0x7f60840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 0x7f60840b77a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6090005e00 tx=0x7f6090000bc0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 msgr2=0x7f609c1a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f609400da90 tx=0x7f609400df50 comp rx=0 tx=0).stop 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 shutdown_connections 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.275+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f609c108020 0x7f609c1a5120 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f609c1076a0 0x7f609c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f60840b52e0 0x7f60840b77a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 --2- 172.21.15.67:0/4194457152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f609c101c90 0x7f609c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:45.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 >> 172.21.15.67:0/4194457152 conn(0x7f609c0fd700 msgr2=0x7f609c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:45.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 shutdown_connections 2024-09-10T21:04:45.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:45.276+0000 7f60a1562640 1 -- 172.21.15.67:0/4194457152 wait complete. 2024-09-10T21:04:46.192 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:04:46.192 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:04:46.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:46 smithi172 ceph-mon[35265]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2024-09-10T21:04:46.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:46 smithi067 ceph-mon[30891]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2024-09-10T21:04:46.622 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:46 smithi083 ceph-mon[35058]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 587 op/s 2024-09-10T21:04:47.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 -- 172.21.15.67:0/4013112204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0102da0 msgr2=0x7fdfc0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:47.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 --2- 172.21.15.67:0/4013112204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0102da0 0x7fdfc0103180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009900 tx=0x7fdfbc02a410 comp rx=0 tx=0).stop 2024-09-10T21:04:47.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 -- 172.21.15.67:0/4013112204 shutdown_connections 2024-09-10T21:04:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 --2- 172.21.15.67:0/4013112204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc0109130 0x7fdfc010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 --2- 172.21.15.67:0/4013112204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc01087b0 0x7fdfc0108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 --2- 172.21.15.67:0/4013112204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0102da0 0x7fdfc0103180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.201+0000 7fdfc7422640 1 -- 172.21.15.67:0/4013112204 >> 172.21.15.67:0/4013112204 conn(0x7fdfc00fe850 msgr2=0x7fdfc0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:47.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.202+0000 7fdfc7422640 1 -- 172.21.15.67:0/4013112204 shutdown_connections 2024-09-10T21:04:47.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.204+0000 7fdfc7422640 1 -- 172.21.15.67:0/4013112204 wait complete. 2024-09-10T21:04:47.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.205+0000 7fdfc7422640 1 Processor -- start 2024-09-10T21:04:47.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 -- start start 2024-09-10T21:04:47.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 0x7fdfc0199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:47.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 0x7fdfc01997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:47.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 0x7fdfc019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0112db0 con 0x7fdfc0102da0 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0112c30 con 0x7fdfc01087b0 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc7422640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc0112f30 con 0x7fdfc0109130 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc51be640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 0x7fdfc0199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc51be640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 0x7fdfc0199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51346/0 (socket says 172.21.15.67:51346) 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc51be640 1 -- 172.21.15.67:0/1805982316 learned_addr learned my addr 172.21.15.67:0/1805982316 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc49bd640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 0x7fdfc01997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:47.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.206+0000 7fdfc59bf640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 0x7fdfc019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 -- 172.21.15.67:0/1805982316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 msgr2=0x7fdfc019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 0x7fdfc019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 -- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 msgr2=0x7fdfc0199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 0x7fdfc0199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 -- 172.21.15.67:0/1805982316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc019f310 con 0x7fdfc01087b0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc59bf640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 0x7fdfc019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc49bd640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 0x7fdfc01997a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000e9f0 tx=0x7fdfb000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000cd80 con 0x7fdfc01087b0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfb00035f0 con 0x7fdfc01087b0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0010670 con 0x7fdfc01087b0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc7422640 1 -- 172.21.15.67:0/1805982316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc019f600 con 0x7fdfc01087b0 2024-09-10T21:04:47.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.207+0000 7fdfc7422640 1 -- 172.21.15.67:0/1805982316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc01a5cc0 con 0x7fdfc01087b0 2024-09-10T21:04:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.208+0000 7fdfc7422640 1 -- 172.21.15.67:0/1805982316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc0103180 con 0x7fdfc01087b0 2024-09-10T21:04:47.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.210+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fdfb0004000 con 0x7fdfc01087b0 2024-09-10T21:04:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.211+0000 7fdfb67fc640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 0x7fdfac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.211+0000 7fdfc51be640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 0x7fdfac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:47.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.211+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdfb00e5da0 con 0x7fdfc01087b0 2024-09-10T21:04:47.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.212+0000 7fdfc51be640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 0x7fdfac0b7820 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc031440 tx=0x7fdfbc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:47.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.217+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdfb00acc90 con 0x7fdfc01087b0 2024-09-10T21:04:47.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.558+0000 7fdfc7422640 1 -- 172.21.15.67:0/1805982316 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc010af10 con 0x7fdfc01087b0 2024-09-10T21:04:47.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.562+0000 7fdfb67fc640 1 -- 172.21.15.67:0/1805982316 <== mon.2 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7fdfb00ac590 con 0x7fdfc01087b0 2024-09-10T21:04:47.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:04:47.573 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:04:47.574 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:04:47.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 msgr2=0x7fdfac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 0x7fdfac0b7820 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc031440 tx=0x7fdfbc0058d0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 msgr2=0x7fdfc01997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 0x7fdfc01997a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000e9f0 tx=0x7fdfb000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 shutdown_connections 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fdfac0b5360 0x7fdfac0b7820 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfc0109130 0x7fdfc019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc01087b0 0x7fdfc01997a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 --2- 172.21.15.67:0/1805982316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdfc0102da0 0x7fdfc0199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:47.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.573+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 >> 172.21.15.67:0/1805982316 conn(0x7fdfc00fe850 msgr2=0x7fdfc0100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:47.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.575+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 shutdown_connections 2024-09-10T21:04:47.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:47.575+0000 7fdfabfff640 1 -- 172.21.15.67:0/1805982316 wait complete. 2024-09-10T21:04:48.230 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:48 smithi067 ceph-mon[30891]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-10T21:04:48.230 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:48 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1805982316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:48.278 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:04:48.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:48 smithi172 ceph-mon[35265]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-10T21:04:48.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:48 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1805982316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:48.645 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:48 smithi083 ceph-mon[35058]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 638 op/s 2024-09-10T21:04:48.645 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:48 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1805982316' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:04:48.652 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 795.0 s, 1563.4 tps, lat 64.612 ms stddev 77.448 2024-09-10T21:04:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 -- 172.21.15.67:0/1704496994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 msgr2=0x7f7fd0102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/1704496994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0102110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009900 tx=0x7f7fcc02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 -- 172.21.15.67:0/1704496994 shutdown_connections 2024-09-10T21:04:49.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/1704496994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd01080c0 0x7f7fd010e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/1704496994 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd0107740 0x7f7fd0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/1704496994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0102110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 -- 172.21.15.67:0/1704496994 >> 172.21.15.67:0/1704496994 conn(0x7f7fd00fd7e0 msgr2=0x7f7fd00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 -- 172.21.15.67:0/1704496994 shutdown_connections 2024-09-10T21:04:49.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.214+0000 7f7fd86f0640 1 -- 172.21.15.67:0/1704496994 wait complete. 2024-09-10T21:04:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 Processor -- start 2024-09-10T21:04:49.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 -- start start 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd0107740 0x7f7fd01986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.216+0000 7f7fd86f0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd0111d80 con 0x7f7fd01080c0 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd86f0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd0111c00 con 0x7f7fd0107740 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd86f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd0111f00 con 0x7f7fd0101d30 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51362/0 (socket says 172.21.15.67:51362) 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 -- 172.21.15.67:0/2238962947 learned_addr learned my addr 172.21.15.67:0/2238962947 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd0107740 0x7f7fd01986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 -- 172.21.15.67:0/2238962947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 msgr2=0x7f7fd0198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 -- 172.21.15.67:0/2238962947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd0107740 msgr2=0x7f7fd01986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd0107740 0x7f7fd01986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 -- 172.21.15.67:0/2238962947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd019e240 con 0x7f7fd01080c0 2024-09-10T21:04:49.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800eaa0 tx=0x7f7fc800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fc77fe640 1 -- 172.21.15.67:0/2238962947 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8004d20 con 0x7f7fd01080c0 2024-09-10T21:04:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd019e530 con 0x7f7fd01080c0 2024-09-10T21:04:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fc77fe640 1 -- 172.21.15.67:0/2238962947 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fc8005020 con 0x7f7fd01080c0 2024-09-10T21:04:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fc77fe640 1 -- 172.21.15.67:0/2238962947 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80116d0 con 0x7f7fd01080c0 2024-09-10T21:04:49.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.217+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd006b4a0 con 0x7f7fd01080c0 2024-09-10T21:04:49.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.221+0000 7f7fdaac5740 1 Processor -- start 2024-09-10T21:04:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.222+0000 7f7fc77fe640 1 -- 172.21.15.67:0/2238962947 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f7fc800f040 con 0x7f7fd01080c0 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.222+0000 7f7fdaac5740 1 -- start start 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffc44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e1fff3aea0 con 0x55e1fffc40f0 2024-09-10T21:04:49.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e1fff2a2d0 con 0x55e1fffc4a10 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1fff2e0e0 con 0x55e1fffd09a0 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffc44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48106/0 (socket says 172.21.15.67:48106) 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd648c640 1 -- 172.21.15.67:0/3078313784 learned_addr learned my addr 172.21.15.67:0/3078313784 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3078313784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 msgr2=0x55e1fffd2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3078313784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 msgr2=0x55e1fffd0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3078313784 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ffc88650 con 0x55e1fffc40f0 2024-09-10T21:04:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.223+0000 7f7fc77fe640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 0x7f7fbc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.224+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffc44d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7fd01010a0 tx=0x7f7fc000a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a041b0817051b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.224+0000 7f7fc77fe640 1 -- 172.21.15.67:0/2238962947 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7fc80e58d0 con 0x7f7fd01080c0 2024-09-10T21:04:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.224+0000 7f7fc4ff9640 1 -- 172.21.15.67:0/3078313784 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0019030 con 0x55e1fffc40f0 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.224+0000 7f7fc4ff9640 1 -- 172.21.15.67:0/3078313784 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fc000faf0 con 0x55e1fffc40f0 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.224+0000 7f7fc4ff9640 1 -- 172.21.15.67:0/3078313784 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc001da70 con 0x55e1fffc40f0 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.225+0000 7f7fd648c640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 0x7f7fbc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.225+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3078313784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 msgr2=0x55e1fffc44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.225+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffc44d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7fd01010a0 tx=0x7f7fc000a690 comp rx=0 tx=0).stop 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3078313784 shutdown_connections 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3078313784 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffc44d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3078313784 >> 172.21.15.67:0/3078313784 conn(0x55e1fffc1f20 msgr2=0x55e1fffc30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3078313784 shutdown_connections 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3078313784 wait complete. 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.226+0000 7f7fd648c640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 0x7f7fbc0b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005ec0 tx=0x7f7fcc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 -- start start 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 Processor -- start 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55e1ffd8b700 con 0x55e1fffc40f0 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55e1ffec5160 con 0x55e1fffc4a10 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1fffd7ad0 con 0x55e1fffd09a0 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fdaac5740 10 client.0 _ll_register_callbacks cb 0x55e1ffede9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fd5c8b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51392/0 (socket says 172.21.15.67:51392) 2024-09-10T21:04:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fd648c640 1 -- 172.21.15.67:0/2709713406 learned_addr learned my addr 172.21.15.67:0/2709713406 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:49.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.227+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/2709713406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 msgr2=0x55e1fffc9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffc9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/2709713406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 msgr2=0x55e1fffcfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/2709713406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1ffef2c90 con 0x55e1fffc4a10 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd648c640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.228+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7fd01010a0 tx=0x7f7fc00052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f88297a2a95c0f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.229+0000 7f7fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.229+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0019050 con 0x55e1fffc4a10 2024-09-10T21:04:49.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.229+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7fc001d9f0 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.229+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fc000faf0 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7fc000adb0 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 10 client.26717 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e1fffe7760 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fc000faf0 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7fc0004b70 con 0x55e1fffc4a10 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 10 client.26717 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 10 client.26717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 20 client.26717 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e1fffe8b60 0x55e1fffeaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 4 client.26717 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1fff3cdf0 con 0x55e1fffe8b60 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.230+0000 7f7fd648c640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e1fffe8b60 0x55e1fffeaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.231+0000 7f7fb9ffb640 10 client.26717 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:49.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.231+0000 7f7fd648c640 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e1fffe8b60 0x55e1fffeaf50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=daed9b15df0e876a server_cookie=52b129b38f8e43ce in_seq=0 out_seq=0 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.231+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/2709713406 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1fff3cdf0 con 0x55e1fffe8b60 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.231+0000 7f7fb9ffb640 10 client.26717 handle_command_reply: tid=0 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.231+0000 7f7fdaac5740 1 client.26717 shutdown 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 msgr2=0x55e1fffd0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7fd01010a0 tx=0x7f7fc00052f0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 shutdown_connections 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e1fffe8b60 0x55e1fffeaf50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffc9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffd0370 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/2709713406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffcfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fb9ffb640 0 client.26717 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 >> 172.21.15.67:0/2709713406 conn(0x55e1fffc1f20 msgr2=0x55e1fffc7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 shutdown_connections 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 1 -- 172.21.15.67:0/2709713406 wait complete. 2024-09-10T21:04:49.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.232+0000 7f7fdaac5740 20 client.26717 trim_cache size 0 max 16384 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 Processor -- start 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 -- start start 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc40f0 0x55e1fffbd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01aea00 con 0x55e1fffc4a10 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01ac2d0 con 0x55e1fffc40f0 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01aa120 con 0x55e1fffd09a0 2024-09-10T21:04:49.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.249+0000 7f7fd5c8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51402/0 (socket says 172.21.15.67:51402) 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3475393858 learned_addr learned my addr 172.21.15.67:0/3475393858 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd648c640 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc40f0 0x55e1fffbd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3475393858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 msgr2=0x55e1fffd3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3475393858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc40f0 msgr2=0x55e1fffbd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc40f0 0x55e1fffbd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.250+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3475393858 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1fffc1c50 con 0x55e1fffc4a10 2024-09-10T21:04:49.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.251+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000ad00 tx=0x7f7fc0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b476140c96a028 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.252+0000 7f7fbbfff640 1 -- 172.21.15.67:0/3475393858 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0037030 con 0x55e1fffc4a10 2024-09-10T21:04:49.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.252+0000 7f7fbbfff640 1 -- 172.21.15.67:0/3475393858 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fc001a040 con 0x55e1fffc4a10 2024-09-10T21:04:49.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.252+0000 7f7fbbfff640 1 -- 172.21.15.67:0/3475393858 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0029970 con 0x55e1fffc4a10 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3475393858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 msgr2=0x55e1fffd37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000ad00 tx=0x7f7fc0001e50 comp rx=0 tx=0).stop 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3475393858 shutdown_connections 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffd3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc4a10 0x55e1fffd37c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3475393858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc40f0 0x55e1fffbd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3475393858 >> 172.21.15.67:0/3475393858 conn(0x55e1fffc1f20 msgr2=0x55e1fffcfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3475393858 shutdown_connections 2024-09-10T21:04:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3475393858 wait complete. 2024-09-10T21:04:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- start start 2024-09-10T21:04:49.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 Processor -- start 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffe1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffe18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01aa790 con 0x55e1fffc40f0 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01abc00 con 0x55e1fffc4a10 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01aae60 con 0x55e1fffd09a0 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.253+0000 7f7fdaac5740 10 client.0 _ll_register_callbacks cb 0x7f7fcc005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:49.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd648c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51410/0 (socket says 172.21.15.67:51410) 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd648c640 1 -- 172.21.15.67:0/3209735846 learned_addr learned my addr 172.21.15.67:0/3209735846 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffe1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd6c8d640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffe18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3209735846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 msgr2=0x55e1fffe18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffe18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3209735846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 msgr2=0x55e1fffe5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 -- 172.21.15.67:0/3209735846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1fffe20f0 con 0x55e1fffc4a10 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd648c640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fd5c8b640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffe1380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55e1fffd6c70 tx=0x7f7fc0005b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2c387b05b3195b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:49.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.254+0000 7f7fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:49.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.255+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0041060 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7fc0029830 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fc001a040 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7fc000a2d0 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 10 client.26723 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e200055720 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fc001a040 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7fc0004bd0 con 0x55e1fffc4a10 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 10 client.26723 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 10 client.26723 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 20 client.26723 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e200055d20 0x55e200058140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 4 client.26723 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:49.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.256+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1fff388a0 con 0x55e200055d20 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fd648c640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e200055d20 0x55e200058140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fd648c640 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e200055d20 0x55e200058140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2473bb3cc244bdad server_cookie=8093a92eba44025f in_seq=0 out_seq=0 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fb9ffb640 10 client.26723 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fb9ffb640 1 -- 172.21.15.67:0/3209735846 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1fff388a0 con 0x55e200055d20 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fb9ffb640 10 client.26723 handle_command_reply: tid=0 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 client.26723 shutdown 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 msgr2=0x55e1fffe1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffe1380 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55e1fffd6c70 tx=0x7f7fc0005b10 comp rx=0 tx=0).stop 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 shutdown_connections 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55e200055d20 0x55e200058140 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1fffd09a0 0x55e1fffe18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e1fffc4a10 0x55e1fffe1380 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 --2- 172.21.15.67:0/3209735846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55e1fffc40f0 0x55e1fffe5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fb9ffb640 0 client.26723 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:04:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 >> 172.21.15.67:0/3209735846 conn(0x55e1fffc1f20 msgr2=0x55e1fffd37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 shutdown_connections 2024-09-10T21:04:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.257+0000 7f7fdaac5740 1 -- 172.21.15.67:0/3209735846 wait complete. 2024-09-10T21:04:49.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fdaac5740 20 client.26723 trim_cache size 0 max 16384 2024-09-10T21:04:49.265 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 msgr2=0x7f7fbc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 0x7f7fbc0b7820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005ec0 tx=0x7f7fcc0095c0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 msgr2=0x7f7fd019da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800eaa0 tx=0x7f7fc800eea0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 shutdown_connections 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7fd01080c0 0x7f7fd019da70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7fd0107740 0x7f7fd01986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f7fbc0b5360 0x7f7fbc0b7820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 --2- 172.21.15.67:0/2238962947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd0101d30 0x7f7fd0198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 >> 172.21.15.67:0/2238962947 conn(0x7f7fd00fd7e0 msgr2=0x7f7fd00ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.258+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 shutdown_connections 2024-09-10T21:04:49.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:49.259+0000 7f7fd86f0640 1 -- 172.21.15.67:0/2238962947 wait complete. 2024-09-10T21:04:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:04:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:04:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:04:49.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:04:49.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:04:49.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:04:49.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:04:49.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:04:49.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:04:49.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:04:49.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:04:49.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:04:50.058 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:04:50.448 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:50 smithi172 ceph-mon[35265]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-10T21:04:50.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:50 smithi067 ceph-mon[30891]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-10T21:04:50.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:50 smithi083 ceph-mon[35058]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 571 op/s 2024-09-10T21:04:50.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 -- 172.21.15.67:0/634215866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c410d100 msgr2=0x7f97c410f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 --2- 172.21.15.67:0/634215866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c410d100 0x7f97c410f570 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009ca0 tx=0x7f97bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 -- 172.21.15.67:0/634215866 shutdown_connections 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 --2- 172.21.15.67:0/634215866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c410d100 0x7f97c410f570 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 --2- 172.21.15.67:0/634215866 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4104550 0x7f97c410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 --2- 172.21.15.67:0/634215866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c4103b50 0x7f97c4103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 -- 172.21.15.67:0/634215866 >> 172.21.15.67:0/634215866 conn(0x7f97c40fd700 msgr2=0x7f97c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:50.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 -- 172.21.15.67:0/634215866 shutdown_connections 2024-09-10T21:04:50.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.948+0000 7f97c8923640 1 -- 172.21.15.67:0/634215866 wait complete. 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 Processor -- start 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 -- start start 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 0x7f97c4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c410d100 0x7f97c419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4112dc0 con 0x7f97c4104550 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4112c40 con 0x7f97c4103b50 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c8923640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97c4112f40 con 0x7f97c410d100 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51432/0 (socket says 172.21.15.67:51432) 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c1d9b640 1 -- 172.21.15.67:0/1165357340 learned_addr learned my addr 172.21.15.67:0/1165357340 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c259c640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 0x7f97c4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.949+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c410d100 0x7f97c419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 -- 172.21.15.67:0/1165357340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c410d100 msgr2=0x7f97c419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c410d100 0x7f97c419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 -- 172.21.15.67:0/1165357340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 msgr2=0x7f97c4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 0x7f97c4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 -- 172.21.15.67:0/1165357340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c419f320 con 0x7f97c4104550 2024-09-10T21:04:50.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c259c640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 0x7f97c4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:50.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c1d9b640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b4a0 tx=0x7f97b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:50.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97b37fe640 1 -- 172.21.15.67:0/1165357340 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8014070 con 0x7f97c4104550 2024-09-10T21:04:50.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c419f610 con 0x7f97c4104550 2024-09-10T21:04:50.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97b37fe640 1 -- 172.21.15.67:0/1165357340 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97b8010ac0 con 0x7f97c4104550 2024-09-10T21:04:50.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97b37fe640 1 -- 172.21.15.67:0/1165357340 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8017c30 con 0x7f97c4104550 2024-09-10T21:04:50.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.950+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c41a5ea0 con 0x7f97c4104550 2024-09-10T21:04:50.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.954+0000 7f97b37fe640 1 -- 172.21.15.67:0/1165357340 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f97b8010610 con 0x7f97c4104550 2024-09-10T21:04:50.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.955+0000 7f97cacf8740 1 Processor -- start 2024-09-10T21:04:50.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.955+0000 7f97cacf8740 1 -- start start 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 0x5569572e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 0x5569572f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572f2190 0x5569572f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x556957257ea0 con 0x5569572e14d0 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5569572472d0 con 0x5569572e1df0 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97cacf8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55695724b0e0 con 0x5569572f2190 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 0x5569572e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 0x5569572e18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51444/0 (socket says 172.21.15.67:51444) 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97c2d9d640 1 -- 172.21.15.67:0/4062620835 learned_addr learned my addr 172.21.15.67:0/4062620835 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97c259c640 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 0x5569572f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.956+0000 7f97c1d9b640 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572f2190 0x5569572f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 -- 172.21.15.67:0/4062620835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572f2190 msgr2=0x5569572f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572f2190 0x5569572f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 -- 172.21.15.67:0/4062620835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 msgr2=0x5569572e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 0x5569572e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 -- 172.21.15.67:0/4062620835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556956fa5650 con 0x5569572e1df0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97b37fe640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 0x7f97ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c259c640 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 0x5569572f1c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009fd0 tx=0x7f97b40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3210d68316f2be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 0x7f97ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97b0ff9640 1 -- 172.21.15.67:0/4062620835 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4004030 con 0x5569572e1df0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97b37fe640 1 -- 172.21.15.67:0/1165357340 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97b80e5410 con 0x7f97c4104550 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97b0ff9640 1 -- 172.21.15.67:0/4062620835 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97b40054d0 con 0x5569572e1df0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.957+0000 7f97b0ff9640 1 -- 172.21.15.67:0/4062620835 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4004ce0 con 0x5569572e1df0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 -- 172.21.15.67:0/4062620835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 msgr2=0x5569572f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 0x7f97ac0b77a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f97bc02f500 tx=0x7f97bc02f370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:50.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 0x5569572f1c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009fd0 tx=0x7f97b40118d0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 -- 172.21.15.67:0/4062620835 shutdown_connections 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572f2190 0x5569572f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e1df0 0x5569572f1c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 --2- 172.21.15.67:0/4062620835 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e14d0 0x5569572e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 -- 172.21.15.67:0/4062620835 >> 172.21.15.67:0/4062620835 conn(0x5569572df300 msgr2=0x5569572e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 -- 172.21.15.67:0/4062620835 shutdown_connections 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.958+0000 7f97cacf8740 1 -- 172.21.15.67:0/4062620835 wait complete. 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 -- start start 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 Processor -- start 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 0x5569572f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 0x5569572eee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 0x5569572ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569570a8700 con 0x5569572e1df0 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5569571e2160 con 0x5569572f2190 2024-09-10T21:04:50.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569572f4e40 con 0x5569572e14d0 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97cacf8740 10 client.0 _ll_register_callbacks cb 0x5569571fb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 0x5569572eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 0x5569572f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c1d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 0x5569572eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51446/0 (socket says 172.21.15.67:51446) 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c1d9b640 1 -- 172.21.15.67:0/1497209864 learned_addr learned my addr 172.21.15.67:0/1497209864 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 0x5569572f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:60906/0 (socket says 172.21.15.67:60906) 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.959+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 0x5569572ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.960+0000 7f97c2d9d640 1 -- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 msgr2=0x5569572f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.960+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 0x5569572f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.960+0000 7f97c2d9d640 1 -- 172.21.15.67:0/1497209864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 msgr2=0x5569572eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.960+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 0x5569572eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.960+0000 7f97c2d9d640 1 -- 172.21.15.67:0/1497209864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695720fc90 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.961+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 0x5569572ef390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d06fcc8577501b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.961+0000 7f97a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.961+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc003d40 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.961+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97bc004040 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.961+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b40054d0 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f97bc004240 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 10 client.26732 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556957300710 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97b40054d0 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f97bc051070 con 0x5569572f2190 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 10 client.26732 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 10 client.26732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:04:50.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 20 client.26732 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x556957301b70 0x556957303f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 4 client.26732 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556957259df0 con 0x556957301b70 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.962+0000 7f97c259c640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x556957301b70 0x556957303f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.963+0000 7f97c259c640 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x556957301b70 0x556957303f80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=add201f3b5b6ea5f server_cookie=bd1b77ec38517f08 in_seq=0 out_seq=0 2024-09-10T21:04:50.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.963+0000 7f97a9ffb640 10 client.26732 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.964+0000 7f97a9ffb640 1 -- 172.21.15.67:0/1497209864 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556957259df0 con 0x556957301b70 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.964+0000 7f97a9ffb640 10 client.26732 handle_command_reply: tid=0 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.964+0000 7f97cacf8740 1 client.26732 shutdown 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 msgr2=0x5569572ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 0x5569572ef390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 shutdown_connections 2024-09-10T21:04:50.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x556957301b70 0x556957303f80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572f2190 0x5569572ef390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97a9ffb640 0 client.26732 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572e1df0 0x5569572eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 --2- 172.21.15.67:0/1497209864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e14d0 0x5569572f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 >> 172.21.15.67:0/1497209864 conn(0x5569572df300 msgr2=0x5569572e4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 shutdown_connections 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 1 -- 172.21.15.67:0/1497209864 wait complete. 2024-09-10T21:04:50.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.965+0000 7f97cacf8740 20 client.26732 trim_cache size 0 max 16384 2024-09-10T21:04:50.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.982+0000 7f97cacf8740 1 Processor -- start 2024-09-10T21:04:50.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 -- start start 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41aea70 con 0x5569572f2190 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41ac340 con 0x5569572e14d0 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97cacf8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41aa190 con 0x5569572e1df0 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51460/0 (socket says 172.21.15.67:51460) 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3990953823 learned_addr learned my addr 172.21.15.67:0/3990953823 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:50.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c1d9b640 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3990953823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 msgr2=0x5569572e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3990953823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 msgr2=0x5569572f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3990953823 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569572e1c20 con 0x5569572f2190 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c259c640 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.983+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97bc005e30 tx=0x7f97bc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5257b652b1238d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.984+0000 7f97abfff640 1 -- 172.21.15.67:0/3990953823 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0043e0 con 0x5569572f2190 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.984+0000 7f97abfff640 1 -- 172.21.15.67:0/3990953823 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97bc036050 con 0x5569572f2190 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.984+0000 7f97abfff640 1 -- 172.21.15.67:0/3990953823 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc030820 con 0x5569572f2190 2024-09-10T21:04:50.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.984+0000 7f97cacf8740 1 -- 172.21.15.67:0/3990953823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 msgr2=0x5569572e06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.984+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f97bc005e30 tx=0x7f97bc0095c0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.985+0000 7f97cacf8740 1 -- 172.21.15.67:0/3990953823 shutdown_connections 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.985+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572e06e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.985+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.985+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3990953823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.985+0000 7f97cacf8740 1 -- 172.21.15.67:0/3990953823 >> 172.21.15.67:0/3990953823 conn(0x5569572df300 msgr2=0x5569572f3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.987+0000 7f97cacf8740 1 -- 172.21.15.67:0/3990953823 shutdown_connections 2024-09-10T21:04:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.987+0000 7f97cacf8740 1 -- 172.21.15.67:0/3990953823 wait complete. 2024-09-10T21:04:50.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.988+0000 7f97cacf8740 1 -- start start 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.988+0000 7f97cacf8740 1 Processor -- start 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.988+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572f7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41aa800 con 0x5569572f2190 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41abc70 con 0x5569572e14d0 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97c41aaed0 con 0x5569572e1df0 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97c2d9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51470/0 (socket says 172.21.15.67:51470) 2024-09-10T21:04:50.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3730955181 learned_addr learned my addr 172.21.15.67:0/3730955181 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.989+0000 7f97cacf8740 10 client.0 _ll_register_callbacks cb 0x7f97bc031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.990+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 msgr2=0x5569572f7100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.990+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572f7100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.990+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3730955181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 msgr2=0x5569572fa8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.990+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572fa8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:50.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:50.990+0000 7f97c2d9d640 1 -- 172.21.15.67:0/3730955181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569572f7e90 con 0x5569572f2190 2024-09-10T21:04:51.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.000+0000 7f97c2d9d640 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a201ea67cf86c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.001+0000 7f97a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.005+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc04d070 con 0x5569572f2190 2024-09-10T21:04:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.005+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97bc036050 con 0x5569572f2190 2024-09-10T21:04:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.005+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97bc0305c0 con 0x5569572f2190 2024-09-10T21:04:51.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.005+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f97bc0307c0 con 0x5569572f2190 2024-09-10T21:04:51.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.006+0000 7f97cacf8740 10 client.17025 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:51.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.006+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55695736fad0 con 0x5569572f2190 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.007+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97bc030e10 con 0x5569572f2190 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.007+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f97bc051040 con 0x5569572f2190 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.007+0000 7f97cacf8740 10 client.17025 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.007+0000 7f97cacf8740 10 client.17025 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.007+0000 7f97cacf8740 20 client.17025 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.008+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5569573700b0 0x5569573724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.008+0000 7f97cacf8740 4 client.17025 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:51.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.008+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f97bc036050 con 0x5569573700b0 2024-09-10T21:04:51.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.011+0000 7f97c259c640 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5569573700b0 0x5569573724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:51.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.016+0000 7f97c259c640 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5569573700b0 0x5569573724d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a59a8bb6742d7d50 server_cookie=bcadb76f6f17e375 in_seq=0 out_seq=0 2024-09-10T21:04:51.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.016+0000 7f97a9ffb640 10 client.17025 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:51.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.016+0000 7f97a9ffb640 1 -- 172.21.15.67:0/3730955181 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f97bc036050 con 0x5569573700b0 2024-09-10T21:04:51.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.016+0000 7f97a9ffb640 10 client.17025 handle_command_reply: tid=0 2024-09-10T21:04:51.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.019+0000 7f97cacf8740 1 client.17025 shutdown 2024-09-10T21:04:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 msgr2=0x5569572f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02f890 comp rx=0 tx=0).stop 2024-09-10T21:04:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 shutdown_connections 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x5569573700b0 0x5569573724d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569572f2190 0x5569572f7660 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97a9ffb640 0 client.17025 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569572e1df0 0x5569572f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 --2- 172.21.15.67:0/3730955181 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569572e14d0 0x5569572fa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.020+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 >> 172.21.15.67:0/3730955181 conn(0x5569572df300 msgr2=0x5569572e4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.021+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 shutdown_connections 2024-09-10T21:04:51.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.024+0000 7f97cacf8740 1 -- 172.21.15.67:0/3730955181 wait complete. 2024-09-10T21:04:51.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.024+0000 7f97cacf8740 20 client.17025 trim_cache size 0 max 16384 2024-09-10T21:04:51.030 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:51.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 msgr2=0x7f97ac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:51.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 0x7f97ac0b77a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f97bc02f500 tx=0x7f97bc02f370 comp rx=0 tx=0).stop 2024-09-10T21:04:51.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 msgr2=0x7f97c41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:51.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f97b800b4a0 tx=0x7f97b800b960 comp rx=0 tx=0).stop 2024-09-10T21:04:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 shutdown_connections 2024-09-10T21:04:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f97ac0b52e0 0x7f97ac0b77a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c410d100 0x7f97c419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97c4104550 0x7f97c41997b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 --2- 172.21.15.67:0/1165357340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f97c4103b50 0x7f97c4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 >> 172.21.15.67:0/1165357340 conn(0x7f97c40fd700 msgr2=0x7f97c40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 shutdown_connections 2024-09-10T21:04:51.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:51.027+0000 7f97c8923640 1 -- 172.21.15.67:0/1165357340 wait complete. 2024-09-10T21:04:51.929 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:04:52.359 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:52.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:52 smithi172 ceph-mon[35265]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-09-10T21:04:52.487 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:52 smithi067 ceph-mon[30891]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-09-10T21:04:52.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:52 smithi083 ceph-mon[35058]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-09-10T21:04:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.108+0000 7fc1a0d48640 1 -- 172.21.15.67:0/2940223521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 msgr2=0x7fc19c10a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.108+0000 7fc1a0d48640 1 --2- 172.21.15.67:0/2940223521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c10a930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009900 tx=0x7fc18c02a4b0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.113+0000 7fc1a0d48640 1 -- 172.21.15.67:0/2940223521 shutdown_connections 2024-09-10T21:04:53.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.113+0000 7fc1a0d48640 1 --2- 172.21.15.67:0/2940223521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.113+0000 7fc1a0d48640 1 --2- 172.21.15.67:0/2940223521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c10a930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.113+0000 7fc1a0d48640 1 --2- 172.21.15.67:0/2940223521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 0x7fc19c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.113+0000 7fc1a0d48640 1 -- 172.21.15.67:0/2940223521 >> 172.21.15.67:0/2940223521 conn(0x7fc19c06dfc0 msgr2=0x7fc19c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.115+0000 7fc1a0d48640 1 -- 172.21.15.67:0/2940223521 shutdown_connections 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.116+0000 7fc1a0d48640 1 -- 172.21.15.67:0/2940223521 wait complete. 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.117+0000 7fc1a0d48640 1 Processor -- start 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.117+0000 7fc1a0d48640 1 -- start start 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.117+0000 7fc1a0d48640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 0x7fc19c1a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.117+0000 7fc1a0d48640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c1a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.117+0000 7fc1a0d48640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c1a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c1a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:57214/0 (socket says 172.21.15.67:57214) 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc19ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc19ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55896/0 (socket says 172.21.15.67:55896) 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc199d9b640 1 -- 172.21.15.67:0/3385594329 learned_addr learned my addr 172.21.15.67:0/3385594329 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:53.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.118+0000 7fc1a0d48640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c121bb0 con 0x7fc19c10a150 2024-09-10T21:04:53.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.119+0000 7fc1a0d48640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c121a30 con 0x7fc19c11c0a0 2024-09-10T21:04:53.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.119+0000 7fc1a0d48640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c121d30 con 0x7fc19c10a530 2024-09-10T21:04:53.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.120+0000 7fc19a59c640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 0x7fc19c1a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 -- 172.21.15.67:0/3385594329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 msgr2=0x7fc19c1a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c1a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 -- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 msgr2=0x7fc19c1a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 0x7fc19c1a8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c1ae130 con 0x7fc19c11c0a0 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.121+0000 7fc19ad9d640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c710 tx=0x7fc19000cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.122+0000 7fc18b7fe640 1 -- 172.21.15.67:0/3385594329 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190004220 con 0x7fc19c11c0a0 2024-09-10T21:04:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.122+0000 7fc18b7fe640 1 -- 172.21.15.67:0/3385594329 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc19000ce20 con 0x7fc19c11c0a0 2024-09-10T21:04:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.122+0000 7fc1a0d48640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c1ae420 con 0x7fc19c11c0a0 2024-09-10T21:04:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.124+0000 7fc1a0d48640 1 -- 172.21.15.67:0/3385594329 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c1b4ae0 con 0x7fc19c11c0a0 2024-09-10T21:04:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.124+0000 7fc18b7fe640 1 -- 172.21.15.67:0/3385594329 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190003d50 con 0x7fc19c11c0a0 2024-09-10T21:04:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.126+0000 7fc18b7fe640 1 -- 172.21.15.67:0/3385594329 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc190020060 con 0x7fc19c11c0a0 2024-09-10T21:04:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.131+0000 7fc1a311d740 1 Processor -- start 2024-09-10T21:04:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 -- start start 2024-09-10T21:04:53.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af48094b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af480a3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55af4800aea0 con 0x55af480947b0 2024-09-10T21:04:53.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55af47ffa2d0 con 0x55af480a1060 2024-09-10T21:04:53.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.132+0000 7fc1a311d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55af47ffe0e0 con 0x55af480950d0 2024-09-10T21:04:53.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.133+0000 7fc18b7fe640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 0x7fc1840b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.133+0000 7fc18b7fe640 1 -- 172.21.15.67:0/3385594329 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc1900e5fe0 con 0x7fc19c11c0a0 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.134+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af480a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.134+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af480a3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55912/0 (socket says 172.21.15.67:55912) 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.134+0000 7fc199d9b640 1 -- 172.21.15.67:0/2435988557 learned_addr learned my addr 172.21.15.67:0/2435988557 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.134+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af48094b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc19a59c640 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc19ad9d640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 0x7fc1840b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc199d9b640 1 -- 172.21.15.67:0/2435988557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 msgr2=0x55af480a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc199d9b640 1 -- 172.21.15.67:0/2435988557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 msgr2=0x55af480a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af480a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.135+0000 7fc199d9b640 1 -- 172.21.15.67:0/2435988557 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af47d58650 con 0x55af480947b0 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.137+0000 7fc19ad9d640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 0x7fc1840b78e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc190003ff0 tx=0x7fc1900043c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.137+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af48094b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc18c034040 tx=0x7fc18c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac68cbad768bc2c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.137+0000 7fc183fff640 1 -- 172.21.15.67:0/2435988557 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c036040 con 0x55af480947b0 2024-09-10T21:04:53.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.137+0000 7fc183fff640 1 -- 172.21.15.67:0/2435988557 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc18c047070 con 0x55af480947b0 2024-09-10T21:04:53.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.137+0000 7fc183fff640 1 -- 172.21.15.67:0/2435988557 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c031c00 con 0x55af480947b0 2024-09-10T21:04:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 -- 172.21.15.67:0/2435988557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 msgr2=0x55af48094b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af48094b90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc18c034040 tx=0x7fc18c005850 comp rx=0 tx=0).stop 2024-09-10T21:04:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 -- 172.21.15.67:0/2435988557 shutdown_connections 2024-09-10T21:04:53.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af480a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2435988557 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af48094b90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 -- 172.21.15.67:0/2435988557 >> 172.21.15.67:0/2435988557 conn(0x55af480925e0 msgr2=0x55af48093780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 -- 172.21.15.67:0/2435988557 shutdown_connections 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.138+0000 7fc1a311d740 1 -- 172.21.15.67:0/2435988557 wait complete. 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 -- start start 2024-09-10T21:04:53.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 Processor -- start 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480a1060 0x55af4809e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55af47e5b700 con 0x55af480950d0 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55af47f95160 con 0x55af480947b0 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55af480a3c10 con 0x55af480a1060 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.139+0000 7fc1a311d740 10 client.0 _ll_register_callbacks cb 0x55af47fae9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:53.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc19a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480a1060 0x55af4809e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55924/0 (socket says 172.21.15.67:55924) 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 -- 172.21.15.67:0/2499113745 learned_addr learned my addr 172.21.15.67:0/2499113745 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc19a59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60074/0 (socket says 172.21.15.67:60074) 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 -- 172.21.15.67:0/2499113745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480a1060 msgr2=0x55af4809e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480a1060 0x55af4809e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 -- 172.21.15.67:0/2499113745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 msgr2=0x55af4809db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 -- 172.21.15.67:0/2499113745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af47fc2c90 con 0x55af480947b0 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc19a59c640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:53.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc199d9b640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0058c0 tx=0x7fc18c0057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f549f3d3bf3969a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.140+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c036070 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc18c047070 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc18c004970 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc18c004b70 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 10 client.26744 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55af480af350 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc18c047070 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc18c03c050 con 0x55af480947b0 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 10 client.26744 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 10 client.26744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 20 client.26744 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.141+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af480b08b0 0x55af480b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.142+0000 7fc1a311d740 4 client.26744 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:53.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.142+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af4800cdf0 con 0x55af480b08b0 2024-09-10T21:04:53.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.144+0000 7fc19a59c640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af480b08b0 0x55af480b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.146+0000 7fc19a59c640 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af480b08b0 0x55af480b2d10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504af4b210e32a69 server_cookie=b1c0d00e0c361191 in_seq=0 out_seq=0 2024-09-10T21:04:53.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.146+0000 7fc181ffb640 10 client.26744 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc181ffb640 1 -- 172.21.15.67:0/2499113745 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af4800cdf0 con 0x55af480b08b0 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc181ffb640 10 client.26744 handle_command_reply: tid=0 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 client.26744 shutdown 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 msgr2=0x55af480a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0058c0 tx=0x7fc18c0057b0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 shutdown_connections 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af480b08b0 0x55af480b2d10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480a1060 0x55af4809e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480950d0 0x55af4809db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 --2- 172.21.15.67:0/2499113745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a06b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 >> 172.21.15.67:0/2499113745 conn(0x55af480925e0 msgr2=0x55af48098150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc181ffb640 0 client.26744 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 shutdown_connections 2024-09-10T21:04:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 1 -- 172.21.15.67:0/2499113745 wait complete. 2024-09-10T21:04:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.147+0000 7fc1a311d740 20 client.26744 trim_cache size 0 max 16384 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.167+0000 7fc1a311d740 1 Processor -- start 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.167+0000 7fc1a311d740 1 -- start start 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af4809c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af4809ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bf8e0 con 0x55af480947b0 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bd1b0 con 0x55af480a1060 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1a311d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bb000 con 0x55af480950d0 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af4809c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:57248/0 (socket says 172.21.15.67:57248) 2024-09-10T21:04:53.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 -- 172.21.15.67:0/4159048524 learned_addr learned my addr 172.21.15.67:0/4159048524 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af4809c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60082/0 (socket says 172.21.15.67:60082) 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc199d9b640 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af4809ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 -- 172.21.15.67:0/4159048524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 msgr2=0x55af4809ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af4809ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 -- 172.21.15.67:0/4159048524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 msgr2=0x55af4809c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af4809c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 -- 172.21.15.67:0/4159048524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4806d040 con 0x55af480950d0 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc194013590 tx=0x7fc1940075b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbd26e17996042f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1837fe640 1 -- 172.21.15.67:0/4159048524 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194011840 con 0x55af480950d0 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1837fe640 1 -- 172.21.15.67:0/4159048524 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc194011e90 con 0x55af480950d0 2024-09-10T21:04:53.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.168+0000 7fc1837fe640 1 -- 172.21.15.67:0/4159048524 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19401b3b0 con 0x55af480950d0 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- 172.21.15.67:0/4159048524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 msgr2=0x55af4809c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc194013590 tx=0x7fc1940075b0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- 172.21.15.67:0/4159048524 shutdown_connections 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480a1060 0x55af4809ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af4809c8c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4159048524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480947b0 0x55af4809c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- 172.21.15.67:0/4159048524 >> 172.21.15.67:0/4159048524 conn(0x55af480925e0 msgr2=0x55af4809dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- 172.21.15.67:0/4159048524 shutdown_connections 2024-09-10T21:04:53.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- 172.21.15.67:0/4159048524 wait complete. 2024-09-10T21:04:53.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 -- start start 2024-09-10T21:04:53.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.170+0000 7fc1a311d740 1 Processor -- start 2024-09-10T21:04:53.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480a1060 0x55af480a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc199d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55940/0 (socket says 172.21.15.67:55940) 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc199d9b640 1 -- 172.21.15.67:0/4202528451 learned_addr learned my addr 172.21.15.67:0/4202528451 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bb670 con 0x55af480a1060 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bcae0 con 0x55af480947b0 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c1bbd40 con 0x55af480950d0 2024-09-10T21:04:53.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc1a311d740 10 client.0 _ll_register_callbacks cb 0x7fc18c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc199d9b640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480a1060 0x55af480a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc19a59c640 1 -- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 msgr2=0x55af480a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.171+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.172+0000 7fc19a59c640 1 -- 172.21.15.67:0/4202528451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480a1060 msgr2=0x55af480a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.172+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480a1060 0x55af480a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.172+0000 7fc19a59c640 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af480a9ae0 con 0x55af480950d0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.172+0000 7fc19a59c640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a94a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55af48091d30 tx=0x7fc194023d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13220465f015ccc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.172+0000 7fc1817fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.173+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194004cc0 con 0x55af480950d0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.173+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc194023440 con 0x55af480950d0 2024-09-10T21:04:53.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.173+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc194011e90 con 0x55af480950d0 2024-09-10T21:04:53.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.173+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc194004e60 con 0x55af480950d0 2024-09-10T21:04:53.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.174+0000 7fc1a311d740 10 client.26707 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:53.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.174+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55af4811dc70 con 0x55af480950d0 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc194023640 con 0x55af480950d0 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc194021020 con 0x55af480950d0 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 10 client.26707 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 10 client.26707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 20 client.26707 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:53.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af4811e2f0 0x55af48120710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 4 client.26707 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc194011e90 con 0x55af4811e2f0 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.175+0000 7fc199d9b640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af4811e2f0 0x55af48120710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc199d9b640 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af4811e2f0 0x55af48120710 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04535e27e978f09 server_cookie=fb6a24fafd9ef594 in_seq=0 out_seq=0 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1817fa640 10 client.26707 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1817fa640 1 -- 172.21.15.67:0/4202528451 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc194011e90 con 0x55af4811e2f0 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1817fa640 10 client.26707 handle_command_reply: tid=0 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 client.26707 shutdown 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 msgr2=0x55af480a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a94a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55af48091d30 tx=0x7fc194023d60 comp rx=0 tx=0).stop 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 shutdown_connections 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55af4811e2f0 0x55af48120710 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55af480a1060 0x55af480a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af480950d0 0x55af480a94a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 --2- 172.21.15.67:0/4202528451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55af480947b0 0x55af480a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1817fa640 0 client.26707 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.176+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 >> 172.21.15.67:0/4202528451 conn(0x55af480925e0 msgr2=0x55af4809c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.177+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 shutdown_connections 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.177+0000 7fc1a311d740 1 -- 172.21.15.67:0/4202528451 wait complete. 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.177+0000 7fc1a311d740 20 client.26707 trim_cache size 0 max 16384 2024-09-10T21:04:53.186 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 msgr2=0x7fc1840b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 0x7fc1840b78e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc190003ff0 tx=0x7fc1900043c0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 msgr2=0x7fc19c1ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c710 tx=0x7fc19000cbd0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 shutdown_connections 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc19c11c0a0 0x7fc19c1ad960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc1840b5420 0x7fc1840b78e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc19c10a530 0x7fc19c1a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 --2- 172.21.15.67:0/3385594329 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc19c10a150 0x7fc19c1a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:53.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 >> 172.21.15.67:0/3385594329 conn(0x7fc19c06dfc0 msgr2=0x7fc19c11c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:53.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 shutdown_connections 2024-09-10T21:04:53.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:53.178+0000 7fc1897fa640 1 -- 172.21.15.67:0/3385594329 wait complete. 2024-09-10T21:04:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 800.0 s, 2010.4 tps, lat 49.909 ms stddev 61.479 2024-09-10T21:04:54.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:54 smithi172 ceph-mon[35265]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-09-10T21:04:54.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:54 smithi067 ceph-mon[30891]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-09-10T21:04:54.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:54 smithi083 ceph-mon[35058]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-09-10T21:04:55.234 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:04:55.235 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:04:55.606 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.259+0000 7fbfeb59e640 1 -- 172.21.15.67:0/1976150453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec11c0a0 msgr2=0x7fbfec11e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.259+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/1976150453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec11c0a0 0x7fbfec11e490 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009ca0 tx=0x7fbfe402a8b0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 -- 172.21.15.67:0/1976150453 shutdown_connections 2024-09-10T21:04:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/1976150453 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec11c0a0 0x7fbfec11e490 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/1976150453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a530 0x7fbfec10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/1976150453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfec10a150 0x7fbfec1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 -- 172.21.15.67:0/1976150453 >> 172.21.15.67:0/1976150453 conn(0x7fbfec06cb30 msgr2=0x7fbfec06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 -- 172.21.15.67:0/1976150453 shutdown_connections 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.262+0000 7fbfeb59e640 1 -- 172.21.15.67:0/1976150453 wait complete. 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.263+0000 7fbfeb59e640 1 Processor -- start 2024-09-10T21:04:56.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.263+0000 7fbfeb59e640 1 -- start start 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a150 0x7fbfec1a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfec11c0a0 0x7fbfec1ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec121a50 con 0x7fbfec10a530 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec1218d0 con 0x7fbfec10a150 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.264+0000 7fbfeb59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec121bd0 con 0x7fbfec11c0a0 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.265+0000 7fbfe9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.265+0000 7fbfe9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60108/0 (socket says 172.21.15.67:60108) 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.265+0000 7fbfe9d9b640 1 -- 172.21.15.67:0/208038414 learned_addr learned my addr 172.21.15.67:0/208038414 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.265+0000 7fbfea59c640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a150 0x7fbfec1a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 -- 172.21.15.67:0/208038414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfec11c0a0 msgr2=0x7fbfec1ad530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfec11c0a0 0x7fbfec1ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 -- 172.21.15.67:0/208038414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a150 msgr2=0x7fbfec1a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a150 0x7fbfec1a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 -- 172.21.15.67:0/208038414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec1add00 con 0x7fbfec10a530 2024-09-10T21:04:56.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00e940 tx=0x7fbfdc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.266+0000 7fbfe37fe640 1 -- 172.21.15.67:0/208038414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004220 con 0x7fbfec10a530 2024-09-10T21:04:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.267+0000 7fbfe37fe640 1 -- 172.21.15.67:0/208038414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfdc0043c0 con 0x7fbfec10a530 2024-09-10T21:04:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.267+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec1adff0 con 0x7fbfec10a530 2024-09-10T21:04:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.267+0000 7fbfe37fe640 1 -- 172.21.15.67:0/208038414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc003e50 con 0x7fbfec10a530 2024-09-10T21:04:56.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.267+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec111880 con 0x7fbfec10a530 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.271+0000 7fbff2c12740 1 Processor -- start 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.271+0000 7fbff2c12740 1 -- start start 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558cf3120e60 con 0x558cf31b69a0 2024-09-10T21:04:56.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558cf3110290 con 0x558cf31aaa10 2024-09-10T21:04:56.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.272+0000 7fbff2c12740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cf31140a0 con 0x558cf31aa0f0 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.273+0000 7fbfead9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.273+0000 7fbfead9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:57274/0 (socket says 172.21.15.67:57274) 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.273+0000 7fbfead9d640 1 -- 172.21.15.67:0/3771638369 learned_addr learned my addr 172.21.15.67:0/3771638369 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 -- 172.21.15.67:0/3771638369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 msgr2=0x558cf31b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 -- 172.21.15.67:0/3771638369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 msgr2=0x558cf31b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 -- 172.21.15.67:0/3771638369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf2e6e930 con 0x558cf31aa0f0 2024-09-10T21:04:56.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfead9d640 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4005fe0 tx=0x7fbfe4001140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c74f3c1a28ac0a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.274+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:04:56.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.275+0000 7fbfe0ff9640 1 -- 172.21.15.67:0/3771638369 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40098c0 con 0x558cf31aa0f0 2024-09-10T21:04:56.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.275+0000 7fbfe37fe640 1 -- 172.21.15.67:0/208038414 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbfdc00c8b0 con 0x7fbfec10a530 2024-09-10T21:04:56.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.276+0000 7fbfe37fe640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 0x7fbfd80b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.276+0000 7fbfe37fe640 1 -- 172.21.15.67:0/208038414 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbfdc0e6170 con 0x7fbfec10a530 2024-09-10T21:04:56.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.277+0000 7fbfe0ff9640 1 -- 172.21.15.67:0/3771638369 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe403f070 con 0x558cf31aa0f0 2024-09-10T21:04:56.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.277+0000 7fbfea59c640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 0x7fbfd80b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.278+0000 7fbff2c12740 1 -- 172.21.15.67:0/3771638369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 msgr2=0x558cf31aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.278+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4005fe0 tx=0x7fbfe4001140 comp rx=0 tx=0).stop 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 -- 172.21.15.67:0/3771638369 shutdown_connections 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3771638369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31aa4d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 -- 172.21.15.67:0/3771638369 >> 172.21.15.67:0/3771638369 conn(0x558cf31a7f20 msgr2=0x558cf31a90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.279+0000 7fbff2c12740 1 -- 172.21.15.67:0/3771638369 shutdown_connections 2024-09-10T21:04:56.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.280+0000 7fbff2c12740 1 -- 172.21.15.67:0/3771638369 wait complete. 2024-09-10T21:04:56.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.280+0000 7fbff2c12740 1 -- start start 2024-09-10T21:04:56.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.280+0000 7fbff2c12740 1 Processor -- start 2024-09-10T21:04:56.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.280+0000 7fbfea59c640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 0x7fbfd80b7c10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x558cf31ad270 tx=0x7fbfd400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x558cf2f71890 con 0x558cf31b69a0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x558cf30aad40 con 0x558cf31aaa10 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cf31b9640 con 0x558cf31aa0f0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbff2c12740 10 client.0 _ll_register_callbacks cb 0x558cf310ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfead9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:57278/0 (socket says 172.21.15.67:57278) 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 -- 172.21.15.67:0/3602006085 learned_addr learned my addr 172.21.15.67:0/3602006085 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 -- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 msgr2=0x558cf31b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 -- 172.21.15.67:0/3602006085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 msgr2=0x558cf31b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.281+0000 7fbfea59c640 1 -- 172.21.15.67:0/3602006085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf31c29f0 con 0x558cf31aa0f0 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.282+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4020690 tx=0x7fbfd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afc76ea5dd6b965 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.282+0000 7fbfd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:04:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.282+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd402f8c0 con 0x558cf31aa0f0 2024-09-10T21:04:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.282+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbfd402fa60 con 0x558cf31aa0f0 2024-09-10T21:04:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.282+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfe403f070 con 0x558cf31aa0f0 2024-09-10T21:04:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.283+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbfd402fc80 con 0x558cf31aa0f0 2024-09-10T21:04:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.283+0000 7fbff2c12740 10 client.26716 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.283+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558cf31c5360 con 0x558cf31aa0f0 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.283+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfe403f070 con 0x558cf31aa0f0 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbfd401f040 con 0x558cf31aa0f0 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 10 client.26716 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 10 client.26716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 20 client.26716 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf31c6810 0x558cf31c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 4 client.26716 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:56.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cf3122db0 con 0x558cf31c6810 2024-09-10T21:04:56.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.284+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf31c6810 0x558cf31c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.285+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf31c6810 0x558cf31c8c00 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e815e8d64c7e900e server_cookie=4f29946da8fa47f3 in_seq=0 out_seq=0 2024-09-10T21:04:56.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.285+0000 7fbfd1ffb640 10 client.26716 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:56.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.286+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/3602006085 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cf3122db0 con 0x558cf31c6810 2024-09-10T21:04:56.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.286+0000 7fbfd1ffb640 10 client.26716 handle_command_reply: tid=0 2024-09-10T21:04:56.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.287+0000 7fbff2c12740 1 client.26716 shutdown 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 msgr2=0x558cf31b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4020690 tx=0x7fbfd40046c0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 shutdown_connections 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf31c6810 0x558cf31c8c00 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf31b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aaa10 0x558cf31b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3602006085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aa0f0 0x558cf31b38e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 >> 172.21.15.67:0/3602006085 conn(0x558cf31a7f20 msgr2=0x558cf31adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbfd1ffb640 0 client.26716 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 shutdown_connections 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 1 -- 172.21.15.67:0/3602006085 wait complete. 2024-09-10T21:04:56.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.288+0000 7fbff2c12740 20 client.26716 trim_cache size 0 max 16384 2024-09-10T21:04:56.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 Processor -- start 2024-09-10T21:04:56.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 -- start start 2024-09-10T21:04:56.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31aaa10 0x558cf31b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31b69a0 0x558cf31b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec1b6fc0 con 0x558cf31aaa10 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec1b4890 con 0x558cf31aa0f0 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.311+0000 7fbff2c12740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec118250 con 0x558cf31b69a0 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55984/0 (socket says 172.21.15.67:55984) 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 -- 172.21.15.67:0/3310896620 learned_addr learned my addr 172.21.15.67:0/3310896620 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31aaa10 0x558cf31b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfead9d640 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31b69a0 0x558cf31b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 -- 172.21.15.67:0/3310896620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31b69a0 msgr2=0x558cf31b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31b69a0 0x558cf31b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 -- 172.21.15.67:0/3310896620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31aaa10 msgr2=0x558cf31b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31aaa10 0x558cf31b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 -- 172.21.15.67:0/3310896620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf31a7d50 con 0x558cf31aa0f0 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfea59c640 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4020e60 tx=0x7fbfd4022d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42864156ee3f7156 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfd3fff640 1 -- 172.21.15.67:0/3310896620 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4021110 con 0x558cf31aa0f0 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfd3fff640 1 -- 172.21.15.67:0/3310896620 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfd4046070 con 0x558cf31aa0f0 2024-09-10T21:04:56.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.312+0000 7fbfd3fff640 1 -- 172.21.15.67:0/3310896620 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4042430 con 0x558cf31aa0f0 2024-09-10T21:04:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- 172.21.15.67:0/3310896620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 msgr2=0x558cf31c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4020e60 tx=0x7fbfd4022d50 comp rx=0 tx=0).stop 2024-09-10T21:04:56.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- 172.21.15.67:0/3310896620 shutdown_connections 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31b69a0 0x558cf31b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31aaa10 0x558cf31b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 --2- 172.21.15.67:0/3310896620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31c1fc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- 172.21.15.67:0/3310896620 >> 172.21.15.67:0/3310896620 conn(0x558cf31a7f20 msgr2=0x558cf31c18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- 172.21.15.67:0/3310896620 shutdown_connections 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- 172.21.15.67:0/3310896620 wait complete. 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.313+0000 7fbff2c12740 1 -- start start 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 Processor -- start 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aaa10 0x558cf31bb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf32326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:55988/0 (socket says 172.21.15.67:55988) 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 -- 172.21.15.67:0/535161346 learned_addr learned my addr 172.21.15.67:0/535161346 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aaa10 0x558cf31bb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfead9d640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf32326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec118870 con 0x558cf31b69a0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec119ce0 con 0x558cf31aa0f0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec118f40 con 0x558cf31aaa10 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbff2c12740 10 client.0 _ll_register_callbacks cb 0x7fbfd400b940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 -- 172.21.15.67:0/535161346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aaa10 msgr2=0x558cf31bb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aaa10 0x558cf31bb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 -- 172.21.15.67:0/535161346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 msgr2=0x558cf32326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf32326d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.314+0000 7fbfea59c640 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf3232c10 con 0x558cf31aa0f0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfea59c640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4041520 tx=0x7fbfd400bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8503b79b5a31775 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd402f6c0 con 0x558cf31aa0f0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbfd402f860 con 0x558cf31aa0f0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd4046070 con 0x558cf31aa0f0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbfd402faa0 con 0x558cf31aa0f0 2024-09-10T21:04:56.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 10 client.26765 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558cf3233da0 con 0x558cf31aa0f0 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfd4046070 con 0x558cf31aa0f0 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbfd4004b00 con 0x558cf31aa0f0 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 10 client.26765 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 10 client.26765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 20 client.26765 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf3234430 0x558cf3236850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 4 client.26765 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.315+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558cf311e860 con 0x558cf3234430 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.316+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf3234430 0x558cf3236850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.316+0000 7fbfd1ffb640 10 client.26765 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:56.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.316+0000 7fbfe9d9b640 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf3234430 0x558cf3236850 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67e65a9ce92de0f server_cookie=317f042e4ddbb703 in_seq=0 out_seq=0 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbfd1ffb640 1 -- 172.21.15.67:0/535161346 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558cf311e860 con 0x558cf3234430 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbfd1ffb640 10 client.26765 handle_command_reply: tid=0 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 client.26765 shutdown 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 msgr2=0x558cf31babf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4041520 tx=0x7fbfd400bb90 comp rx=0 tx=0).stop 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 shutdown_connections 2024-09-10T21:04:56.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x558cf3234430 0x558cf3236850 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558cf31b69a0 0x558cf32326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf31aaa10 0x558cf31bb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 --2- 172.21.15.67:0/535161346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cf31aa0f0 0x558cf31babf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 >> 172.21.15.67:0/535161346 conn(0x558cf31a7f20 msgr2=0x558cf31c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbfd1ffb640 0 client.26765 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 shutdown_connections 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 1 -- 172.21.15.67:0/535161346 wait complete. 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.318+0000 7fbff2c12740 20 client.26765 trim_cache size 0 max 16384 2024-09-10T21:04:56.327 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:04:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "8bb82cad-9ae8-449f-9468-bc614adadf24", 2024-09-10T21:04:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:04:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:56.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 msgr2=0x7fbfd80b7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 0x7fbfd80b7c10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x558cf31ad270 tx=0x7fbfd400b390 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 msgr2=0x7fbfec1a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00e940 tx=0x7fbfdc00ee00 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 shutdown_connections 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbfd80b5750 0x7fbfd80b7c10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfec11c0a0 0x7fbfec1ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbfec10a530 0x7fbfec1a8190 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 --2- 172.21.15.67:0/208038414 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfec10a150 0x7fbfec1a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 >> 172.21.15.67:0/208038414 conn(0x7fbfec06cb30 msgr2=0x7fbfec10b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 shutdown_connections 2024-09-10T21:04:56.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:56.319+0000 7fbfeb59e640 1 -- 172.21.15.67:0/208038414 wait complete. 2024-09-10T21:04:56.445 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:56 smithi083 ceph-mon[35058]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2024-09-10T21:04:56.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:56 smithi172 ceph-mon[35265]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2024-09-10T21:04:56.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:56 smithi067 ceph-mon[30891]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 544 op/s 2024-09-10T21:04:57.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:57 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:04:57.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:57 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:57 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:57.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:57 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:57.450 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:57 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:57 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:04:57.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:57 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:57 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:57.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:57 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:57.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:57 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:04:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:57 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:04:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:57 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:57 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:57 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:57.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:57 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:57.977 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:04:58.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:58 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:04:58.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:58.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:58 smithi067 ceph-mon[30891]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 621 op/s 2024-09-10T21:04:58.440 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:04:58 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.565+0000 7f07ef4e7640 1 -- 172.21.15.67:0/3641330795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8075540 msgr2=0x7f07e8075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.565+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/3641330795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8075540 0x7f07e8075920 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009900 tx=0x7f07e402a410 comp rx=0 tx=0).stop 2024-09-10T21:04:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 -- 172.21.15.67:0/3641330795 shutdown_connections 2024-09-10T21:04:58.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/3641330795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8113960 0x7f07e8115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/3641330795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075e60 0x7f07e8113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/3641330795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8075540 0x7f07e8075920 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 -- 172.21.15.67:0/3641330795 >> 172.21.15.67:0/3641330795 conn(0x7f07e80fe6b0 msgr2=0x7f07e8100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 -- 172.21.15.67:0/3641330795 shutdown_connections 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.566+0000 7f07ef4e7640 1 -- 172.21.15.67:0/3641330795 wait complete. 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.567+0000 7f07ef4e7640 1 Processor -- start 2024-09-10T21:04:58.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.567+0000 7f07ef4e7640 1 -- start start 2024-09-10T21:04:58.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075540 0x7f07e8112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8113960 0x7f07e810c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81191e0 con 0x7f07e8113960 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8119060 con 0x7f07e8075e60 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ef4e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8119360 con 0x7f07e8075540 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07ee4e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075540 0x7f07e8112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:56014/0 (socket says 172.21.15.67:56014) 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 -- 172.21.15.67:0/2712299642 learned_addr learned my addr 172.21.15.67:0/2712299642 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07eece6640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8113960 0x7f07e810c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 -- 172.21.15.67:0/2712299642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075540 msgr2=0x7f07e8112d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075540 0x7f07e8112d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 -- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8113960 msgr2=0x7f07e810c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8113960 0x7f07e810c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.568+0000 7f07edce4640 1 -- 172.21.15.67:0/2712299642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e810c8c0 con 0x7f07e8075e60 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07edce4640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d950 tx=0x7f07d800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07df7fe640 1 -- 172.21.15.67:0/2712299642 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8017070 con 0x7f07e8075e60 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07df7fe640 1 -- 172.21.15.67:0/2712299642 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d8009c30 con 0x7f07e8075e60 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07df7fe640 1 -- 172.21.15.67:0/2712299642 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d800f620 con 0x7f07e8075e60 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e810cbb0 con 0x7f07e8075e60 2024-09-10T21:04:58.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.569+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e8111b40 con 0x7f07e8075e60 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 Processor -- start 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 -- start start 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51c3f00 0x5599c51c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5599c512de50 con 0x5599c51b7f70 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5599c511d280 con 0x5599c51c3f00 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.572+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c5121090 con 0x5599c51b7650 2024-09-10T21:04:58.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07ee4e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:57334/0 (socket says 172.21.15.67:57334) 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 -- 172.21.15.67:0/3604164719 learned_addr learned my addr 172.21.15.67:0/3604164719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 -- 172.21.15.67:0/3604164719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51c3f00 msgr2=0x5599c51c62f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51c3f00 0x5599c51c62f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 -- 172.21.15.67:0/3604164719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 msgr2=0x5599c51c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 -- 172.21.15.67:0/3604164719 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c4e7b650 con 0x5599c51b7650 2024-09-10T21:04:58.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.573+0000 7f07eece6640 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07e000ae60 tx=0x7f07e000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0aa9a38be3e2fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.574+0000 7f07df7fe640 1 -- 172.21.15.67:0/2712299642 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f07d8010460 con 0x7f07e8075e60 2024-09-10T21:04:58.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.574+0000 7f07dcff9640 1 -- 172.21.15.67:0/3604164719 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0003b70 con 0x5599c51b7650 2024-09-10T21:04:58.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.574+0000 7f07dcff9640 1 -- 172.21.15.67:0/3604164719 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e0003d10 con 0x5599c51b7650 2024-09-10T21:04:58.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.574+0000 7f07dcff9640 1 -- 172.21.15.67:0/3604164719 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0010be0 con 0x5599c51b7650 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3604164719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 msgr2=0x5599c51b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07e000ae60 tx=0x7f07e000f790 comp rx=0 tx=0).stop 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07df7fe640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 0x7f07d40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3604164719 shutdown_connections 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51c3f00 0x5599c51c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3604164719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51b7650 0x5599c51b7a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3604164719 >> 172.21.15.67:0/3604164719 conn(0x5599c51b5480 msgr2=0x5599c51b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07df7fe640 1 -- 172.21.15.67:0/2712299642 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f07d80e56c0 con 0x7f07e8075e60 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 0x7f07d40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.575+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3604164719 shutdown_connections 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3604164719 wait complete. 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 -- start start 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 Processor -- start 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5599c4f7e700 con 0x5599c51b7f70 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5599c50b8110 con 0x5599c51b7650 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c51c6b80 con 0x5599c51c14e0 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 0x7f07d40b78d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f07e4031440 tx=0x7f07e4009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07f2b1e740 10 client.0 _ll_register_callbacks cb 0x5599c50d1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07edce4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07edce4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60188/0 (socket says 172.21.15.67:60188) 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.576+0000 7f07edce4640 1 -- 172.21.15.67:0/3696989974 learned_addr learned my addr 172.21.15.67:0/3696989974 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07eece6640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 -- 172.21.15.67:0/3696989974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 msgr2=0x5599c51cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 -- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 msgr2=0x5599c51c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 -- 172.21.15.67:0/3696989974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c50e5c40 con 0x5599c51b7f70 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07edce4640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f07d80e3560 tx=0x7f07d80ab790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855867ef48bfac68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8020070 con 0x5599c51b7f70 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f07d80ab1c0 con 0x5599c51b7f70 2024-09-10T21:04:58.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.577+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e0003d10 con 0x5599c51b7f70 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f07d80b0990 con 0x5599c51b7f70 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 10 client.17064 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5599c51d2a80 con 0x5599c51b7f70 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e0003d10 con 0x5599c51b7f70 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f07d80930b0 con 0x5599c51b7f70 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 10 client.17064 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 20 client.17064 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c51d6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 4 client.17064 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c512fda0 con 0x5599c51d3f40 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.578+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c51d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.579+0000 7f07d1ffb640 10 client.17064 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.579+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c51d6330 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2be158f0ffa7b8f9 server_cookie=bed53fd0494ef4b5 in_seq=0 out_seq=0 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07d1ffb640 1 -- 172.21.15.67:0/3696989974 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599c512fda0 con 0x5599c51d3f40 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07d1ffb640 10 client.17064 handle_command_reply: tid=0 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 client.17064 shutdown 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 msgr2=0x5599c51c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f07d80e3560 tx=0x7f07d80ab790 comp rx=0 tx=0).stop 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 shutdown_connections 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c51d6330 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07d1ffb640 0 client.17064 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c0df0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/3696989974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 >> 172.21.15.67:0/3696989974 conn(0x5599c51b5480 msgr2=0x5599c51ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 shutdown_connections 2024-09-10T21:04:58.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 1 -- 172.21.15.67:0/3696989974 wait complete. 2024-09-10T21:04:58.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.580+0000 7f07f2b1e740 20 client.17064 trim_cache size 0 max 16384 2024-09-10T21:04:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.614+0000 7f07f2b1e740 1 Processor -- start 2024-09-10T21:04:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.614+0000 7f07f2b1e740 1 -- start start 2024-09-10T21:04:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.614+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.614+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 0x5599c51bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.614+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51bf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bf6f0 con 0x5599c51b7650 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bcfc0 con 0x5599c51b7f70 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bae10 con 0x5599c51c14e0 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60196/0 (socket says 172.21.15.67:60196) 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 -- 172.21.15.67:0/834970951 learned_addr learned my addr 172.21.15.67:0/834970951 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07eece6640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07edce4640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 0x5599c51bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 -- 172.21.15.67:0/834970951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 msgr2=0x5599c51bf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51bf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 -- 172.21.15.67:0/834970951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 msgr2=0x5599c51bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 0x5599c51bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 -- 172.21.15.67:0/834970951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c51bf2f0 con 0x5599c51b7650 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07edce4640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 0x5599c51bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.615+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009900 tx=0x7f07e403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51336154c3aa7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07d3fff640 1 -- 172.21.15.67:0/834970951 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4056070 con 0x5599c51b7650 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07d3fff640 1 -- 172.21.15.67:0/834970951 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e40044d0 con 0x5599c51b7650 2024-09-10T21:04:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07d3fff640 1 -- 172.21.15.67:0/834970951 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4035040 con 0x5599c51b7650 2024-09-10T21:04:58.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 -- 172.21.15.67:0/834970951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 msgr2=0x5599c51bbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009900 tx=0x7f07e403f000 comp rx=0 tx=0).stop 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 -- 172.21.15.67:0/834970951 shutdown_connections 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51bf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7f70 0x5599c51bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/834970951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7650 0x5599c51bbfb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.616+0000 7f07f2b1e740 1 -- 172.21.15.67:0/834970951 >> 172.21.15.67:0/834970951 conn(0x5599c51b5480 msgr2=0x5599c51b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- 172.21.15.67:0/834970951 shutdown_connections 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- 172.21.15.67:0/834970951 wait complete. 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- start start 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 Processor -- start 2024-09-10T21:04:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bb480 con 0x5599c51b7f70 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bc8f0 con 0x5599c51b7650 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81bbb50 con 0x5599c51c14e0 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07f2b1e740 10 client.0 _ll_register_callbacks cb 0x7f07d800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07edce4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07ee4e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07edce4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60206/0 (socket says 172.21.15.67:60206) 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07edce4640 1 -- 172.21.15.67:0/4171782607 learned_addr learned my addr 172.21.15.67:0/4171782607 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.617+0000 7f07eece6640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 -- 172.21.15.67:0/4171782607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 msgr2=0x5599c51c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 -- 172.21.15.67:0/4171782607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 msgr2=0x5599c51c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 -- 172.21.15.67:0/4171782607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c51c88b0 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07eece6640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07edce4640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07ee4e5640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51cc630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c00 tx=0x7f07e40316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ae092eb5043769 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e4056040 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f07e4004810 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.618+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e40044d0 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f07e4004b40 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 10 client.26777 fetch_fsmap learned FSMap version 34 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5599c5240d50 con 0x5599c51b7650 2024-09-10T21:04:58.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e40044d0 con 0x5599c51b7650 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f07e403d7f0 con 0x5599c51b7650 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 10 client.26777 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 10 client.26777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 20 client.26777 populate_metadata read hostname 'smithi067' 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c5243500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 4 client.26777 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5599c512b850 con 0x5599c51d3f40 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.619+0000 7f07edce4640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c5243500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:04:58.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.620+0000 7f07edce4640 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c5243500 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36b015eeea205f7b server_cookie=e8433a848a64782e in_seq=0 out_seq=0 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.620+0000 7f07d1ffb640 10 client.26777 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.620+0000 7f07d1ffb640 1 -- 172.21.15.67:0/4171782607 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x5599c512b850 con 0x5599c51d3f40 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.620+0000 7f07d1ffb640 10 client.26777 handle_command_reply: tid=0 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.620+0000 7f07f2b1e740 1 client.26777 shutdown 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 msgr2=0x5599c51cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51cc630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07e4000c00 tx=0x7f07e40316f0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 shutdown_connections 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5599c51d3f40 0x5599c5243500 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07d1ffb640 0 client.26777 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c51c14e0 0x5599c51c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5599c51b7f70 0x5599c51c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 --2- 172.21.15.67:0/4171782607 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5599c51b7650 0x5599c51cc630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 >> 172.21.15.67:0/4171782607 conn(0x5599c51b5480 msgr2=0x5599c51bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.621+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 shutdown_connections 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.622+0000 7f07f2b1e740 1 -- 172.21.15.67:0/4171782607 wait complete. 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.622+0000 7f07f2b1e740 20 client.26777 trim_cache size 0 max 16384 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:04:58.633 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "8bb82cad-9ae8-449f-9468-bc614adadf24", 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.634 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:04:58.635 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.636 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.637 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:04:58.640 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.641 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.643 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:04:58.646 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:58.647 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:04:58.647 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:04:58.647 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:58 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:04:58.647 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:58.648 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:58 smithi083 ceph-mon[35058]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 621 op/s 2024-09-10T21:04:58.648 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:04:58 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 msgr2=0x7f07d40b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 0x7f07d40b78d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f07e4031440 tx=0x7f07e4009620 comp rx=0 tx=0).stop 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 msgr2=0x7f07e8113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f07d800d950 tx=0x7f07d800de10 comp rx=0 tx=0).stop 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 shutdown_connections 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e8113960 0x7f07e810c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07e8075e60 0x7f07e8113240 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07d40b5410 0x7f07d40b78d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 --2- 172.21.15.67:0/2712299642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e8075540 0x7f07e8112d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:04:58.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 >> 172.21.15.67:0/2712299642 conn(0x7f07e80fe6b0 msgr2=0x7f07e80ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:04:58.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 shutdown_connections 2024-09-10T21:04:58.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:04:58.623+0000 7f07ef4e7640 1 -- 172.21.15.67:0/2712299642 wait complete. 2024-09-10T21:04:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:58 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:04:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:58 smithi172 ceph-mon[35265]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 621 op/s 2024-09-10T21:04:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:04:58 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:04:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 805.0 s, 1641.2 tps, lat 59.856 ms stddev 73.876 2024-09-10T21:04:59.667 INFO:tasks.cephfs.filesystem:scrub status for tag:8bb82cad-9ae8-449f-9468-bc614adadf24 - {'path': '/', 'tag': '8bb82cad-9ae8-449f-9468-bc614adadf24', 'options': 'recursive,force'} 2024-09-10T21:05:00.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:00 smithi067 ceph-mon[30891]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 655 op/s 2024-09-10T21:05:00.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:00 smithi083 ceph-mon[35058]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 655 op/s 2024-09-10T21:05:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:00 smithi172 ceph-mon[35265]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 655 op/s 2024-09-10T21:05:02.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:02 smithi067 ceph-mon[30891]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-09-10T21:05:02.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:02 smithi083 ceph-mon[35058]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-09-10T21:05:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:02 smithi172 ceph-mon[35265]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.6 MiB/s wr, 624 op/s 2024-09-10T21:05:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 810.0 s, 1856.6 tps, lat 54.678 ms stddev 57.322 2024-09-10T21:05:04.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:04 smithi067 ceph-mon[30891]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 750 op/s 2024-09-10T21:05:04.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:04 smithi083 ceph-mon[35058]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 750 op/s 2024-09-10T21:05:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:04 smithi172 ceph-mon[35265]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 750 op/s 2024-09-10T21:05:06.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:06 smithi067 ceph-mon[30891]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 618 op/s 2024-09-10T21:05:06.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:06 smithi083 ceph-mon[35058]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 618 op/s 2024-09-10T21:05:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:06 smithi172 ceph-mon[35265]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 618 op/s 2024-09-10T21:05:08.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:08 smithi067 ceph-mon[30891]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:05:08.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:08 smithi083 ceph-mon[35058]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:05:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:08 smithi172 ceph-mon[35265]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-09-10T21:05:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 815.0 s, 1634.0 tps, lat 60.937 ms stddev 63.651 2024-09-10T21:05:10.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:10 smithi067 ceph-mon[30891]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 626 op/s 2024-09-10T21:05:10.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:10 smithi083 ceph-mon[35058]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 626 op/s 2024-09-10T21:05:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:10 smithi172 ceph-mon[35265]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 626 op/s 2024-09-10T21:05:11.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:11.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:11 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:11.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:11 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:11.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:11.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:11.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:11 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:12.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:12 smithi067 ceph-mon[30891]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 584 op/s 2024-09-10T21:05:12.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:12 smithi083 ceph-mon[35058]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 584 op/s 2024-09-10T21:05:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:12 smithi172 ceph-mon[35265]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 584 op/s 2024-09-10T21:05:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 820.0 s, 1652.4 tps, lat 60.565 ms stddev 67.965 2024-09-10T21:05:14.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:14 smithi067 ceph-mon[30891]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-09-10T21:05:14.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:14 smithi083 ceph-mon[35058]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-09-10T21:05:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:14 smithi172 ceph-mon[35265]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-09-10T21:05:16.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:16 smithi067 ceph-mon[30891]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 554 op/s 2024-09-10T21:05:16.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:16 smithi083 ceph-mon[35058]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 554 op/s 2024-09-10T21:05:16.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:16 smithi172 ceph-mon[35265]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 5.0 MiB/s wr, 554 op/s 2024-09-10T21:05:18.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:18 smithi067 ceph-mon[30891]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-10T21:05:18.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:18 smithi083 ceph-mon[35058]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-10T21:05:18.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:18 smithi172 ceph-mon[35265]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-10T21:05:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 825.0 s, 2827.6 tps, lat 35.452 ms stddev 50.383 2024-09-10T21:05:20.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:20 smithi067 ceph-mon[30891]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-09-10T21:05:20.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:20 smithi083 ceph-mon[35058]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-09-10T21:05:20.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:20 smithi172 ceph-mon[35265]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 708 op/s 2024-09-10T21:05:22.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:22 smithi067 ceph-mon[30891]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 617 op/s 2024-09-10T21:05:22.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:22 smithi083 ceph-mon[35058]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 617 op/s 2024-09-10T21:05:22.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:22 smithi172 ceph-mon[35265]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5.9 MiB/s wr, 617 op/s 2024-09-10T21:05:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 830.0 s, 2412.0 tps, lat 41.441 ms stddev 50.777 2024-09-10T21:05:24.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:24 smithi067 ceph-mon[30891]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-10T21:05:24.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:24 smithi083 ceph-mon[35058]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-10T21:05:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:24 smithi172 ceph-mon[35265]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.0 MiB/s wr, 735 op/s 2024-09-10T21:05:26.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:26 smithi083 ceph-mon[35058]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-09-10T21:05:26.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:26 smithi172 ceph-mon[35265]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-09-10T21:05:26.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:26 smithi067 ceph-mon[30891]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 MiB/s wr, 618 op/s 2024-09-10T21:05:28.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:28 smithi083 ceph-mon[35058]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 MiB/s wr, 697 op/s 2024-09-10T21:05:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:28 smithi172 ceph-mon[35265]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 MiB/s wr, 697 op/s 2024-09-10T21:05:28.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:28 smithi067 ceph-mon[30891]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 MiB/s wr, 697 op/s 2024-09-10T21:05:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 835.0 s, 1873.6 tps, lat 53.062 ms stddev 58.361 2024-09-10T21:05:29.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:05:30.066 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:30.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:30 smithi067 ceph-mon[30891]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.9 MiB/s wr, 748 op/s 2024-09-10T21:05:30.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:30 smithi083 ceph-mon[35058]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.9 MiB/s wr, 748 op/s 2024-09-10T21:05:30.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:30 smithi172 ceph-mon[35265]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.9 MiB/s wr, 748 op/s 2024-09-10T21:05:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.751+0000 7f5e07126640 1 -- 172.21.15.67:0/2462729923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e00115a10 msgr2=0x7f5e00117e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.751+0000 7f5e07126640 1 --2- 172.21.15.67:0/2462729923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e00115a10 0x7f5e00117e00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009900 tx=0x7f5df402a410 comp rx=0 tx=0).stop 2024-09-10T21:05:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 -- 172.21.15.67:0/2462729923 shutdown_connections 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 --2- 172.21.15.67:0/2462729923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e00115a10 0x7f5e00117e00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 --2- 172.21.15.67:0/2462729923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0010aa70 0x7f5e001154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 --2- 172.21.15.67:0/2462729923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010a150 0x7f5e0010a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 -- 172.21.15.67:0/2462729923 >> 172.21.15.67:0/2462729923 conn(0x7f5e0006e2e0 msgr2=0x7f5e0006e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 -- 172.21.15.67:0/2462729923 shutdown_connections 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 -- 172.21.15.67:0/2462729923 wait complete. 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 Processor -- start 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.752+0000 7f5e07126640 1 -- start start 2024-09-10T21:05:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 0x7f5e001a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e00115a10 0x7f5e001a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0011b5d0 con 0x7f5e0010a150 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0011b450 con 0x7f5e0010aa70 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e07126640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0011b750 con 0x7f5e00115a10 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43466/0 (socket says 172.21.15.67:43466) 2024-09-10T21:05:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5e04ec2640 1 -- 172.21.15.67:0/3609809213 learned_addr learned my addr 172.21.15.67:0/3609809213 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.753+0000 7f5dfffff640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 0x7f5e001a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e056c3640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e00115a10 0x7f5e001a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 -- 172.21.15.67:0/3609809213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e00115a10 msgr2=0x7f5e001a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e00115a10 0x7f5e001a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 -- 172.21.15.67:0/3609809213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 msgr2=0x7f5e001a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 0x7f5e001a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 -- 172.21.15.67:0/3609809213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e001a7b30 con 0x7f5e0010a150 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5dfffff640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 0x7f5e001a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e9f0 tx=0x7f5df000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5dfdffb640 1 -- 172.21.15.67:0/3609809213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df000cd80 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5dfdffb640 1 -- 172.21.15.67:0/3609809213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00108e0 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.754+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e001a7e20 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.755+0000 7f5dfdffb640 1 -- 172.21.15.67:0/3609809213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0018980 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.755+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0010b430 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.758+0000 7f5dfdffb640 1 -- 172.21.15.67:0/3609809213 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5df0018b20 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.759+0000 7f5e094fb740 1 Processor -- start 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.760+0000 7f5dfdffb640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 0x7f5de80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.760+0000 7f5dfdffb640 1 -- 172.21.15.67:0/3609809213 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5df00e5ea0 con 0x7f5e0010a150 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.760+0000 7f5e094fb740 1 -- start start 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e056c3640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 0x7f5de80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428da0 0x5633d24347f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41208/0 (socket says 172.21.15.67:41208) 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.761+0000 7f5e04ec2640 1 -- 172.21.15.67:0/4243008461 learned_addr learned my addr 172.21.15.67:0/4243008461 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e094fb740 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 0x5633d2437120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5dfffff640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428da0 0x5633d24347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5633d239ee50 con 0x5633d2434d30 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5633d238e280 con 0x5633d2428da0 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e056c3640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 0x5633d2437120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e056c3640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 0x7f5de80b78a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5df4005ab0 tx=0x7f5df4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.762+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5633d2392090 con 0x5633d2428480 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 -- 172.21.15.67:0/4243008461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428da0 msgr2=0x5633d24347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428da0 0x5633d24347f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 -- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 msgr2=0x5633d2437120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 0x5633d2437120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 -- 172.21.15.67:0/4243008461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d20ec650 con 0x5633d2428480 2024-09-10T21:05:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e056c3640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 0x5633d2437120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a9950 tx=0x7f5df00ac2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ab6fa369b152c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5de6ffd640 1 -- 172.21.15.67:0/4243008461 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00b5bc0 con 0x5633d2428480 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5de6ffd640 1 -- 172.21.15.67:0/4243008461 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00a8950 con 0x5633d2428480 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.763+0000 7f5de6ffd640 1 -- 172.21.15.67:0/4243008461 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a8320 con 0x5633d2428480 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 msgr2=0x5633d2428860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a9950 tx=0x7f5df00ac2b0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 shutdown_connections 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2434d30 0x5633d2437120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428da0 0x5633d24347f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 --2- 172.21.15.67:0/4243008461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2428860 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.764+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 >> 172.21.15.67:0/4243008461 conn(0x5633d24262b0 msgr2=0x5633d2427450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.765+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 shutdown_connections 2024-09-10T21:05:30.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.765+0000 7f5e094fb740 1 -- 172.21.15.67:0/4243008461 wait complete. 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.766+0000 7f5e094fb740 1 -- start start 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.766+0000 7f5e094fb740 1 Processor -- start 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.766+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2431ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 0x5633d2432130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5633d21ef700 con 0x5633d2428da0 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5633d2329110 con 0x5633d2428480 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5633d24379f0 con 0x5633d2434d30 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e094fb740 10 client.0 _ll_register_callbacks cb 0x5633d2342990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:30.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e056c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 0x5633d2432130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:37332/0 (socket says 172.21.15.67:37332) 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 -- 172.21.15.67:0/440909536 learned_addr learned my addr 172.21.15.67:0/440909536 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5dfffff640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2431ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 -- 172.21.15.67:0/440909536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 msgr2=0x5633d2432130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 0x5633d2432130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 -- 172.21.15.67:0/440909536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 msgr2=0x5633d2431ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2431ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 -- 172.21.15.67:0/440909536 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d2356c40 con 0x5633d2428480 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e056c3640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 0x5633d2432130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5dfffff640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2431ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a8ea0 tx=0x7f5df0009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a811f08bc4f5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.767+0000 7f5ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a8030 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5df00a81d0 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df00a8950 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5df00c7310 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 10 client.26789 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633d24433b0 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00b22a0 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5df00d31c0 con 0x5633d2428480 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 10 client.26789 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 10 client.26789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 20 client.26789 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:30.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d2444700 0x5633d2446af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 4 client.26789 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.768+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5df00a8950 con 0x5633d2444700 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.770+0000 7f5dfffff640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d2444700 0x5633d2446af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.771+0000 7f5ddffff640 10 client.26789 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.771+0000 7f5dfffff640 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d2444700 0x5633d2446af0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2de38104aec94b2b server_cookie=54770ca1d5e1ea11 in_seq=0 out_seq=0 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.771+0000 7f5ddffff640 1 -- 172.21.15.67:0/440909536 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5df00a8950 con 0x5633d2444700 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.771+0000 7f5ddffff640 10 client.26789 handle_command_reply: tid=0 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.771+0000 7f5e094fb740 1 client.26789 shutdown 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 msgr2=0x5633d2434660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a8ea0 tx=0x7f5df0009770 comp rx=0 tx=0).stop 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 shutdown_connections 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d2444700 0x5633d2446af0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2434d30 0x5633d2432130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2431ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 --2- 172.21.15.67:0/440909536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2428480 0x5633d2434660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5ddffff640 0 client.26789 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 >> 172.21.15.67:0/440909536 conn(0x5633d24262b0 msgr2=0x5633d242be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 shutdown_connections 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 1 -- 172.21.15.67:0/440909536 wait complete. 2024-09-10T21:05:30.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.772+0000 7f5e094fb740 20 client.26789 trim_cache size 0 max 16384 2024-09-10T21:05:30.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.795+0000 7f5e094fb740 1 Processor -- start 2024-09-10T21:05:30.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.795+0000 7f5e094fb740 1 -- start start 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.795+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2421340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.795+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2425bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.795+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d2436120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2421340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e094fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b7210 con 0x5633d2428da0 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e094fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b4ae0 con 0x5633d2434d30 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e094fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b2930 con 0x5633d2428480 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2421340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41232/0 (socket says 172.21.15.67:41232) 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e04ec2640 1 -- 172.21.15.67:0/970854560 learned_addr learned my addr 172.21.15.67:0/970854560 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5e056c3640 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d2436120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.796+0000 7f5dfffff640 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2425bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.797+0000 7f5e056c3640 1 -- 172.21.15.67:0/970854560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 msgr2=0x5633d2421340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.797+0000 7f5e056c3640 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2421340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.797+0000 7f5e056c3640 1 -- 172.21.15.67:0/970854560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 msgr2=0x5633d2425bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.797+0000 7f5e056c3640 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2425bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.797+0000 7f5e056c3640 1 -- 172.21.15.67:0/970854560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d2428bd0 con 0x5633d2434d30 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.798+0000 7f5e056c3640 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d2436120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009230 tx=0x7f5df403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd94f6e0a79b2d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.798+0000 7f5de67fc640 1 -- 172.21.15.67:0/970854560 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4035040 con 0x5633d2434d30 2024-09-10T21:05:30.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.798+0000 7f5de67fc640 1 -- 172.21.15.67:0/970854560 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df404f070 con 0x5633d2434d30 2024-09-10T21:05:30.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.798+0000 7f5de67fc640 1 -- 172.21.15.67:0/970854560 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df404b440 con 0x5633d2434d30 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 -- 172.21.15.67:0/970854560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 msgr2=0x5633d2436120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d2436120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009230 tx=0x7f5df403d000 comp rx=0 tx=0).stop 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 -- 172.21.15.67:0/970854560 shutdown_connections 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d2436120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2425bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 --2- 172.21.15.67:0/970854560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2421340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 -- 172.21.15.67:0/970854560 >> 172.21.15.67:0/970854560 conn(0x5633d24262b0 msgr2=0x5633d2430330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 -- 172.21.15.67:0/970854560 shutdown_connections 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.799+0000 7f5e094fb740 1 -- 172.21.15.67:0/970854560 wait complete. 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 -- start start 2024-09-10T21:05:30.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 Processor -- start 2024-09-10T21:05:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2446980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d24aa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b2fa0 con 0x5633d2428da0 2024-09-10T21:05:30.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b4410 con 0x5633d2434d30 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001b3670 con 0x5633d2428480 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e094fb740 10 client.0 _ll_register_callbacks cb 0x7f5df00b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.800+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:41248/0 (socket says 172.21.15.67:41248) 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 -- 172.21.15.67:0/2270457157 learned_addr learned my addr 172.21.15.67:0/2270457157 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e056c3640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d24aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5dfffff640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2446980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 -- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 msgr2=0x5633d24aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d24aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 -- 172.21.15.67:0/2270457157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 msgr2=0x5633d2446980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2446980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 -- 172.21.15.67:0/2270457157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d24aa940 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.801+0000 7f5e04ec2640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a8cb0 tx=0x7f5df00a82e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57c5512157c9b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a8580 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5df00b22a0 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df404f070 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5df00a8d30 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5e094fb740 10 client.26758 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633d24aa940 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.802+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df404f070 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5df00b24a0 con 0x5633d2428480 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 10 client.26758 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 10 client.26758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 20 client.26758 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:30.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d24b20d0 0x5633d24b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 4 client.26758 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:05:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5633d23a0da0 con 0x5633d24b20d0 2024-09-10T21:05:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5dfffff640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d24b20d0 0x5633d24b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5ddffff640 10 client.26758 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:30.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.803+0000 7f5dfffff640 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d24b20d0 0x5633d24b44f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1046f96006208819 server_cookie=5e7664bfe3c8c6fe in_seq=0 out_seq=0 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5ddffff640 1 -- 172.21.15.67:0/2270457157 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x5633d23a0da0 con 0x5633d24b20d0 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5ddffff640 10 client.26758 handle_command_reply: tid=0 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 client.26758 shutdown 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 msgr2=0x5633d2446400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5df00a8cb0 tx=0x7f5df00a82e0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 shutdown_connections 2024-09-10T21:05:30.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5633d24b20d0 0x5633d24b44f0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5633d2434d30 0x5633d24aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5ddffff640 0 client.26758 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5633d2428da0 0x5633d2446980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 --2- 172.21.15.67:0/2270457157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633d2428480 0x5633d2446400 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 >> 172.21.15.67:0/2270457157 conn(0x5633d24262b0 msgr2=0x5633d24330e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 shutdown_connections 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 1 -- 172.21.15.67:0/2270457157 wait complete. 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.804+0000 7f5e094fb740 20 client.26758 trim_cache size 0 max 16384 2024-09-10T21:05:30.812 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.815 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:05:30.818 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:05:30.821 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.822 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.823 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:05:30.824 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 msgr2=0x7f5de80b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 0x7f5de80b78a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5df4005ab0 tx=0x7f5df4005a40 comp rx=0 tx=0).stop 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 msgr2=0x7f5e001a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5df000e9f0 tx=0x7f5df000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 shutdown_connections 2024-09-10T21:05:30.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b53e0 0x7f5de80b78a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e00115a10 0x7f5e001a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e0010aa70 0x7f5e001a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 --2- 172.21.15.67:0/3609809213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5e0010a150 0x7f5e001a1a80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 >> 172.21.15.67:0/3609809213 conn(0x7f5e0006e2e0 msgr2=0x7f5e00072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 shutdown_connections 2024-09-10T21:05:30.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:30.805+0000 7f5e07126640 1 -- 172.21.15.67:0/3609809213 wait complete. 2024-09-10T21:05:31.637 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:05:31.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:05:32.024 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:32.487 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:32 smithi067 ceph-mon[30891]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 594 op/s 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 -- 172.21.15.67:0/3035464538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103b90 msgr2=0x7f31b0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 --2- 172.21.15.67:0/3035464538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103b90 0x7f31b0103f70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009860 tx=0x7f31a002a340 comp rx=0 tx=0).stop 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 -- 172.21.15.67:0/3035464538 shutdown_connections 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 --2- 172.21.15.67:0/3035464538 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b010d140 0x7f31b010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 --2- 172.21.15.67:0/3035464538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31b0104590 0x7f31b010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 --2- 172.21.15.67:0/3035464538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103b90 0x7f31b0103f70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 -- 172.21.15.67:0/3035464538 >> 172.21.15.67:0/3035464538 conn(0x7f31b00fd700 msgr2=0x7f31b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:32.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 -- 172.21.15.67:0/3035464538 shutdown_connections 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 -- 172.21.15.67:0/3035464538 wait complete. 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.583+0000 7f31b586d640 1 Processor -- start 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.584+0000 7f31b586d640 1 -- start start 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.584+0000 7f31b586d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31b0103b90 0x7f31b0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.584+0000 7f31b586d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31b586d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 0x7f31b019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31b586d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0112d60 con 0x7f31b0104590 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31ae7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31ae7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42724/0 (socket says 172.21.15.67:42724) 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31ae7fc640 1 -- 172.21.15.67:0/2008818788 learned_addr learned my addr 172.21.15.67:0/2008818788 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0112be0 con 0x7f31b0103b90 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0112ee0 con 0x7f31b010d140 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.585+0000 7f31af7fe640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 0x7f31b019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 -- 172.21.15.67:0/2008818788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31b0103b90 msgr2=0x7f31b0199290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31b0103b90 0x7f31b0199290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 -- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 msgr2=0x7f31b01997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b019f340 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31ae7fc640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.586+0000 7f31af7fe640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 0x7f31b019eb70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005fd0 tx=0x7f31a800bae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.587+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8004b20 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.587+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31a8004cc0 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.587+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8005700 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.587+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b019f630 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.587+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b01018f0 con 0x7f31b010d140 2024-09-10T21:05:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.588+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b006b0f0 con 0x7f31b010d140 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.590+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f31a800b040 con 0x7f31b010d140 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.590+0000 7f31b486b640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 0x7f31980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.591+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f31a80e9af0 con 0x7f31b010d140 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.591+0000 7f31aeffd640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 0x7f31980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.591+0000 7f31aeffd640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 0x7f31980b7820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f31a00057c0 tx=0x7f31a00095b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:32.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.595+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31a80b09e0 con 0x7f31b010d140 2024-09-10T21:05:32.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:32 smithi083 ceph-mon[35058]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 594 op/s 2024-09-10T21:05:32.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:32 smithi172 ceph-mon[35265]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 594 op/s 2024-09-10T21:05:32.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.932+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b0108230 con 0x7f31b010d140 2024-09-10T21:05:32.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.933+0000 7f31b486b640 1 -- 172.21.15.67:0/2008818788 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f31a80b02e0 con 0x7f31b010d140 2024-09-10T21:05:32.938 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:05:32.938 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:05:32.938 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 msgr2=0x7f31980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 0x7f31980b7820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f31a00057c0 tx=0x7f31a00095b0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 msgr2=0x7f31b019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 0x7f31b019eb70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31a8005fd0 tx=0x7f31a800bae0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 shutdown_connections 2024-09-10T21:05:32.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f31980b5360 0x7f31980b7820 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b010d140 0x7f31b019eb70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31b0104590 0x7f31b01997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 --2- 172.21.15.67:0/2008818788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f31b0103b90 0x7f31b0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 >> 172.21.15.67:0/2008818788 conn(0x7f31b00fd700 msgr2=0x7f31b00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 shutdown_connections 2024-09-10T21:05:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:32.936+0000 7f31b586d640 1 -- 172.21.15.67:0/2008818788 wait complete. 2024-09-10T21:05:33.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:33 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2008818788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:05:33.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:33 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2008818788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:05:33.647 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:05:33.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:33 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2008818788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:05:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 840.0 s, 2042.0 tps, lat 49.306 ms stddev 52.004 2024-09-10T21:05:34.039 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:34.520 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:34 smithi067 ceph-mon[30891]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 MiB/s wr, 780 op/s 2024-09-10T21:05:34.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:34 smithi083 ceph-mon[35058]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 MiB/s wr, 780 op/s 2024-09-10T21:05:34.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:34 smithi172 ceph-mon[35265]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.2 MiB/s wr, 780 op/s 2024-09-10T21:05:34.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/1890952650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e411c0a0 msgr2=0x7fe1e411e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/1890952650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e411c0a0 0x7fe1e411e490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009ca0 tx=0x7fe1dc02a950 comp rx=0 tx=0).stop 2024-09-10T21:05:34.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/1890952650 shutdown_connections 2024-09-10T21:05:34.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/1890952650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e411c0a0 0x7fe1e411e490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/1890952650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e410a530 0x7fe1e410a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/1890952650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/1890952650 >> 172.21.15.67:0/1890952650 conn(0x7fe1e406dfc0 msgr2=0x7fe1e406e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/1890952650 shutdown_connections 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.812+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/1890952650 wait complete. 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 Processor -- start 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 -- start start 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 0x7fe1e41ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e4121b60 con 0x7fe1e410a530 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41219e0 con 0x7fe1e410a150 2024-09-10T21:05:34.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ec5b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e4121ce0 con 0x7fe1e411c0a0 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1e9b52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1ea353640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1e9b52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42732/0 (socket says 172.21.15.67:42732) 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1e9b52640 1 -- 172.21.15.67:0/3823223953 learned_addr learned my addr 172.21.15.67:0/3823223953 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.813+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 0x7fe1e41ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 -- 172.21.15.67:0/3823223953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 msgr2=0x7fe1e41ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 0x7fe1e41ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 -- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 msgr2=0x7fe1e41a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 -- 172.21.15.67:0/3823223953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e41ae180 con 0x7fe1e410a150 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 0x7fe1e41ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:34.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ea353640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41a80d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1db7fe640 1 -- 172.21.15.67:0/3823223953 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000ccc0 con 0x7fe1e410a150 2024-09-10T21:05:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e41ae470 con 0x7fe1e410a150 2024-09-10T21:05:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e41b4d00 con 0x7fe1e410a150 2024-09-10T21:05:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.814+0000 7fe1db7fe640 1 -- 172.21.15.67:0/3823223953 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e00108e0 con 0x7fe1e410a150 2024-09-10T21:05:34.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.816+0000 7fe1db7fe640 1 -- 172.21.15.67:0/3823223953 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0018880 con 0x7fe1e410a150 2024-09-10T21:05:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.818+0000 7fe1ee98c740 1 Processor -- start 2024-09-10T21:05:34.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.818+0000 7fe1ee98c740 1 -- start start 2024-09-10T21:05:34.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa60840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa63170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55663a9caea0 con 0x55663aa54df0 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55663a9ba2d0 con 0x55663aa544d0 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55663a9be0e0 con 0x55663aa60d80 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1db7fe640 1 -- 172.21.15.67:0/3823223953 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe1e0018ae0 con 0x7fe1e410a150 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43762/0 (socket says 172.21.15.67:43762) 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 -- 172.21.15.67:0/613675949 learned_addr learned my addr 172.21.15.67:0/613675949 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa63170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1ea353640 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa60840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 -- 172.21.15.67:0/613675949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 msgr2=0x55663aa63170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa63170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 -- 172.21.15.67:0/613675949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 msgr2=0x55663aa60840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa60840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.819+0000 7fe1eab54640 1 -- 172.21.15.67:0/613675949 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663a718650 con 0x55663aa544d0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.820+0000 7fe1eab54640 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009ca0 tx=0x7fe1dc009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d41d7d01e78192a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.820+0000 7fe1d8ff9640 1 -- 172.21.15.67:0/613675949 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc048070 con 0x55663aa544d0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.820+0000 7fe1d8ff9640 1 -- 172.21.15.67:0/613675949 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1dc003e20 con 0x55663aa544d0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.820+0000 7fe1d8ff9640 1 -- 172.21.15.67:0/613675949 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc034040 con 0x55663aa544d0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.820+0000 7fe1db7fe640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 0x7fe1d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ea353640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 0x7fe1d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1db7fe640 1 -- 172.21.15.67:0/3823223953 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1e00e6340 con 0x7fe1e410a150 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 -- 172.21.15.67:0/613675949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 msgr2=0x55663aa548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009ca0 tx=0x7fe1dc009360 comp rx=0 tx=0).stop 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ea353640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 0x7fe1d00b7820 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00e41e0 tx=0x7fe1e0010590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 -- 172.21.15.67:0/613675949 shutdown_connections 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa63170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa60840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/613675949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa548b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 -- 172.21.15.67:0/613675949 >> 172.21.15.67:0/613675949 conn(0x55663aa52300 msgr2=0x55663aa534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 -- 172.21.15.67:0/613675949 shutdown_connections 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.821+0000 7fe1ee98c740 1 -- 172.21.15.67:0/613675949 wait complete. 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 -- start start 2024-09-10T21:05:34.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 Processor -- start 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa5e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55663a81b700 con 0x55663aa54df0 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55663a955160 con 0x55663aa544d0 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55663aa639a0 con 0x55663aa60d80 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1ee98c740 10 client.0 _ll_register_callbacks cb 0x55663a96e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:34.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1e9b52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43776/0 (socket says 172.21.15.67:43776) 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1eab54640 1 -- 172.21.15.67:0/3937213585 learned_addr learned my addr 172.21.15.67:0/3937213585 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1e9b52640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42746/0 (socket says 172.21.15.67:42746) 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.822+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa5e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 -- 172.21.15.67:0/3937213585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 msgr2=0x55663aa5e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa5e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 -- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 msgr2=0x55663aa606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 -- 172.21.15.67:0/3937213585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663a982c90 con 0x55663aa54df0 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe1e411b860 tx=0x7fe1d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a2f90b5c8d36a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.823+0000 7fe1cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.824+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40120d0 con 0x55663aa54df0 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.824+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1dc003e20 con 0x55663aa54df0 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.824+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1d4005020 con 0x55663aa54df0 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.825+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1d4012270 con 0x55663aa54df0 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.825+0000 7fe1ee98c740 10 client.17106 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:34.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.825+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55663aa6f430 con 0x55663aa54df0 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d40047a0 con 0x55663aa54df0 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe1d4010500 con 0x55663aa54df0 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 10 client.17106 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 10 client.17106 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 20 client.17106 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aa70c70 0x55663aa730d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 4 client.17106 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe1dc003e20 con 0x55663aa70c70 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.826+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aa70c70 0x55663aa730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.827+0000 7fe1cdffb640 10 client.17106 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.827+0000 7fe1eab54640 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aa70c70 0x55663aa730d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ab11ff0da8df8e2 server_cookie=86bd43004c00b3c0 in_seq=0 out_seq=0 2024-09-10T21:05:34.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1cdffb640 1 -- 172.21.15.67:0/3937213585 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe1dc003e20 con 0x55663aa70c70 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1cdffb640 10 client.17106 handle_command_reply: tid=0 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 client.17106 shutdown 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 msgr2=0x55663aa5db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe1e411b860 tx=0x7fe1d400f790 comp rx=0 tx=0).stop 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 shutdown_connections 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aa70c70 0x55663aa730d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa60d80 0x55663aa5e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa5db40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/3937213585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa544d0 0x55663aa606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 >> 172.21.15.67:0/3937213585 conn(0x55663aa52300 msgr2=0x55663aa57ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1cdffb640 0 client.17106 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 shutdown_connections 2024-09-10T21:05:34.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.828+0000 7fe1ee98c740 1 -- 172.21.15.67:0/3937213585 wait complete. 2024-09-10T21:05:34.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.829+0000 7fe1ee98c740 20 client.17106 trim_cache size 0 max 16384 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 Processor -- start 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 -- start start 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa54df0 0x55663aa51c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bfa10 con 0x55663aa544d0 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bd2e0 con 0x55663aa60d80 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bb150 con 0x55663aa54df0 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42754/0 (socket says 172.21.15.67:42754) 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 -- 172.21.15.67:0/381760053 learned_addr learned my addr 172.21.15.67:0/381760053 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa54df0 0x55663aa51c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 -- 172.21.15.67:0/381760053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa54df0 msgr2=0x55663aa51c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa54df0 0x55663aa51c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 -- 172.21.15.67:0/381760053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 msgr2=0x55663aa62170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa62170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.846+0000 7fe1eab54640 1 -- 172.21.15.67:0/381760053 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663aa5ee10 con 0x55663aa544d0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.847+0000 7fe1eab54640 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009bf0 tx=0x7fe1dc005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6263a7546f700772 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.847+0000 7fe1cffff640 1 -- 172.21.15.67:0/381760053 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc048040 con 0x55663aa544d0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.847+0000 7fe1cffff640 1 -- 172.21.15.67:0/381760053 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1dc004800 con 0x55663aa544d0 2024-09-10T21:05:34.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.847+0000 7fe1cffff640 1 -- 172.21.15.67:0/381760053 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0519c0 con 0x55663aa544d0 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- 172.21.15.67:0/381760053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 msgr2=0x55663aa53ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009bf0 tx=0x7fe1dc005c50 comp rx=0 tx=0).stop 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- 172.21.15.67:0/381760053 shutdown_connections 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa62170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa54df0 0x55663aa51c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/381760053 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa544d0 0x55663aa53ad0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- 172.21.15.67:0/381760053 >> 172.21.15.67:0/381760053 conn(0x55663aa52300 msgr2=0x55663aa533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- 172.21.15.67:0/381760053 shutdown_connections 2024-09-10T21:05:34.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- 172.21.15.67:0/381760053 wait complete. 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 -- start start 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.848+0000 7fe1ee98c740 1 Processor -- start 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa61e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bb7a0 con 0x55663aa54df0 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bcc10 con 0x55663aa60d80 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e41bbe70 con 0x55663aa544d0 2024-09-10T21:05:34.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.849+0000 7fe1ee98c740 10 client.0 _ll_register_callbacks cb 0x7fe1d4009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43638/0 (socket says 172.21.15.67:43638) 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 -- 172.21.15.67:0/675654257 learned_addr learned my addr 172.21.15.67:0/675654257 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa61e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 -- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 msgr2=0x55663aa623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa623e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 -- 172.21.15.67:0/675654257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 msgr2=0x55663aa61e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa61e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 -- 172.21.15.67:0/675654257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663aa62c10 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1eab54640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02a990 tx=0x7fe1dc009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4bf0f1083f292dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.851+0000 7fe1cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc05d060 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1dc004350 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1dc004800 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1dc048040 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 10 client.26782 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55663aaddca0 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1dc004800 con 0x55663aa544d0 2024-09-10T21:05:34.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe1dc04e040 con 0x55663aa544d0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 10 client.26782 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 10 client.26782 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 20 client.26782 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aade1e0 0x55663aae05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 4 client.26782 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.852+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55663a9ccdf0 con 0x55663aade1e0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aade1e0 0x55663aae05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1e9b52640 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aade1e0 0x55663aae05d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=92338abfa2e87b5d server_cookie=3cc3f2c1d5de33b5 in_seq=0 out_seq=0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1cdffb640 10 client.26782 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1cdffb640 1 -- 172.21.15.67:0/675654257 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55663a9ccdf0 con 0x55663aade1e0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1cdffb640 10 client.26782 handle_command_reply: tid=0 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1ee98c740 1 client.26782 shutdown 2024-09-10T21:05:34.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.853+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 msgr2=0x55663aa69470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02a990 tx=0x7fe1dc009360 comp rx=0 tx=0).stop 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 shutdown_connections 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55663aade1e0 0x55663aae05d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55663aa60d80 0x55663aa623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55663aa54df0 0x55663aa61e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 --2- 172.21.15.67:0/675654257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55663aa544d0 0x55663aa69470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 >> 172.21.15.67:0/675654257 conn(0x55663aa52300 msgr2=0x55663aa5f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1cdffb640 0 client.26782 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 shutdown_connections 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 1 -- 172.21.15.67:0/675654257 wait complete. 2024-09-10T21:05:34.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ee98c740 20 client.26782 trim_cache size 0 max 16384 2024-09-10T21:05:34.863 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 msgr2=0x7fe1d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 0x7fe1d00b7820 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00e41e0 tx=0x7fe1e0010590 comp rx=0 tx=0).stop 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 msgr2=0x7fe1e41a80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.854+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41a80d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 shutdown_connections 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1d00b5360 0x7fe1d00b7820 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e411c0a0 0x7fe1e41ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1e410a530 0x7fe1e41a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 --2- 172.21.15.67:0/3823223953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1e410a150 0x7fe1e41a80d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:34.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 >> 172.21.15.67:0/3823223953 conn(0x7fe1e406dfc0 msgr2=0x7fe1e411c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:34.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 shutdown_connections 2024-09-10T21:05:34.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:34.855+0000 7fe1ec5b7640 1 -- 172.21.15.67:0/3823223953 wait complete. 2024-09-10T21:05:35.626 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:05:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:36.449 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:36 smithi067 ceph-mon[30891]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2024-09-10T21:05:36.647 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:36 smithi083 ceph-mon[35058]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.589+0000 7f66aae4e640 1 -- 172.21.15.67:0/2460603783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 msgr2=0x7f66a4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.589+0000 7f66aae4e640 1 --2- 172.21.15.67:0/2460603783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a4107ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f669001e920 tx=0x7f669003b180 comp rx=0 tx=0).stop 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 -- 172.21.15.67:0/2460603783 shutdown_connections 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 --2- 172.21.15.67:0/2460603783 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4108020 0x7f66a410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 --2- 172.21.15.67:0/2460603783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a4107ae0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 --2- 172.21.15.67:0/2460603783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4101c90 0x7f66a4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 -- 172.21.15.67:0/2460603783 >> 172.21.15.67:0/2460603783 conn(0x7f66a40fd700 msgr2=0x7f66a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 -- 172.21.15.67:0/2460603783 shutdown_connections 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 -- 172.21.15.67:0/2460603783 wait complete. 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 Processor -- start 2024-09-10T21:05:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.590+0000 7f66aae4e640 1 -- start start 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a41948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4108020 0x7f66a4074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f66a406e2f0 con 0x7f66a4101c90 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f66a406e170 con 0x7f66a4108020 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66aae4e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66a406e470 con 0x7f66a41076a0 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42780/0 (socket says 172.21.15.67:42780) 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 -- 172.21.15.67:0/1370608452 learned_addr learned my addr 172.21.15.67:0/1370608452 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a3fff640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a41948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a93eb640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4108020 0x7f66a4074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 -- 172.21.15.67:0/1370608452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 msgr2=0x7f66a41948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a41948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 -- 172.21.15.67:0/1370608452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4108020 msgr2=0x7f66a4074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.591+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4108020 0x7f66a4074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.592+0000 7f66a8bea640 1 -- 172.21.15.67:0/1370608452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a40749a0 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.592+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f70 tx=0x7f669800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.592+0000 7f66a1ffb640 1 -- 172.21.15.67:0/1370608452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698005220 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.592+0000 7f66a1ffb640 1 -- 172.21.15.67:0/1370608452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6698004c50 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.592+0000 7f66a1ffb640 1 -- 172.21.15.67:0/1370608452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669800cb90 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.593+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a4074c90 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.593+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a419b330 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.596+0000 7f66ad223740 1 Processor -- start 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.596+0000 7f66ad223740 1 -- start start 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.596+0000 7f66a1ffb640 1 -- 172.21.15.67:0/1370608452 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f669801f440 con 0x7f66a4101c90 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.596+0000 7f66ad223740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66ad223740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66ad223740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66ad223740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a8eea0 con 0x55ee18b18a10 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66ad223740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a7e2d0 con 0x55ee18b249a0 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66ad223740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a820e0 con 0x55ee18b180f0 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42792/0 (socket says 172.21.15.67:42792) 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66a8bea640 1 -- 172.21.15.67:0/253352080 learned_addr learned my addr 172.21.15.67:0/253352080 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66a3fff640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.597+0000 7f66a93eb640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 -- 172.21.15.67:0/253352080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 msgr2=0x55ee18b26d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b26d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a1ffb640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 0x7f66940b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 -- 172.21.15.67:0/253352080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 msgr2=0x55ee18b24460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 -- 172.21.15.67:0/253352080 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee187dc650 con 0x55ee18b180f0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a8bea640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a1ffb640 1 -- 172.21.15.67:0/1370608452 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f66980ee030 con 0x7f66a4101c90 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 0x7f66940b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f66a93eb640 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b184d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f669c009e20 tx=0x7f669c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60404cf2b9f80092 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.598+0000 7f668effd640 1 -- 172.21.15.67:0/253352080 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c003c70 con 0x55ee18b180f0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.599+0000 7f668effd640 1 -- 172.21.15.67:0/253352080 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669c0198e0 con 0x55ee18b180f0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.599+0000 7f668effd640 1 -- 172.21.15.67:0/253352080 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c0175d0 con 0x55ee18b180f0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 -- 172.21.15.67:0/253352080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 msgr2=0x55ee18b184d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b184d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f669c009e20 tx=0x7f669c009500 comp rx=0 tx=0).stop 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66a93eb640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 0x7f66940b7970 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f669c021000 tx=0x7f669c024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 -- 172.21.15.67:0/253352080 shutdown_connections 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b26d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b24460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 --2- 172.21.15.67:0/253352080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b184d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.601+0000 7f66ad223740 1 -- 172.21.15.67:0/253352080 >> 172.21.15.67:0/253352080 conn(0x55ee18b15f20 msgr2=0x55ee18b170c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.602+0000 7f66ad223740 1 -- 172.21.15.67:0/253352080 shutdown_connections 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.602+0000 7f66ad223740 1 -- 172.21.15.67:0/253352080 wait complete. 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.602+0000 7f66ad223740 1 -- start start 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.602+0000 7f66ad223740 1 Processor -- start 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b24150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b249a0 0x55ee18b21ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55ee188df700 con 0x55ee18b249a0 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ee18a19160 con 0x55ee18b18a10 2024-09-10T21:05:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee18b27620 con 0x55ee18b180f0 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66ad223740 10 client.0 _ll_register_callbacks cb 0x55ee18a329e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43828/0 (socket says 172.21.15.67:43828) 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 -- 172.21.15.67:0/1081365184 learned_addr learned my addr 172.21.15.67:0/1081365184 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a93eb640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b249a0 0x55ee18b21ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b24150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 -- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 msgr2=0x55ee18b24150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b24150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 -- 172.21.15.67:0/1081365184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b249a0 msgr2=0x55ee18b21ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b249a0 0x55ee18b21ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a3fff640 1 -- 172.21.15.67:0/1081365184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee18a46c90 con 0x55ee18b18a10 2024-09-10T21:05:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.603+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b24150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f6683fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f66a3fff640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f669003b6a0 tx=0x7f669003bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ea62ae4841e220 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690051070 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6690048070 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f669c0198e0 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f669005d050 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f66ad223740 10 client.26828 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.604+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee18b32ed0 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f669003f040 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f669004d440 con 0x55ee18b18a10 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 10 client.26828 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 10 client.26828 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 20 client.26828 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:36.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18b34330 0x55ee18b367b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 4 client.26828 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f669c0198e0 con 0x55ee18b34330 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.605+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18b34330 0x55ee18b367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.606+0000 7f66a8bea640 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18b34330 0x55ee18b367b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a67601e48117317d server_cookie=e8a3a39d7c0aa4cb in_seq=0 out_seq=0 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.606+0000 7f6683fff640 10 client.26828 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.606+0000 7f6683fff640 1 -- 172.21.15.67:0/1081365184 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f669c0198e0 con 0x55ee18b34330 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.606+0000 7f6683fff640 10 client.26828 handle_command_reply: tid=0 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.606+0000 7f66ad223740 1 client.26828 shutdown 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 msgr2=0x55ee18b215a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f669003b6a0 tx=0x7f669003bd60 comp rx=0 tx=0).stop 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 shutdown_connections 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18b34330 0x55ee18b367b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b249a0 0x55ee18b21ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b18a10 0x55ee18b215a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 --2- 172.21.15.67:0/1081365184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b24150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f6683fff640 0 client.26828 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 >> 172.21.15.67:0/1081365184 conn(0x55ee18b15f20 msgr2=0x55ee18b1ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 shutdown_connections 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 1 -- 172.21.15.67:0/1081365184 wait complete. 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.607+0000 7f66ad223740 20 client.26828 trim_cache size 0 max 16384 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.624+0000 7f66ad223740 1 Processor -- start 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.624+0000 7f66ad223740 1 -- start start 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.624+0000 7f66ad223740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66ad223740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 0x55ee18b20360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66ad223740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b1e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42802/0 (socket says 172.21.15.67:42802) 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 -- 172.21.15.67:0/2099324482 learned_addr learned my addr 172.21.15.67:0/2099324482 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6688010c60 con 0x55ee18b180f0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f668800e530 con 0x55ee18b249a0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f668800c380 con 0x55ee18b18a10 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a3fff640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 0x55ee18b20360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 -- 172.21.15.67:0/2099324482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 msgr2=0x55ee18b20360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a93eb640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b1e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 0x55ee18b20360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 -- 172.21.15.67:0/2099324482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 msgr2=0x55ee18b1e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b1e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 -- 172.21.15.67:0/2099324482 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee18b17600 con 0x55ee18b180f0 2024-09-10T21:05:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a3fff640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 0x55ee18b20360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a93eb640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b1e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f66a8bea640 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6698005820 tx=0x7f66980eb9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b735173b22d6df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f668e7fc640 1 -- 172.21.15.67:0/2099324482 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980b4640 con 0x55ee18b180f0 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f668e7fc640 1 -- 172.21.15.67:0/2099324482 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6698004e00 con 0x55ee18b180f0 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.625+0000 7f668e7fc640 1 -- 172.21.15.67:0/2099324482 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980b3fe0 con 0x55ee18b180f0 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 msgr2=0x55ee18b1fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6698005820 tx=0x7f66980eb9d0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 shutdown_connections 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b1e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b18a10 0x55ee18b20360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 --2- 172.21.15.67:0/2099324482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b180f0 0x55ee18b1fe20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 >> 172.21.15.67:0/2099324482 conn(0x55ee18b15f20 msgr2=0x55ee18b1c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 shutdown_connections 2024-09-10T21:05:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.626+0000 7f66ad223740 1 -- 172.21.15.67:0/2099324482 wait complete. 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 -- start start 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 Processor -- start 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b2ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b27900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f668800c9f0 con 0x55ee18b18a10 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f668800de60 con 0x55ee18b249a0 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f668800d0c0 con 0x55ee18b180f0 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66ad223740 10 client.0 _ll_register_callbacks cb 0x7f669001e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66a3fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b2ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66a8bea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43672/0 (socket says 172.21.15.67:43672) 2024-09-10T21:05:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.627+0000 7f66a8bea640 1 -- 172.21.15.67:0/600117317 learned_addr learned my addr 172.21.15.67:0/600117317 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a93eb640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b27900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 -- 172.21.15.67:0/600117317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 msgr2=0x55ee18b27900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b27900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 -- 172.21.15.67:0/600117317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 msgr2=0x55ee18b2ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b2ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 -- 172.21.15.67:0/600117317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee18b27e90 con 0x55ee18b180f0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66a8bea640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66980b0e40 tx=0x7f66980b92a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b589f3a413275b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f6683fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66980b41c0 con 0x55ee18b180f0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f66980bd8c0 con 0x55ee18b180f0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.628+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee18a90df0 con 0x55ee18b180f0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.629+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66980b4640 con 0x55ee18b180f0 2024-09-10T21:05:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.629+0000 7f66ad223740 10 client.26797 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.629+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee18ba1ab0 con 0x55ee18b180f0 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.629+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ee18a90df0 con 0x55ee18b180f0 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f66980b3b40 con 0x55ee18b180f0 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 10 client.26797 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 10 client.26797 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 20 client.26797 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18ba2130 0x55ee18ba4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 4 client.26797 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee18a8c8a0 con 0x55ee18ba2130 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.630+0000 7f66a3fff640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18ba2130 0x55ee18ba4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f66a3fff640 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18ba2130 0x55ee18ba4550 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75fb89ffd255a544 server_cookie=edf4c7f98b1a40d7 in_seq=0 out_seq=0 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f6683fff640 10 client.26797 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f6683fff640 1 -- 172.21.15.67:0/600117317 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee18a8c8a0 con 0x55ee18ba2130 2024-09-10T21:05:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f6683fff640 10 client.26797 handle_command_reply: tid=0 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f66ad223740 1 client.26797 shutdown 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 msgr2=0x55ee18b2c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.631+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66980b0e40 tx=0x7f66980b92a0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 shutdown_connections 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55ee18ba2130 0x55ee18ba4550 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f6683fff640 0 client.26797 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ee18b249a0 0x55ee18b27900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55ee18b18a10 0x55ee18b2ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 --2- 172.21.15.67:0/600117317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee18b180f0 0x55ee18b2c950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 >> 172.21.15.67:0/600117317 conn(0x55ee18b15f20 msgr2=0x55ee18b21470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 shutdown_connections 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 1 -- 172.21.15.67:0/600117317 wait complete. 2024-09-10T21:05:36.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.632+0000 7f66ad223740 20 client.26797 trim_cache size 0 max 16384 2024-09-10T21:05:36.676 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:05:36.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 msgr2=0x7f66940b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 0x7f66940b7970 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f669c021000 tx=0x7f669c024000 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 msgr2=0x7f66a4194380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f70 tx=0x7f669800ee50 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 shutdown_connections 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66a4108020 0x7f66a4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f66940b54b0 0x7f66940b7970 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66a41076a0 0x7f66a41948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 --2- 172.21.15.67:0/1370608452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66a4101c90 0x7f66a4194380 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 >> 172.21.15.67:0/1370608452 conn(0x7f66a40fd700 msgr2=0x7f66a40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 shutdown_connections 2024-09-10T21:05:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:36.633+0000 7f66aae4e640 1 -- 172.21.15.67:0/1370608452 wait complete. 2024-09-10T21:05:36.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:36 smithi172 ceph-mon[35265]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.4 MiB/s wr, 620 op/s 2024-09-10T21:05:37.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:05:37.805 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.383+0000 7fbed4837640 1 -- 172.21.15.67:0/3025553314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed011c0a0 msgr2=0x7fbed011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.383+0000 7fbed4837640 1 --2- 172.21.15.67:0/3025553314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed011c0a0 0x7fbed011e490 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009be0 tx=0x7fbec802a6d0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.384+0000 7fbed4837640 1 -- 172.21.15.67:0/3025553314 shutdown_connections 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.384+0000 7fbed4837640 1 --2- 172.21.15.67:0/3025553314 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed011c0a0 0x7fbed011e490 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.384+0000 7fbed4837640 1 --2- 172.21.15.67:0/3025553314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed010a530 0x7fbed010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.384+0000 7fbed4837640 1 --2- 172.21.15.67:0/3025553314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.384+0000 7fbed4837640 1 -- 172.21.15.67:0/3025553314 >> 172.21.15.67:0/3025553314 conn(0x7fbed006cb30 msgr2=0x7fbed006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.385+0000 7fbed4837640 1 -- 172.21.15.67:0/3025553314 shutdown_connections 2024-09-10T21:05:38.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.385+0000 7fbed4837640 1 -- 172.21.15.67:0/3025553314 wait complete. 2024-09-10T21:05:38.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.386+0000 7fbed4837640 1 Processor -- start 2024-09-10T21:05:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.387+0000 7fbed4837640 1 -- start start 2024-09-10T21:05:38.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.387+0000 7fbed4837640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.387+0000 7fbed4837640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.387+0000 7fbed4837640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed011c0a0 0x7fbed01ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.388+0000 7fbed4837640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0121a50 con 0x7fbed010a530 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.388+0000 7fbed4837640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01218d0 con 0x7fbed011c0a0 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.388+0000 7fbed4837640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0121bd0 con 0x7fbed010a150 2024-09-10T21:05:38.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.388+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01a7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43686/0 (socket says 172.21.15.67:43686) 2024-09-10T21:05:38.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42818/0 (socket says 172.21.15.67:42818) 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbecf7fe640 1 -- 172.21.15.67:0/712023968 learned_addr learned my addr 172.21.15.67:0/712023968 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 -- 172.21.15.67:0/712023968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 msgr2=0x7fbed01a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 -- 172.21.15.67:0/712023968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed011c0a0 msgr2=0x7fbed01ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed011c0a0 0x7fbed01ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.389+0000 7fbeceffd640 1 -- 172.21.15.67:0/712023968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed01adf10 con 0x7fbed010a530 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbeceffd640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbec400d650 tx=0x7fbec400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbeccff9640 1 -- 172.21.15.67:0/712023968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4017070 con 0x7fbed010a530 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbeccff9640 1 -- 172.21.15.67:0/712023968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec4009c70 con 0x7fbed010a530 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed01ae200 con 0x7fbed010a530 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed01b4a90 con 0x7fbed010a530 2024-09-10T21:05:38.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.390+0000 7fbeccff9640 1 -- 172.21.15.67:0/712023968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4003a60 con 0x7fbed010a530 2024-09-10T21:05:38.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.394+0000 7fbed7e6e740 1 Processor -- start 2024-09-10T21:05:38.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.394+0000 7fbed7e6e740 1 -- start start 2024-09-10T21:05:38.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be215e9fc0 0x55be21606a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be21609350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55be2155fea0 con 0x55be215e9fc0 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55be2154f2d0 con 0x55be21606f60 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be215530e0 con 0x55be215e96a0 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbecffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbecffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43698/0 (socket says 172.21.15.67:43698) 2024-09-10T21:05:38.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.395+0000 7fbecffff640 1 -- 172.21.15.67:0/952503229 learned_addr learned my addr 172.21.15.67:0/952503229 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be215e9fc0 0x55be21606a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 -- 172.21.15.67:0/952503229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 msgr2=0x55be21609350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be21609350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 -- 172.21.15.67:0/952503229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be215e9fc0 msgr2=0x55be21606a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be215e9fc0 0x55be21606a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 -- 172.21.15.67:0/952503229 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be212ad650 con 0x55be215e96a0 2024-09-10T21:05:38.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.396+0000 7fbecffff640 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbec80304a0 tx=0x7fbec80304d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c3e4cfb4b8531e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.397+0000 7fbeccff9640 1 -- 172.21.15.67:0/712023968 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fbec4004220 con 0x7fbed010a530 2024-09-10T21:05:38.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.398+0000 7fbeb5ffb640 1 -- 172.21.15.67:0/952503229 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8040020 con 0x55be215e96a0 2024-09-10T21:05:38.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.398+0000 7fbeb5ffb640 1 -- 172.21.15.67:0/952503229 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec8003e20 con 0x55be215e96a0 2024-09-10T21:05:38.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbeccff9640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 0x7fbeb80b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 -- 172.21.15.67:0/952503229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 msgr2=0x55be215e9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbec80304a0 tx=0x7fbec80304d0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 -- 172.21.15.67:0/952503229 shutdown_connections 2024-09-10T21:05:38.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be21609350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be215e9fc0 0x55be21606a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/952503229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e96a0 0x55be215e9a80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 0x7fbeb80b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.399+0000 7fbed7e6e740 1 -- 172.21.15.67:0/952503229 >> 172.21.15.67:0/952503229 conn(0x55be215e74d0 msgr2=0x55be215e8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.400+0000 7fbed7e6e740 1 -- 172.21.15.67:0/952503229 shutdown_connections 2024-09-10T21:05:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.400+0000 7fbed7e6e740 1 -- 172.21.15.67:0/952503229 wait complete. 2024-09-10T21:05:38.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.400+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 0x7fbeb80b7920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55be215ed8e0 tx=0x7fbec000b3a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.400+0000 7fbeccff9640 1 -- 172.21.15.67:0/712023968 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbec40e53e0 con 0x7fbed010a530 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.400+0000 7fbed7e6e740 1 -- start start 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 Processor -- start 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be21606f60 0x55be21603a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be216043d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55be213b0700 con 0x55be21603f50 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55be214ea160 con 0x55be215e9fc0 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be21609c00 con 0x55be21606f60 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbed7e6e740 10 client.0 _ll_register_callbacks cb 0x55be215039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43874/0 (socket says 172.21.15.67:43874) 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.401+0000 7fbecf7fe640 1 -- 172.21.15.67:0/4093693725 learned_addr learned my addr 172.21.15.67:0/4093693725 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.402+0000 7fbecf7fe640 1 -- 172.21.15.67:0/4093693725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be21606f60 msgr2=0x55be21603a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.402+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be21606f60 0x55be21603a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.402+0000 7fbecf7fe640 1 -- 172.21.15.67:0/4093693725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 msgr2=0x55be216043d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbecffff640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be216043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be216043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbecf7fe640 1 -- 172.21.15.67:0/4093693725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be21517c90 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbec00126d0 tx=0x7fbec00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886d33c951132a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbeaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000fae0 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be21561df0 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbec000fc80 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbec000fe80 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbed7e6e740 10 client.26837 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55be216158e0 con 0x55be215e9fc0 2024-09-10T21:05:38.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.403+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55be21561df0 con 0x55be215e9fc0 2024-09-10T21:05:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbec0027540 con 0x55be215e9fc0 2024-09-10T21:05:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 10 client.26837 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:38.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 10 client.26837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 20 client.26837 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21616de0 0x55be21619250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 4 client.26837 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be2155d8a0 con 0x55be21616de0 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbeceffd640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21616de0 0x55be21619250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.404+0000 7fbeceffd640 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21616de0 0x55be21619250 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05c9290d9c55302 server_cookie=ec1c18d020d56073 in_seq=0 out_seq=0 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbeaeffd640 10 client.26837 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbeaeffd640 1 -- 172.21.15.67:0/4093693725 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be2155d8a0 con 0x55be21616de0 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbeaeffd640 10 client.26837 handle_command_reply: tid=0 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbed7e6e740 1 client.26837 shutdown 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 msgr2=0x55be216065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.405+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbec00126d0 tx=0x7fbec00046c0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 shutdown_connections 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21616de0 0x55be21619250 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be216043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be21606f60 0x55be21603a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/4093693725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be215e9fc0 0x55be216065c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 >> 172.21.15.67:0/4093693725 conn(0x55be215e74d0 msgr2=0x55be215e5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbeaeffd640 0 client.26837 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 shutdown_connections 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 1 -- 172.21.15.67:0/4093693725 wait complete. 2024-09-10T21:05:38.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.406+0000 7fbed7e6e740 20 client.26837 trim_cache size 0 max 16384 2024-09-10T21:05:38.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 Processor -- start 2024-09-10T21:05:38.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 -- start start 2024-09-10T21:05:38.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be21608b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be21609080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc010ca0 con 0x55be21603f50 2024-09-10T21:05:38.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc00e570 con 0x55be21606f60 2024-09-10T21:05:38.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbed7e6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc00c3c0 con 0x55be215e9fc0 2024-09-10T21:05:38.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbecffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be21608b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbecffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43880/0 (socket says 172.21.15.67:43880) 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbecffff640 1 -- 172.21.15.67:0/3677202651 learned_addr learned my addr 172.21.15.67:0/3677202651 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.429+0000 7fbeceffd640 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be21609080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 -- 172.21.15.67:0/3677202651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 msgr2=0x55be21608b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be21608b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 -- 172.21.15.67:0/3677202651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 msgr2=0x55be21609080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be21609080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 -- 172.21.15.67:0/3677202651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be216037c0 con 0x55be21606f60 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbecffff640 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbec802ac40 tx=0x7fbec8005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2e128d8cd0ca21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbeb57fa640 1 -- 172.21.15.67:0/3677202651 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8040040 con 0x55be21606f60 2024-09-10T21:05:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbeb57fa640 1 -- 172.21.15.67:0/3677202651 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec8049070 con 0x55be21606f60 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.430+0000 7fbeb57fa640 1 -- 172.21.15.67:0/3677202651 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8003bd0 con 0x55be21606f60 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 -- 172.21.15.67:0/3677202651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 msgr2=0x55be215e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbec802ac40 tx=0x7fbec8005bd0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 -- 172.21.15.67:0/3677202651 shutdown_connections 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21606f60 0x55be215e5e50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21603f50 0x55be21609080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/3677202651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be21608b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.431+0000 7fbed7e6e740 1 -- 172.21.15.67:0/3677202651 >> 172.21.15.67:0/3677202651 conn(0x55be215e74d0 msgr2=0x55be215e8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.433+0000 7fbed7e6e740 1 -- 172.21.15.67:0/3677202651 shutdown_connections 2024-09-10T21:05:38.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.433+0000 7fbed7e6e740 1 -- 172.21.15.67:0/3677202651 wait complete. 2024-09-10T21:05:38.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.433+0000 7fbed7e6e740 1 -- start start 2024-09-10T21:05:38.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.433+0000 7fbed7e6e740 1 Processor -- start 2024-09-10T21:05:38.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.434+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.434+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.434+0000 7fbed7e6e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21606f60 0x55be21609f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.434+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43716/0 (socket says 172.21.15.67:43716) 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbeceffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43888/0 (socket says 172.21.15.67:43888) 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 -- 172.21.15.67:0/2973767050 learned_addr learned my addr 172.21.15.67:0/2973767050 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc00ca30 con 0x55be21606f60 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc00dea0 con 0x55be21603f50 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbebc00d100 con 0x55be215e9fc0 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbed7e6e740 10 client.0 _ll_register_callbacks cb 0x7fbec000ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecffff640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21606f60 0x55be21609f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 -- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 msgr2=0x55be2160f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:38.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 -- 172.21.15.67:0/2973767050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21606f60 msgr2=0x55be21609f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:38.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21606f60 0x55be21609f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbecf7fe640 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be2160a470 con 0x55be215e9fc0 2024-09-10T21:05:38.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.435+0000 7fbeceffd640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbecf7fe640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbec0012fd0 tx=0x7fbec0027630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be12a8007d79050 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbeaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec000faf0 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbec0032430 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec8049070 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbec000fc90 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbed7e6e740 10 client.26812 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55be216844a0 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.436+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec0032ae0 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fbec0047570 con 0x55be215e9fc0 2024-09-10T21:05:38.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 10 client.26812 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 10 client.26812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 20 client.26812 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21684c50 0x55be21687070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 4 client.26812 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbec8049070 con 0x55be21684c50 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbeceffd640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21684c50 0x55be21687070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbeaeffd640 10 client.26812 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.437+0000 7fbeceffd640 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21684c50 0x55be21687070 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=220372b498b22bdd server_cookie=8786e09831ed0a7f in_seq=0 out_seq=0 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbeaeffd640 1 -- 172.21.15.67:0/2973767050 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbec8049070 con 0x55be21684c50 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbeaeffd640 10 client.26812 handle_command_reply: tid=0 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 client.26812 shutdown 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 msgr2=0x55be2160ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbec0012fd0 tx=0x7fbec0027630 comp rx=0 tx=0).stop 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 shutdown_connections 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55be21684c50 0x55be21687070 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55be21606f60 0x55be21609f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be21603f50 0x55be2160f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 --2- 172.21.15.67:0/2973767050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be215e9fc0 0x55be2160ef80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 >> 172.21.15.67:0/2973767050 conn(0x55be215e74d0 msgr2=0x55be215e84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbeaeffd640 0 client.26812 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 shutdown_connections 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 1 -- 172.21.15.67:0/2973767050 wait complete. 2024-09-10T21:05:38.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.438+0000 7fbed7e6e740 20 client.26812 trim_cache size 0 max 16384 2024-09-10T21:05:38.446 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 msgr2=0x7fbeb80b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 0x7fbeb80b7920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55be215ed8e0 tx=0x7fbec000b3a0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 msgr2=0x7fbed01a83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbec400d650 tx=0x7fbec400db10 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 shutdown_connections 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbed011c0a0 0x7fbed01ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbed010a530 0x7fbed01a83a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fbeb80b5460 0x7fbeb80b7920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 --2- 172.21.15.67:0/712023968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed010a150 0x7fbed01a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.439+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 >> 172.21.15.67:0/712023968 conn(0x7fbed006cb30 msgr2=0x7fbed011c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.440+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 shutdown_connections 2024-09-10T21:05:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:38.440+0000 7fbed4837640 1 -- 172.21.15.67:0/712023968 wait complete. 2024-09-10T21:05:38.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:38 smithi067 ceph-mon[30891]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 629 op/s 2024-09-10T21:05:38.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:38 smithi083 ceph-mon[35058]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 629 op/s 2024-09-10T21:05:38.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:38 smithi172 ceph-mon[35265]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 629 op/s 2024-09-10T21:05:39.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 845.0 s, 1517.7 tps, lat 65.715 ms stddev 70.792 2024-09-10T21:05:40.288 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:05:40.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:05:40.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:40 smithi083 ceph-mon[35058]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-09-10T21:05:40.679 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:40.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:40 smithi172 ceph-mon[35265]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-09-10T21:05:40.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:40 smithi067 ceph-mon[30891]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.4 MiB/s wr, 657 op/s 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 -- 172.21.15.67:0/470359775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a530 msgr2=0x7fc69810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 --2- 172.21.15.67:0/470359775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a530 0x7fc69810a930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009860 tx=0x7fc68c02a410 comp rx=0 tx=0).stop 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 -- 172.21.15.67:0/470359775 shutdown_connections 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 --2- 172.21.15.67:0/470359775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc69811c0a0 0x7fc69811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 --2- 172.21.15.67:0/470359775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a530 0x7fc69810a930 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009860 tx=0x7fc68c02a410 comp rx=0 tx=0).stop 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 --2- 172.21.15.67:0/470359775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69810a150 0x7fc6981111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.503+0000 7fc69deb4640 1 -- 172.21.15.67:0/470359775 >> 172.21.15.67:0/470359775 conn(0x7fc69806dfc0 msgr2=0x7fc69806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.506+0000 7fc69deb4640 1 -- 172.21.15.67:0/470359775 shutdown_connections 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.506+0000 7fc69deb4640 1 -- 172.21.15.67:0/470359775 wait complete. 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 Processor -- start 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 -- start start 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 0x7fc6981196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 0x7fc698112900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc698112e40 0x7fc6981132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc698121bb0 con 0x7fc698112e40 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc698121a30 con 0x7fc69810a150 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.507+0000 7fc69deb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc698121d30 con 0x7fc69811c0a0 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.508+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 0x7fc6981196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.508+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 0x7fc6981196d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43912/0 (socket says 172.21.15.67:43912) 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.508+0000 7fc6977fe640 1 -- 172.21.15.67:0/1627757873 learned_addr learned my addr 172.21.15.67:0/1627757873 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:41.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.508+0000 7fc696ffd640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 0x7fc698112900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 -- 172.21.15.67:0/1627757873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 msgr2=0x7fc6981196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 0x7fc6981196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 -- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc698112e40 msgr2=0x7fc6981132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc698112e40 0x7fc6981132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 -- 172.21.15.67:0/1627757873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc698118370 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.509+0000 7fc696ffd640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 0x7fc698112900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc68c008000 tx=0x7fc68c030f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.510+0000 7fc694ff9640 1 -- 172.21.15.67:0/1627757873 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c040020 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.510+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc698118600 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.510+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc698118aa0 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.510+0000 7fc694ff9640 1 -- 172.21.15.67:0/1627757873 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc68c009450 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.511+0000 7fc694ff9640 1 -- 172.21.15.67:0/1627757873 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c004900 con 0x7fc69811c0a0 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.513+0000 7fc6a0289740 1 Processor -- start 2024-09-10T21:05:41.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 -- start start 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c77489b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c774811e60 con 0x55c77489aee0 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c774801290 con 0x55c77489b800 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6a0289740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c7748050a0 con 0x55c7748a7790 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:43914/0 (socket says 172.21.15.67:43914) 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc6977fe640 1 -- 172.21.15.67:0/1437487884 learned_addr learned my addr 172.21.15.67:0/1437487884 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.514+0000 7fc697fff640 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c77489b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 -- 172.21.15.67:0/1437487884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 msgr2=0x55c7748a9b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 -- 172.21.15.67:0/1437487884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 msgr2=0x55c77489b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c77489b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 -- 172.21.15.67:0/1437487884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c77455f930 con 0x55c77489b800 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc697fff640 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c77489b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc6977fe640 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d30 tx=0x7fc6880117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df3dff094177f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc694ff9640 1 -- 172.21.15.67:0/1627757873 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fc68c031400 con 0x7fc69811c0a0 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc67dffb640 1 -- 172.21.15.67:0/1437487884 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688012650 con 0x55c77489b800 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc67dffb640 1 -- 172.21.15.67:0/1437487884 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc688009e20 con 0x55c77489b800 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.515+0000 7fc67dffb640 1 -- 172.21.15.67:0/1437487884 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68800fc20 con 0x55c77489b800 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc694ff9640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 0x7fc6800b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 -- 172.21.15.67:0/1437487884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 msgr2=0x55c7748a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc688009d30 tx=0x7fc6880117b0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc697fff640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 0x7fc6800b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 -- 172.21.15.67:0/1437487884 shutdown_connections 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489b800 0x55c7748a7250 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 --2- 172.21.15.67:0/1437487884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c77489b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc6a0289740 1 -- 172.21.15.67:0/1437487884 >> 172.21.15.67:0/1437487884 conn(0x55c774898d10 msgr2=0x55c774899eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.516+0000 7fc694ff9640 1 -- 172.21.15.67:0/1627757873 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc68c106900 con 0x7fc69811c0a0 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.517+0000 7fc6a0289740 1 -- 172.21.15.67:0/1437487884 shutdown_connections 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.517+0000 7fc6a0289740 1 -- 172.21.15.67:0/1437487884 wait complete. 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.517+0000 7fc6a0289740 1 -- start start 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.518+0000 7fc6a0289740 1 Processor -- start 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c7748a4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c7748a7790 0x55c7748a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55c774662890 con 0x55c7748a7790 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c77479bd40 con 0x55c77489aee0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc6a0289740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c7748aa440 con 0x55c77489b800 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:43746/0 (socket says 172.21.15.67:43746) 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.520+0000 7fc696ffd640 1 -- 172.21.15.67:0/2593397079 learned_addr learned my addr 172.21.15.67:0/2593397079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc697fff640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c7748a7790 0x55c7748a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc6a0289740 10 client.0 _ll_register_callbacks cb 0x55c7747ffc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c7748a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc697fff640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 0x7fc6800b7860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc690005fd0 tx=0x7fc69000f7d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc696ffd640 1 -- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 msgr2=0x55c7748a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c7748a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc696ffd640 1 -- 172.21.15.67:0/2593397079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c7748a7790 msgr2=0x55c7748a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c7748a7790 0x55c7748a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.521+0000 7fc696ffd640 1 -- 172.21.15.67:0/2593397079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7748b38b0 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0ca360 tx=0x7fc68c0cccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba8773053b05dc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0d1bd0 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc68c0cd350 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc688009e20 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc68c0d6680 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc6a0289740 10 client.26821 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c7748b6240 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.522+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc688009e20 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc68c0c8a40 con 0x55c77489b800 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 10 client.26821 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:41.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 10 client.26821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 20 client.26821 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c7748b7770 0x55c7748b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 4 client.26821 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c774813db0 con 0x55c7748b7770 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c7748b7770 0x55c7748b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c7748b7770 0x55c7748b9bd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f36aa211ee019c server_cookie=c5cd00169450e563 in_seq=0 out_seq=0 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.523+0000 7fc676ffd640 10 client.26821 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc676ffd640 1 -- 172.21.15.67:0/2593397079 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c774813db0 con 0x55c7748b7770 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc676ffd640 10 client.26821 handle_command_reply: tid=0 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 client.26821 shutdown 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 msgr2=0x55c7748a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0ca360 tx=0x7fc68c0cccc0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 shutdown_connections 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c7748b7770 0x55c7748b9bd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c7748a7790 0x55c7748a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748a4c80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2593397079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c7748a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 >> 172.21.15.67:0/2593397079 conn(0x55c774898d10 msgr2=0x55c774897f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.524+0000 7fc676ffd640 0 client.26821 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.525+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 shutdown_connections 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.525+0000 7fc6a0289740 1 -- 172.21.15.67:0/2593397079 wait complete. 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.525+0000 7fc6a0289740 20 client.26821 trim_cache size 0 max 16384 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.548+0000 7fc6a0289740 1 Processor -- start 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.548+0000 7fc6a0289740 1 -- start start 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c77489e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 0x55c7748a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc684010ba0 con 0x55c77489b800 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400e470 con 0x55c77489aee0 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6a0289740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400c2c0 con 0x55c7748a7790 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 0x55c7748a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 0x55c7748a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42910/0 (socket says 172.21.15.67:42910) 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc696ffd640 1 -- 172.21.15.67:0/2412425597 learned_addr learned my addr 172.21.15.67:0/2412425597 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c77489e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc697fff640 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 -- 172.21.15.67:0/2412425597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 msgr2=0x55c7748a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 -- 172.21.15.67:0/2412425597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 msgr2=0x55c7748a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 0x55c7748a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 -- 172.21.15.67:0/2412425597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c774894640 con 0x55c77489aee0 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.549+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c77489e7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc68800f800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3357ff665f21ff18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.550+0000 7fc67d7fa640 1 -- 172.21.15.67:0/2412425597 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6880052b0 con 0x55c77489aee0 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.550+0000 7fc67d7fa640 1 -- 172.21.15.67:0/2412425597 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc688009e20 con 0x55c77489aee0 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.550+0000 7fc67d7fa640 1 -- 172.21.15.67:0/2412425597 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688003850 con 0x55c77489aee0 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- 172.21.15.67:0/2412425597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 msgr2=0x55c77489e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c77489e7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc688000c00 tx=0x7fc68800f800 comp rx=0 tx=0).stop 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- 172.21.15.67:0/2412425597 shutdown_connections 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c7748a7790 0x55c7748a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489b800 0x55c7748a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2412425597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c77489aee0 0x55c77489e7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- 172.21.15.67:0/2412425597 >> 172.21.15.67:0/2412425597 conn(0x55c774898d10 msgr2=0x55c77489e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- 172.21.15.67:0/2412425597 shutdown_connections 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- 172.21.15.67:0/2412425597 wait complete. 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.551+0000 7fc6a0289740 1 -- start start 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 Processor -- start 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 0x55c7748acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400c930 con 0x55c77489aee0 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400dda0 con 0x55c7748a7790 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc68400d000 con 0x55c77489b800 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6a0289740 10 client.0 _ll_register_callbacks cb 0x7fc68c005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6977fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42920/0 (socket says 172.21.15.67:42920) 2024-09-10T21:05:41.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc6977fe640 1 -- 172.21.15.67:0/2059648245 learned_addr learned my addr 172.21.15.67:0/2059648245 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.552+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc697fff640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 0x55c7748acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 -- 172.21.15.67:0/2059648245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 msgr2=0x55c7748ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 -- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 msgr2=0x55c7748acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 0x55c7748acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 -- 172.21.15.67:0/2059648245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7749246f0 con 0x55c77489aee0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc697fff640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 0x55c7748acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc6977fe640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc68801c040 tx=0x7fc6880052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ba8b38bb2bdb80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.553+0000 7fc676ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68803d060 con 0x55c77489aee0 2024-09-10T21:05:41.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc68800f870 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc688009e20 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc68800fab0 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc6a0289740 10 client.17160 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.554+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c774925930 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc688009e20 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc68802c070 con 0x55c77489aee0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 10 client.17160 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 20 client.17160 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c774925ec0 0x55c7749282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 4 client.17160 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c77480f860 con 0x55c774925ec0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c774925ec0 0x55c7749282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:41.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.555+0000 7fc676ffd640 10 client.17160 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.556+0000 7fc696ffd640 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c774925ec0 0x55c7749282e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8fbf1a70587e2b server_cookie=5ff5a79371c4542a in_seq=0 out_seq=0 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.557+0000 7fc676ffd640 1 -- 172.21.15.67:0/2059648245 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c77480f860 con 0x55c774925ec0 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.557+0000 7fc676ffd640 10 client.17160 handle_command_reply: tid=0 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.557+0000 7fc6a0289740 1 client.17160 shutdown 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 msgr2=0x55c7748b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc68801c040 tx=0x7fc6880052c0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 shutdown_connections 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55c774925ec0 0x55c7749282e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7748a7790 0x55c7748acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c77489b800 0x55c7748ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 --2- 172.21.15.67:0/2059648245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55c77489aee0 0x55c7748b00a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 >> 172.21.15.67:0/2059648245 conn(0x55c774898d10 msgr2=0x55c77489e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc676ffd640 0 client.17160 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 shutdown_connections 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 1 -- 172.21.15.67:0/2059648245 wait complete. 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.558+0000 7fc6a0289740 20 client.17160 trim_cache size 0 max 16384 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "9e11199e-c064-436b-9d7c-aa344083de78", 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:05:41.588 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 msgr2=0x7fc6800b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 0x7fc6800b7860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc690005fd0 tx=0x7fc69000f7d0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 msgr2=0x7fc698112900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 0x7fc698112900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc68c008000 tx=0x7fc68c030f60 comp rx=0 tx=0).stop 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 shutdown_connections 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc698112e40 0x7fc6981132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fc6800b53a0 0x7fc6800b7860 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc69811c0a0 0x7fc698112900 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 --2- 172.21.15.67:0/1627757873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc69810a150 0x7fc6981196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:41.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 >> 172.21.15.67:0/1627757873 conn(0x7fc69806dfc0 msgr2=0x7fc69811c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:41.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 shutdown_connections 2024-09-10T21:05:41.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:41.559+0000 7fc69deb4640 1 -- 172.21.15.67:0/1627757873 wait complete. 2024-09-10T21:05:42.295 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:05:42.546 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:42 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-10T21:05:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:05:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:05:42.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:05:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:05:42.642 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:42 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.698 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 582 op/s 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:05:42.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:42 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 -- 172.21.15.67:0/1001966924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8113af0 msgr2=0x7f83b8115ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 --2- 172.21.15.67:0/1001966924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8113af0 0x7f83b8115ee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009900 tx=0x7f83ac02a410 comp rx=0 tx=0).stop 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 -- 172.21.15.67:0/1001966924 shutdown_connections 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 --2- 172.21.15.67:0/1001966924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8113af0 0x7f83b8115ee0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 --2- 172.21.15.67:0/1001966924 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83b8075e60 0x7f83b81135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 --2- 172.21.15.67:0/1001966924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8075540 0x7f83b8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 -- 172.21.15.67:0/1001966924 >> 172.21.15.67:0/1001966924 conn(0x7f83b80fe820 msgr2=0x7f83b8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 -- 172.21.15.67:0/1001966924 shutdown_connections 2024-09-10T21:05:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.450+0000 7f83be705640 1 -- 172.21.15.67:0/1001966924 wait complete. 2024-09-10T21:05:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.451+0000 7f83be705640 1 Processor -- start 2024-09-10T21:05:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.451+0000 7f83be705640 1 -- start start 2024-09-10T21:05:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83b8075e60 0x7f83b819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8113af0 0x7f83b81a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81193b0 con 0x7f83b8075540 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8119230 con 0x7f83b8075e60 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83be705640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8119530 con 0x7f83b8113af0 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52234/0 (socket says 172.21.15.67:52234) 2024-09-10T21:05:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.452+0000 7f83b7fff640 1 -- 172.21.15.67:0/2370191753 learned_addr learned my addr 172.21.15.67:0/2370191753 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.453+0000 7f83b7fff640 1 -- 172.21.15.67:0/2370191753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8113af0 msgr2=0x7f83b81a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.453+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8113af0 0x7f83b81a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.453+0000 7f83b7fff640 1 -- 172.21.15.67:0/2370191753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83b8075e60 msgr2=0x7f83b819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.453+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83b8075e60 0x7f83b819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.453+0000 7f83b7fff640 1 -- 172.21.15.67:0/2370191753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b81a5910 con 0x7f83b8075540 2024-09-10T21:05:43.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.454+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e9f0 tx=0x7f83a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.454+0000 7f83b57fa640 1 -- 172.21.15.67:0/2370191753 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a800cd80 con 0x7f83b8075540 2024-09-10T21:05:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.454+0000 7f83b57fa640 1 -- 172.21.15.67:0/2370191753 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a80054d0 con 0x7f83b8075540 2024-09-10T21:05:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.455+0000 7f83b57fa640 1 -- 172.21.15.67:0/2370191753 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8010430 con 0x7f83b8075540 2024-09-10T21:05:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.455+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b81a5c00 con 0x7f83b8075540 2024-09-10T21:05:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.455+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81ac2c0 con 0x7f83b8075540 2024-09-10T21:05:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.457+0000 7f83b57fa640 1 -- 172.21.15.67:0/2370191753 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f83a8005000 con 0x7f83b8075540 2024-09-10T21:05:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.458+0000 7f83c0ada740 1 Processor -- start 2024-09-10T21:05:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.458+0000 7f83c0ada740 1 -- start start 2024-09-10T21:05:43.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83b57fa640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 0x7f83a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bdc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564cc5b52e50 con 0x564cc5bdcda0 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564cc5b42280 con 0x564cc5bdc480 2024-09-10T21:05:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83c0ada740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cc5b46090 con 0x564cc5be8d30 2024-09-10T21:05:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83bcca2640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 0x7f83a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83bcca2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83bcca2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34716/0 (socket says 172.21.15.67:34716) 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.459+0000 7f83bcca2640 1 -- 172.21.15.67:0/1599088283 learned_addr learned my addr 172.21.15.67:0/1599088283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83bcca2640 1 -- 172.21.15.67:0/1599088283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 msgr2=0x564cc5bdc860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83b77fe640 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83bcca2640 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bdc860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83bcca2640 1 -- 172.21.15.67:0/1599088283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 msgr2=0x564cc5be87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83bcca2640 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.460+0000 7f83bcca2640 1 -- 172.21.15.67:0/1599088283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc58a0650 con 0x564cc5be8d30 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f83b57fa640 1 -- 172.21.15.67:0/2370191753 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83a80e6110 con 0x7f83b8075540 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f83bcca2640 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83ac033000 tx=0x7f83ac043000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e7fce07576017aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f83bcca2640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 0x7f83a00b7820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009900 tx=0x7f83ac0042d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f839e7fc640 1 -- 172.21.15.67:0/1599088283 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac04f070 con 0x564cc5be8d30 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f839e7fc640 1 -- 172.21.15.67:0/1599088283 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83ac0314a0 con 0x564cc5be8d30 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.461+0000 7f839e7fc640 1 -- 172.21.15.67:0/1599088283 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac035040 con 0x564cc5be8d30 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83b77fe640 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:05:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 -- 172.21.15.67:0/1599088283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 msgr2=0x564cc5beb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83ac033000 tx=0x7f83ac043000 comp rx=0 tx=0).stop 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 -- 172.21.15.67:0/1599088283 shutdown_connections 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5beb120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 --2- 172.21.15.67:0/1599088283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bdc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 -- 172.21.15.67:0/1599088283 >> 172.21.15.67:0/1599088283 conn(0x564cc5bda2b0 msgr2=0x564cc5bdb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 -- 172.21.15.67:0/1599088283 shutdown_connections 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.462+0000 7f83c0ada740 1 -- 172.21.15.67:0/1599088283 wait complete. 2024-09-10T21:05:43.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.463+0000 7f83c0ada740 1 -- start start 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.463+0000 7f83c0ada740 1 Processor -- start 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x564cc59a3700 con 0x564cc5bdcda0 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x564cc5add110 con 0x564cc5be8d30 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564cc5beb950 con 0x564cc5bdc480 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83c0ada740 10 client.0 _ll_register_callbacks cb 0x564cc5af6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b77fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52260/0 (socket says 172.21.15.67:52260) 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:34720/0 (socket says 172.21.15.67:34720) 2024-09-10T21:05:43.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:45620/0 (socket says 172.21.15.67:45620) 2024-09-10T21:05:43.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b77fe640 1 -- 172.21.15.67:0/2758547719 learned_addr learned my addr 172.21.15.67:0/2758547719 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 -- 172.21.15.67:0/2758547719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 msgr2=0x564cc5be8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 -- 172.21.15.67:0/2758547719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 msgr2=0x564cc5be5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83bcca2640 1 -- 172.21.15.67:0/2758547719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc5b0ac40 con 0x564cc5be8d30 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.464+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:05:43.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83bcca2640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83ac031440 tx=0x7f83ac003a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ada62c603b88b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac035070 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83ac0314a0 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83ac04a440 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f83ac04f030 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83c0ada740 10 client.26867 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564cc5bf7240 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83ac0314a0 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.465+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f83ac05c030 con 0x564cc5be8d30 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 10 client.26867 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 10 client.26867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 20 client.26867 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:43.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5bf86a0 0x564cc5bfaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 4 client.26867 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:05:43.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cc5b54da0 con 0x564cc5bf86a0 2024-09-10T21:05:43.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5bf86a0 0x564cc5bfaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.466+0000 7f83b7fff640 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5bf86a0 0x564cc5bfaa90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5812f3ab2856e4 server_cookie=12483f0ec1273bbe in_seq=0 out_seq=0 2024-09-10T21:05:43.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.467+0000 7f83977fe640 10 client.26867 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.467+0000 7f83977fe640 1 -- 172.21.15.67:0/2758547719 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564cc5b54da0 con 0x564cc5bf86a0 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.467+0000 7f83977fe640 10 client.26867 handle_command_reply: tid=0 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 client.26867 shutdown 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 msgr2=0x564cc5be6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83ac031440 tx=0x7f83ac003a70 comp rx=0 tx=0).stop 2024-09-10T21:05:43.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 shutdown_connections 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5bf86a0 0x564cc5bfaa90 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5be8d30 0x564cc5be6090 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdcda0 0x564cc5be5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 --2- 172.21.15.67:0/2758547719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdc480 0x564cc5be8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.468+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 >> 172.21.15.67:0/2758547719 conn(0x564cc5bda2b0 msgr2=0x564cc5bdfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.469+0000 7f83977fe640 0 client.26867 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.469+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 shutdown_connections 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.469+0000 7f83c0ada740 1 -- 172.21.15.67:0/2758547719 wait complete. 2024-09-10T21:05:43.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.469+0000 7f83c0ada740 20 client.26867 trim_cache size 0 max 16384 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.495+0000 7f83c0ada740 1 Processor -- start 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.495+0000 7f83c0ada740 1 -- start start 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.495+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdcda0 0x564cc5bea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5be8d30 0x564cc5bea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83c0ada740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b71b0 con 0x564cc5be8d30 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83c0ada740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b4a80 con 0x564cc5bdc480 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83c0ada740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b28d0 con 0x564cc5bdcda0 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:45626/0 (socket says 172.21.15.67:45626) 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 -- 172.21.15.67:0/3126170106 learned_addr learned my addr 172.21.15.67:0/3126170106 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 -- 172.21.15.67:0/3126170106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdcda0 msgr2=0x564cc5bea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b77fe640 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdcda0 0x564cc5bea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdcda0 0x564cc5bea120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 -- 172.21.15.67:0/3126170106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5be8d30 msgr2=0x564cc5bea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5be8d30 0x564cc5bea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.496+0000 7f83b7fff640 1 -- 172.21.15.67:0/3126170106 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc5be6d30 con 0x564cc5bdc480 2024-09-10T21:05:43.502 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:43 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.497+0000 7f83b7fff640 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83a80e3be0 tx=0x7f83a8004a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66bddf79dc3f7740 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.498+0000 7f839dffb640 1 -- 172.21.15.67:0/3126170106 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8005680 con 0x564cc5bdc480 2024-09-10T21:05:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.498+0000 7f839dffb640 1 -- 172.21.15.67:0/3126170106 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a80b1070 con 0x564cc5bdc480 2024-09-10T21:05:43.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.498+0000 7f839dffb640 1 -- 172.21.15.67:0/3126170106 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a80b5e30 con 0x564cc5bdc480 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 -- 172.21.15.67:0/3126170106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 msgr2=0x564cc5bd9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83a80e3be0 tx=0x7f83a8004a20 comp rx=0 tx=0).stop 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 -- 172.21.15.67:0/3126170106 shutdown_connections 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5be8d30 0x564cc5bea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5bdcda0 0x564cc5bea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 --2- 172.21.15.67:0/3126170106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdc480 0x564cc5bd9bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.499+0000 7f83c0ada740 1 -- 172.21.15.67:0/3126170106 >> 172.21.15.67:0/3126170106 conn(0x564cc5bda2b0 msgr2=0x564cc5be78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.500+0000 7f83c0ada740 1 -- 172.21.15.67:0/3126170106 shutdown_connections 2024-09-10T21:05:43.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.500+0000 7f83c0ada740 1 -- 172.21.15.67:0/3126170106 wait complete. 2024-09-10T21:05:43.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.500+0000 7f83c0ada740 1 -- start start 2024-09-10T21:05:43.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.500+0000 7f83c0ada740 1 Processor -- start 2024-09-10T21:05:43.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 0x564cc5bfc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdcda0 0x564cc5bfcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5c75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b2f40 con 0x564cc5bdc480 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b43b0 con 0x564cc5bdcda0 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b3610 con 0x564cc5be8d30 2024-09-10T21:05:43.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.501+0000 7f83c0ada740 10 client.0 _ll_register_callbacks cb 0x7f83ac04d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 0x564cc5bfc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 0x564cc5bfc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52292/0 (socket says 172.21.15.67:52292) 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83b7fff640 1 -- 172.21.15.67:0/4013545222 learned_addr learned my addr 172.21.15.67:0/4013545222 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83b77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdcda0 0x564cc5bfcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5c75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 -- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdcda0 msgr2=0x564cc5bfcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdcda0 0x564cc5bfcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 -- 172.21.15.67:0/4013545222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 msgr2=0x564cc5bfc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:05:43.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 0x564cc5bfc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.502+0000 7f83bcca2640 1 -- 172.21.15.67:0/4013545222 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc5c759b0 con 0x564cc5be8d30 2024-09-10T21:05:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.503+0000 7f83bcca2640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5c75470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ac02a450 tx=0x7f83ac005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9fe6ec3f63d1ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:05:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.503+0000 7f83977fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:05:43.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.503+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac035070 con 0x564cc5be8d30 2024-09-10T21:05:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.503+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83ac0043c0 con 0x564cc5be8d30 2024-09-10T21:05:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.503+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a80b1070 con 0x564cc5be8d30 2024-09-10T21:05:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.504+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f83ac06f050 con 0x564cc5be8d30 2024-09-10T21:05:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.504+0000 7f83c0ada740 10 client.26839 fetch_fsmap learned FSMap version 34 2024-09-10T21:05:43.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.504+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564cc5c76bf0 con 0x564cc5be8d30 2024-09-10T21:05:43.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a80b1070 con 0x564cc5be8d30 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f83ac05c070 con 0x564cc5be8d30 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 10 client.26839 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 10 client.26839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 20 client.26839 populate_metadata read hostname 'smithi067' 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5c772e0 0x564cc5c79700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 4 client.26839 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.506+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564cc5b50850 con 0x564cc5c772e0 2024-09-10T21:05:43.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83b7fff640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5c772e0 0x564cc5c79700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83b7fff640 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5c772e0 0x564cc5c79700 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=580d3a42b8a48149 server_cookie=3b80c9679a4b3066 in_seq=0 out_seq=0 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83977fe640 10 client.26839 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83977fe640 1 -- 172.21.15.67:0/4013545222 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x564cc5b50850 con 0x564cc5c772e0 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83977fe640 10 client.26839 handle_command_reply: tid=0 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.507+0000 7f83c0ada740 1 client.26839 shutdown 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 msgr2=0x564cc5c75470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5c75470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ac02a450 tx=0x7f83ac005900 comp rx=0 tx=0).stop 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 shutdown_connections 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x564cc5c772e0 0x564cc5c79700 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83977fe640 0 client.26839 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cc5be8d30 0x564cc5c75470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564cc5bdcda0 0x564cc5bfcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 --2- 172.21.15.67:0/4013545222 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x564cc5bdc480 0x564cc5bfc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.508+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 >> 172.21.15.67:0/4013545222 conn(0x564cc5bda2b0 msgr2=0x564cc5be42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.509+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 shutdown_connections 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.509+0000 7f83c0ada740 1 -- 172.21.15.67:0/4013545222 wait complete. 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.509+0000 7f83c0ada740 20 client.26839 trim_cache size 0 max 16384 2024-09-10T21:05:43.514 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "9e11199e-c064-436b-9d7c-aa344083de78": { 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "9e11199e-c064-436b-9d7c-aa344083de78", 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.515 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.516 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.517 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:05:43.518 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.520 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "9e11199e-c064-436b-9d7c-aa344083de78": { 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:05:41.556434+0000", 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:05:43.521 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.522 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.523 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.524 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.525 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.526 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:05:43.527 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:05:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 msgr2=0x7f83a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 0x7f83a00b7820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009900 tx=0x7f83ac0042d0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 msgr2=0x7f83b819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:05:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e9f0 tx=0x7f83a800edf0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 shutdown_connections 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f83a00b5360 0x7f83a00b7820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83b8113af0 0x7f83b81a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83b8075e60 0x7f83b819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 --2- 172.21.15.67:0/2370191753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83b8075540 0x7f83b819f860 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 >> 172.21.15.67:0/2370191753 conn(0x7f83b80fe820 msgr2=0x7f83b80ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 shutdown_connections 2024-09-10T21:05:43.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:05:43.510+0000 7f83be705640 1 -- 172.21.15.67:0/2370191753 wait complete. 2024-09-10T21:05:43.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:43 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:43.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:43 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:05:44.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 850.0 s, 1312.4 tps, lat 75.595 ms stddev 84.550 2024-09-10T21:05:44.311 INFO:tasks.cephfs.filesystem:scrub status for tag:9e11199e-c064-436b-9d7c-aa344083de78 - {'path': '/', 'tag': '9e11199e-c064-436b-9d7c-aa344083de78', 'options': 'recursive,force'} 2024-09-10T21:05:44.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:44 smithi067 ceph-mon[30891]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 697 op/s 2024-09-10T21:05:44.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:44 smithi083 ceph-mon[35058]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 697 op/s 2024-09-10T21:05:44.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:44 smithi172 ceph-mon[35265]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 697 op/s 2024-09-10T21:05:46.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:46 smithi083 ceph-mon[35058]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-10T21:05:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:46 smithi172 ceph-mon[35265]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-10T21:05:46.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:46 smithi067 ceph-mon[30891]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-10T21:05:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:48 smithi083 ceph-mon[35058]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-10T21:05:48.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:48 smithi172 ceph-mon[35265]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-10T21:05:48.797 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:48 smithi067 ceph-mon[30891]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-10T21:05:49.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 855.0 s, 1685.6 tps, lat 59.851 ms stddev 63.057 2024-09-10T21:05:49.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:49 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:49.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:49 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:49.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:49 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:50 smithi172 ceph-mon[35265]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-10T21:05:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:05:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:05:50.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:05:50.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:50 smithi067 ceph-mon[30891]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-10T21:05:50.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:05:50.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:05:50.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:05:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:50 smithi083 ceph-mon[35058]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-09-10T21:05:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:05:50.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:05:50.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:05:52.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:52 smithi172 ceph-mon[35265]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-10T21:05:52.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:52 smithi067 ceph-mon[30891]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-10T21:05:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:52 smithi083 ceph-mon[35058]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-09-10T21:05:54.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 860.0 s, 1657.0 tps, lat 60.220 ms stddev 64.598 2024-09-10T21:05:54.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:54 smithi172 ceph-mon[35265]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 673 op/s 2024-09-10T21:05:54.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:54 smithi067 ceph-mon[30891]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 673 op/s 2024-09-10T21:05:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:54 smithi083 ceph-mon[35058]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 673 op/s 2024-09-10T21:05:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:56 smithi083 ceph-mon[35058]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-09-10T21:05:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:56.693 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:56 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:05:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:56 smithi172 ceph-mon[35265]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-09-10T21:05:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:56.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:56 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:05:56.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:56 smithi067 ceph-mon[30891]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-09-10T21:05:56.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:56.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:56 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:05:58.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:05:58 smithi172 ceph-mon[35265]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-10T21:05:58.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:05:58 smithi067 ceph-mon[30891]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-10T21:05:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:05:58 smithi083 ceph-mon[35058]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-09-10T21:05:59.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 865.0 s, 1523.2 tps, lat 65.462 ms stddev 70.649 2024-09-10T21:06:00.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:00 smithi172 ceph-mon[35265]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:06:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:00 smithi067 ceph-mon[30891]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:06:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:00 smithi083 ceph-mon[35058]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T21:06:02.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:02 smithi172 ceph-mon[35265]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-10T21:06:02.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:02 smithi067 ceph-mon[30891]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-10T21:06:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:02 smithi083 ceph-mon[35058]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5.6 MiB/s wr, 566 op/s 2024-09-10T21:06:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 870.0 s, 1948.0 tps, lat 51.009 ms stddev 54.489 2024-09-10T21:06:04.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:04 smithi172 ceph-mon[35265]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.3 MiB/s wr, 716 op/s 2024-09-10T21:06:04.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:04 smithi067 ceph-mon[30891]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.3 MiB/s wr, 716 op/s 2024-09-10T21:06:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:04 smithi083 ceph-mon[35058]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 7.3 MiB/s wr, 716 op/s 2024-09-10T21:06:06.687 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:06 smithi067 ceph-mon[30891]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 605 op/s 2024-09-10T21:06:06.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:06 smithi172 ceph-mon[35265]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 605 op/s 2024-09-10T21:06:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:06 smithi083 ceph-mon[35058]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.1 MiB/s wr, 605 op/s 2024-09-10T21:06:08.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:08 smithi172 ceph-mon[35265]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:06:08.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:08 smithi067 ceph-mon[30891]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:06:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:08 smithi083 ceph-mon[35058]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.9 MiB/s wr, 583 op/s 2024-09-10T21:06:09.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 875.0 s, 1834.8 tps, lat 55.235 ms stddev 59.364 2024-09-10T21:06:10.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:10 smithi172 ceph-mon[35265]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.1 MiB/s wr, 644 op/s 2024-09-10T21:06:10.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:10 smithi067 ceph-mon[30891]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.1 MiB/s wr, 644 op/s 2024-09-10T21:06:10.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:10 smithi083 ceph-mon[35058]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.1 MiB/s wr, 644 op/s 2024-09-10T21:06:12.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:12 smithi172 ceph-mon[35265]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-10T21:06:12.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:12 smithi067 ceph-mon[30891]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-10T21:06:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:12 smithi083 ceph-mon[35058]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.2 MiB/s wr, 614 op/s 2024-09-10T21:06:14.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 880.0 s, 2220.6 tps, lat 44.541 ms stddev 56.175 2024-09-10T21:06:14.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:06:14.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:14 smithi172 ceph-mon[35265]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 MiB/s wr, 680 op/s 2024-09-10T21:06:14.703 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:14.798 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:14 smithi067 ceph-mon[30891]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 MiB/s wr, 680 op/s 2024-09-10T21:06:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:14 smithi083 ceph-mon[35058]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 MiB/s wr, 680 op/s 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13cb7fe640 1 -- 172.21.15.67:0/2872190250 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c00318a0 con 0x7f13cc1069e0 2024-09-10T21:06:15.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2872190250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 msgr2=0x7f13cc106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2872190250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc106e20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009900 tx=0x7f13c002a420 comp rx=0 tx=0).stop 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2872190250 shutdown_connections 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2872190250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2872190250 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc106e20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2872190250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 0x7f13cc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2872190250 >> 172.21.15.67:0/2872190250 conn(0x7f13cc0fca20 msgr2=0x7f13cc0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2872190250 shutdown_connections 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.339+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2872190250 wait complete. 2024-09-10T21:06:15.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.340+0000 7f13d2cf9640 1 Processor -- start 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.340+0000 7f13d2cf9640 1 -- start start 2024-09-10T21:06:15.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 0x7f13cc197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc1977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1110d0 con 0x7f13cc1069e0 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc110f50 con 0x7f13cc100fd0 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d2cf9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc111250 con 0x7f13cc107360 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d1296640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d1296640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49294/0 (socket says 172.21.15.67:49294) 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.341+0000 7f13d1296640 1 -- 172.21.15.67:0/2029424652 learned_addr learned my addr 172.21.15.67:0/2029424652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d0a95640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 0x7f13cc197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13cbfff640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc1977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 -- 172.21.15.67:0/2029424652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 msgr2=0x7f13cc197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 0x7f13cc197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 -- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 msgr2=0x7f13cc1977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc1977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 -- 172.21.15.67:0/2029424652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc19d2c0 con 0x7f13cc107360 2024-09-10T21:06:15.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13d1296640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b970 tx=0x7f13c400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.342+0000 7f13c9ffb640 1 -- 172.21.15.67:0/2029424652 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4019070 con 0x7f13cc107360 2024-09-10T21:06:15.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.343+0000 7f13c9ffb640 1 -- 172.21.15.67:0/2029424652 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c4014440 con 0x7f13cc107360 2024-09-10T21:06:15.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.343+0000 7f13c9ffb640 1 -- 172.21.15.67:0/2029424652 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40075d0 con 0x7f13cc107360 2024-09-10T21:06:15.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.344+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc19d5b0 con 0x7f13cc107360 2024-09-10T21:06:15.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.344+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc19dcb0 con 0x7f13cc107360 2024-09-10T21:06:15.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.350+0000 7f13d50ce740 1 Processor -- start 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.350+0000 7f13c9ffb640 1 -- 172.21.15.67:0/2029424652 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f13c400cb40 con 0x7f13cc107360 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 -- start start 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b3d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b40120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562e28aa7e50 con 0x562e28b31da0 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562e28a97280 con 0x562e28b3dd30 2024-09-10T21:06:15.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.351+0000 7f13d50ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e28a9b090 con 0x562e28b31480 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13c9ffb640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 0x7f13b40b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b40120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49308/0 (socket says 172.21.15.67:49308) 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13cbfff640 1 -- 172.21.15.67:0/4080550299 learned_addr learned my addr 172.21.15.67:0/4080550299 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.352+0000 7f13c9ffb640 1 -- 172.21.15.67:0/2029424652 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f13c40e4fa0 con 0x7f13cc107360 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 -- 172.21.15.67:0/4080550299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 msgr2=0x562e28b40120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b40120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 -- 172.21.15.67:0/4080550299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 msgr2=0x562e28b3d7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b3d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 -- 172.21.15.67:0/4080550299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e287f5650 con 0x562e28b31480 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13cbfff640 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005c40 tx=0x7f13c0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d9d29403b8bb73d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13b2ffd640 1 -- 172.21.15.67:0/4080550299 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0035070 con 0x562e28b31480 2024-09-10T21:06:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.353+0000 7f13b2ffd640 1 -- 172.21.15.67:0/4080550299 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c0005020 con 0x562e28b31480 2024-09-10T21:06:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.354+0000 7f13d1296640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 0x7f13b40b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.354+0000 7f13d50ce740 1 -- 172.21.15.67:0/4080550299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 msgr2=0x562e28b31860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.354+0000 7f13b2ffd640 1 -- 172.21.15.67:0/4080550299 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0035070 con 0x562e28b31480 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.354+0000 7f13d50ce740 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005c40 tx=0x7f13c0031400 comp rx=0 tx=0).stop 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.355+0000 7f13d50ce740 1 -- 172.21.15.67:0/4080550299 shutdown_connections 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.355+0000 7f13d50ce740 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b40120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.355+0000 7f13d50ce740 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b3d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.355+0000 7f13d50ce740 1 --2- 172.21.15.67:0/4080550299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b31860 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.355+0000 7f13d50ce740 1 -- 172.21.15.67:0/4080550299 >> 172.21.15.67:0/4080550299 conn(0x562e28b2f2b0 msgr2=0x562e28b30450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.356+0000 7f13d50ce740 1 -- 172.21.15.67:0/4080550299 shutdown_connections 2024-09-10T21:06:15.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.357+0000 7f13d1296640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 0x7f13b40b79b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f13c40a7740 tx=0x7f13c4014d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.357+0000 7f13d50ce740 1 -- 172.21.15.67:0/4080550299 wait complete. 2024-09-10T21:06:15.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.357+0000 7f13d50ce740 1 -- start start 2024-09-10T21:06:15.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.358+0000 7f13d50ce740 1 Processor -- start 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31480 0x562e28b3d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b3b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x562e288f8700 con 0x562e28b31480 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562e28a32110 con 0x562e28b3dd30 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d0a95640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e28b409a0 con 0x562e28b31da0 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d0a95640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49324/0 (socket says 172.21.15.67:49324) 2024-09-10T21:06:15.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d0a95640 1 -- 172.21.15.67:0/305196527 learned_addr learned my addr 172.21.15.67:0/305196527 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:15.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13cbfff640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31480 0x562e28b3d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13cbfff640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b3b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.359+0000 7f13d50ce740 10 client.0 _ll_register_callbacks cb 0x562e28a4b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 -- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 msgr2=0x562e28b3b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b3b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 -- 172.21.15.67:0/305196527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31480 msgr2=0x562e28b3d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31480 0x562e28b3d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 -- 172.21.15.67:0/305196527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e28a5fc40 con 0x562e28b31da0 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13d0a95640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00af20 tx=0x7f13bc00c5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d844275163f7186 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.360+0000 7f13abfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc015070 con 0x562e28b31da0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c0005020 con 0x562e28b31da0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f13bc0115f0 con 0x562e28b31da0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13bc021050 con 0x562e28b31da0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13d50ce740 10 client.26848 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.361+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562e28b4c360 con 0x562e28b31da0 2024-09-10T21:06:15.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.362+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13bc011ca0 con 0x562e28b31da0 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.362+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13bc019b10 con 0x562e28b31da0 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 10 client.26848 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 10 client.26848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 20 client.26848 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28b4fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 4 client.26848 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:15.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f13c0005020 con 0x562e28b4d770 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.363+0000 7f13cbfff640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28b4fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.364+0000 7f13cbfff640 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28b4fb80 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca257f899f5ae41 server_cookie=fe823f823829fa6c in_seq=0 out_seq=0 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.364+0000 7f13abfff640 10 client.26848 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.365+0000 7f13abfff640 1 -- 172.21.15.67:0/305196527 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f13c0005020 con 0x562e28b4d770 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.365+0000 7f13abfff640 10 client.26848 handle_command_reply: tid=0 2024-09-10T21:06:15.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.365+0000 7f13d50ce740 1 client.26848 shutdown 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.365+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 msgr2=0x562e28b3aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.365+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00af20 tx=0x7f13bc00c5e0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 shutdown_connections 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28b4fb80 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b3dd30 0x562e28b3b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13abfff640 0 client.26848 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:15.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31da0 0x562e28b3aa40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 --2- 172.21.15.67:0/305196527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31480 0x562e28b3d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 >> 172.21.15.67:0/305196527 conn(0x562e28b2f2b0 msgr2=0x562e28b34e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 shutdown_connections 2024-09-10T21:06:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 1 -- 172.21.15.67:0/305196527 wait complete. 2024-09-10T21:06:15.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.366+0000 7f13d50ce740 20 client.26848 trim_cache size 0 max 16384 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.399+0000 7f13d50ce740 1 Processor -- start 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 -- start start 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b49c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 0x562e28b39f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b3dd30 0x562e28b30370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc1c82b0 con 0x562e28b3dd30 2024-09-10T21:06:15.404 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0740f0 con 0x562e28b31da0 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d50ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc071f40 con 0x562e28b31480 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d0a95640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 0x562e28b39f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b49c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d0a95640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 0x562e28b39f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57604/0 (socket says 172.21.15.67:57604) 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13d0a95640 1 -- 172.21.15.67:0/3399484283 learned_addr learned my addr 172.21.15.67:0/3399484283 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:15.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b3dd30 0x562e28b30370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 -- 172.21.15.67:0/3399484283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 msgr2=0x562e28b39f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 0x562e28b39f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 -- 172.21.15.67:0/3399484283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b3dd30 msgr2=0x562e28b30370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.400+0000 7f13cbfff640 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b3dd30 0x562e28b30370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.401+0000 7f13cbfff640 1 -- 172.21.15.67:0/3399484283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e28b40890 con 0x562e28b31480 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.401+0000 7f13cbfff640 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b49c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009850 tx=0x7f13c0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be519dbac7726fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.401+0000 7f13b27fc640 1 -- 172.21.15.67:0/3399484283 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0035040 con 0x562e28b31480 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.401+0000 7f13b27fc640 1 -- 172.21.15.67:0/3399484283 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c00047a0 con 0x562e28b31480 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.401+0000 7f13b27fc640 1 -- 172.21.15.67:0/3399484283 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0031700 con 0x562e28b31480 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.402+0000 7f13d50ce740 1 -- 172.21.15.67:0/3399484283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 msgr2=0x562e28b49c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.402+0000 7f13d50ce740 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b49c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009850 tx=0x7f13c0004040 comp rx=0 tx=0).stop 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.404+0000 7f13d50ce740 1 -- 172.21.15.67:0/3399484283 shutdown_connections 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.404+0000 7f13d50ce740 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b3dd30 0x562e28b30370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.404+0000 7f13d50ce740 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31da0 0x562e28b39f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.404+0000 7f13d50ce740 1 --2- 172.21.15.67:0/3399484283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b31480 0x562e28b49c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.404+0000 7f13d50ce740 1 -- 172.21.15.67:0/3399484283 >> 172.21.15.67:0/3399484283 conn(0x562e28b2f2b0 msgr2=0x562e28b392c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.405+0000 7f13d50ce740 1 -- 172.21.15.67:0/3399484283 shutdown_connections 2024-09-10T21:06:15.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.405+0000 7f13d50ce740 1 -- 172.21.15.67:0/3399484283 wait complete. 2024-09-10T21:06:15.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.406+0000 7f13d50ce740 1 -- start start 2024-09-10T21:06:15.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.406+0000 7f13d50ce740 1 Processor -- start 2024-09-10T21:06:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b3dd30 0x562e28b40c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc0725b0 con 0x562e28b31da0 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc073a20 con 0x562e28b31480 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc072c80 con 0x562e28b3dd30 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d50ce740 10 client.0 _ll_register_callbacks cb 0x7f13bc006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13d0a95640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57612/0 (socket says 172.21.15.67:57612) 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13cbfff640 1 -- 172.21.15.67:0/1756343045 learned_addr learned my addr 172.21.15.67:0/1756343045 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.407+0000 7f13cbfff640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b3dd30 0x562e28b40c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.408+0000 7f13cbfff640 1 -- 172.21.15.67:0/1756343045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b3dd30 msgr2=0x562e28b40c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.408+0000 7f13cbfff640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b3dd30 0x562e28b40c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.408+0000 7f13cbfff640 1 -- 172.21.15.67:0/1756343045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 msgr2=0x562e28b461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.408+0000 7f13cbfff640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.408+0000 7f13cbfff640 1 -- 172.21.15.67:0/1756343045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e28b46840 con 0x562e28b31480 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.409+0000 7f13d0a95640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.409+0000 7f13cbfff640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005c40 tx=0x7f13c004f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5342a6f12cedebd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.409+0000 7f13abfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.409+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0035030 con 0x562e28b31480 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.409+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c00047a0 con 0x562e28b31480 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.410+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f13c00039d0 con 0x562e28b31480 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.410+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13c0003bf0 con 0x562e28b31480 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.410+0000 7f13d50ce740 10 client.26885 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:15.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.410+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562e28bbaac0 con 0x562e28b31480 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c00047a0 con 0x562e28b31480 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13c0031710 con 0x562e28b31480 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 10 client.26885 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 10 client.26885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 20 client.26885 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28bbcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 4 client.26885 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:06:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.411+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e28aa9da0 con 0x562e28b4d770 2024-09-10T21:06:15.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.412+0000 7f13d0a95640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28bbcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.413+0000 7f13d0a95640 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28bbcd00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8554bf05e8415c65 server_cookie=699e1fd171ff1ba4 in_seq=0 out_seq=0 2024-09-10T21:06:15.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.413+0000 7f13abfff640 10 client.26885 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13abfff640 1 -- 172.21.15.67:0/1756343045 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x562e28aa9da0 con 0x562e28b4d770 2024-09-10T21:06:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13abfff640 10 client.26885 handle_command_reply: tid=0 2024-09-10T21:06:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 client.26885 shutdown 2024-09-10T21:06:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 msgr2=0x562e28b45c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f13c0005c40 tx=0x7f13c004f040 comp rx=0 tx=0).stop 2024-09-10T21:06:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 shutdown_connections 2024-09-10T21:06:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x562e28b4d770 0x562e28bbcd00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e28b3dd30 0x562e28b40c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13abfff640 0 client.26885 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.414+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x562e28b31da0 0x562e28b461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.415+0000 7f13d50ce740 1 --2- 172.21.15.67:0/1756343045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e28b31480 0x562e28b45c60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.415+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 >> 172.21.15.67:0/1756343045 conn(0x562e28b2f2b0 msgr2=0x562e28b301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.415+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 shutdown_connections 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.415+0000 7f13d50ce740 1 -- 172.21.15.67:0/1756343045 wait complete. 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.415+0000 7f13d50ce740 20 client.26885 trim_cache size 0 max 16384 2024-09-10T21:06:15.420 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.421 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.422 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.423 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.424 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.425 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.426 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "9e11199e-c064-436b-9d7c-aa344083de78": { 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:05:41.556434+0000", 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.427 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.428 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.429 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.430 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:06:15.431 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.432 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:06:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 msgr2=0x7f13b40b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 0x7f13b40b79b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f13c40a7740 tx=0x7f13c4014d00 comp rx=0 tx=0).stop 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 msgr2=0x7f13cc19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13c400b970 tx=0x7f13c400be30 comp rx=0 tx=0).stop 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 shutdown_connections 2024-09-10T21:06:15.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f13b40b54f0 0x7f13b40b79b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc107360 0x7f13cc19cb40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13cc1069e0 0x7f13cc1977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 --2- 172.21.15.67:0/2029424652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f13cc100fd0 0x7f13cc197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.416+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 >> 172.21.15.67:0/2029424652 conn(0x7f13cc0fca20 msgr2=0x7f13cc0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.417+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 shutdown_connections 2024-09-10T21:06:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:15.417+0000 7f13d2cf9640 1 -- 172.21.15.67:0/2029424652 wait complete. 2024-09-10T21:06:16.376 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:06:16.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:06:16.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:16 smithi067 ceph-mon[30891]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T21:06:16.829 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:16 smithi083 ceph-mon[35058]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T21:06:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:16 smithi172 ceph-mon[35265]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.496+0000 7f096730d640 1 -- 172.21.15.67:0/633420028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0960114810 msgr2=0x7f0960116c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.496+0000 7f096730d640 1 --2- 172.21.15.67:0/633420028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0960114810 0x7f0960116c60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0958009ca0 tx=0x7f095802a950 comp rx=0 tx=0).stop 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.497+0000 7f096730d640 1 -- 172.21.15.67:0/633420028 shutdown_connections 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.497+0000 7f096730d640 1 --2- 172.21.15.67:0/633420028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0960114810 0x7f0960116c60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.497+0000 7f096730d640 1 --2- 172.21.15.67:0/633420028 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f096010bb80 0x7f09601142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.497+0000 7f096730d640 1 --2- 172.21.15.67:0/633420028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010b260 0x7f096010b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.498+0000 7f096730d640 1 -- 172.21.15.67:0/633420028 >> 172.21.15.67:0/633420028 conn(0x7f096006dfc0 msgr2=0x7f096006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:17.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.498+0000 7f096730d640 1 -- 172.21.15.67:0/633420028 shutdown_connections 2024-09-10T21:06:17.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.498+0000 7f096730d640 1 -- 172.21.15.67:0/633420028 wait complete. 2024-09-10T21:06:17.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.499+0000 7f096730d640 1 Processor -- start 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 -- start start 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f096010b260 0x7f09601a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 0x7f09601a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f096011b580 con 0x7f0960114810 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f096011b400 con 0x7f096010b260 2024-09-10T21:06:17.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f096730d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f096011b700 con 0x7f096010bb80 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09658aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09648a8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 0x7f09601a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09648a8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 0x7f09601a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49374/0 (socket says 172.21.15.67:49374) 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09658aa640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33090/0 (socket says 172.21.15.67:33090) 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09648a8640 1 -- 172.21.15.67:0/1258686652 learned_addr learned my addr 172.21.15.67:0/1258686652 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:17.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.500+0000 7f09650a9640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f096010b260 0x7f09601a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 -- 172.21.15.67:0/1258686652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 msgr2=0x7f09601a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 0x7f09601a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 -- 172.21.15.67:0/1258686652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f096010b260 msgr2=0x7f09601a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f096010b260 0x7f09601a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 -- 172.21.15.67:0/1258686652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09601a7b00 con 0x7f0960114810 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09658aa640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f095802ae70 tx=0x7f0958031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958034040 con 0x7f0960114810 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09580308f0 con 0x7f0960114810 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09601a7d90 con 0x7f0960114810 2024-09-10T21:06:17.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095803ecd0 con 0x7f0960114810 2024-09-10T21:06:17.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.501+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09601177a0 con 0x7f0960114810 2024-09-10T21:06:17.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.503+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096010b640 con 0x7f0960114810 2024-09-10T21:06:17.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.504+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0958003b70 con 0x7f0960114810 2024-09-10T21:06:17.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.505+0000 7f09567fc640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 0x7f094c0b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:17.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.505+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0958106410 con 0x7f0960114810 2024-09-10T21:06:17.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.506+0000 7f09650a9640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 0x7f094c0b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:17.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.506+0000 7f09650a9640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 0x7f094c0b7890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f095c009bd0 tx=0x7f095c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:17.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.513+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f09580098b0 con 0x7f0960114810 2024-09-10T21:06:17.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.887+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0960117a30 con 0x7f0960114810 2024-09-10T21:06:17.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.887+0000 7f09567fc640 1 -- 172.21.15.67:0/1258686652 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f09580cd2a0 con 0x7f0960114810 2024-09-10T21:06:17.892 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:17.892 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:06:17.892 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:06:17.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.891+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 msgr2=0x7f094c0b7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.891+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 0x7f094c0b7890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f095c009bd0 tx=0x7f095c005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.891+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 msgr2=0x7f09601a7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.891+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f095802ae70 tx=0x7f0958031f40 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.891+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 shutdown_connections 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0960114810 0x7f09601a7330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f094c0b53d0 0x7f094c0b7890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f096010bb80 0x7f09601a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 --2- 172.21.15.67:0/1258686652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f096010b260 0x7f09601a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:17.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 >> 172.21.15.67:0/1258686652 conn(0x7f096006dfc0 msgr2=0x7f0960072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 shutdown_connections 2024-09-10T21:06:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:17.892+0000 7f096730d640 1 -- 172.21.15.67:0/1258686652 wait complete. 2024-09-10T21:06:18.531 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:18 smithi067 ceph-mon[30891]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-10T21:06:18.532 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:18 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1258686652' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:06:18.586 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:06:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:18 smithi083 ceph-mon[35058]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-10T21:06:18.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:18 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1258686652' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:06:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:18 smithi172 ceph-mon[35265]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-09-10T21:06:18.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:18 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1258686652' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:06:18.956 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:19.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 885.0 s, 1196.8 tps, lat 83.423 ms stddev 94.328 2024-09-10T21:06:19.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 -- 172.21.15.67:0/1071056929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b58109170 msgr2=0x7f6b5810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/1071056929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b58109170 0x7f6b5810f970 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009ca0 tx=0x7f6b5002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 -- 172.21.15.67:0/1071056929 shutdown_connections 2024-09-10T21:06:19.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/1071056929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b58109170 0x7f6b5810f970 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/1071056929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b581087f0 0x7f6b58108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/1071056929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58102de0 0x7f6b581031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 -- 172.21.15.67:0/1071056929 >> 172.21.15.67:0/1071056929 conn(0x7f6b580fe830 msgr2=0x7f6b58100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 -- 172.21.15.67:0/1071056929 shutdown_connections 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.543+0000 7f6b5eda0640 1 -- 172.21.15.67:0/1071056929 wait complete. 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.544+0000 7f6b5eda0640 1 Processor -- start 2024-09-10T21:06:19.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.544+0000 7f6b5eda0640 1 -- start start 2024-09-10T21:06:19.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.544+0000 7f6b5eda0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.544+0000 7f6b5eda0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 0x7f6b581997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5cb3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 0x7f6b581997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5cb3c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49382/0 (socket says 172.21.15.67:49382) 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 0x7f6b581997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33106/0 (socket says 172.21.15.67:33106) 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5eda0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5eda0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112df0 con 0x7f6b581087f0 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5eda0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112c70 con 0x7f6b58109170 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5eda0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112f70 con 0x7f6b58102de0 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:57656/0 (socket says 172.21.15.67:57656) 2024-09-10T21:06:19.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.545+0000 7f6b5d33d640 1 -- 172.21.15.67:0/3515496387 learned_addr learned my addr 172.21.15.67:0/3515496387 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 -- 172.21.15.67:0/3515496387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 msgr2=0x7f6b5819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 -- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 msgr2=0x7f6b581997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 0x7f6b581997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 -- 172.21.15.67:0/3515496387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5819f310 con 0x7f6b58102de0 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.546+0000 7f6b5cb3c640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00e9f0 tx=0x7f6b4c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.547+0000 7f6b55ffb640 1 -- 172.21.15.67:0/3515496387 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00ccc0 con 0x7f6b58102de0 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.547+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5819f600 con 0x7f6b58102de0 2024-09-10T21:06:19.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.547+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:19.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.547+0000 7f6b55ffb640 1 -- 172.21.15.67:0/3515496387 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4c0108e0 con 0x7f6b58102de0 2024-09-10T21:06:19.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.547+0000 7f6b55ffb640 1 -- 172.21.15.67:0/3515496387 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0188e0 con 0x7f6b58102de0 2024-09-10T21:06:19.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.548+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581a5e90 con 0x7f6b58102de0 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 Processor -- start 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 -- start start 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c525ea0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c5152d0 con 0x55fc8c5bbd80 2024-09-10T21:06:19.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b61175740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c5190e0 con 0x55fc8c5afdf0 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33122/0 (socket says 172.21.15.67:33122) 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b5d33d640 1 -- 172.21.15.67:0/357109813 learned_addr learned my addr 172.21.15.67:0/357109813 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.551+0000 7f6b57fff640 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b55ffb640 1 -- 172.21.15.67:0/3515496387 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f6b4c010430 con 0x7f6b58102de0 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 -- 172.21.15.67:0/357109813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 msgr2=0x55fc8c5bb840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5bb840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 -- 172.21.15.67:0/357109813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 msgr2=0x55fc8c5be170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5be170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 -- 172.21.15.67:0/357109813 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc8c273650 con 0x55fc8c5af4d0 2024-09-10T21:06:19.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.552+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b50004af0 tx=0x7f6b50009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d1cd84fed23a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.553+0000 7f6b42ffd640 1 -- 172.21.15.67:0/357109813 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50031d70 con 0x55fc8c5af4d0 2024-09-10T21:06:19.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.553+0000 7f6b42ffd640 1 -- 172.21.15.67:0/357109813 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b50036070 con 0x55fc8c5af4d0 2024-09-10T21:06:19.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.553+0000 7f6b55ffb640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 0x7f6b480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.554+0000 7f6b55ffb640 1 -- 172.21.15.67:0/3515496387 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6b4c0e5fa0 con 0x7f6b58102de0 2024-09-10T21:06:19.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.554+0000 7f6b61175740 1 -- 172.21.15.67:0/357109813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 msgr2=0x55fc8c5af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.554+0000 7f6b61175740 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6b50004af0 tx=0x7f6b50009880 comp rx=0 tx=0).stop 2024-09-10T21:06:19.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 -- 172.21.15.67:0/357109813 shutdown_connections 2024-09-10T21:06:19.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5be170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b5cb3c640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 0x7f6b480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 --2- 172.21.15.67:0/357109813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5af8b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 -- 172.21.15.67:0/357109813 >> 172.21.15.67:0/357109813 conn(0x55fc8c5ad300 msgr2=0x55fc8c5ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.555+0000 7f6b61175740 1 -- 172.21.15.67:0/357109813 shutdown_connections 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.556+0000 7f6b61175740 1 -- 172.21.15.67:0/357109813 wait complete. 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.556+0000 7f6b5cb3c640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 0x7f6b480b7820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0ac490 tx=0x7f6b4c0e3f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.556+0000 7f6b61175740 1 -- start start 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.556+0000 7f6b61175740 1 Processor -- start 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33130/0 (socket says 172.21.15.67:33130) 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b5d33d640 1 -- 172.21.15.67:0/3720297581 learned_addr learned my addr 172.21.15.67:0/3720297581 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c376700 con 0x55fc8c5af4d0 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c4b0160 con 0x55fc8c5bbd80 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fc8c5bea40 con 0x55fc8c5afdf0 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b57fff640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.557+0000 7f6b61175740 10 client.0 _ll_register_callbacks cb 0x55fc8c4c99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 -- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 msgr2=0x55fc8c5b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 -- 172.21.15.67:0/3720297581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 msgr2=0x55fc8c5bb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc8c4ddc90 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b57fff640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b89d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b440126d0 tx=0x7f6b44012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a31d59972b596fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b50036070 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b37fff640 10 client.26869 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b37fff640 1 -- 172.21.15.67:0/3720297581 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44011c70 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b37fff640 1 -- 172.21.15.67:0/3720297581 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6b44011e10 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b37fff640 1 -- 172.21.15.67:0/3720297581 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6b44004030 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b61175740 10 client.26869 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.558+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55fc8c5ca290 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b37fff640 1 -- 172.21.15.67:0/3720297581 <== mon.1 v2:172.21.15.172:3300/0 4 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6b440041d0 con 0x55fc8c5afdf0 2024-09-10T21:06:19.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 10 client.26869 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:19.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 10 client.26869 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:06:19.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 20 client.26869 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:19.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c5cb640 0x55fc8c5cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 4 client.26869 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:19.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.559+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc8c527df0 con 0x55fc8c5cb640 2024-09-10T21:06:19.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.560+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c5cb640 0x55fc8c5cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.560+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c5cb640 0x55fc8c5cdac0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c257446dd54127fc server_cookie=82f390a87d9b72 in_seq=0 out_seq=0 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.560+0000 7f6b37fff640 10 client.26869 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.560+0000 7f6b37fff640 1 -- 172.21.15.67:0/3720297581 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc8c527df0 con 0x55fc8c5cb640 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.560+0000 7f6b37fff640 10 client.26869 handle_command_reply: tid=0 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.561+0000 7f6b61175740 1 client.26869 shutdown 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.561+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 msgr2=0x55fc8c5b89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.561+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b89d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b440126d0 tx=0x7f6b44012b90 comp rx=0 tx=0).stop 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 shutdown_connections 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c5cb640 0x55fc8c5cdac0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b37fff640 0 client.26869 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b89d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 --2- 172.21.15.67:0/3720297581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5bb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 >> 172.21.15.67:0/3720297581 conn(0x55fc8c5ad300 msgr2=0x55fc8c5b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 shutdown_connections 2024-09-10T21:06:19.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 1 -- 172.21.15.67:0/3720297581 wait complete. 2024-09-10T21:06:19.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.563+0000 7f6b61175740 20 client.26869 trim_cache size 0 max 16384 2024-09-10T21:06:19.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 Processor -- start 2024-09-10T21:06:19.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 -- start start 2024-09-10T21:06:19.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581aea90 con 0x55fc8c5af4d0 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ac360 con 0x55fc8c5afdf0 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b61175740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581aa1b0 con 0x55fc8c5bbd80 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33140/0 (socket says 172.21.15.67:33140) 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b5d33d640 1 -- 172.21.15.67:0/2187916249 learned_addr learned my addr 172.21.15.67:0/2187916249 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b57fff640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.586+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 -- 172.21.15.67:0/2187916249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5bbd80 msgr2=0x55fc8c5b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 -- 172.21.15.67:0/2187916249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 msgr2=0x55fc8c5b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 -- 172.21.15.67:0/2187916249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc8c5add80 con 0x55fc8c5af4d0 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b57fff640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009620 tx=0x7f6b50005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d958d15e46d35040 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b427fc640 1 -- 172.21.15.67:0/2187916249 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50031d70 con 0x55fc8c5af4d0 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b427fc640 1 -- 172.21.15.67:0/2187916249 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b50031450 con 0x55fc8c5af4d0 2024-09-10T21:06:19.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.587+0000 7f6b427fc640 1 -- 172.21.15.67:0/2187916249 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5004fd60 con 0x55fc8c5af4d0 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 -- 172.21.15.67:0/2187916249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 msgr2=0x55fc8c5acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009620 tx=0x7f6b50005fb0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 -- 172.21.15.67:0/2187916249 shutdown_connections 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5bbd80 0x55fc8c5b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 --2- 172.21.15.67:0/2187916249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5acc10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 -- 172.21.15.67:0/2187916249 >> 172.21.15.67:0/2187916249 conn(0x55fc8c5ad300 msgr2=0x55fc8c5ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 -- 172.21.15.67:0/2187916249 shutdown_connections 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.588+0000 7f6b61175740 1 -- 172.21.15.67:0/2187916249 wait complete. 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 -- start start 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 Processor -- start 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c631640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581aa820 con 0x55fc8c5afdf0 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581abc90 con 0x55fc8c5bbd80 2024-09-10T21:06:19.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581aaef0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b61175740 10 client.0 _ll_register_callbacks cb 0x7f6b440097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b5d33d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33148/0 (socket says 172.21.15.67:33148) 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b57fff640 1 -- 172.21.15.67:0/4187024034 learned_addr learned my addr 172.21.15.67:0/4187024034 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.589+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c631640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 -- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 msgr2=0x55fc8c631640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c631640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 -- 172.21.15.67:0/4187024034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 msgr2=0x55fc8c5c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 -- 172.21.15.67:0/4187024034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc8c631d80 con 0x55fc8c5af4d0 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b57fff640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:19.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b5d33d640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5c0750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009d90 tx=0x7f6b5002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c72d1519a6850c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b37fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50031cf0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6b5004fae0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.590+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b50031450 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6b5004fce0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 10 client.26875 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fc8c6391e0 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b50031450 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6b5002f940 con 0x55fc8c5af4d0 2024-09-10T21:06:19.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 10 client.26875 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 10 client.26875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 20 client.26875 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c639460 0x55fc8c63b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 4 client.26875 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.591+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc8c5238a0 con 0x55fc8c639460 2024-09-10T21:06:19.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.592+0000 7f6b57fff640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c639460 0x55fc8c63b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b57fff640 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c639460 0x55fc8c63b850 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82ab76c8035aff64 server_cookie=67afd47b729050cd in_seq=0 out_seq=0 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b37fff640 10 client.26875 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b37fff640 1 -- 172.21.15.67:0/4187024034 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc8c5238a0 con 0x55fc8c639460 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b37fff640 10 client.26875 handle_command_reply: tid=0 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b61175740 1 client.26875 shutdown 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 msgr2=0x55fc8c5c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5c0750 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009d90 tx=0x7f6b5002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.594+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 shutdown_connections 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x55fc8c639460 0x55fc8c63b850 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fc8c5bbd80 0x55fc8c631640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b37fff640 0 client.26875 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55fc8c5afdf0 0x55fc8c5c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 --2- 172.21.15.67:0/4187024034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fc8c5af4d0 0x55fc8c5c0750 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 >> 172.21.15.67:0/4187024034 conn(0x55fc8c5ad300 msgr2=0x55fc8c5b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 shutdown_connections 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 1 -- 172.21.15.67:0/4187024034 wait complete. 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.595+0000 7f6b61175740 20 client.26875 trim_cache size 0 max 16384 2024-09-10T21:06:19.604 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 msgr2=0x7f6b480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 0x7f6b480b7820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0ac490 tx=0x7f6b4c0e3f90 comp rx=0 tx=0).stop 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 msgr2=0x7f6b58199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00e9f0 tx=0x7f6b4c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 shutdown_connections 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b58109170 0x7f6b5819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6b581087f0 0x7f6b581997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f6b480b5360 0x7f6b480b7820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 --2- 172.21.15.67:0/3515496387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58102de0 0x7f6b58199260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:19.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 >> 172.21.15.67:0/3515496387 conn(0x7f6b580fe830 msgr2=0x7f6b580ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:19.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 shutdown_connections 2024-09-10T21:06:19.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:19.596+0000 7f6b5eda0640 1 -- 172.21.15.67:0/3515496387 wait complete. 2024-09-10T21:06:20.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:06:20.789 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:20.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:20 smithi067 ceph-mon[30891]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-10T21:06:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:20 smithi083 ceph-mon[35058]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-10T21:06:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:20 smithi172 ceph-mon[35265]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 -- 172.21.15.67:0/372864413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed481076a0 msgr2=0x7fed48107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 --2- 172.21.15.67:0/372864413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed481076a0 0x7fed48107ae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009900 tx=0x7fed3c02a410 comp rx=0 tx=0).stop 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 -- 172.21.15.67:0/372864413 shutdown_connections 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 --2- 172.21.15.67:0/372864413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 --2- 172.21.15.67:0/372864413 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed481076a0 0x7fed48107ae0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 --2- 172.21.15.67:0/372864413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed48101c90 0x7fed48102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 -- 172.21.15.67:0/372864413 >> 172.21.15.67:0/372864413 conn(0x7fed480fd700 msgr2=0x7fed480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 -- 172.21.15.67:0/372864413 shutdown_connections 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.429+0000 7fed4e812640 1 -- 172.21.15.67:0/372864413 wait complete. 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.430+0000 7fed4e812640 1 Processor -- start 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.430+0000 7fed4e812640 1 -- start start 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.430+0000 7fed4e812640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.430+0000 7fed4e812640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed481076a0 0x7fed48199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4e812640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4e812640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed48111c70 con 0x7fed48101c90 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4e812640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed48111af0 con 0x7fed481076a0 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4e812640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed48111df0 con 0x7fed48108020 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33154/0 (socket says 172.21.15.67:33154) 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 -- 172.21.15.67:0/962963843 learned_addr learned my addr 172.21.15.67:0/962963843 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed477fe640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed481076a0 0x7fed48199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 -- 172.21.15.67:0/962963843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 msgr2=0x7fed4819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 -- 172.21.15.67:0/962963843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed481076a0 msgr2=0x7fed48199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed481076a0 0x7fed48199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 -- 172.21.15.67:0/962963843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4819f390 con 0x7fed48101c90 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.431+0000 7fed47fff640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fed3800d950 tx=0x7fed3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.432+0000 7fed457fa640 1 -- 172.21.15.67:0/962963843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38017030 con 0x7fed48101c90 2024-09-10T21:06:21.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.432+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4819f680 con 0x7fed48101c90 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.432+0000 7fed457fa640 1 -- 172.21.15.67:0/962963843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed38004020 con 0x7fed48101c90 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.432+0000 7fed457fa640 1 -- 172.21.15.67:0/962963843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380047a0 con 0x7fed48101c90 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.432+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed481a5f10 con 0x7fed48101c90 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.434+0000 7fed50be7740 1 Processor -- start 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.434+0000 7fed50be7740 1 -- start start 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa90d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b72a9f8ea0 con 0x55b72aa8e9a0 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b72a9e82d0 con 0x55b72aa82a10 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed50be7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b72a9ec0e0 con 0x55b72aa820f0 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49446/0 (socket says 172.21.15.67:49446) 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.435+0000 7fed4cdaf640 1 -- 172.21.15.67:0/2937565016 learned_addr learned my addr 172.21.15.67:0/2937565016 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.436+0000 7fed47fff640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.436+0000 7fed477fe640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 -- 172.21.15.67:0/2937565016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 msgr2=0x55b72aa8e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 -- 172.21.15.67:0/2937565016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 msgr2=0x55b72aa90d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa90d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 -- 172.21.15.67:0/2937565016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72a746650 con 0x55b72aa820f0 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed47fff640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fed40010710 tx=0x7fed40010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346c63361e1a08ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.437+0000 7fed457fa640 1 -- 172.21.15.67:0/962963843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fed38009a30 con 0x7fed48101c90 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.438+0000 7fed2e7fc640 1 -- 172.21.15.67:0/2937565016 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000e8d0 con 0x55b72aa820f0 2024-09-10T21:06:21.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.438+0000 7fed2e7fc640 1 -- 172.21.15.67:0/2937565016 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed40012450 con 0x55b72aa820f0 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.438+0000 7fed2e7fc640 1 -- 172.21.15.67:0/2937565016 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40011640 con 0x55b72aa820f0 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed457fa640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 0x7fed300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed47fff640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 0x7fed300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed457fa640 1 -- 172.21.15.67:0/962963843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fed380e5640 con 0x7fed48101c90 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 -- 172.21.15.67:0/2937565016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 msgr2=0x55b72aa824d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fed40010710 tx=0x7fed40010bd0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed47fff640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 0x7fed300b7820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed380abd60 tx=0x7fed38000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 -- 172.21.15.67:0/2937565016 shutdown_connections 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa90d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 --2- 172.21.15.67:0/2937565016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa824d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.439+0000 7fed50be7740 1 -- 172.21.15.67:0/2937565016 >> 172.21.15.67:0/2937565016 conn(0x55b72aa7ff20 msgr2=0x55b72aa810c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.440+0000 7fed50be7740 1 -- 172.21.15.67:0/2937565016 shutdown_connections 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.440+0000 7fed50be7740 1 -- 172.21.15.67:0/2937565016 wait complete. 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.440+0000 7fed50be7740 1 -- start start 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.440+0000 7fed50be7740 1 Processor -- start 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.440+0000 7fed50be7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b72a849700 con 0x55b72aa8e9a0 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b72a983160 con 0x55b72aa82a10 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b72aa91670 con 0x55b72aa820f0 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed50be7740 10 client.0 _ll_register_callbacks cb 0x55b72a99c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:49458/0 (socket says 172.21.15.67:49458) 2024-09-10T21:06:21.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 -- 172.21.15.67:0/3876344197 learned_addr learned my addr 172.21.15.67:0/3876344197 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed477fe640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 -- 172.21.15.67:0/3876344197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 msgr2=0x55b72aa8b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 -- 172.21.15.67:0/3876344197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 msgr2=0x55b72aa8bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 -- 172.21.15.67:0/3876344197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72a9b0c90 con 0x55b72aa820f0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed40012cf0 tx=0x7fed40012df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9667c26692b582d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.441+0000 7fed277fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.442+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40004a40 con 0x55b72aa820f0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.442+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fed40004be0 con 0x55b72aa820f0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.442+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed40012450 con 0x55b72aa820f0 2024-09-10T21:06:21.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.443+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed40031050 con 0x55b72aa820f0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.443+0000 7fed50be7740 10 client.26887 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.443+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b72aa9cfd0 con 0x55b72aa820f0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.443+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed40012450 con 0x55b72aa820f0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.443+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fed4000f040 con 0x55b72aa820f0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 10 client.26887 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 10 client.26887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 20 client.26887 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72aa9e700 0x55b72aaa0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 4 client.26887 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b72a9fadf0 con 0x55b72aa9e700 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed477fe640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72aa9e700 0x55b72aaa0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.444+0000 7fed277fe640 10 client.26887 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.445+0000 7fed477fe640 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72aa9e700 0x55b72aaa0b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ecd3b56acb16fde server_cookie=93da4f93f3d61ffc in_seq=0 out_seq=0 2024-09-10T21:06:21.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.445+0000 7fed277fe640 1 -- 172.21.15.67:0/3876344197 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b72a9fadf0 con 0x55b72aa9e700 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.445+0000 7fed277fe640 10 client.26887 handle_command_reply: tid=0 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 client.26887 shutdown 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 msgr2=0x55b72aa8e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fed40012cf0 tx=0x7fed40012df0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 shutdown_connections 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72aa9e700 0x55b72aaa0b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa82a10 0x55b72aa8b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 --2- 172.21.15.67:0/3876344197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa820f0 0x55b72aa8e260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 >> 172.21.15.67:0/3876344197 conn(0x55b72aa7ff20 msgr2=0x55b72aa85a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed277fe640 0 client.26887 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 shutdown_connections 2024-09-10T21:06:21.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 1 -- 172.21.15.67:0/3876344197 wait complete. 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.446+0000 7fed50be7740 20 client.26887 trim_cache size 0 max 16384 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.464+0000 7fed50be7740 1 Processor -- start 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.464+0000 7fed50be7740 1 -- start start 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.464+0000 7fed50be7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.464+0000 7fed50be7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 0x55b72aa89f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed50be7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed50be7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed481aea70 con 0x55b72aa820f0 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed50be7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed481ac340 con 0x55b72aa8e9a0 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed50be7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed481aa1b0 con 0x55b72aa82a10 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33186/0 (socket says 172.21.15.67:33186) 2024-09-10T21:06:21.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed4cdaf640 1 -- 172.21.15.67:0/3487073431 learned_addr learned my addr 172.21.15.67:0/3487073431 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 0x55b72aa89f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 -- 172.21.15.67:0/3487073431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa8e9a0 msgr2=0x55b72aa8a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 -- 172.21.15.67:0/3487073431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 msgr2=0x55b72aa9a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 -- 172.21.15.67:0/3487073431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72aa8c000 con 0x55b72aa82a10 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.465+0000 7fed477fe640 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 0x55b72aa89f30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009230 tx=0x7fed3c005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57113d3ffd54d468 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.468+0000 7fed2dffb640 1 -- 172.21.15.67:0/3487073431 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c04f070 con 0x55b72aa82a10 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.468+0000 7fed2dffb640 1 -- 172.21.15.67:0/3487073431 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed3c0054f0 con 0x55b72aa82a10 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.468+0000 7fed2dffb640 1 -- 172.21.15.67:0/3487073431 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c035040 con 0x55b72aa82a10 2024-09-10T21:06:21.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- 172.21.15.67:0/3487073431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 msgr2=0x55b72aa89f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 0x55b72aa89f30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009230 tx=0x7fed3c005c00 comp rx=0 tx=0).stop 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- 172.21.15.67:0/3487073431 shutdown_connections 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa8e9a0 0x55b72aa8a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa82a10 0x55b72aa89f30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 --2- 172.21.15.67:0/3487073431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa820f0 0x55b72aa9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- 172.21.15.67:0/3487073431 >> 172.21.15.67:0/3487073431 conn(0x55b72aa7ff20 msgr2=0x55b72aa869b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- 172.21.15.67:0/3487073431 shutdown_connections 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- 172.21.15.67:0/3487073431 wait complete. 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.469+0000 7fed50be7740 1 -- start start 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 Processor -- start 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 0x55b72aa96f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa8e9a0 0x55b72aa888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed481aa800 con 0x55b72aa82a10 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed481abc70 con 0x55b72aa820f0 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed481aaed0 con 0x55b72aa8e9a0 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed50be7740 10 client.0 _ll_register_callbacks cb 0x7fed40016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.470+0000 7fed477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 0x55b72aa96f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa8e9a0 0x55b72aa888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed477fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33200/0 (socket says 172.21.15.67:33200) 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed477fe640 1 -- 172.21.15.67:0/61210078 learned_addr learned my addr 172.21.15.67:0/61210078 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 -- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa8e9a0 msgr2=0x55b72aa888c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa8e9a0 0x55b72aa888c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 -- 172.21.15.67:0/61210078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 msgr2=0x55b72aa88380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.471+0000 7fed4cdaf640 1 -- 172.21.15.67:0/61210078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72aa88f30 con 0x55b72aa820f0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed477fe640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed4cdaf640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 0x55b72aa96f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed40011010 tx=0x7fed4002efe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca60743e5b60f5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed277fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40012e60 con 0x55b72aa820f0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fed400049a0 con 0x55b72aa820f0 2024-09-10T21:06:21.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed3c0054f0 con 0x55b72aa820f0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed40020040 con 0x55b72aa820f0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.472+0000 7fed50be7740 10 client.26921 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b72ab0b640 con 0x55b72aa820f0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed40021040 con 0x55b72aa820f0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fed40041070 con 0x55b72aa820f0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 10 client.26921 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 10 client.26921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 20 client.26921 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72ab0ba60 0x55b72ab0de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 4 client.26921 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fed3c0054f0 con 0x55b72ab0ba60 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.473+0000 7fed477fe640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72ab0ba60 0x55b72ab0de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:21.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.474+0000 7fed277fe640 10 client.26921 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.474+0000 7fed477fe640 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72ab0ba60 0x55b72ab0de50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31677a46bb7c6380 server_cookie=ac869f3dc2693e6f in_seq=0 out_seq=0 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.474+0000 7fed277fe640 1 -- 172.21.15.67:0/61210078 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fed3c0054f0 con 0x55b72ab0ba60 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.474+0000 7fed277fe640 10 client.26921 handle_command_reply: tid=0 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.474+0000 7fed50be7740 1 client.26921 shutdown 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 msgr2=0x55b72aa96f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 0x55b72aa96f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fed40011010 tx=0x7fed4002efe0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 shutdown_connections 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x55b72ab0ba60 0x55b72ab0de50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed277fe640 0 client.26921 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b72aa8e9a0 0x55b72aa888c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b72aa82a10 0x55b72aa88380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 --2- 172.21.15.67:0/61210078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b72aa820f0 0x55b72aa96f50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 >> 172.21.15.67:0/61210078 conn(0x55b72aa7ff20 msgr2=0x55b72aa89eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 shutdown_connections 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 1 -- 172.21.15.67:0/61210078 wait complete. 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.475+0000 7fed50be7740 20 client.26921 trim_cache size 0 max 16384 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 msgr2=0x7fed300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 0x7fed300b7820 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed380abd60 tx=0x7fed38000bc0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 msgr2=0x7fed481992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fed3800d950 tx=0x7fed3800de10 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 shutdown_connections 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fed300b5360 0x7fed300b7820 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed48108020 0x7fed4819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed481076a0 0x7fed48199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 --2- 172.21.15.67:0/962963843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed48101c90 0x7fed481992e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 >> 172.21.15.67:0/962963843 conn(0x7fed480fd700 msgr2=0x7fed48100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 shutdown_connections 2024-09-10T21:06:21.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:21.476+0000 7fed4e812640 1 -- 172.21.15.67:0/962963843 wait complete. 2024-09-10T21:06:22.705 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:06:22.731 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:22 smithi067 ceph-mon[30891]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.3 MiB/s wr, 661 op/s 2024-09-10T21:06:22.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:22 smithi083 ceph-mon[35058]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.3 MiB/s wr, 661 op/s 2024-09-10T21:06:22.952 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:22 smithi172 ceph-mon[35265]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 9.3 MiB/s wr, 661 op/s 2024-09-10T21:06:23.095 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 -- 172.21.15.67:0/1868173958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410a3b0 msgr2=0x7f2c3410a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 --2- 172.21.15.67:0/1868173958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410a3b0 0x7f2c3410a790 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009860 tx=0x7f2c2802a360 comp rx=0 tx=0).stop 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 -- 172.21.15.67:0/1868173958 shutdown_connections 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 --2- 172.21.15.67:0/1868173958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410fb90 0x7f2c34116370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 --2- 172.21.15.67:0/1868173958 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c3410f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 --2- 172.21.15.67:0/1868173958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410a3b0 0x7f2c3410a790 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.670+0000 7f2c3af51640 1 -- 172.21.15.67:0/1868173958 >> 172.21.15.67:0/1868173958 conn(0x7f2c3406e2e0 msgr2=0x7f2c3406e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.672+0000 7f2c3af51640 1 -- 172.21.15.67:0/1868173958 shutdown_connections 2024-09-10T21:06:23.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.672+0000 7f2c3af51640 1 -- 172.21.15.67:0/1868173958 wait complete. 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.673+0000 7f2c3af51640 1 Processor -- start 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 -- start start 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 0x7f2c34120280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 0x7f2c34119650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34121c30 con 0x7f2c3410a3b0 2024-09-10T21:06:23.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34121ab0 con 0x7f2c3410f210 2024-09-10T21:06:23.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.674+0000 7f2c3af51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c34121db0 con 0x7f2c3410fb90 2024-09-10T21:06:23.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48464/0 (socket says 172.21.15.67:48464) 2024-09-10T21:06:23.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c33fff640 1 -- 172.21.15.67:0/4021132985 learned_addr learned my addr 172.21.15.67:0/4021132985 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:23.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c38ced640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 0x7f2c34120280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c33fff640 1 -- 172.21.15.67:0/4021132985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 msgr2=0x7f2c34119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.679+0000 7f2c394ee640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 0x7f2c34119650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.680+0000 7f2c33fff640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 0x7f2c34119650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.680+0000 7f2c33fff640 1 -- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 msgr2=0x7f2c34120280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.680+0000 7f2c33fff640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 0x7f2c34120280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.680+0000 7f2c33fff640 1 -- 172.21.15.67:0/4021132985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34119f10 con 0x7f2c3410f210 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.680+0000 7f2c33fff640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d950 tx=0x7f2c2c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.681+0000 7f2c38ced640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 0x7f2c34120280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.681+0000 7f2c394ee640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 0x7f2c34119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:23.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.681+0000 7f2c31ffb640 1 -- 172.21.15.67:0/4021132985 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c017070 con 0x7f2c3410f210 2024-09-10T21:06:23.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.681+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3411a200 con 0x7f2c3410f210 2024-09-10T21:06:23.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.682+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3411f170 con 0x7f2c3410f210 2024-09-10T21:06:23.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.683+0000 7f2c31ffb640 1 -- 172.21.15.67:0/4021132985 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2c009c30 con 0x7f2c3410f210 2024-09-10T21:06:23.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.684+0000 7f2c31ffb640 1 -- 172.21.15.67:0/4021132985 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00f620 con 0x7f2c3410f210 2024-09-10T21:06:23.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.686+0000 7f2c31ffb640 1 -- 172.21.15.67:0/4021132985 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f2c2c00f7c0 con 0x7f2c3410f210 2024-09-10T21:06:23.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.690+0000 7f2c31ffb640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 0x7f2c1c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.691+0000 7f2c31ffb640 1 -- 172.21.15.67:0/4021132985 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c2c0e6790 con 0x7f2c3410f210 2024-09-10T21:06:23.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.692+0000 7f2c3d326740 1 Processor -- start 2024-09-10T21:06:23.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.692+0000 7f2c3d326740 1 -- start start 2024-09-10T21:06:23.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.693+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.693+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfe7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.695+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.696+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48468/0 (socket says 172.21.15.67:48468) 2024-09-10T21:06:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.696+0000 7f2c38ced640 1 -- 172.21.15.67:0/39454079 learned_addr learned my addr 172.21.15.67:0/39454079 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.696+0000 7f2c3d326740 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.696+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b34bf51ea0 con 0x55b34bfdba10 2024-09-10T21:06:23.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.696+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b34bf412d0 con 0x55b34bfdb0f0 2024-09-10T21:06:23.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.697+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b34bf450e0 con 0x55b34bfe79a0 2024-09-10T21:06:23.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.698+0000 7f2c33fff640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfe7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.698+0000 7f2c394ee640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.699+0000 7f2c394ee640 1 -- 172.21.15.67:0/39454079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 msgr2=0x55b34bfdb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.699+0000 7f2c394ee640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.699+0000 7f2c394ee640 1 -- 172.21.15.67:0/39454079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 msgr2=0x55b34bfe7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.699+0000 7f2c394ee640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfe7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.699+0000 7f2c394ee640 1 -- 172.21.15.67:0/39454079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b34bc9f650 con 0x55b34bfe79a0 2024-09-10T21:06:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.700+0000 7f2c38ced640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:06:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.700+0000 7f2c38ced640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 0x7f2c1c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.701+0000 7f2c394ee640 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe9d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2c24007e50 tx=0x7f2c2400c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8601ba651ee3e532 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.702+0000 7f2c1affd640 1 -- 172.21.15.67:0/39454079 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24014070 con 0x55b34bfe79a0 2024-09-10T21:06:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.702+0000 7f2c1affd640 1 -- 172.21.15.67:0/39454079 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2400fad0 con 0x55b34bfe79a0 2024-09-10T21:06:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.702+0000 7f2c1affd640 1 -- 172.21.15.67:0/39454079 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400ec10 con 0x55b34bfe79a0 2024-09-10T21:06:23.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.703+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 msgr2=0x55b34bfe9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.704+0000 7f2c3d326740 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe9d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2c24007e50 tx=0x7f2c2400c670 comp rx=0 tx=0).stop 2024-09-10T21:06:23.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.705+0000 7f2c38ced640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 0x7f2c1c0b79a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009780 tx=0x7f2c28000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 shutdown_connections 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe9d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfe7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 --2- 172.21.15.67:0/39454079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfdb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 >> 172.21.15.67:0/39454079 conn(0x55b34bfd8f20 msgr2=0x55b34bfda0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 shutdown_connections 2024-09-10T21:06:23.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.706+0000 7f2c3d326740 1 -- 172.21.15.67:0/39454079 wait complete. 2024-09-10T21:06:23.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.707+0000 7f2c3d326740 1 -- start start 2024-09-10T21:06:23.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.707+0000 7f2c3d326740 1 Processor -- start 2024-09-10T21:06:23.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.708+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfe70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.708+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfe70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfe70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48478/0 (socket says 172.21.15.67:48478) 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:53956/0 (socket says 172.21.15.67:53956) 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c33fff640 1 -- 172.21.15.67:0/685257683 learned_addr learned my addr 172.21.15.67:0/685257683 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfe79a0 0x55b34bfe4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x55b34bda2700 con 0x55b34bfe79a0 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.709+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55b34bedc160 con 0x55b34bfdb0f0 2024-09-10T21:06:23.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.710+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b34bfea670 con 0x55b34bfdba10 2024-09-10T21:06:23.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.710+0000 7f2c3d326740 10 client.0 _ll_register_callbacks cb 0x55b34bef59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.712+0000 7f2c33fff640 1 -- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 msgr2=0x55b34bfe70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.712+0000 7f2c33fff640 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfe70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.712+0000 7f2c33fff640 1 -- 172.21.15.67:0/685257683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfe79a0 msgr2=0x55b34bfe4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.712+0000 7f2c33fff640 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfe79a0 0x55b34bfe4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.712+0000 7f2c33fff640 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b34bf09c90 con 0x55b34bfdba10 2024-09-10T21:06:23.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.713+0000 7f2c33fff640 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0acc20 tx=0x7f2c2c0a9420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f70e45efbb4ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.715+0000 7f2c13fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-10T21:06:23.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.715+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c020040 con 0x55b34bfdba10 2024-09-10T21:06:23.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.716+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c2c0981b0 con 0x55b34bfdba10 2024-09-10T21:06:23.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.716+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2400fad0 con 0x55b34bfdba10 2024-09-10T21:06:23.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.717+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c2c0acf20 con 0x55b34bfdba10 2024-09-10T21:06:23.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.717+0000 7f2c3d326740 10 client.26902 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:23.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.717+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b34bff5f00 con 0x55b34bfdba10 2024-09-10T21:06:23.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2c0b1a00 con 0x55b34bfdba10 2024-09-10T21:06:23.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2c2c0b0070 con 0x55b34bfdba10 2024-09-10T21:06:23.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 10 client.26902 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 10 client.26902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 20 client.26902 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34bff73c0 0x55b34bff97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 4 client.26902 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2c2400fad0 con 0x55b34bff73c0 2024-09-10T21:06:23.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.718+0000 7f2c38ced640 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34bff73c0 0x55b34bff97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.723+0000 7f2c38ced640 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34bff73c0 0x55b34bff97b0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9510c62cac7ad05 server_cookie=d4c5913e1a7220a9 in_seq=0 out_seq=0 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.723+0000 7f2c13fff640 10 client.26902 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.724+0000 7f2c13fff640 1 -- 172.21.15.67:0/685257683 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2c2400fad0 con 0x55b34bff73c0 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.724+0000 7f2c13fff640 10 client.26902 handle_command_reply: tid=0 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.724+0000 7f2c3d326740 1 client.26902 shutdown 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 msgr2=0x55b34bfe45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0acc20 tx=0x7f2c2c0a9420 comp rx=0 tx=0).stop 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 shutdown_connections 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34bff73c0 0x55b34bff97b0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfe79a0 0x55b34bfe4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfdba10 0x55b34bfe45c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 --2- 172.21.15.67:0/685257683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bfe70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 >> 172.21.15.67:0/685257683 conn(0x55b34bfd8f20 msgr2=0x55b34bfdea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c13fff640 0 client.26902 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 shutdown_connections 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 1 -- 172.21.15.67:0/685257683 wait complete. 2024-09-10T21:06:23.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.725+0000 7f2c3d326740 20 client.26902 trim_cache size 0 max 16384 2024-09-10T21:06:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.752+0000 7f2c3d326740 1 Processor -- start 2024-09-10T21:06:23.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.752+0000 7f2c3d326740 1 -- start start 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdb0f0 0x55b34bfda310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48494/0 (socket says 172.21.15.67:48494) 2024-09-10T21:06:23.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c33fff640 1 -- 172.21.15.67:0/3900270570 learned_addr learned my addr 172.21.15.67:0/3900270570 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c20010d70 con 0x55b34bfdb0f0 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2000e640 con 0x55b34bfdba10 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c394ee640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2000c490 con 0x55b34bfe79a0 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.753+0000 7f2c38ced640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdb0f0 0x55b34bfda310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 -- 172.21.15.67:0/3900270570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 msgr2=0x55b34bfe1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 -- 172.21.15.67:0/3900270570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdb0f0 msgr2=0x55b34bfda310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdb0f0 0x55b34bfda310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 -- 172.21.15.67:0/3900270570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b34bfea100 con 0x55b34bfdba10 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c394ee640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c33fff640 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b2ce0 tx=0x7f2c2c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d9b5e2a10381da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c1a7fc640 1 -- 172.21.15.67:0/3900270570 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c020040 con 0x55b34bfdba10 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c1a7fc640 1 -- 172.21.15.67:0/3900270570 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2c014030 con 0x55b34bfdba10 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.754+0000 7f2c1a7fc640 1 -- 172.21.15.67:0/3900270570 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c0abdf0 con 0x55b34bfdba10 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 msgr2=0x55b34bfe17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0b2ce0 tx=0x7f2c2c00bf60 comp rx=0 tx=0).stop 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 shutdown_connections 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfe1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdba10 0x55b34bfe17d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.755+0000 7f2c3d326740 1 --2- 172.21.15.67:0/3900270570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdb0f0 0x55b34bfda310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.756+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 >> 172.21.15.67:0/3900270570 conn(0x55b34bfd8f20 msgr2=0x55b34bfd9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.756+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 shutdown_connections 2024-09-10T21:06:23.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.756+0000 7f2c3d326740 1 -- 172.21.15.67:0/3900270570 wait complete. 2024-09-10T21:06:23.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.756+0000 7f2c3d326740 1 -- start start 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c3d326740 1 Processor -- start 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c38ced640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48500/0 (socket says 172.21.15.67:48500) 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.757+0000 7f2c3d326740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfeccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 -- 172.21.15.67:0/818185593 learned_addr learned my addr 172.21.15.67:0/818185593 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2000cb00 con 0x55b34bfdba10 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2000df70 con 0x55b34bfdb0f0 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2000d1d0 con 0x55b34bfe79a0 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c3d326740 10 client.0 _ll_register_callbacks cb 0x7f2c2c0accf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c33fff640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 -- 172.21.15.67:0/818185593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 msgr2=0x55b34bfeccd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:06:23.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfeccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 -- 172.21.15.67:0/818185593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 msgr2=0x55b34bfec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:23.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.758+0000 7f2c38ced640 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b34bfe7440 con 0x55b34bfdb0f0 2024-09-10T21:06:23.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.761+0000 7f2c38ced640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c28030460 tx=0x7f2c28005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1469477d4604395e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:23.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.761+0000 7f2c13fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:06:23.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28042040 con 0x55b34bfdb0f0 2024-09-10T21:06:23.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c28003dd0 con 0x55b34bfdb0f0 2024-09-10T21:06:23.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2c014030 con 0x55b34bfdb0f0 2024-09-10T21:06:23.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c28037070 con 0x55b34bfdb0f0 2024-09-10T21:06:23.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c3d326740 10 client.26936 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:23.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.762+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b34c065130 con 0x55b34bfdb0f0 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2c014030 con 0x55b34bfdb0f0 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2c28048040 con 0x55b34bfdb0f0 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 10 client.26936 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 10 client.26936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 20 client.26936 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34c065910 0x55b34c067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 4 client.26936 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b34bf53df0 con 0x55b34c065910 2024-09-10T21:06:23.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.763+0000 7f2c33fff640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34c065910 0x55b34c067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:23.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c33fff640 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34c065910 0x55b34c067d30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96de9b5785dba4a server_cookie=30bba4851b6e52bb in_seq=0 out_seq=0 2024-09-10T21:06:23.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c13fff640 10 client.26936 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:23.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c13fff640 1 -- 172.21.15.67:0/818185593 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b34bf53df0 con 0x55b34c065910 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c13fff640 10 client.26936 handle_command_reply: tid=0 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c3d326740 1 client.26936 shutdown 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 msgr2=0x55b34bff01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c28030460 tx=0x7f2c28005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 shutdown_connections 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.764+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x55b34c065910 0x55b34c067d30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c13fff640 0 client.26936 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b34bfe79a0 0x55b34bfeccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x55b34bfdba10 0x55b34bfec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 --2- 172.21.15.67:0/818185593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b34bfdb0f0 0x55b34bff01e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 >> 172.21.15.67:0/818185593 conn(0x55b34bfd8f20 msgr2=0x55b34bfe6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 shutdown_connections 2024-09-10T21:06:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.765+0000 7f2c3d326740 1 -- 172.21.15.67:0/818185593 wait complete. 2024-09-10T21:06:23.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.766+0000 7f2c3d326740 20 client.26936 trim_cache size 0 max 16384 2024-09-10T21:06:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:06:23.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.766+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 msgr2=0x7f2c1c0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.766+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 0x7f2c1c0b79a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009780 tx=0x7f2c28000bc0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.766+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 msgr2=0x7f2c341207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.766+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00d950 tx=0x7f2c2c00de10 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 shutdown_connections 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f2c1c0b54e0 0x7f2c1c0b79a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c3410fb90 0x7f2c34119650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c3410f210 0x7f2c341207c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 --2- 172.21.15.67:0/4021132985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2c3410a3b0 0x7f2c34120280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 >> 172.21.15.67:0/4021132985 conn(0x7f2c3406e2e0 msgr2=0x7f2c34073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 shutdown_connections 2024-09-10T21:06:23.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:23.767+0000 7f2c3af51640 1 -- 172.21.15.67:0/4021132985 wait complete. 2024-09-10T21:06:24.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 890.0 s, 1340.8 tps, lat 75.411 ms stddev 86.264 2024-09-10T21:06:24.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:24 smithi067 ceph-mon[30891]: pgmap v793: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 12 MiB/s wr, 711 op/s 2024-09-10T21:06:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:24 smithi083 ceph-mon[35058]: pgmap v793: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 12 MiB/s wr, 711 op/s 2024-09-10T21:06:24.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:24 smithi172 ceph-mon[35265]: pgmap v793: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 12 MiB/s wr, 711 op/s 2024-09-10T21:06:25.490 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:06:25.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:06:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:26.543 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:26 smithi067 ceph-mon[30891]: pgmap v794: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 723 op/s 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 -- 172.21.15.67:0/3502707720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 msgr2=0x7f00a811e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 --2- 172.21.15.67:0/3502707720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a811e490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009be0 tx=0x7f00a002a750 comp rx=0 tx=0).stop 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 -- 172.21.15.67:0/3502707720 shutdown_connections 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 --2- 172.21.15.67:0/3502707720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a811e490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 --2- 172.21.15.67:0/3502707720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a530 0x7f00a810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 --2- 172.21.15.67:0/3502707720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a150 0x7f00a81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 -- 172.21.15.67:0/3502707720 >> 172.21.15.67:0/3502707720 conn(0x7f00a806dfc0 msgr2=0x7f00a806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 -- 172.21.15.67:0/3502707720 shutdown_connections 2024-09-10T21:06:26.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 -- 172.21.15.67:0/3502707720 wait complete. 2024-09-10T21:06:26.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.542+0000 7f00afff8640 1 Processor -- start 2024-09-10T21:06:26.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 -- start start 2024-09-10T21:06:26.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 0x7f00a81a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 0x7f00a81a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a81ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8121b60 con 0x7f00a810a530 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81219e0 con 0x7f00a811c0a0 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00afff8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8121ce0 con 0x7f00a810a150 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00ad593640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 0x7f00a81a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 0x7f00a81a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00ad593640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 0x7f00a81a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41960/0 (socket says 172.21.15.67:41960) 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00ae595640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a81ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00ad593640 1 -- 172.21.15.67:0/1748952749 learned_addr learned my addr 172.21.15.67:0/1748952749 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 -- 172.21.15.67:0/1748952749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 msgr2=0x7f00a81ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a81ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 -- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 msgr2=0x7f00a81a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 0x7f00a81a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00add94640 1 -- 172.21.15.67:0/1748952749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a81ae0a0 con 0x7f00a810a150 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.543+0000 7f00ae595640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a81ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f00add94640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 0x7f00a81a7ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f009800e9f0 tx=0x7f009800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f009effd640 1 -- 172.21.15.67:0/1748952749 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009800ccc0 con 0x7f00a810a150 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a81ae390 con 0x7f00a810a150 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f009effd640 1 -- 172.21.15.67:0/1748952749 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980108e0 con 0x7f00a810a150 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f009effd640 1 -- 172.21.15.67:0/1748952749 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098018880 con 0x7f00a810a150 2024-09-10T21:06:26.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.544+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81b4c20 con 0x7f00a810a150 2024-09-10T21:06:26.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.548+0000 7f00b23cd740 1 Processor -- start 2024-09-10T21:06:26.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.549+0000 7f00b23cd740 1 -- start start 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff62fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6308250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ff6272e60 con 0x563ff62fbee0 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563ff6262290 con 0x563ff62fc800 2024-09-10T21:06:26.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00b23cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ff62660a0 con 0x563ff6308790 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f009effd640 1 -- 172.21.15.67:0/1748952749 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f0098010430 con 0x7f00a810a150 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ae595640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff62fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:54002/0 (socket says 172.21.15.67:54002) 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00add94640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6308250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 -- 172.21.15.67:0/3716473097 learned_addr learned my addr 172.21.15.67:0/3716473097 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 -- 172.21.15.67:0/3716473097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 msgr2=0x563ff6308250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6308250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 -- 172.21.15.67:0/3716473097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 msgr2=0x563ff62fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff62fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 -- 172.21.15.67:0/3716473097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff5fc0930 con 0x563ff6308790 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.550+0000 7f00ad593640 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009d80 tx=0x7f00a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98b77b20094818f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f0093fff640 1 -- 172.21.15.67:0/3716473097 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a401e070 con 0x563ff6308790 2024-09-10T21:06:26.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f0093fff640 1 -- 172.21.15.67:0/3716473097 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a4019ae0 con 0x563ff6308790 2024-09-10T21:06:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f009effd640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 0x7f00940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f0093fff640 1 -- 172.21.15.67:0/3716473097 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a400eb30 con 0x563ff6308790 2024-09-10T21:06:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f009effd640 1 -- 172.21.15.67:0/1748952749 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f00980e5ec0 con 0x7f00a810a150 2024-09-10T21:06:26.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.551+0000 7f00ae595640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 0x7f00940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 -- 172.21.15.67:0/3716473097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 msgr2=0x563ff630ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f00a4009d80 tx=0x7f00a4011810 comp rx=0 tx=0).stop 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00ae595640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 0x7f00940b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006010 tx=0x7f00a0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 -- 172.21.15.67:0/3716473097 shutdown_connections 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff630ab80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6308250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 --2- 172.21.15.67:0/3716473097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff62fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.552+0000 7f00b23cd740 1 -- 172.21.15.67:0/3716473097 >> 172.21.15.67:0/3716473097 conn(0x563ff62f9d10 msgr2=0x563ff62faeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 -- 172.21.15.67:0/3716473097 shutdown_connections 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 -- 172.21.15.67:0/3716473097 wait complete. 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 -- start start 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 Processor -- start 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 0x563ff63056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.553+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff6306130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x563ff60c3890 con 0x563ff62fc800 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x563ff61fcd40 con 0x563ff62fbee0 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ff630b4e0 con 0x563ff6308790 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 10 client.0 _ll_register_callbacks cb 0x563ff6260c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41978/0 (socket says 172.21.15.67:41978) 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 -- 172.21.15.67:0/1189229507 learned_addr learned my addr 172.21.15.67:0/1189229507 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00add94640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 0x563ff63056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ae595640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff6306130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 -- 172.21.15.67:0/1189229507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 msgr2=0x563ff6306130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff6306130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 -- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 msgr2=0x563ff63056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 0x563ff63056b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 -- 172.21.15.67:0/1189229507 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff6314860 con 0x563ff62fc800 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00add94640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 0x563ff63056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00ad593640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e7d0 tx=0x7f00a4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd8a99af36cb04e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00917fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4026030 con 0x563ff62fc800 2024-09-10T21:06:26.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f00a4019700 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.554+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a4019ae0 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f00a401e040 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 10 client.17250 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563ff6317210 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a4019ae0 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f00a40046c0 con 0x563ff62fc800 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 10 client.17250 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 20 client.17250 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff6318960 0x563ff631ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 4 client.17250 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff6274db0 con 0x563ff6318960 2024-09-10T21:06:26.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.555+0000 7f00add94640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff6318960 0x563ff631ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.556+0000 7f00add94640 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff6318960 0x563ff631ae20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa01bb18074225c server_cookie=6235270b9659d8ce in_seq=0 out_seq=0 2024-09-10T21:06:26.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.556+0000 7f00917fa640 10 client.17250 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.556+0000 7f00917fa640 1 -- 172.21.15.67:0/1189229507 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ff6274db0 con 0x563ff6318960 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.556+0000 7f00917fa640 10 client.17250 handle_command_reply: tid=0 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.556+0000 7f00b23cd740 1 client.17250 shutdown 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 msgr2=0x563ff6305bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e7d0 tx=0x7f00a4009a60 comp rx=0 tx=0).stop 2024-09-10T21:06:26.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 shutdown_connections 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff6318960 0x563ff631ae20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff6308790 0x563ff6306130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fc800 0x563ff6305bf0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 --2- 172.21.15.67:0/1189229507 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fbee0 0x563ff63056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 >> 172.21.15.67:0/1189229507 conn(0x563ff62f9d10 msgr2=0x563ff62f8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.557+0000 7f00917fa640 0 client.17250 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.558+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 shutdown_connections 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.558+0000 7f00b23cd740 1 -- 172.21.15.67:0/1189229507 wait complete. 2024-09-10T21:06:26.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.558+0000 7f00b23cd740 20 client.17250 trim_cache size 0 max 16384 2024-09-10T21:06:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.581+0000 7f00b23cd740 1 Processor -- start 2024-09-10T21:06:26.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.581+0000 7f00b23cd740 1 -- start start 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6320730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff6308790 0x563ff6320c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bf9b0 con 0x563ff6308790 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bd280 con 0x563ff62fc800 2024-09-10T21:06:26.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00b23cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bb0d0 con 0x563ff62fbee0 2024-09-10T21:06:26.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00ad593640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6320730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00add94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00add94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:54028/0 (socket says 172.21.15.67:54028) 2024-09-10T21:06:26.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00add94640 1 -- 172.21.15.67:0/96572775 learned_addr learned my addr 172.21.15.67:0/96572775 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.582+0000 7f00ae595640 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff6308790 0x563ff6320c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 -- 172.21.15.67:0/96572775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 msgr2=0x563ff6320730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6320730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 -- 172.21.15.67:0/96572775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff6308790 msgr2=0x563ff6320c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff6308790 0x563ff6320c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 -- 172.21.15.67:0/96572775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff62fc630 con 0x563ff62fbee0 2024-09-10T21:06:26.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.583+0000 7f00add94640 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00980ac460 tx=0x7f00980e38c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=388d93c6cb8c49d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.584+0000 7f00937fe640 1 -- 172.21.15.67:0/96572775 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980a6e60 con 0x563ff62fbee0 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.584+0000 7f00937fe640 1 -- 172.21.15.67:0/96572775 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980ac270 con 0x563ff62fbee0 2024-09-10T21:06:26.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.584+0000 7f00937fe640 1 -- 172.21.15.67:0/96572775 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980b1190 con 0x563ff62fbee0 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- 172.21.15.67:0/96572775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 msgr2=0x563ff62fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00980ac460 tx=0x7f00980e38c0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- 172.21.15.67:0/96572775 shutdown_connections 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff6308790 0x563ff6320c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff62fc800 0x563ff6320730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 --2- 172.21.15.67:0/96572775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fbee0 0x563ff62fb100 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- 172.21.15.67:0/96572775 >> 172.21.15.67:0/96572775 conn(0x563ff62f9d10 msgr2=0x563ff62fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- 172.21.15.67:0/96572775 shutdown_connections 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- 172.21.15.67:0/96572775 wait complete. 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 -- start start 2024-09-10T21:06:26.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.585+0000 7f00b23cd740 1 Processor -- start 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff63109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 0x563ff6310ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff6308790 0x563ff630b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bb740 con 0x563ff62fbee0 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bcbb0 con 0x563ff6308790 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81bbe10 con 0x563ff62fc800 2024-09-10T21:06:26.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.586+0000 7f00b23cd740 10 client.0 _ll_register_callbacks cb 0x7f00a401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.587+0000 7f00add94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff63109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.587+0000 7f00ad593640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 0x563ff6310ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.587+0000 7f00ad593640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 0x563ff6310ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.67:54034/0 (socket says 172.21.15.67:54034) 2024-09-10T21:06:26.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.587+0000 7f00ad593640 1 -- 172.21.15.67:0/4041866630 learned_addr learned my addr 172.21.15.67:0/4041866630 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.590+0000 7f00add94640 1 -- 172.21.15.67:0/4041866630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 msgr2=0x563ff6310ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.590+0000 7f00add94640 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 0x563ff6310ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.590+0000 7f00add94640 1 -- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff6308790 msgr2=0x563ff630b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.590+0000 7f00add94640 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff6308790 0x563ff630b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.590+0000 7f00add94640 1 -- 172.21.15.67:0/4041866630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff630be70 con 0x563ff62fbee0 2024-09-10T21:06:26.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.591+0000 7f00add94640 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff63109b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00980a8770 tx=0x7f0098005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef6f96c550806df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.591+0000 7f00917fa640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:06:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.592+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980a6e60 con 0x563ff62fbee0 2024-09-10T21:06:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.592+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f00980e9040 con 0x563ff62fbee0 2024-09-10T21:06:26.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.593+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00980ac270 con 0x563ff62fbee0 2024-09-10T21:06:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.594+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f00980ac530 con 0x563ff62fbee0 2024-09-10T21:06:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.594+0000 7f00b23cd740 10 client.17256 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:26.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.594+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563ff6386350 con 0x563ff62fbee0 2024-09-10T21:06:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980ac270 con 0x563ff62fbee0 2024-09-10T21:06:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f00980a8250 con 0x563ff62fbee0 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 10 client.17256 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 20 client.17256 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff63868d0 0x563ff6388cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 4 client.17256 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:06:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.599+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563ff6270860 con 0x563ff63868d0 2024-09-10T21:06:26.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.602+0000 7f00ad593640 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff63868d0 0x563ff6388cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.616+0000 7f00ad593640 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff63868d0 0x563ff6388cf0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211c7bd9259c7cfd server_cookie=6a824cc176f2e9ee in_seq=0 out_seq=0 2024-09-10T21:06:26.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.616+0000 7f00917fa640 10 client.17256 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:26.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.621+0000 7f00917fa640 1 -- 172.21.15.67:0/4041866630 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563ff6270860 con 0x563ff63868d0 2024-09-10T21:06:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.621+0000 7f00917fa640 10 client.17256 handle_command_reply: tid=0 2024-09-10T21:06:26.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.621+0000 7f00b23cd740 1 client.17256 shutdown 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 msgr2=0x563ff63109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff63109b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f00980a8770 tx=0x7f0098005c50 comp rx=0 tx=0).stop 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 shutdown_connections 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x563ff63868d0 0x563ff6388cf0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563ff6308790 0x563ff630b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ff62fc800 0x563ff6310ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 --2- 172.21.15.67:0/4041866630 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x563ff62fbee0 0x563ff63109b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 >> 172.21.15.67:0/4041866630 conn(0x563ff62f9d10 msgr2=0x563ff62f8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.625+0000 7f00917fa640 0 client.17256 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.629+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 shutdown_connections 2024-09-10T21:06:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.630+0000 7f00b23cd740 1 -- 172.21.15.67:0/4041866630 wait complete. 2024-09-10T21:06:26.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.630+0000 7f00b23cd740 20 client.17256 trim_cache size 0 max 16384 2024-09-10T21:06:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:06:26.639 INFO:teuthology.orchestra.run.smithi067.stdout: "return_code": 0, 2024-09-10T21:06:26.639 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_tag": "98335283-d0ad-4144-87e3-6720661b92f6", 2024-09-10T21:06:26.640 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": "asynchronous" 2024-09-10T21:06:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.636+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 msgr2=0x7f00940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.636+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 0x7f00940b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f00a0006010 tx=0x7f00a0004a40 comp rx=0 tx=0).stop 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.636+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 msgr2=0x7f00a81a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 0x7f00a81a7ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f009800e9f0 tx=0x7f009800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 shutdown_connections 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00a811c0a0 0x7f00a81ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f00a810a530 0x7f00a81a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f00940b52e0 0x7f00940b77a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 --2- 172.21.15.67:0/1748952749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a810a150 0x7f00a81a7ff0 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f009800e9f0 tx=0x7f009800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:06:26.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.637+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 >> 172.21.15.67:0/1748952749 conn(0x7f00a806dfc0 msgr2=0x7f00a811c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:26.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.639+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 shutdown_connections 2024-09-10T21:06:26.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:26.639+0000 7f00afff8640 1 -- 172.21.15.67:0/1748952749 wait complete. 2024-09-10T21:06:26.751 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:26 smithi172 ceph-mon[35265]: pgmap v794: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 723 op/s 2024-09-10T21:06:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:26 smithi083 ceph-mon[35058]: pgmap v794: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 MiB/s wr, 723 op/s 2024-09-10T21:06:27.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub queued for path: / 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: active paths [/] 2024-09-10T21:06:27.752 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.753 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:27 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub queued for path: / 2024-09-10T21:06:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:06:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:06:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: active paths [/] 2024-09-10T21:06:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:27 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub queued for path: / 2024-09-10T21:06:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:06:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:06:27.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: active paths [/] 2024-09-10T21:06:27.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:27.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:27 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:28.089 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 -- 172.21.15.67:0/200966194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c106ef0 msgr2=0x7fe11c107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 --2- 172.21.15.67:0/200966194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c106ef0 0x7fe11c107340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe114009ca0 tx=0x7fe11402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 -- 172.21.15.67:0/200966194 shutdown_connections 2024-09-10T21:06:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 --2- 172.21.15.67:0/200966194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c106ef0 0x7fe11c107340 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 --2- 172.21.15.67:0/200966194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c1023d0 0x7fe11c1068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 --2- 172.21.15.67:0/200966194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 0x7fe11c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 -- 172.21.15.67:0/200966194 >> 172.21.15.67:0/200966194 conn(0x7fe11c0fd700 msgr2=0x7fe11c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 -- 172.21.15.67:0/200966194 shutdown_connections 2024-09-10T21:06:28.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.678+0000 7fe1214dd640 1 -- 172.21.15.67:0/200966194 wait complete. 2024-09-10T21:06:28.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 Processor -- start 2024-09-10T21:06:28.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 -- start start 2024-09-10T21:06:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 0x7fe11c19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c1023d0 0x7fe11c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c119430 con 0x7fe11c1023d0 2024-09-10T21:06:28.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1192b0 con 0x7fe11c106ef0 2024-09-10T21:06:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.679+0000 7fe1214dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1195b0 con 0x7fe11c101ab0 2024-09-10T21:06:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48586/0 (socket says 172.21.15.67:48586) 2024-09-10T21:06:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 -- 172.21.15.67:0/550762803 learned_addr learned my addr 172.21.15.67:0/550762803 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:28.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11affd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 0x7fe11c19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c1023d0 0x7fe11c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 -- 172.21.15.67:0/550762803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 msgr2=0x7fe11c19f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 0x7fe11c19f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 -- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c1023d0 msgr2=0x7fe11c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c1023d0 0x7fe11c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.680+0000 7fe11b7fe640 1 -- 172.21.15.67:0/550762803 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c1a5950 con 0x7fe11c106ef0 2024-09-10T21:06:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe114009430 tx=0x7fe1140317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe103fff640 1 -- 172.21.15.67:0/550762803 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114003b70 con 0x7fe11c106ef0 2024-09-10T21:06:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe103fff640 1 -- 172.21.15.67:0/550762803 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe114003d10 con 0x7fe11c106ef0 2024-09-10T21:06:28.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c1a5be0 con 0x7fe11c106ef0 2024-09-10T21:06:28.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe103fff640 1 -- 172.21.15.67:0/550762803 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11402f990 con 0x7fe11c106ef0 2024-09-10T21:06:28.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.681+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c1ac380 con 0x7fe11c106ef0 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe103fff640 1 -- 172.21.15.67:0/550762803 <== mon.2 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe11402fb30 con 0x7fe11c106ef0 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 Processor -- start 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 -- start start 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f94f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 0x561e3f95b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 0x561e3f95dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561e3f8c5e50 con 0x561e3f95b950 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561e3f8b5280 con 0x561e3f94f9c0 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe1238b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e3f8b9090 con 0x561e3f94f0a0 2024-09-10T21:06:28.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe11affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 0x561e3f95b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 0x561e3f95dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 0x561e3f95dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42034/0 (socket says 172.21.15.67:42034) 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe11a7fc640 1 -- 172.21.15.67:0/1191636720 learned_addr learned my addr 172.21.15.67:0/1191636720 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.684+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f94f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11a7fc640 1 -- 172.21.15.67:0/1191636720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 msgr2=0x561e3f95b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 0x561e3f95b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11a7fc640 1 -- 172.21.15.67:0/1191636720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 msgr2=0x561e3f95dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 0x561e3f95dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11a7fc640 1 -- 172.21.15.67:0/1191636720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3f613650 con 0x561e3f94f0a0 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe11affd640 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 0x561e3f95b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:28.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe103fff640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 0x7fe1040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.685+0000 7fe103fff640 1 -- 172.21.15.67:0/550762803 <== mon.2 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe114106ec0 con 0x7fe11c106ef0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.686+0000 7fe11affd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 0x7fe1040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.686+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f94f480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009580 tx=0x7fe10c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c946f6b382bac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.687+0000 7fe11affd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 0x7fe1040b7820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x561e3f94ddb0 tx=0x7fe110009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.687+0000 7fe1017fa640 1 -- 172.21.15.67:0/1191636720 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c016070 con 0x561e3f94f0a0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.688+0000 7fe1017fa640 1 -- 172.21.15.67:0/1191636720 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe10c00d740 con 0x561e3f94f0a0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.688+0000 7fe1017fa640 1 -- 172.21.15.67:0/1191636720 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c003850 con 0x561e3f94f0a0 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- 172.21.15.67:0/1191636720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 msgr2=0x561e3f94f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f94f480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009580 tx=0x7fe10c005f90 comp rx=0 tx=0).stop 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- 172.21.15.67:0/1191636720 shutdown_connections 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f95b950 0x561e3f95dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f9c0 0x561e3f95b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 --2- 172.21.15.67:0/1191636720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f94f480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- 172.21.15.67:0/1191636720 >> 172.21.15.67:0/1191636720 conn(0x561e3f94ced0 msgr2=0x561e3f94e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- 172.21.15.67:0/1191636720 shutdown_connections 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- 172.21.15.67:0/1191636720 wait complete. 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.689+0000 7fe1238b2740 1 -- start start 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 Processor -- start 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f958700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f958d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x561e3f716700 con 0x561e3f94f9c0 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x561e3f850110 con 0x561e3f94f0a0 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e3f95e620 con 0x561e3f95b950 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe1238b2740 10 client.0 _ll_register_callbacks cb 0x561e3f869990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:28.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe11affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe11affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48614/0 (socket says 172.21.15.67:48614) 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.690+0000 7fe11affd640 1 -- 172.21.15.67:0/2146253731 learned_addr learned my addr 172.21.15.67:0/2146253731 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f958d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f958700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11affd640 1 -- 172.21.15.67:0/2146253731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 msgr2=0x561e3f958d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11affd640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f958d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11affd640 1 -- 172.21.15.67:0/2146253731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 msgr2=0x561e3f958700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11affd640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f958700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11affd640 1 -- 172.21.15.67:0/2146253731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3f87dc40 con 0x561e3f94f0a0 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f958700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.691+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f958d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe11affd640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1100149d0 tx=0x7fe1100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49302b124df7fadf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe0feff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110025070 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe110021600 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe10c00d740 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe110021800 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe1238b2740 10 client.26963 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.692+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561e3f96a060 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.696+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe10c00d740 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.696+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe110020070 con 0x561e3f94f0a0 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 10 client.26963 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 10 client.26963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 20 client.26963 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f96b510 0x561e3f96d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 4 client.26963 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:06:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.697+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e3f8c7da0 con 0x561e3f96b510 2024-09-10T21:06:28.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.705+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f96b510 0x561e3f96d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.731+0000 7fe0feff5640 10 client.26963 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:28.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.731+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f96b510 0x561e3f96d940 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228bb6577ab22287 server_cookie=49d51d4d659ab4f in_seq=0 out_seq=0 2024-09-10T21:06:28.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.735+0000 7fe0feff5640 1 -- 172.21.15.67:0/2146253731 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e3f8c7da0 con 0x561e3f96b510 2024-09-10T21:06:28.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.735+0000 7fe0feff5640 10 client.26963 handle_command_reply: tid=0 2024-09-10T21:06:28.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.735+0000 7fe1238b2740 1 client.26963 shutdown 2024-09-10T21:06:28.741 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:28 smithi067 ceph-mon[30891]: pgmap v795: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 682 op/s 2024-09-10T21:06:28.741 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:28 smithi067 ceph-mon[30891]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 msgr2=0x561e3f95b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1100149d0 tx=0x7fe1100046c0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 shutdown_connections 2024-09-10T21:06:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f96b510 0x561e3f96d940 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f958d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f958700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2146253731 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f95b2b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 >> 172.21.15.67:0/2146253731 conn(0x561e3f94ced0 msgr2=0x561e3f952a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.740+0000 7fe0feff5640 0 client.26963 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.741+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 shutdown_connections 2024-09-10T21:06:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.741+0000 7fe1238b2740 1 -- 172.21.15.67:0/2146253731 wait complete. 2024-09-10T21:06:28.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.741+0000 7fe1238b2740 20 client.26963 trim_cache size 0 max 16384 2024-09-10T21:06:28.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.783+0000 7fe1238b2740 1 Processor -- start 2024-09-10T21:06:28.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.783+0000 7fe1238b2740 1 -- start start 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f967880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f955930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b72a0 con 0x561e3f94f9c0 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b4b70 con 0x561e3f95b950 2024-09-10T21:06:28.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.784+0000 7fe1238b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b29c0 con 0x561e3f94f0a0 2024-09-10T21:06:28.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48620/0 (socket says 172.21.15.67:48620) 2024-09-10T21:06:28.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 -- 172.21.15.67:0/839484097 learned_addr learned my addr 172.21.15.67:0/839484097 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:28.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f955930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11affd640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f967880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 -- 172.21.15.67:0/839484097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 msgr2=0x561e3f967880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f967880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 -- 172.21.15.67:0/839484097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 msgr2=0x561e3f955930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f955930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11b7fe640 1 -- 172.21.15.67:0/839484097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3f94d950 con 0x561e3f95b950 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.785+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f955930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.786+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe1140c9c20 tx=0x7fe1140cd4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a96adc56aa7db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.786+0000 7fe100ff9640 1 -- 172.21.15.67:0/839484097 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140cdd50 con 0x561e3f95b950 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.787+0000 7fe100ff9640 1 -- 172.21.15.67:0/839484097 <== mon.2 v2:172.21.15.83:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe114104e50 con 0x561e3f95b950 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.787+0000 7fe100ff9640 1 -- 172.21.15.67:0/839484097 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1140cd8b0 con 0x561e3f95b950 2024-09-10T21:06:28.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.787+0000 7fe1238b2740 1 -- 172.21.15.67:0/839484097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 msgr2=0x561e3f955e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe1140c9c20 tx=0x7fe1140cd4e0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 -- 172.21.15.67:0/839484097 shutdown_connections 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f95b950 0x561e3f955e70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f955930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 --2- 172.21.15.67:0/839484097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f94f0a0 0x561e3f967880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 -- 172.21.15.67:0/839484097 >> 172.21.15.67:0/839484097 conn(0x561e3f94ced0 msgr2=0x561e3f95a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 -- 172.21.15.67:0/839484097 shutdown_connections 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 -- 172.21.15.67:0/839484097 wait complete. 2024-09-10T21:06:28.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.788+0000 7fe1238b2740 1 -- start start 2024-09-10T21:06:28.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.789+0000 7fe1238b2740 1 Processor -- start 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.789+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe1238b2740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f964210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe11affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe11affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.67:48626/0 (socket says 172.21.15.67:48626) 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f964210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f964210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42052/0 (socket says 172.21.15.67:42052) 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe11affd640 1 -- 172.21.15.67:0/2747990906 learned_addr learned my addr 172.21.15.67:0/2747990906 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f954a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b3030 con 0x561e3f94f9c0 2024-09-10T21:06:28.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b44a0 con 0x561e3f94f0a0 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.790+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b3700 con 0x561e3f95b950 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11b7fe640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f954a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe1238b2740 10 client.0 _ll_register_callbacks cb 0x7fe110011ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 -- 172.21.15.67:0/2747990906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 msgr2=0x561e3f954a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f954a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 -- 172.21.15.67:0/2747990906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 msgr2=0x561e3f964210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f964210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3f947e20 con 0x561e3f94f0a0 2024-09-10T21:06:28.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe11affd640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe110011b20 tx=0x7fe110005f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d375ba525e63be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.791+0000 7fe0feff5640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mon.2 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110039070 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mon.2 v2:172.21.15.83:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe110021bb0 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe114104e50 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mon.2 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe110025040 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe1238b2740 10 client.26969 fetch_fsmap learned FSMap version 34 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561e3f956370 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mon.2 v2:172.21.15.83:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe114104e50 con 0x561e3f94f0a0 2024-09-10T21:06:28.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.792+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mon.2 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe110020040 con 0x561e3f94f0a0 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 10 client.26969 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 10 client.26969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 20 client.26969 populate_metadata read hostname 'smithi067' 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f9d95d0 0x561e3f9db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 4 client.26969 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e3f8c3850 con 0x561e3f9d95d0 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f9d95d0 0x561e3f9db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe0feff5640 10 client.26969 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:28.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.793+0000 7fe11a7fc640 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f9d95d0 0x561e3f9db9f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9983f925e8a6dfff server_cookie=d9d2f795ebb353d in_seq=0 out_seq=0 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe0feff5640 1 -- 172.21.15.67:0/2747990906 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x561e3f8c3850 con 0x561e3f9d95d0 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe0feff5640 10 client.26969 handle_command_reply: tid=0 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe1238b2740 1 client.26969 shutdown 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 msgr2=0x561e3f963c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe110011b20 tx=0x7fe110005f50 comp rx=0 tx=0).stop 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.794+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 shutdown_connections 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x561e3f9d95d0 0x561e3f9db9f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3f95b950 0x561e3f954a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe0feff5640 0 client.26969 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x561e3f94f9c0 0x561e3f964210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 --2- 172.21.15.67:0/2747990906 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561e3f94f0a0 0x561e3f963c90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 >> 172.21.15.67:0/2747990906 conn(0x561e3f94ced0 msgr2=0x561e3f959d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.795+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 shutdown_connections 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.796+0000 7fe1238b2740 1 -- 172.21.15.67:0/2747990906 wait complete. 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.796+0000 7fe1238b2740 20 client.26969 trim_cache size 0 max 16384 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": { 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout: "98335283-d0ad-4144-87e3-6720661b92f6": { 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.805 INFO:teuthology.orchestra.run.smithi067.stdout: "tag": "98335283-d0ad-4144-87e3-6720661b92f6", 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "options": "recursive,force" 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "98335283-d0ad-4144-87e3-6720661b92f6": { 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:06:26.616382+0000", 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:06:28.806 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.807 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.808 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.809 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.810 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:06:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:06:28.812 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.813 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "9e11199e-c064-436b-9d7c-aa344083de78": { 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:05:41.556434+0000", 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.814 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.815 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.816 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:06:28.817 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.819 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:06:28.820 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:06:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 msgr2=0x7fe1040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 0x7fe1040b7820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x561e3f94ddb0 tx=0x7fe110009110 comp rx=0 tx=0).stop 2024-09-10T21:06:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 msgr2=0x7fe11c1a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:06:28.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe114009430 tx=0x7fe1140317c0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 shutdown_connections 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe11c106ef0 0x7fe11c1a5180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe11c1023d0 0x7fe11c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1040b5360 0x7fe1040b7820 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 --2- 172.21.15.67:0/550762803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe11c101ab0 0x7fe11c19f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.797+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 >> 172.21.15.67:0/550762803 conn(0x7fe11c0fd700 msgr2=0x7fe11c104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.798+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 shutdown_connections 2024-09-10T21:06:28.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:06:28.798+0000 7fe1214dd640 1 -- 172.21.15.67:0/550762803 wait complete. 2024-09-10T21:06:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:28 smithi083 ceph-mon[35058]: pgmap v795: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 682 op/s 2024-09-10T21:06:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:28 smithi083 ceph-mon[35058]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:28 smithi172 ceph-mon[35265]: pgmap v795: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 14 MiB/s wr, 682 op/s 2024-09-10T21:06:28.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:28 smithi172 ceph-mon[35265]: scrub summary: idle+waiting paths [/] 2024-09-10T21:06:29.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 895.0 s, 1579.6 tps, lat 63.358 ms stddev 71.544 2024-09-10T21:06:29.839 INFO:tasks.cephfs.filesystem:scrub status for tag:98335283-d0ad-4144-87e3-6720661b92f6 - {'path': '/', 'tag': '98335283-d0ad-4144-87e3-6720661b92f6', 'options': 'recursive,force'} 2024-09-10T21:06:30.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:30 smithi067 ceph-mon[30891]: pgmap v796: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-10T21:06:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:30 smithi083 ceph-mon[35058]: pgmap v796: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-10T21:06:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:30 smithi172 ceph-mon[35265]: pgmap v796: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 786 op/s 2024-09-10T21:06:32.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:32 smithi067 ceph-mon[30891]: pgmap v797: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 653 op/s 2024-09-10T21:06:32.908 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:32 smithi083 ceph-mon[35058]: pgmap v797: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 653 op/s 2024-09-10T21:06:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:32 smithi172 ceph-mon[35265]: pgmap v797: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 MiB/s wr, 653 op/s 2024-09-10T21:06:34.036 INFO:teuthology.orchestra.run.smithi067.stderr:progress: 900.0 s, 1890.8 tps, lat 52.687 ms stddev 55.671 2024-09-10T21:06:34.176 INFO:teuthology.orchestra.run.smithi067.stdout:transaction type: 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:scaling factor: 32 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:query mode: simple 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:number of clients: 100 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:number of threads: 4 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:duration: 900 s 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:number of transactions actually processed: 2522455 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:latency average = 35.677 ms 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:latency stddev = 92.134 ms 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:tps = 2802.290233 (including connections establishing) 2024-09-10T21:06:34.177 INFO:teuthology.orchestra.run.smithi067.stdout:tps = 2802.298345 (excluding connections establishing) 2024-09-10T21:06:34.180 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-10T21:06:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:34 smithi067 ceph-mon[30891]: pgmap v798: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 735 op/s 2024-09-10T21:06:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:34 smithi083 ceph-mon[35058]: pgmap v798: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 735 op/s 2024-09-10T21:06:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:34 smithi172 ceph-mon[35265]: pgmap v798: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 735 op/s 2024-09-10T21:06:36.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:36 smithi067 ceph-mon[30891]: pgmap v799: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 741 op/s 2024-09-10T21:06:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:36 smithi083 ceph-mon[35058]: pgmap v799: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 741 op/s 2024-09-10T21:06:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:36 smithi172 ceph-mon[35265]: pgmap v799: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 17 MiB/s wr, 741 op/s 2024-09-10T21:06:38.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:38 smithi067 ceph-mon[30891]: pgmap v800: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 869 op/s 2024-09-10T21:06:38.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:38 smithi083 ceph-mon[35058]: pgmap v800: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 869 op/s 2024-09-10T21:06:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:38 smithi172 ceph-mon[35265]: pgmap v800: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 MiB/s wr, 869 op/s 2024-09-10T21:06:40.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:40 smithi067 ceph-mon[30891]: pgmap v801: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 34 MiB/s wr, 1.52k op/s 2024-09-10T21:06:40.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:40 smithi083 ceph-mon[35058]: pgmap v801: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 34 MiB/s wr, 1.52k op/s 2024-09-10T21:06:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:40 smithi172 ceph-mon[35265]: pgmap v801: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 34 MiB/s wr, 1.52k op/s 2024-09-10T21:06:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:06:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:06:41.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:41 smithi067 ceph-mon[30891]: scrub summary: idle 2024-09-10T21:06:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:06:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:06:41.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:41 smithi083 ceph-mon[35058]: scrub summary: idle 2024-09-10T21:06:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:06:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:06:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:41 smithi172 ceph-mon[35265]: scrub summary: idle 2024-09-10T21:06:42.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:42 smithi067 ceph-mon[30891]: pgmap v802: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.55k op/s 2024-09-10T21:06:42.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:42 smithi083 ceph-mon[35058]: pgmap v802: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.55k op/s 2024-09-10T21:06:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:42 smithi172 ceph-mon[35265]: pgmap v802: 97 pgs: 97 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.55k op/s 2024-09-10T21:06:44.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:44 smithi067 ceph-mon[30891]: pgmap v803: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 MiB/s wr, 1.52k op/s 2024-09-10T21:06:44.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:44 smithi083 ceph-mon[35058]: pgmap v803: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 MiB/s wr, 1.52k op/s 2024-09-10T21:06:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:44 smithi172 ceph-mon[35265]: pgmap v803: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 33 MiB/s wr, 1.52k op/s 2024-09-10T21:06:46.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:46 smithi083 ceph-mon[35058]: pgmap v804: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-09-10T21:06:46.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:46 smithi172 ceph-mon[35265]: pgmap v804: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-09-10T21:06:47.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:46 smithi067 ceph-mon[30891]: pgmap v804: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-09-10T21:06:48.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:48 smithi083 ceph-mon[35058]: pgmap v805: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 30 MiB/s wr, 1.50k op/s 2024-09-10T21:06:48.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:48 smithi172 ceph-mon[35265]: pgmap v805: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 30 MiB/s wr, 1.50k op/s 2024-09-10T21:06:49.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:48 smithi067 ceph-mon[30891]: pgmap v805: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 30 MiB/s wr, 1.50k op/s 2024-09-10T21:06:49.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/: 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 data 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data: 2024-09-10T21:06:49.332 INFO:teuthology.orchestra.run.smithi067.stdout:total 36 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 . 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 .. 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 base 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 10 20:51 current_logfiles 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 10 20:51 global 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 log 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_commit_ts 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_dynshmem 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 20:51 pg_hba.conf 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 20:51 pg_ident.conf 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 pg_logical 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 pg_multixact 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_notify 2024-09-10T21:06:49.333 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_replslot 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_serial 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_snapshots 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 pg_stat 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 21:06 pg_stat_tmp 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 21:06 pg_subtrans 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_tblspc 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pg_twophase 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 21:06 pg_wal 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 pg_xact 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 20:51 postgresql.auto.conf 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 20:51 postgresql.conf 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 10 20:51 postmaster.opts 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.334 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base: 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 . 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 1 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 13493 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 10 20:53 13494 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 pgsql_tmp 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:total 7777 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 . 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 .. 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T21:06:49.335 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 20:51 1259 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T21:06:49.336 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T21:06:49.337 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T21:06:49.338 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T21:06:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T21:06:49.340 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T21:06:49.341 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 20:51 2619 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2619_fsm 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T21:06:49.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T21:06:49.343 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T21:06:49.344 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2696 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T21:06:49.345 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T21:06:49.346 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T21:06:49.347 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T21:06:49.348 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T21:06:49.349 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T21:06:49.350 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T21:06:49.351 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T21:06:49.352 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T21:06:49.353 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T21:06:49.353 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T21:06:49.353 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T21:06:49.353 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T21:06:49.353 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T21:06:49.423 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T21:06:49.423 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T21:06:49.423 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T21:06:49.423 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T21:06:49.424 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:total 7777 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 20:51 . 2024-09-10T21:06:49.425 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 .. 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 20:51 1259 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T21:06:49.426 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T21:06:49.427 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T21:06:49.428 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T21:06:49.429 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T21:06:49.430 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T21:06:49.431 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 20:51 2619 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2619_fsm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T21:06:49.432 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T21:06:49.433 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T21:06:49.434 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2696 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T21:06:49.435 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T21:06:49.436 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T21:06:49.437 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T21:06:49.438 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T21:06:49.439 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T21:06:49.440 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T21:06:49.441 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T21:06:49.442 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T21:06:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T21:06:49.444 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T21:06:49.446 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:total 646910 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 10 20:53 . 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 .. 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 112 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 113 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 1247 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1247_fsm 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1247_vm 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 20:51 1249 2024-09-10T21:06:49.447 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1249_fsm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1249_vm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 20:51 1255 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1255_fsm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1255_vm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 21:06 1259 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1259_fsm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1259_vm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 20:51 13344 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13344_fsm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13344_vm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13346 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13348 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13349_fsm 2024-09-10T21:06:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13349_vm 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13351 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13353 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13354_fsm 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13354_vm 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13356 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13358 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 13359_fsm 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13359_vm 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 13361 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 13363 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1417 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 1418 2024-09-10T21:06:49.449 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 447160320 Sep 10 21:06 16396 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 10 21:06 16396_fsm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:54 16396_vm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1081344 Sep 10 21:06 16397 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 21:06 16397_fsm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 21:06 16397_vm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1720320 Sep 10 21:06 16399 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 21:05 16399_fsm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 21:05 16399_vm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 21:06 16400 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 21:06 16402 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 10 21:06 16404 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 132079616 Sep 10 21:06 16406 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 21:06 16406_fsm 2024-09-10T21:06:49.450 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 21:04 16406_vm 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 174 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 175 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2187 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2224 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2328 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2336 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2337 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2579 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2600 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2600_fsm 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2600_vm 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2601_fsm 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2601_vm 2024-09-10T21:06:49.451 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2602 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2602_fsm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2602_vm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2603 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2603_fsm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2603_vm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2604 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2605 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2605_fsm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2605_vm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2606_fsm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2606_vm 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2607 2024-09-10T21:06:49.452 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2607_fsm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2607_vm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 20:51 2608 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2608_fsm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2608_vm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 20:51 2609 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2609_fsm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2609_vm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2610 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2610_fsm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2610_vm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2611 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2612_fsm 2024-09-10T21:06:49.453 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2612_vm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2613 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2615_fsm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2615_vm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2616 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2616_fsm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2616_vm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 20:51 2617 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2617_fsm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2617_vm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 20:51 2618 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2618_fsm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2618_vm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 10 21:06 2619 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:53 2619_fsm 2024-09-10T21:06:49.454 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2619_vm 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2620 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2650 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2651 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2652 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2653 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2654 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2655 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2656 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2657 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 20:51 2658 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 20:51 2659 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2660 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2661 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2662 2024-09-10T21:06:49.455 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2663 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2664 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2665 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2666 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2667 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2668 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2669 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2670 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 20:51 2673 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 20:51 2674 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 20:51 2675 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2678 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2679 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2680 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2681 2024-09-10T21:06:49.456 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2682 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2683 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2684 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2685 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2686 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2687 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2688 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 20:51 2689 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 20:51 2690 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 20:51 2691 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2692 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2693 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:55 2696 2024-09-10T21:06:49.457 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2699 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2701 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2702 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2703 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 2704 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2753 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2753_fsm 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2753_vm 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2754 2024-09-10T21:06:49.458 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2755 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2756 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 2757 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2830 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2831 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2832 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2833 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2834 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2835 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2836 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2837 2024-09-10T21:06:49.459 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 20:51 2838 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2838_fsm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2838_vm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2839 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2840_fsm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2840_vm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2841 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2995 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2996 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3079_fsm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3079_vm 2024-09-10T21:06:49.460 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3080 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3081 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3085 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3118 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3119 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 20:51 3164 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3256 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3257 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3258 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3350 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3351 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3379 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3380 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3381 2024-09-10T21:06:49.461 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3394 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3394_fsm 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3394_vm 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3395 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3429 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3430 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3431 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3433 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3439 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3440 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 20:51 3455 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 20:51 3456 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3456_fsm 2024-09-10T21:06:49.462 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3456_vm 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3466 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3467 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3468 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3501 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3502 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3503 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3534 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3541_fsm 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3541_vm 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3542 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3574 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3575 2024-09-10T21:06:49.463 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3576 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3596 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3597 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3598 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3599 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3600_fsm 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3600_vm 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3601_fsm 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3601_vm 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602 2024-09-10T21:06:49.464 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3602_fsm 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3602_vm 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3603_fsm 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3603_vm 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3604 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3605 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3606 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3607 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3608 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 20:51 3609 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3712 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 3764_fsm 2024-09-10T21:06:49.465 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3764_vm 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3766 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 3767 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3997 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4143 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4144 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4145 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4146 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4147 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4148 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4149 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4150 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4151 2024-09-10T21:06:49.466 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4152 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4153 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4154 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4155 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4156 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4157 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4158 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4159 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4160 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4161 2024-09-10T21:06:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4162 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4163 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4164 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4165 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4166 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4167 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4168 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4169 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4170 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4171 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4172 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4173 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4174 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 5002 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 548 2024-09-10T21:06:49.468 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 549 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6102 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6104 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6106 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6110 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6111 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6112 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6113 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6117 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 826 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 827 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 828 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 10 20:51 pg_internal.init 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 20:51 PG_VERSION 2024-09-10T21:06:49.469 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 20:51 .. 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/global: 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:total 560 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 10 20:51 . 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1213 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1213_fsm 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1213_vm 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1214 2024-09-10T21:06:49.470 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1214_fsm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1214_vm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 1232 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 1233 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1260 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1260_fsm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1260_vm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1261 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1261_fsm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1261_vm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1262 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 1262_fsm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 1262_vm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2396 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 20:51 2396_fsm 2024-09-10T21:06:49.471 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2396_vm 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2397 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2671 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2672 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2676 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2677 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2694 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2695 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2697 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 20:51 2698 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2846 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2847 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2964 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2965 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 2966 2024-09-10T21:06:49.472 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 2967 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 3592 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 3593 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4060 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4061 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4175 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4176 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4177 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4178 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4181 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4182 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4183 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4184 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 4185 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 4186 2024-09-10T21:06:49.473 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6000 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6001 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6002 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 6100 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6114 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 6115 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 21:06 pg_control 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 20:51 pg_filenode.map 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 10 20:51 pg_internal.init 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/log: 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:total 2 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1223 Sep 10 21:06 postgresql-Tue.log 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.474 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:total 1 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 . 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 mappings 2024-09-10T21:06:49.475 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 21:06 replorigin_checkpoint 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 snapshots 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 .. 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 .. 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.476 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 . 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 members 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 offsets 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 .. 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:51 0000 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-10T21:06:49.477 INFO:teuthology.orchestra.run.smithi067.stdout:total 8 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 20:51 . 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 20:51 .. 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 20:53 0000 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.478 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:total 15 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 . 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.479 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 10 21:06 db_0.stat 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 10 21:06 db_13494.stat 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 10 21:06 global.stat 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 21:06 . 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:total 128 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 21:06 . 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 10 21:06 0026 2024-09-10T21:06:49.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:total 1048576 2024-09-10T21:06:49.481 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 21:06 . 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 0000000100000000000000DF 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:59 0000000100000000000000E0 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:58 0000000100000000000000E1 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:59 0000000100000000000000E2 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:00 0000000100000000000000E3 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:58 0000000100000000000000E4 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:58 0000000100000000000000E5 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:59 0000000100000000000000E6 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 20:58 0000000100000000000000E7 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:01 0000000100000000000000E8 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 0000000100000000000000E9 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000EA 2024-09-10T21:06:49.482 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000EB 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 0000000100000000000000EC 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000ED 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000EE 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000EF 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F0 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 0000000100000000000000F1 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F2 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F3 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F4 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F5 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F6 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 0000000100000000000000F7 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F8 2024-09-10T21:06:49.483 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000F9 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000FA 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000FB 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 0000000100000000000000FC 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:04 0000000100000000000000FD 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:04 0000000100000000000000FE 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 0000000100000000000000FF 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000000 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000001 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 000000010000000100000002 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:04 000000010000000100000003 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000004 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000005 2024-09-10T21:06:49.484 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:05 000000010000000100000006 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000007 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:05 000000010000000100000008 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 000000010000000100000009 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 00000001000000010000000A 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 00000001000000010000000B 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:03 00000001000000010000000C 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:04 00000001000000010000000D 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:05 00000001000000010000000E 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000000F 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000010 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:02 000000010000000100000011 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:05 000000010000000100000012 2024-09-10T21:06:49.485 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000013 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000014 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000015 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000016 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000017 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000018 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 000000010000000100000019 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000001A 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000001B 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000001C 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000001D 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 21:06 00000001000000010000001E 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 archive_status 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:total 0 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 20:51 . 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 21:06 .. 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:total 616 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 21:06 . 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 21:06 .. 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 10 20:55 0000 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 10 21:06 0001 2024-09-10T21:06:49.487 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 21:06 0002 2024-09-10T21:06:49.488 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T21:06:49.499 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T21:06:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:50 smithi083 ceph-mon[35058]: pgmap v806: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.57k op/s 2024-09-10T21:06:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:50.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:50.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:50 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:06:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:50 smithi172 ceph-mon[35265]: pgmap v806: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.57k op/s 2024-09-10T21:06:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:50.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:50.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:50.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:50 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:06:51.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:50 smithi067 ceph-mon[30891]: pgmap v806: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.57k op/s 2024-09-10T21:06:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:51.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:50 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' 2024-09-10T21:06:52.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:52 smithi083 ceph-mon[35058]: pgmap v807: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 911 op/s 2024-09-10T21:06:52.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:52 smithi172 ceph-mon[35265]: pgmap v807: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 911 op/s 2024-09-10T21:06:53.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:52 smithi067 ceph-mon[30891]: pgmap v807: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 911 op/s 2024-09-10T21:06:54.847 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:54 smithi067 ceph-mon[30891]: pgmap v808: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 752 op/s 2024-09-10T21:06:54.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:54 smithi083 ceph-mon[35058]: pgmap v808: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 752 op/s 2024-09-10T21:06:54.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:54 smithi172 ceph-mon[35265]: pgmap v808: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 752 op/s 2024-09-10T21:06:56.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:56 smithi083 ceph-mon[35058]: pgmap v809: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-10T21:06:56.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:56 smithi172 ceph-mon[35265]: pgmap v809: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-10T21:06:57.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:56 smithi067 ceph-mon[30891]: pgmap v809: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 6.7 MiB/s wr, 719 op/s 2024-09-10T21:06:58.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:06:58 smithi083 ceph-mon[35058]: pgmap v810: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 627 op/s 2024-09-10T21:06:58.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:06:58 smithi172 ceph-mon[35265]: pgmap v810: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 627 op/s 2024-09-10T21:06:59.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:06:58 smithi067 ceph-mon[30891]: pgmap v810: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.9 MiB/s wr, 627 op/s 2024-09-10T21:06:59.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:07:00.117 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 -- 172.21.15.67:0/1362098422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac1045c0 msgr2=0x7fb5ac10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 --2- 172.21.15.67:0/1362098422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac10cab0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009900 tx=0x7fb59c02a410 comp rx=0 tx=0).stop 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 -- 172.21.15.67:0/1362098422 shutdown_connections 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 --2- 172.21.15.67:0/1362098422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac10d100 0x7fb5ac10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 --2- 172.21.15.67:0/1362098422 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac10cab0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 --2- 172.21.15.67:0/1362098422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 0x7fb5ac104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 -- 172.21.15.67:0/1362098422 >> 172.21.15.67:0/1362098422 conn(0x7fb5ac0fd700 msgr2=0x7fb5ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 -- 172.21.15.67:0/1362098422 shutdown_connections 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.597+0000 7fb5b441f640 1 -- 172.21.15.67:0/1362098422 wait complete. 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 Processor -- start 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 -- start start 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 0x7fb5ac101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac112dc0 con 0x7fb5ac10d100 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac112c40 con 0x7fb5ac103ca0 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b441f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac112f40 con 0x7fb5ac1045c0 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52018/0 (socket says 172.21.15.67:52018) 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 -- 172.21.15.67:0/3184770662 learned_addr learned my addr 172.21.15.67:0/3184770662 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 0x7fb5ac101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 -- 172.21.15.67:0/3184770662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 msgr2=0x7fb5ac101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 -- 172.21.15.67:0/3184770662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 msgr2=0x7fb5ac101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 0x7fb5ac101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b29bc640 1 -- 172.21.15.67:0/3184770662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac1a75f0 con 0x7fb5ac10d100 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.598+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5b29bc640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400cce0 tx=0x7fb5a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5a37fe640 1 -- 172.21.15.67:0/3184770662 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400f450 con 0x7fb5ac10d100 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5a37fe640 1 -- 172.21.15.67:0/3184770662 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a400faa0 con 0x7fb5ac10d100 2024-09-10T21:07:00.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5a37fe640 1 -- 172.21.15.67:0/3184770662 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4018a80 con 0x7fb5ac10d100 2024-09-10T21:07:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac1a78e0 con 0x7fb5ac10d100 2024-09-10T21:07:00.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.599+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac1a7df0 con 0x7fb5ac10d100 2024-09-10T21:07:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.601+0000 7fb5a37fe640 1 -- 172.21.15.67:0/3184770662 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb5a4020030 con 0x7fb5ac10d100 2024-09-10T21:07:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.601+0000 7fb5b67f4740 1 Processor -- start 2024-09-10T21:07:00.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 -- start start 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bc480 0x5572795bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557279532e50 con 0x5572795c8d30 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557279522280 con 0x5572795bcda0 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557279526090 con 0x5572795bc480 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52026/0 (socket says 172.21.15.67:52026) 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3797277561 learned_addr learned my addr 172.21.15.67:0/3797277561 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bc480 0x5572795bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5a37fe640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 0x7fb5980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3797277561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bc480 msgr2=0x5572795bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bc480 0x5572795bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3797277561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 msgr2=0x5572795c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.602+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3797277561 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557279280650 con 0x5572795c8d30 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5b29bc640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 0x7fb5980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5a37fe640 1 -- 172.21.15.67:0/3184770662 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb5a40e5cd0 con 0x7fb5ac10d100 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009900 tx=0x7fb59c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a85245ccc465dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5a0de6640 1 -- 172.21.15.67:0/3797277561 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c035040 con 0x5572795c8d30 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5a0de6640 1 -- 172.21.15.67:0/3797277561 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c003900 con 0x5572795c8d30 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.603+0000 7fb5a0de6640 1 -- 172.21.15.67:0/3797277561 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c004a00 con 0x5572795c8d30 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3797277561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 msgr2=0x5572795cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b29bc640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 0x7fb5980b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40a9730 tx=0x7fb5a40a0d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009900 tx=0x7fb59c000bc0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3797277561 shutdown_connections 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795c8d30 0x5572795cb120 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3797277561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bc480 0x5572795bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3797277561 >> 172.21.15.67:0/3797277561 conn(0x5572795ba2b0 msgr2=0x5572795bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3797277561 shutdown_connections 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3797277561 wait complete. 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 -- start start 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.604+0000 7fb5b67f4740 1 Processor -- start 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bcda0 0x5572795c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795c8d30 0x5572795c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x557279383700 con 0x5572795bc480 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5572794bd110 con 0x5572795c8d30 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572795cb950 con 0x5572795bcda0 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 10 client.0 _ll_register_callbacks cb 0x5572794d6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52034/0 (socket says 172.21.15.67:52034) 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3600382987 learned_addr learned my addr 172.21.15.67:0/3600382987 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795c8d30 0x5572795c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bcda0 0x5572795c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3600382987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bcda0 msgr2=0x5572795c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bcda0 0x5572795c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795c8d30 msgr2=0x5572795c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795c8d30 0x5572795c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 -- 172.21.15.67:0/3600382987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572794eac40 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009630 tx=0x7fb59c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff6110487d89803 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c035050 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb59c003e90 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.605+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59c003900 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb59c0047a0 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 10 client.17286 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5572795d7320 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c003900 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb59c03a040 con 0x5572795bc480 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 10 client.17286 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:07:00.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 20 client.17286 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:00.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5572795d8670 0x5572795daa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 4 client.17286 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:07:00.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557279534da0 con 0x5572795d8670 2024-09-10T21:07:00.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.606+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5572795d8670 0x5572795daa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.607+0000 7fb595ffb640 10 client.17286 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.607+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5572795d8670 0x5572795daa60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78868c87b0cffb30 server_cookie=4c5d1cdb38afbd3b in_seq=0 out_seq=0 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.607+0000 7fb595ffb640 1 -- 172.21.15.67:0/3600382987 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557279534da0 con 0x5572795d8670 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.607+0000 7fb595ffb640 10 client.17286 handle_command_reply: tid=0 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 client.17286 shutdown 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 msgr2=0x5572795c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009630 tx=0x7fb59c001e50 comp rx=0 tx=0).stop 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 shutdown_connections 2024-09-10T21:07:00.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5572795d8670 0x5572795daa60 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795c8d30 0x5572795c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795bcda0 0x5572795c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/3600382987 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795c86c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 >> 172.21.15.67:0/3600382987 conn(0x5572795ba2b0 msgr2=0x5572795bfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb595ffb640 0 client.17286 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 shutdown_connections 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 1 -- 172.21.15.67:0/3600382987 wait complete. 2024-09-10T21:07:00.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.608+0000 7fb5b67f4740 20 client.17286 trim_cache size 0 max 16384 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.625+0000 7fb5b67f4740 1 Processor -- start 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 -- start start 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795e0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1b2c00 con 0x5572795bc480 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1b04d0 con 0x5572795bcda0 2024-09-10T21:07:00.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1ae320 con 0x5572795c8d30 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52038/0 (socket says 172.21.15.67:52038) 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 -- 172.21.15.67:0/776525593 learned_addr learned my addr 172.21.15.67:0/776525593 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 -- 172.21.15.67:0/776525593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 msgr2=0x5572795c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 -- 172.21.15.67:0/776525593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 msgr2=0x5572795e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795e0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 -- 172.21.15.67:0/776525593 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572795bad30 con 0x5572795bc480 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.626+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb59c02a450 tx=0x7fb59c0040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e873a78b602e9166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb597fff640 1 -- 172.21.15.67:0/776525593 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c035070 con 0x5572795bc480 2024-09-10T21:07:00.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb597fff640 1 -- 172.21.15.67:0/776525593 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c003e90 con 0x5572795bc480 2024-09-10T21:07:00.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb597fff640 1 -- 172.21.15.67:0/776525593 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c03d440 con 0x5572795bc480 2024-09-10T21:07:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 -- 172.21.15.67:0/776525593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 msgr2=0x5572795d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb59c02a450 tx=0x7fb59c0040b0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 -- 172.21.15.67:0/776525593 shutdown_connections 2024-09-10T21:07:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bcda0 0x5572795e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/776525593 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bc480 0x5572795d4bf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 -- 172.21.15.67:0/776525593 >> 172.21.15.67:0/776525593 conn(0x5572795ba2b0 msgr2=0x5572795c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 -- 172.21.15.67:0/776525593 shutdown_connections 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.627+0000 7fb5b67f4740 1 -- 172.21.15.67:0/776525593 wait complete. 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 -- start start 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 Processor -- start 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 0x5572795d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1ae990 con 0x5572795bcda0 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1afe00 con 0x5572795bc480 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1af060 con 0x5572795c8d30 2024-09-10T21:07:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b67f4740 10 client.0 _ll_register_callbacks cb 0x7fb5a800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52046/0 (socket says 172.21.15.67:52046) 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 -- 172.21.15.67:0/243583977 learned_addr learned my addr 172.21.15.67:0/243583977 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 0x5572795d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 -- 172.21.15.67:0/243583977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 msgr2=0x5572795da270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795da270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 -- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 msgr2=0x5572795d97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 0x5572795d97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b21bb640 1 -- 172.21.15.67:0/243583977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557279644350 con 0x5572795bcda0 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.628+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 0x5572795d97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b21bb640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8000c00 tx=0x7fb5a8010b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486ea0400bfc6365 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a800fb80 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb5a800fd20 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb59c003e90 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb5a802f460 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 10 client.17292 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557279645710 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb59c003e90 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb5a802c400 con 0x5572795bcda0 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 10 client.17292 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 20 client.17292 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557279645eb0 0x5572796482d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 4 client.17292 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.629+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557279530850 con 0x557279645eb0 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557279645eb0 0x5572796482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b19ba640 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557279645eb0 0x5572796482d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16e9c2d53e45eb5f server_cookie=39e6c3add2d758fd in_seq=0 out_seq=0 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb595ffb640 10 client.17292 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb595ffb640 1 -- 172.21.15.67:0/243583977 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x557279530850 con 0x557279645eb0 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb595ffb640 10 client.17292 handle_command_reply: tid=0 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 client.17292 shutdown 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 msgr2=0x5572795d9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8000c00 tx=0x7fb5a8010b40 comp rx=0 tx=0).stop 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 shutdown_connections 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x557279645eb0 0x5572796482d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572795c8d30 0x5572795da270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5572795bcda0 0x5572795d9d30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 --2- 172.21.15.67:0/243583977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5572795bc480 0x5572795d97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb595ffb640 0 client.17292 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.630+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 >> 172.21.15.67:0/243583977 conn(0x5572795ba2b0 msgr2=0x5572795c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 shutdown_connections 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b67f4740 1 -- 172.21.15.67:0/243583977 wait complete. 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b67f4740 20 client.17292 trim_cache size 0 max 16384 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stdout: "status": "no active scrubs running", 2024-09-10T21:07:00.641 INFO:teuthology.orchestra.run.smithi067.stdout: "scrubs": {}, 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "scrub_stats": { 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "98335283-d0ad-4144-87e3-6720661b92f6": { 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:06:26.616382+0000", 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "8bb82cad-9ae8-449f-9468-bc614adadf24": { 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:56.316491+0000", 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.642 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "a6999373-d3de-4c6f-b925-141ef2f2ace5": { 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:04:11.564527+0000", 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "a5fc1e9b-49b6-4d79-9338-dac38d5d982c": { 2024-09-10T21:07:00.643 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:03:26.591567+0000", 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "f3e15e4c-c74b-49ea-8413-178fe49e3fd4": { 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:11.889697+0000", 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.644 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "5ecb4bf8-59ef-4cd6-824c-75c4862c200d": { 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:51:21.946593+0000", 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "981f879a-3122-4d40-b6b6-eac2b02991bb": { 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:53:41.344305+0000", 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.645 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "4417332c-b083-4bcd-9cd4-3276ff51958b": { 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:55.404389+0000", 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "8e9ba2fd-f3bf-4ab2-b88d-3223e00e9d68": { 2024-09-10T21:07:00.646 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:54:26.516238+0000", 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "65baa163-fbe0-42fc-aa2f-bacdb8686051": { 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:12.123160+0000", 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "9e11199e-c064-436b-9d7c-aa344083de78": { 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:05:41.556434+0000", 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "8c5e9db5-2a09-4b0a-b7cc-f9df12052330": { 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:58.650825+0000", 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.648 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "62ef957c-4a5c-44c5-966a-de0ff7bc5a0c": { 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:01:57.051642+0000", 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "d954cbbc-ffbf-4f04-83f9-3f2226bebfb1": { 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:59:43.355773+0000", 2024-09-10T21:07:00.649 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "5df62bf1-149c-47de-b39c-8e2017c0c4a6": { 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:55:57.960079+0000", 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.650 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "dce5d13a-8bd9-49f2-a2e0-59003826ab2e": { 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:02:41.784602+0000", 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "ded77e3f-35e5-4ca0-b02b-666b66695112": { 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:56:43.444008+0000", 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.651 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "1f9d2ba2-964d-4d5b-95da-6012bce65179": { 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:52:08.699491+0000", 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "00387259-d45d-4cdd-860d-55aed9326a82": { 2024-09-10T21:07:00.652 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:57:28.310952+0000", 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "f15fee58-a6bb-478a-9502-37153f1e699f": { 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T20:58:13.898879+0000", 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.653 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "4fd089fd-25a7-43b5-8370-7c6c02380382": { 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "start_time": "2024-09-10T21:00:27.395739+0000", 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_started": 0, 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_passed": 0, 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_failed": 0, 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: "uninline_skipped": 0 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:00.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 msgr2=0x7fb5980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 0x7fb5980b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40a9730 tx=0x7fb5a40a0d70 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 msgr2=0x7fb5ac1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400cce0 tx=0x7fb5a400a620 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 shutdown_connections 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb5ac10d100 0x7fb5ac1023d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb5980b5360 0x7fb5980b7820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ac1045c0 0x7fb5ac101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 --2- 172.21.15.67:0/3184770662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac103ca0 0x7fb5ac101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 >> 172.21.15.67:0/3184770662 conn(0x7fb5ac0fd700 msgr2=0x7fb5ac10f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 shutdown_connections 2024-09-10T21:07:00.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:00.631+0000 7fb5b441f640 1 -- 172.21.15.67:0/3184770662 wait complete. 2024-09-10T21:07:00.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:00 smithi067 ceph-mon[30891]: pgmap v811: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-10T21:07:00.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:00 smithi083 ceph-mon[35058]: pgmap v811: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-10T21:07:00.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:00 smithi172 ceph-mon[35265]: pgmap v811: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-10T21:07:01.437 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:07:01.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:07:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 -- 172.21.15.67:0/3432279739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc109150 msgr2=0x7f5dfc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 --2- 172.21.15.67:0/3432279739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc109150 0x7f5dfc10f950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009ca0 tx=0x7f5df402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 -- 172.21.15.67:0/3432279739 shutdown_connections 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 --2- 172.21.15.67:0/3432279739 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc109150 0x7f5dfc10f950 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 --2- 172.21.15.67:0/3432279739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc1087d0 0x7f5dfc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 --2- 172.21.15.67:0/3432279739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 -- 172.21.15.67:0/3432279739 >> 172.21.15.67:0/3432279739 conn(0x7f5dfc0fe830 msgr2=0x7f5dfc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 -- 172.21.15.67:0/3432279739 shutdown_connections 2024-09-10T21:07:02.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.143+0000 7f5e03505640 1 -- 172.21.15.67:0/3432279739 wait complete. 2024-09-10T21:07:02.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 Processor -- start 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 -- start start 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc1087d0 0x7f5dfc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 0x7f5dfc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc112dd0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc112c50 con 0x7f5dfc1087d0 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e03505640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc112f50 con 0x7f5dfc109150 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e012a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e012a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52060/0 (socket says 172.21.15.67:52060) 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e012a1640 1 -- 172.21.15.67:0/2159803713 learned_addr learned my addr 172.21.15.67:0/2159803713 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e00aa0640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc1087d0 0x7f5dfc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e01aa2640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 0x7f5dfc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.144+0000 7f5e012a1640 1 -- 172.21.15.67:0/2159803713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 msgr2=0x7f5dfc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e012a1640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 0x7f5dfc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e012a1640 1 -- 172.21.15.67:0/2159803713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc1087d0 msgr2=0x7f5dfc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e012a1640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc1087d0 0x7f5dfc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e012a1640 1 -- 172.21.15.67:0/2159803713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc1a7680 con 0x7f5dfc102dc0 2024-09-10T21:07:02.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e01aa2640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 0x7f5dfc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e012a1640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d950 tx=0x7f5df000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0017030 con 0x7f5dfc102dc0 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc1a7970 con 0x7f5dfc102dc0 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df0004020 con 0x7f5dfc102dc0 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00047a0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.145+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc1a7f00 con 0x7f5dfc102dc0 2024-09-10T21:07:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.146+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc1031a0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.148+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5df0009a30 con 0x7f5dfc102dc0 2024-09-10T21:07:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.149+0000 7f5dee7fc640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 0x7f5de80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:02.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.149+0000 7f5e00aa0640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 0x7f5de80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.149+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5df00e5c60 con 0x7f5dfc102dc0 2024-09-10T21:07:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.150+0000 7f5e00aa0640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 0x7f5de80b7820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc076f90 tx=0x7f5df800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:02.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.152+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5df00acbd0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.377+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dfc0767a0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.378+0000 7f5dee7fc640 1 -- 172.21.15.67:0/2159803713 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7f5df00580e0 con 0x7f5dfc102dc0 2024-09-10T21:07:02.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:02.382 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:07:02.382 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 msgr2=0x7f5de80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 0x7f5de80b7820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc076f90 tx=0x7f5df800b390 comp rx=0 tx=0).stop 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 msgr2=0x7f5dfc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5df000d950 tx=0x7f5df000de10 comp rx=0 tx=0).stop 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 shutdown_connections 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5de80b5360 0x7f5de80b7820 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc109150 0x7f5dfc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dfc1087d0 0x7f5dfc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 --2- 172.21.15.67:0/2159803713 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5dfc102dc0 0x7f5dfc0754a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 >> 172.21.15.67:0/2159803713 conn(0x7f5dfc0fe830 msgr2=0x7f5dfc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 shutdown_connections 2024-09-10T21:07:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:02.381+0000 7f5e03505640 1 -- 172.21.15.67:0/2159803713 wait complete. 2024-09-10T21:07:02.685 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:02 smithi067 ceph-mon[30891]: pgmap v812: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-09-10T21:07:02.685 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:02 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2159803713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:02.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:02 smithi083 ceph-mon[35058]: pgmap v812: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-09-10T21:07:02.892 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:02 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2159803713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:02 smithi172 ceph-mon[35265]: pgmap v812: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-09-10T21:07:02.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:02 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2159803713' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:03.032 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:07:03.290 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.778+0000 7f9c34962640 1 -- 172.21.15.67:0/2139585293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c30101730 msgr2=0x7f9c3010ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.778+0000 7f9c34962640 1 --2- 172.21.15.67:0/2139585293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c30101730 0x7f9c3010ebb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c1802a480 comp rx=0 tx=0).stop 2024-09-10T21:07:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 -- 172.21.15.67:0/2139585293 shutdown_connections 2024-09-10T21:07:04.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 --2- 172.21.15.67:0/2139585293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3010f310 0x7f9c301117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 --2- 172.21.15.67:0/2139585293 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c30101730 0x7f9c3010ebb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 --2- 172.21.15.67:0/2139585293 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 0x7f9c301011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 -- 172.21.15.67:0/2139585293 >> 172.21.15.67:0/2139585293 conn(0x7f9c300fca20 msgr2=0x7f9c300fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 -- 172.21.15.67:0/2139585293 shutdown_connections 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 -- 172.21.15.67:0/2139585293 wait complete. 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 Processor -- start 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.779+0000 7f9c34962640 1 -- start start 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 0x7f9c3019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101730 0x7f9c3019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30114f40 con 0x7f9c3010f310 2024-09-10T21:07:04.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30114dc0 con 0x7f9c30100e10 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c34962640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301150c0 con 0x7f9c30101730 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35092/0 (socket says 172.21.15.67:35092) 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/316512555 learned_addr learned my addr 172.21.15.67:0/316512555 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c27fff640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101730 0x7f9c3019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 0x7f9c3019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/316512555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101730 msgr2=0x7f9c3019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101730 0x7f9c3019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/316512555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 msgr2=0x7f9c3019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 0x7f9c3019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/316512555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301a1500 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.780+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800eaa0 tx=0x7f9c2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.781+0000 7f9c277fe640 1 -- 172.21.15.67:0/316512555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800cdb0 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.781+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301a17f0 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.781+0000 7f9c277fe640 1 -- 172.21.15.67:0/316512555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c28005020 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.781+0000 7f9c277fe640 1 -- 172.21.15.67:0/316512555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280116d0 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.781+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301a7eb0 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.783+0000 7f9c36d37740 1 Processor -- start 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.783+0000 7f9c277fe640 1 -- 172.21.15.67:0/316512555 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9c2800f040 con 0x7f9c3010f310 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 -- start start 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2a5d80 0x56071c2a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56071c20fea0 con 0x56071c2994d0 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56071c1ff2d0 con 0x56071c2a5d80 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c36d37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56071c2030e0 con 0x56071c299df0 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35100/0 (socket says 172.21.15.67:35100) 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 -- 172.21.15.67:0/3734267037 learned_addr learned my addr 172.21.15.67:0/3734267037 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2a5d80 0x56071c2a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 -- 172.21.15.67:0/3734267037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 msgr2=0x56071c2a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 -- 172.21.15.67:0/3734267037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2a5d80 msgr2=0x56071c2a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2a5d80 0x56071c2a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c27fff640 1 -- 172.21.15.67:0/3734267037 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071bf5d650 con 0x56071c2994d0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.784+0000 7f9c277fe640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 0x7f9c1c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c27fff640 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c18009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a851859c602b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 0x7f9c1c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c277fe640 1 -- 172.21.15.67:0/316512555 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c280e5a30 con 0x7f9c3010f310 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c24ff9640 1 -- 172.21.15.67:0/3734267037 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18044020 con 0x56071c2994d0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c24ff9640 1 -- 172.21.15.67:0/3734267037 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18031870 con 0x56071c2994d0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c24ff9640 1 -- 172.21.15.67:0/3734267037 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035040 con 0x56071c2994d0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c36d37740 1 -- 172.21.15.67:0/3734267037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 msgr2=0x56071c2998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c18009660 comp rx=0 tx=0).stop 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.785+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 0x7f9c1c0b77a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x56071c2981e0 tx=0x7f9c2000c4b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- 172.21.15.67:0/3734267037 shutdown_connections 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2a5d80 0x56071c2a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- 172.21.15.67:0/3734267037 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2998b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- 172.21.15.67:0/3734267037 >> 172.21.15.67:0/3734267037 conn(0x56071c297300 msgr2=0x56071c2984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- 172.21.15.67:0/3734267037 shutdown_connections 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- 172.21.15.67:0/3734267037 wait complete. 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- start start 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 Processor -- start 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2a5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56071c060700 con 0x56071c2a5d80 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56071c19a160 con 0x56071c2994d0 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56071c2a89a0 con 0x56071c299df0 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.786+0000 7f9c36d37740 10 client.0 _ll_register_callbacks cb 0x56071c1b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:04.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35114/0 (socket says 172.21.15.67:35114) 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/2884110319 learned_addr learned my addr 172.21.15.67:0/2884110319 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c27fff640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/2884110319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 msgr2=0x56071c2a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 msgr2=0x56071c2a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 -- 172.21.15.67:0/2884110319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071c1c7c90 con 0x56071c2a5d80 2024-09-10T21:07:04.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c2ed9d640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c280a9490 tx=0x7f9c280abdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9de829b772a0ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2801f030 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c280cf070 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18031870 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9c280b0d00 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c36d37740 10 client.17310 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.787+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56071c2b42f0 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18031870 con 0x56071c2a5d80 2024-09-10T21:07:04.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9c280a7b70 con 0x56071c2a5d80 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 10 client.17310 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 10 client.17310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 20 client.17310 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c2b5820 0x56071c2b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 4 client.17310 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56071c211df0 con 0x56071c2b5820 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c2b5820 0x56071c2b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c2b5820 0x56071c2b7c80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b11279252357b684 server_cookie=3b3a6f9185fc749c in_seq=0 out_seq=0 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.788+0000 7f9c15ffb640 10 client.17310 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2884110319 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56071c211df0 con 0x56071c2b5820 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c15ffb640 10 client.17310 handle_command_reply: tid=0 2024-09-10T21:07:04.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 client.17310 shutdown 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 msgr2=0x56071c2a30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c280a9490 tx=0x7f9c280abdf0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 shutdown_connections 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c2b5820 0x56071c2b7c80 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2a5d80 0x56071c2a30e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c299df0 0x56071c2a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c15ffb640 0 client.17310 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2884110319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.789+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 >> 172.21.15.67:0/2884110319 conn(0x56071c297300 msgr2=0x56071c29ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.790+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 shutdown_connections 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.790+0000 7f9c36d37740 1 -- 172.21.15.67:0/2884110319 wait complete. 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.790+0000 7f9c36d37740 20 client.17310 trim_cache size 0 max 16384 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 Processor -- start 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 -- start start 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2a7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301b2ca0 con 0x56071c299df0 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301b0570 con 0x56071c2994d0 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c36d37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301ae3c0 con 0x56071c2a5d80 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35120/0 (socket says 172.21.15.67:35120) 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 -- 172.21.15.67:0/1169901436 learned_addr learned my addr 172.21.15.67:0/1169901436 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 -- 172.21.15.67:0/1169901436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 msgr2=0x56071c2a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 -- 172.21.15.67:0/1169901436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 msgr2=0x56071c2b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 -- 172.21.15.67:0/1169901436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071c297fe0 con 0x56071c299df0 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.803+0000 7f9c27fff640 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c18005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3d8b7f7e3054ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c17fff640 1 -- 172.21.15.67:0/1169901436 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18044050 con 0x56071c299df0 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c17fff640 1 -- 172.21.15.67:0/1169901436 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18031670 con 0x56071c299df0 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c17fff640 1 -- 172.21.15.67:0/1169901436 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18035040 con 0x56071c299df0 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- 172.21.15.67:0/1169901436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 msgr2=0x56071c2a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009900 tx=0x7f9c18005460 comp rx=0 tx=0).stop 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- 172.21.15.67:0/1169901436 shutdown_connections 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c299df0 0x56071c2a47f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 --2- 172.21.15.67:0/1169901436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c2994d0 0x56071c2b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- 172.21.15.67:0/1169901436 >> 172.21.15.67:0/1169901436 conn(0x56071c297300 msgr2=0x56071c2a40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- 172.21.15.67:0/1169901436 shutdown_connections 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- 172.21.15.67:0/1169901436 wait complete. 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.804+0000 7f9c36d37740 1 -- start start 2024-09-10T21:07:04.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 Processor -- start 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c299df0 0x56071c2abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301aea30 con 0x56071c2994d0 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301afea0 con 0x56071c299df0 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301af100 con 0x56071c2a5d80 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c36d37740 10 client.0 _ll_register_callbacks cb 0x7f9c2800cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35134/0 (socket says 172.21.15.67:35134) 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 -- 172.21.15.67:0/2568336312 learned_addr learned my addr 172.21.15.67:0/2568336312 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c27fff640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c299df0 0x56071c2abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 -- 172.21.15.67:0/2568336312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 msgr2=0x56071c2ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 -- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c299df0 msgr2=0x56071c2abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c299df0 0x56071c2abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 -- 172.21.15.67:0/2568336312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071c2acc10 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c2e59c640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56071c2b84c0 tx=0x7f9c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b57180c587cacfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.805+0000 7f9c15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c20011e60 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c20027630 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c18031670 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9c20035070 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 10 client.17316 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56071c323860 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c18031670 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9c20018040 con 0x56071c2994d0 2024-09-10T21:07:04.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 10 client.17316 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 10 client.17316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 20 client.17316 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c323fc0 0x56071c3263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 4 client.17316 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.806+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 --> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56071c20d8a0 con 0x56071c323fc0 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c27fff640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c323fc0 0x56071c3263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c27fff640 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c323fc0 0x56071c3263e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9c5fd7283f0acf0 server_cookie=be06ee6dfa0605e8 in_seq=0 out_seq=0 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c15ffb640 10 client.17316 ms_handle_connect on v2:172.21.15.83:6836/725743109 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c15ffb640 1 -- 172.21.15.67:0/2568336312 <== mds.2 v2:172.21.15.83:6836/725743109 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56071c20d8a0 con 0x56071c323fc0 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c15ffb640 10 client.17316 handle_command_reply: tid=0 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 client.17316 shutdown 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 msgr2=0x56071c2ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x56071c2b84c0 tx=0x7f9c200046c0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 shutdown_connections 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:6836/725743109,v1:172.21.15.83:6837/725743109] conn(0x56071c323fc0 0x56071c3263e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071c2a5d80 0x56071c2ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56071c299df0 0x56071c2abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 --2- 172.21.15.67:0/2568336312 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56071c2994d0 0x56071c2ae3d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c15ffb640 0 client.17316 ms_handle_reset on v2:172.21.15.83:6836/725743109 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 >> 172.21.15.67:0/2568336312 conn(0x56071c297300 msgr2=0x56071c2a4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 shutdown_connections 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 1 -- 172.21.15.67:0/2568336312 wait complete. 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.807+0000 7f9c36d37740 20 client.17316 trim_cache size 0 max 16384 2024-09-10T21:07:04.035 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 msgr2=0x7f9c1c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 0x7f9c1c0b77a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x56071c2981e0 tx=0x7f9c2000c4b0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 msgr2=0x7f9c301a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800eaa0 tx=0x7f9c2800ef60 comp rx=0 tx=0).stop 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 shutdown_connections 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9c3010f310 0x7f9c301a0d30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9c1c0b52e0 0x7f9c1c0b77a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c30101730 0x7f9c3019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 --2- 172.21.15.67:0/316512555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c30100e10 0x7f9c3019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 >> 172.21.15.67:0/316512555 conn(0x7f9c300fca20 msgr2=0x7f9c300fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 shutdown_connections 2024-09-10T21:07:04.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:03.808+0000 7f9c34962640 1 -- 172.21.15.67:0/316512555 wait complete. 2024-09-10T21:07:04.746 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:04 smithi067 ceph-mon[30891]: pgmap v813: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 531 KiB/s wr, 68 op/s 2024-09-10T21:07:04.782 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:07:04.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:04 smithi083 ceph-mon[35058]: pgmap v813: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 531 KiB/s wr, 68 op/s 2024-09-10T21:07:04.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:04 smithi172 ceph-mon[35265]: pgmap v813: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 531 KiB/s wr, 68 op/s 2024-09-10T21:07:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 -- 172.21.15.67:0/3305040687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0104550 msgr2=0x7f79b010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 --2- 172.21.15.67:0/3305040687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0104550 0x7f79b010cb30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009900 tx=0x7f79a002a410 comp rx=0 tx=0).stop 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 -- 172.21.15.67:0/3305040687 shutdown_connections 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 --2- 172.21.15.67:0/3305040687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 --2- 172.21.15.67:0/3305040687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0104550 0x7f79b010cb30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 --2- 172.21.15.67:0/3305040687 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0103b50 0x7f79b0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.688+0000 7f79b7469640 1 -- 172.21.15.67:0/3305040687 >> 172.21.15.67:0/3305040687 conn(0x7f79b00fd700 msgr2=0x7f79b00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- 172.21.15.67:0/3305040687 shutdown_connections 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- 172.21.15.67:0/3305040687 wait complete. 2024-09-10T21:07:05.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 Processor -- start 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- start start 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 0x7f79b019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b01a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79b0112d80 con 0x7f79b0103b50 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79b0112c00 con 0x7f79b0104550 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.689+0000 7f79b7469640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79b0112f00 con 0x7f79b010d100 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35144/0 (socket says 172.21.15.67:35144) 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 -- 172.21.15.67:0/1266702796 learned_addr learned my addr 172.21.15.67:0/1266702796 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:05.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b4a04640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 0x7f79b019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b01a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 -- 172.21.15.67:0/1266702796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 msgr2=0x7f79b01a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b01a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 -- 172.21.15.67:0/1266702796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 msgr2=0x7f79b019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 0x7f79b019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 -- 172.21.15.67:0/1266702796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b01a1510 con 0x7f79b0103b50 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b4a04640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 0x7f79b019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b01a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b5205640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00e9f0 tx=0x7f79ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79a67fc640 1 -- 172.21.15.67:0/1266702796 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac00cd80 con 0x7f79b0103b50 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b01a1800 con 0x7f79b0103b50 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79a67fc640 1 -- 172.21.15.67:0/1266702796 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79ac0108e0 con 0x7f79b0103b50 2024-09-10T21:07:05.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79a67fc640 1 -- 172.21.15.67:0/1266702796 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac018980 con 0x7f79b0103b50 2024-09-10T21:07:05.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.690+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b01a7ec0 con 0x7f79b0103b50 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 Processor -- start 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79a67fc640 1 -- 172.21.15.67:0/1266702796 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f79ac010430 con 0x7f79b0103b50 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 -- start start 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e98d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e999840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56481e903ea0 con 0x56481e999d80 2024-09-10T21:07:05.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56481e8f32d0 con 0x56481e98d4d0 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.693+0000 7f79b983e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56481e8f70e0 con 0x56481e98ddf0 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35160/0 (socket says 172.21.15.67:35160) 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 -- 172.21.15.67:0/2360381041 learned_addr learned my addr 172.21.15.67:0/2360381041 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b5205640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e999840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b5a06640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e98d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 -- 172.21.15.67:0/2360381041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 msgr2=0x56481e999840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e999840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 -- 172.21.15.67:0/2360381041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 msgr2=0x56481e98d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e98d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 -- 172.21.15.67:0/2360381041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e651650 con 0x56481e999d80 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b5a06640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e98d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:05.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79b4a04640 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009900 tx=0x7f79a0032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a981f1e07e5b59a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f79a67fc640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 0x7f799c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.694+0000 7f799b7fe640 1 -- 172.21.15.67:0/2360381041 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a003f070 con 0x56481e999d80 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 0x7f799c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f799b7fe640 1 -- 172.21.15.67:0/2360381041 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a0032e10 con 0x56481e999d80 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f799b7fe640 1 -- 172.21.15.67:0/2360381041 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0035070 con 0x56481e999d80 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79a67fc640 1 -- 172.21.15.67:0/1266702796 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f79ac0e5fb0 con 0x7f79b0103b50 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 -- 172.21.15.67:0/2360381041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 msgr2=0x56481e99c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009900 tx=0x7f79a0032c20 comp rx=0 tx=0).stop 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 0x7f799c0b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005fd0 tx=0x7f79a8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 -- 172.21.15.67:0/2360381041 shutdown_connections 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e999d80 0x56481e99c170 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e999840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 --2- 172.21.15.67:0/2360381041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e98d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 -- 172.21.15.67:0/2360381041 >> 172.21.15.67:0/2360381041 conn(0x56481e98b300 msgr2=0x56481e98c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 -- 172.21.15.67:0/2360381041 shutdown_connections 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.695+0000 7f79b983e740 1 -- 172.21.15.67:0/2360381041 wait complete. 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 -- start start 2024-09-10T21:07:05.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 Processor -- start 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e9995f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e999d80 0x56481e996fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x56481e754700 con 0x56481e98ddf0 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56481e88e160 con 0x56481e98d4d0 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56481e99c9a0 con 0x56481e999d80 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b983e740 10 client.0 _ll_register_callbacks cb 0x56481e8a79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.696+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35172/0 (socket says 172.21.15.67:35172) 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 -- 172.21.15.67:0/3695898753 learned_addr learned my addr 172.21.15.67:0/3695898753 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b5205640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e9995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b5a06640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e999d80 0x56481e996fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 -- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e999d80 msgr2=0x56481e996fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e999d80 0x56481e996fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 -- 172.21.15.67:0/3695898753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 msgr2=0x56481e9995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e9995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 -- 172.21.15.67:0/3695898753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e8bbc90 con 0x56481e98ddf0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b5205640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e9995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000c00 tx=0x7f79a00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e1fc33ab63fac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f7998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a003f040 con 0x56481e98ddf0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f79a0004440 con 0x56481e98ddf0 2024-09-10T21:07:05.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79a0032e10 con 0x56481e98ddf0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79a0035040 con 0x56481e98ddf0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b983e740 10 client.17328 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.697+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56481e9a8280 con 0x56481e98ddf0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a0032e10 con 0x56481e98ddf0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f79a0004960 con 0x56481e98ddf0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 10 client.17328 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 10 client.17328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 20 client.17328 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481e9a95d0 0x56481e9ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 4 client.17328 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56481e905df0 con 0x56481e9a95d0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.698+0000 7f79b5205640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481e9a95d0 0x56481e9ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.699+0000 7f79b5205640 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481e9a95d0 0x56481e9ab9c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7522c942a90e7f1 server_cookie=95a8b93a9990df77 in_seq=0 out_seq=0 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.699+0000 7f7998ff9640 10 client.17328 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.699+0000 7f7998ff9640 1 -- 172.21.15.67:0/3695898753 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56481e905df0 con 0x56481e9a95d0 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.699+0000 7f7998ff9640 10 client.17328 handle_command_reply: tid=0 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 client.17328 shutdown 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 msgr2=0x56481e996a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000c00 tx=0x7f79a00316d0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 shutdown_connections 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481e9a95d0 0x56481e9ab9c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e999d80 0x56481e996fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e996a40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 --2- 172.21.15.67:0/3695898753 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e98d4d0 0x56481e9995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 >> 172.21.15.67:0/3695898753 conn(0x56481e98b300 msgr2=0x56481e990e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f7998ff9640 0 client.17328 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:07:05.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 shutdown_connections 2024-09-10T21:07:05.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 1 -- 172.21.15.67:0/3695898753 wait complete. 2024-09-10T21:07:05.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.700+0000 7f79b983e740 20 client.17328 trim_cache size 0 max 16384 2024-09-10T21:07:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 Processor -- start 2024-09-10T21:07:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 -- start start 2024-09-10T21:07:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98d4d0 0x56481e98c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481e993c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01b2d70 con 0x56481e98ddf0 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01b0640 con 0x56481e999d80 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.713+0000 7f79b983e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01ae490 con 0x56481e98d4d0 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35182/0 (socket says 172.21.15.67:35182) 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 -- 172.21.15.67:0/1083906520 learned_addr learned my addr 172.21.15.67:0/1083906520 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b5205640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98d4d0 0x56481e98c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481e993c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 -- 172.21.15.67:0/1083906520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98d4d0 msgr2=0x56481e98c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98d4d0 0x56481e98c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 -- 172.21.15.67:0/1083906520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 msgr2=0x56481e993c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481e993c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 -- 172.21.15.67:0/1083906520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56481e99c8e0 con 0x56481e98ddf0 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b5a06640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481e993c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f79b4a04640 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f79a0004d80 tx=0x7f79a00056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f963bb0b9f8f076b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f799affd640 1 -- 172.21.15.67:0/1083906520 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a005b020 con 0x56481e98ddf0 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f799affd640 1 -- 172.21.15.67:0/1083906520 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a0004240 con 0x56481e98ddf0 2024-09-10T21:07:05.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.714+0000 7f799affd640 1 -- 172.21.15.67:0/1083906520 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a003f030 con 0x56481e98ddf0 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- 172.21.15.67:0/1083906520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 msgr2=0x56481e998780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f79a0004d80 tx=0x7f79a00056f0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- 172.21.15.67:0/1083906520 shutdown_connections 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481e993c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98ddf0 0x56481e998780 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 --2- 172.21.15.67:0/1083906520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98d4d0 0x56481e98c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- 172.21.15.67:0/1083906520 >> 172.21.15.67:0/1083906520 conn(0x56481e98b300 msgr2=0x56481e998070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- 172.21.15.67:0/1083906520 shutdown_connections 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- 172.21.15.67:0/1083906520 wait complete. 2024-09-10T21:07:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 -- start start 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.715+0000 7f79b983e740 1 Processor -- start 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e9ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481ea15140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01aeb00 con 0x56481e98d4d0 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01aff70 con 0x56481e999d80 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79b01af1d0 con 0x56481e98ddf0 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b983e740 10 client.0 _ll_register_callbacks cb 0x7f79ac0e99f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35192/0 (socket says 172.21.15.67:35192) 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 -- 172.21.15.67:0/3738062325 learned_addr learned my addr 172.21.15.67:0/3738062325 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e9ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5a06640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481ea15140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 -- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 msgr2=0x56481e9ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e9ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 -- 172.21.15.67:0/3738062325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 msgr2=0x56481ea15140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481ea15140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 -- 172.21.15.67:0/3738062325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56481e98bd80 con 0x56481e98d4d0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e9ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5a06640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481ea15140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f79b5205640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ac7d0 tx=0x7f79ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75464118d9c9a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.716+0000 7f7998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0ac610 con 0x56481e98d4d0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f79ac0e8110 con 0x56481e98d4d0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79a0004240 con 0x56481e98d4d0 2024-09-10T21:07:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79ac0abfb0 con 0x56481e98d4d0 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 10 client.17334 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56481ea16790 con 0x56481e98d4d0 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79a0004240 con 0x56481e98d4d0 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f79ac0cfb90 con 0x56481e98d4d0 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 10 client.17334 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 10 client.17334 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 20 client.17334 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481ea16f00 0x56481ea192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 4 client.17334 mds_command: new command op to 24583 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 --> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56481e9018a0 con 0x56481ea16f00 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.717+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481ea16f00 0x56481ea192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b4a04640 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481ea16f00 0x56481ea192f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=937bfa6e12ff109f server_cookie=d4e1f9c82c26f6aa in_seq=0 out_seq=0 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f7998ff9640 10 client.17334 ms_handle_connect on v2:172.21.15.172:6838/977540301 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f7998ff9640 1 -- 172.21.15.67:0/3738062325 <== mds.1 v2:172.21.15.172:6838/977540301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56481e9018a0 con 0x56481ea16f00 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f7998ff9640 10 client.17334 handle_command_reply: tid=0 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 client.17334 shutdown 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 msgr2=0x56481e9acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ac7d0 tx=0x7f79ac000bc0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 shutdown_connections 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:6838/977540301,v1:172.21.15.172:6839/977540301] conn(0x56481ea16f00 0x56481ea192f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56481e999d80 0x56481ea15140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56481e98ddf0 0x56481e9ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 --2- 172.21.15.67:0/3738062325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x56481e98d4d0 0x56481e9acc80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 >> 172.21.15.67:0/3738062325 conn(0x56481e98b300 msgr2=0x56481e998890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f7998ff9640 0 client.17334 ms_handle_reset on v2:172.21.15.172:6838/977540301 2024-09-10T21:07:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 shutdown_connections 2024-09-10T21:07:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.718+0000 7f79b983e740 1 -- 172.21.15.67:0/3738062325 wait complete. 2024-09-10T21:07:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b983e740 20 client.17334 trim_cache size 0 max 16384 2024-09-10T21:07:05.729 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:07:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 msgr2=0x7f799c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 0x7f799c0b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005fd0 tx=0x7f79a8009500 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 msgr2=0x7f79b019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00e9f0 tx=0x7f79ac00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 shutdown_connections 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f799c0b52e0 0x7f799c0b77a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79b010d100 0x7f79b01a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79b0104550 0x7f79b019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 --2- 172.21.15.67:0/1266702796 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79b0103b50 0x7f79b019b460 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 >> 172.21.15.67:0/1266702796 conn(0x7f79b00fd700 msgr2=0x7f79b00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 shutdown_connections 2024-09-10T21:07:05.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:05.719+0000 7f79b7469640 1 -- 172.21.15.67:0/1266702796 wait complete. 2024-09-10T21:07:06.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:07:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:06.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:06 smithi067 ceph-mon[30891]: pgmap v814: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 130 KiB/s wr, 24 op/s 2024-09-10T21:07:06.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:06 smithi083 ceph-mon[35058]: pgmap v814: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 130 KiB/s wr, 24 op/s 2024-09-10T21:07:06.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:06 smithi172 ceph-mon[35265]: pgmap v814: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 130 KiB/s wr, 24 op/s 2024-09-10T21:07:07.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 -- 172.21.15.67:0/3138706447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f44109150 msgr2=0x7f8f4410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 --2- 172.21.15.67:0/3138706447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f44109150 0x7f8f4410f950 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009ca0 tx=0x7f8f3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 -- 172.21.15.67:0/3138706447 shutdown_connections 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 --2- 172.21.15.67:0/3138706447 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f44109150 0x7f8f4410f950 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 --2- 172.21.15.67:0/3138706447 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f441087d0 0x7f8f44108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 --2- 172.21.15.67:0/3138706447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44102dc0 0x7f8f441031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 -- 172.21.15.67:0/3138706447 >> 172.21.15.67:0/3138706447 conn(0x7f8f440fe830 msgr2=0x7f8f44100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 -- 172.21.15.67:0/3138706447 shutdown_connections 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.240+0000 7f8f49f35640 1 -- 172.21.15.67:0/3138706447 wait complete. 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 Processor -- start 2024-09-10T21:07:07.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 -- start start 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f44102dc0 0x7f8f44199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 0x7f8f4419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44112dd0 con 0x7f8f441087d0 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44112c50 con 0x7f8f44102dc0 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f49f35640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44112f50 con 0x7f8f44109150 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f42ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35212/0 (socket says 172.21.15.67:35212) 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f42ffd640 1 -- 172.21.15.67:0/201432067 learned_addr learned my addr 172.21.15.67:0/201432067 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:07.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f437fe640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f44102dc0 0x7f8f44199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.241+0000 7f8f43fff640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 0x7f8f4419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 -- 172.21.15.67:0/201432067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 msgr2=0x7f8f4419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 0x7f8f4419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 -- 172.21.15.67:0/201432067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f44102dc0 msgr2=0x7f8f44199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f44102dc0 0x7f8f44199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 -- 172.21.15.67:0/201432067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4419f310 con 0x7f8f441087d0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f43fff640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 0x7f8f4419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800d950 tx=0x7f8f3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f40ff9640 1 -- 172.21.15.67:0/201432067 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38017070 con 0x7f8f441087d0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f40ff9640 1 -- 172.21.15.67:0/201432067 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f38009c30 con 0x7f8f441087d0 2024-09-10T21:07:07.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4419f600 con 0x7f8f441087d0 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f40ff9640 1 -- 172.21.15.67:0/201432067 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3800f620 con 0x7f8f441087d0 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.242+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f441a5cc0 con 0x7f8f441087d0 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 Processor -- start 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 -- start start 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f40ff9640 1 -- 172.21.15.67:0/201432067 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8f38010460 con 0x7f8f441087d0 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abf0f0 0x5569b9abf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9acdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569b9a35ea0 con 0x5569b9abfa10 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5569b9a252d0 con 0x5569b9acb9a0 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.245+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569b9a290e0 con 0x5569b9abf0f0 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35216/0 (socket says 172.21.15.67:35216) 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 -- 172.21.15.67:0/2793176879 learned_addr learned my addr 172.21.15.67:0/2793176879 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abf0f0 0x5569b9abf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9acdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 -- 172.21.15.67:0/2793176879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abf0f0 msgr2=0x5569b9abf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abf0f0 0x5569b9abf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 -- 172.21.15.67:0/2793176879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 msgr2=0x5569b9acdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9acdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 -- 172.21.15.67:0/2793176879 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b9783650 con 0x5569b9abfa10 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9acdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400ac10 tx=0x7f8f3400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67c7c35538ec4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f40ff9640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 0x7f8f2c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f29ffb640 1 -- 172.21.15.67:0/2793176879 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401d070 con 0x5569b9abfa10 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f29ffb640 1 -- 172.21.15.67:0/2793176879 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34018af0 con 0x5569b9abfa10 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.246+0000 7f8f43fff640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 0x7f8f2c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f40ff9640 1 -- 172.21.15.67:0/201432067 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8f380e5840 con 0x7f8f441087d0 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f29ffb640 1 -- 172.21.15.67:0/2793176879 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34010a60 con 0x5569b9abfa10 2024-09-10T21:07:07.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2793176879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 msgr2=0x5569b9acb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f43fff640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 0x7f8f2c0b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009a60 tx=0x7f8f3c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400ac10 tx=0x7f8f3400f790 comp rx=0 tx=0).stop 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2793176879 shutdown_connections 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9acdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abfa10 0x5569b9acb460 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2793176879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abf0f0 0x5569b9abf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2793176879 >> 172.21.15.67:0/2793176879 conn(0x5569b9abcf20 msgr2=0x5569b9abe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2793176879 shutdown_connections 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.247+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2793176879 wait complete. 2024-09-10T21:07:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 -- start start 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 Processor -- start 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abf0f0 0x5569b9acb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x5569b9886700 con 0x5569b9acb9a0 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5569b99c0160 con 0x5569b9abf0f0 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569b9ace670 con 0x5569b9abfa10 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f4c30a740 10 client.0 _ll_register_callbacks cb 0x5569b99d99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f43fff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35228/0 (socket says 172.21.15.67:35228) 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f43fff640 1 -- 172.21.15.67:0/2347847517 learned_addr learned my addr 172.21.15.67:0/2347847517 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.248+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abf0f0 0x5569b9acb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 -- 172.21.15.67:0/2347847517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 msgr2=0x5569b9ac8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 -- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abf0f0 msgr2=0x5569b9acb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abf0f0 0x5569b9acb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 -- 172.21.15.67:0/2347847517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b99edc90 con 0x5569b9acb9a0 2024-09-10T21:07:07.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c035000 tx=0x7f8f3c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca0d41fd30d8685 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c003e30 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8f3c004040 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f34018af0 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f3c004240 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f4c30a740 10 client.17346 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5569b9ad9e30 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.249+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34018af0 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8f3c051020 con 0x5569b9acb9a0 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 10 client.17346 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 10 client.17346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 20 client.17346 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9adb2e0 0x5569b9add720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 4 client.17346 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b9a37df0 con 0x5569b9adb2e0 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9adb2e0 0x5569b9add720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f22ffd640 10 client.17346 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.250+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9adb2e0 0x5569b9add720 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e171a8665571df server_cookie=4dee9c3420e91991 in_seq=0 out_seq=0 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f22ffd640 1 -- 172.21.15.67:0/2347847517 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569b9a37df0 con 0x5569b9adb2e0 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f22ffd640 10 client.17346 handle_command_reply: tid=0 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 client.17346 shutdown 2024-09-10T21:07:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 msgr2=0x5569b9ac8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c035000 tx=0x7f8f3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 shutdown_connections 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9adb2e0 0x5569b9add720 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9acb9a0 0x5569b9ac8ac0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2347847517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abf0f0 0x5569b9acb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f22ffd640 0 client.17346 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 >> 172.21.15.67:0/2347847517 conn(0x5569b9abcf20 msgr2=0x5569b9ac2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 shutdown_connections 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.251+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2347847517 wait complete. 2024-09-10T21:07:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.252+0000 7f8f4c30a740 20 client.17346 trim_cache size 0 max 16384 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 Processor -- start 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 -- start start 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9ac5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441b0bd0 con 0x5569b9abf0f0 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441ae4a0 con 0x5569b9acb9a0 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441ac2f0 con 0x5569b9abfa10 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35230/0 (socket says 172.21.15.67:35230) 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 -- 172.21.15.67:0/2702300010 learned_addr learned my addr 172.21.15.67:0/2702300010 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9ac5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 -- 172.21.15.67:0/2702300010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 msgr2=0x5569b9ac5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 -- 172.21.15.67:0/2702300010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 msgr2=0x5569b9ac5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9ac5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f437fe640 1 -- 172.21.15.67:0/2702300010 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b9abe600 con 0x5569b9abf0f0 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.265+0000 7f8f43fff640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9ac5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f437fe640 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f340106f0 tx=0x7f8f3400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d19ff8b57811b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f297fa640 1 -- 172.21.15.67:0/2702300010 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401d040 con 0x5569b9abf0f0 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f297fa640 1 -- 172.21.15.67:0/2702300010 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34010430 con 0x5569b9abf0f0 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f297fa640 1 -- 172.21.15.67:0/2702300010 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340109f0 con 0x5569b9abf0f0 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2702300010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 msgr2=0x5569b9abde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f340106f0 tx=0x7f8f3400f790 comp rx=0 tx=0).stop 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2702300010 shutdown_connections 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9acb9a0 0x5569b9ac5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9abfa10 0x5569b9ac5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/2702300010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9abde30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.266+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2702300010 >> 172.21.15.67:0/2702300010 conn(0x5569b9abcf20 msgr2=0x5569b9ac6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2702300010 shutdown_connections 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- 172.21.15.67:0/2702300010 wait complete. 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- start start 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 Processor -- start 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abfa10 0x5569b9ad4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9acb9a0 0x5569b9aceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441ac960 con 0x5569b9abf0f0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441addd0 con 0x5569b9abfa10 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.267+0000 7f8f4c30a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f441ad030 con 0x5569b9acb9a0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f4c30a740 10 client.0 _ll_register_callbacks cb 0x7f8f3c009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35232/0 (socket says 172.21.15.67:35232) 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 -- 172.21.15.67:0/884834070 learned_addr learned my addr 172.21.15.67:0/884834070 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abfa10 0x5569b9ad4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f43fff640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9acb9a0 0x5569b9aceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 -- 172.21.15.67:0/884834070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9acb9a0 msgr2=0x5569b9aceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9acb9a0 0x5569b9aceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 -- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abfa10 msgr2=0x5569b9ad4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abfa10 0x5569b9ad4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 -- 172.21.15.67:0/884834070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b9acf3c0 con 0x5569b9abf0f0 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f437fe640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400a9a0 tx=0x7f8f3400afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec206f925a7bfc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f22ffd640 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34032050 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8f34005240 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.268+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f34010430 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f34005440 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 10 client.17352 fetch_fsmap learned FSMap version 34 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5569b9b48f40 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34010430 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8f3402c040 con 0x5569b9abf0f0 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 10 client.17352 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 20 client.17352 populate_metadata read hostname 'smithi067' 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9b49410 0x5569b9b4b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 4 client.17352 mds_command: new command op to 24608 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 --> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569b9a338a0 con 0x5569b9b49410 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.269+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9b49410 0x5569b9b4b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f22ffd640 10 client.17352 ms_handle_connect on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f42ffd640 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9b49410 0x5569b9b4b830 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9994636b53c728a7 server_cookie=c5b37b487dfb17bd in_seq=0 out_seq=0 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f22ffd640 1 -- 172.21.15.67:0/884834070 <== mds.0 v2:172.21.15.83:6838/4114167156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569b9a338a0 con 0x5569b9b49410 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f22ffd640 10 client.17352 handle_command_reply: tid=0 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 client.17352 shutdown 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 msgr2=0x5569b9ad3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400a9a0 tx=0x7f8f3400afa0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 shutdown_connections 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:6838/4114167156,v1:172.21.15.83:6839/4114167156] conn(0x5569b9b49410 0x5569b9b4b830 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569b9acb9a0 0x5569b9aceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f22ffd640 0 client.17352 ms_handle_reset on v2:172.21.15.83:6838/4114167156 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5569b9abfa10 0x5569b9ad4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 --2- 172.21.15.67:0/884834070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x5569b9abf0f0 0x5569b9ad3dd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 >> 172.21.15.67:0/884834070 conn(0x5569b9abcf20 msgr2=0x5569b9ac6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 shutdown_connections 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 1 -- 172.21.15.67:0/884834070 wait complete. 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.270+0000 7f8f4c30a740 20 client.17352 trim_cache size 0 max 16384 2024-09-10T21:07:07.295 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-10T21:07:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 msgr2=0x7f8f2c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 0x7f8f2c0b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009a60 tx=0x7f8f3c005c30 comp rx=0 tx=0).stop 2024-09-10T21:07:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 msgr2=0x7f8f441997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800d950 tx=0x7f8f3800de10 comp rx=0 tx=0).stop 2024-09-10T21:07:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 shutdown_connections 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f8f2c0b52e0 0x7f8f2c0b77a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f44109150 0x7f8f4419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8f441087d0 0x7f8f441997a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 --2- 172.21.15.67:0/201432067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f44102dc0 0x7f8f44199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 >> 172.21.15.67:0/201432067 conn(0x7f8f440fe830 msgr2=0x7f8f440ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 shutdown_connections 2024-09-10T21:07:07.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:07.271+0000 7f8f49f35640 1 -- 172.21.15.67:0/201432067 wait complete. 2024-09-10T21:07:07.992 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T21:07:07.994 INFO:tasks.fwd_scrub:done joining 2024-09-10T21:07:07.994 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T21:07:08.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2237195189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78105e50 msgr2=0x7f9b78108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2237195189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78105e50 0x7f9b78108240 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009900 tx=0x7f9b6c02a410 comp rx=0 tx=0).stop 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2237195189 shutdown_connections 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2237195189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78108780 0x7f9b7810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2237195189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78105e50 0x7f9b78108240 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2237195189 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 0x7f9b78101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2237195189 >> 172.21.15.67:0/2237195189 conn(0x7f9b780fc8d0 msgr2=0x7f9b780fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2237195189 shutdown_connections 2024-09-10T21:07:08.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.106+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2237195189 wait complete. 2024-09-10T21:07:08.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 Processor -- start 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 -- start start 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 0x7f9b78198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78105e50 0x7f9b78199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7810e6a0 con 0x7f9b78108780 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7810e520 con 0x7f9b78100d90 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.107+0000 7f9b7d82a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7810e820 con 0x7f9b78105e50 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35248/0 (socket says 172.21.15.67:35248) 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 -- 172.21.15.67:0/2332838571 learned_addr learned my addr 172.21.15.67:0/2332838571 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b76ffd640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 0x7f9b78198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b767fc640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78105e50 0x7f9b78199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 -- 172.21.15.67:0/2332838571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78105e50 msgr2=0x7f9b78199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78105e50 0x7f9b78199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 -- 172.21.15.67:0/2332838571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 msgr2=0x7f9b78198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 0x7f9b78198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 -- 172.21.15.67:0/2332838571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7819a930 con 0x7f9b78108780 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b777fe640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000b9e0 tx=0x7f9b7000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70019070 con 0x7f9b78108780 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b70014440 con 0x7f9b78108780 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7819ac20 con 0x7f9b78108780 2024-09-10T21:07:08.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b700125a0 con 0x7f9b78108780 2024-09-10T21:07:08.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.108+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b781a12f0 con 0x7f9b78108780 2024-09-10T21:07:08.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.109+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b780fe3c0 con 0x7f9b78108780 2024-09-10T21:07:08.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.111+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f9b700145f0 con 0x7f9b78108780 2024-09-10T21:07:08.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.111+0000 7f9b7c828640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 0x7f9b600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.112+0000 7f9b76ffd640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 0x7f9b600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.112+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9b700e5840 con 0x7f9b78108780 2024-09-10T21:07:08.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.112+0000 7f9b76ffd640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 0x7f9b600b7820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800bbe0 tx=0x7f9b6800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.115+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b700ac0e0 con 0x7f9b78108780 2024-09-10T21:07:08.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.301+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b7802e810 con 0x7f9b78108780 2024-09-10T21:07:08.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.302+0000 7f9b7c828640 1 -- 172.21.15.67:0/2332838571 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7f9b700b0b10 con 0x7f9b78108780 2024-09-10T21:07:08.307 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:08.307 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 msgr2=0x7f9b600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 0x7f9b600b7820 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800bbe0 tx=0x7f9b6800b390 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 msgr2=0x7f9b7819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000b9e0 tx=0x7f9b7000bea0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 shutdown_connections 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9b78108780 0x7f9b7819a070 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f9b600b5360 0x7f9b600b7820 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b78105e50 0x7f9b78199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 --2- 172.21.15.67:0/2332838571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b78100d90 0x7f9b78198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.304+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 >> 172.21.15.67:0/2332838571 conn(0x7f9b780fc8d0 msgr2=0x7f9b78106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.305+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 shutdown_connections 2024-09-10T21:07:08.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.305+0000 7f9b7d82a640 1 -- 172.21.15.67:0/2332838571 wait complete. 2024-09-10T21:07:08.320 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T20:44:51.135967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T20:49:21.721858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T20:49:23.984209+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:07:08.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 -- 172.21.15.67:0/2125732364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58103370 msgr2=0x7f5b58109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2125732364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58103370 0x7f5b58109cf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009930 tx=0x7f5b5002a420 comp rx=0 tx=0).stop 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 -- 172.21.15.67:0/2125732364 shutdown_connections 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2125732364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58103370 0x7f5b58109cf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2125732364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b581029b0 0x7f5b58102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2125732364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b58101860 0x7f5b58101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 -- 172.21.15.67:0/2125732364 >> 172.21.15.67:0/2125732364 conn(0x7f5b580fd140 msgr2=0x7f5b580ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 -- 172.21.15.67:0/2125732364 shutdown_connections 2024-09-10T21:07:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.423+0000 7f5b5c964640 1 -- 172.21.15.67:0/2125732364 wait complete. 2024-09-10T21:07:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 Processor -- start 2024-09-10T21:07:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 -- start start 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 0x7f5b58103e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 0x7f5b581043a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810d550 con 0x7f5b58101860 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810d3d0 con 0x7f5b58103370 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5c964640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5810d6d0 con 0x7f5b581029b0 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35272/0 (socket says 172.21.15.67:35272) 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b5659c640 1 -- 172.21.15.67:0/2769006241 learned_addr learned my addr 172.21.15.67:0/2769006241 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.424+0000 7f5b55d9b640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 0x7f5b58103e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b56d9d640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 0x7f5b581043a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 -- 172.21.15.67:0/2769006241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 msgr2=0x7f5b58103e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 0x7f5b58103e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 -- 172.21.15.67:0/2769006241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 msgr2=0x7f5b581043a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 0x7f5b581043a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 -- 172.21.15.67:0/2769006241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b58104c10 con 0x7f5b58101860 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b55d9b640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 0x7f5b58103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b56d9d640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 0x7f5b581043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5659c640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800ea80 tx=0x7f5b4800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800ce40 con 0x7f5b58101860 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b48005020 con 0x7f5b58101860 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b581a2e70 con 0x7f5b58101860 2024-09-10T21:07:08.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b480116d0 con 0x7f5b58101860 2024-09-10T21:07:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.425+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581a3350 con 0x7f5b58101860 2024-09-10T21:07:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.426+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b581a35e0 con 0x7f5b58101860 2024-09-10T21:07:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.427+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f5b4800f040 con 0x7f5b58101860 2024-09-10T21:07:08.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.428+0000 7f5b4f7fe640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 0x7f5b440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.428+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5b480e5fa0 con 0x7f5b58101860 2024-09-10T21:07:08.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.428+0000 7f5b55d9b640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 0x7f5b440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.429+0000 7f5b55d9b640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 0x7f5b440b7820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009930 tx=0x7f5b40008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.431+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5b48016030 con 0x7f5b58101860 2024-09-10T21:07:08.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.616+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5b581a38d0 con 0x7f5b58101860 2024-09-10T21:07:08.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.616+0000 7f5b4f7fe640 1 -- 172.21.15.67:0/2769006241 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f5b480aceb0 con 0x7f5b58101860 2024-09-10T21:07:08.620 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2024-09-10T21:07:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 msgr2=0x7f5b440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 0x7f5b440b7820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009930 tx=0x7f5b40008040 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 msgr2=0x7f5b58105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800ea80 tx=0x7f5b4800ef40 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 shutdown_connections 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b58103370 0x7f5b581043a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f5b440b5360 0x7f5b440b7820 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b581029b0 0x7f5b58103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 --2- 172.21.15.67:0/2769006241 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b58101860 0x7f5b58105600 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 >> 172.21.15.67:0/2769006241 conn(0x7f5b580fd140 msgr2=0x7f5b580feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 shutdown_connections 2024-09-10T21:07:08.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.618+0000 7f5b5c964640 1 -- 172.21.15.67:0/2769006241 wait complete. 2024-09-10T21:07:08.633 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T21:07:08.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 -- 172.21.15.67:0/2209556735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 msgr2=0x7fe188105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/2209556735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188105620 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe178009900 tx=0x7fe17802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:08.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 -- 172.21.15.67:0/2209556735 shutdown_connections 2024-09-10T21:07:08.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/2209556735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe18810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/2209556735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe188107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/2209556735 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188105620 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 -- 172.21.15.67:0/2209556735 >> 172.21.15.67:0/2209556735 conn(0x7fe1880fd150 msgr2=0x7fe1880ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 -- 172.21.15.67:0/2209556735 shutdown_connections 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.736+0000 7fe18c8ef640 1 -- 172.21.15.67:0/2209556735 wait complete. 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 Processor -- start 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 -- start start 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe1881015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe188101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe18810e680 con 0x7fe18806bde0 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe18810e500 con 0x7fe1881086b0 2024-09-10T21:07:08.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18c8ef640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe18810e800 con 0x7fe188105b60 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35300/0 (socket says 172.21.15.67:35300) 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 -- 172.21.15.67:0/4041632539 learned_addr learned my addr 172.21.15.67:0/4041632539 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe17ffff640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe1881015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 -- 172.21.15.67:0/4041632539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 msgr2=0x7fe1881015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe186d9d640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe188101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe1881015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 -- 172.21.15.67:0/4041632539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 msgr2=0x7fe188101b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe188101b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 -- 172.21.15.67:0/4041632539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe188102370 con 0x7fe18806bde0 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe17ffff640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe1881015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe186d9d640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe188101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:08.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.737+0000 7fe18659c640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe178031500 tx=0x7fe1780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.738+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17803f030 con 0x7fe18806bde0 2024-09-10T21:07:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.738+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe178003800 con 0x7fe18806bde0 2024-09-10T21:07:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.738+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178035070 con 0x7fe18806bde0 2024-09-10T21:07:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.738+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1881a2e80 con 0x7fe18806bde0 2024-09-10T21:07:08.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.738+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1881a3310 con 0x7fe18806bde0 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.739+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1880fec40 con 0x7fe18806bde0 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.740+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe178031b10 con 0x7fe18806bde0 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.741+0000 7fe17f7fe640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 0x7fe1740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.741+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe1781067a0 con 0x7fe18806bde0 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.741+0000 7fe17ffff640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 0x7fe1740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:08.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.741+0000 7fe17ffff640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 0x7fe1740b7820 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe170006fd0 tx=0x7fe170008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:08.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.744+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1780cd690 con 0x7fe18806bde0 2024-09-10T21:07:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:08 smithi083 ceph-mon[35058]: pgmap v815: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2024-09-10T21:07:08.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:08 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2332838571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:08.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.932+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe188063ea0 con 0x7fe18806bde0 2024-09-10T21:07:08.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.933+0000 7fe17f7fe640 1 -- 172.21.15.67:0/4041632539 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7fe1780ccf90 con 0x7fe18806bde0 2024-09-10T21:07:08.937 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 msgr2=0x7fe1740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 0x7fe1740b7820 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe170006fd0 tx=0x7fe170008040 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 msgr2=0x7fe188102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe178031500 tx=0x7fe1780043c0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 shutdown_connections 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1881086b0 0x7fe188101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe1740b5360 0x7fe1740b7820 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe188105b60 0x7fe1881015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 --2- 172.21.15.67:0/4041632539 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe18806bde0 0x7fe188102d60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 >> 172.21.15.67:0/4041632539 conn(0x7fe1880fd150 msgr2=0x7fe188103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 shutdown_connections 2024-09-10T21:07:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:08.935+0000 7fe18c8ef640 1 -- 172.21.15.67:0/4041632539 wait complete. 2024-09-10T21:07:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:08 smithi172 ceph-mon[35265]: pgmap v815: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2024-09-10T21:07:08.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:08 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2332838571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:08.949 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:08 smithi067 ceph-mon[30891]: pgmap v815: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.9 KiB/s wr, 8 op/s 2024-09-10T21:07:08.950 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:08 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2332838571' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:08.950 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 -- 172.21.15.67:0/1975881778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf901029e0 msgr2=0x7fcf90102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 --2- 172.21.15.67:0/1975881778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf901029e0 0x7fcf90102e60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009930 tx=0x7fcf7802a420 comp rx=0 tx=0).stop 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 -- 172.21.15.67:0/1975881778 shutdown_connections 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 --2- 172.21.15.67:0/1975881778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901033a0 0x7fcf90109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 --2- 172.21.15.67:0/1975881778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf901029e0 0x7fcf90102e60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 --2- 172.21.15.67:0/1975881778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf90101890 0x7fcf90101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 -- 172.21.15.67:0/1975881778 >> 172.21.15.67:0/1975881778 conn(0x7fcf900fd150 msgr2=0x7fcf900ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 -- 172.21.15.67:0/1975881778 shutdown_connections 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.052+0000 7fcf97023640 1 -- 172.21.15.67:0/1975881778 wait complete. 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 Processor -- start 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 -- start start 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 0x7fcf901994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 0x7fcf9019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d550 con 0x7fcf90101890 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d3d0 con 0x7fcf901033a0 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf97023640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d6d0 con 0x7fcf901029e0 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35326/0 (socket says 172.21.15.67:35326) 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 -- 172.21.15.67:0/2091164767 learned_addr learned my addr 172.21.15.67:0/2091164767 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf955c0640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 0x7fcf9019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf8ffff640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 0x7fcf901994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 -- 172.21.15.67:0/2091164767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 msgr2=0x7fcf901994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 0x7fcf901994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 -- 172.21.15.67:0/2091164767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 msgr2=0x7fcf9019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 0x7fcf9019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf94dbf640 1 -- 172.21.15.67:0/2091164767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9019a990 con 0x7fcf90101890 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf8ffff640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 0x7fcf901994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.053+0000 7fcf955c0640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 0x7fcf9019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf94dbf640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000cce0 tx=0x7fcf8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80004b20 con 0x7fcf90101890 2024-09-10T21:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf80004cc0 con 0x7fcf90101890 2024-09-10T21:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9019ac80 con 0x7fcf90101890 2024-09-10T21:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000f6b0 con 0x7fcf90101890 2024-09-10T21:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.054+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf901a1350 con 0x7fcf90101890 2024-09-10T21:07:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.055+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf901a1580 con 0x7fcf90101890 2024-09-10T21:07:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.056+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcf8000f850 con 0x7fcf90101890 2024-09-10T21:07:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.057+0000 7fcf8dffb640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 0x7fcf7c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.057+0000 7fcf8ffff640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 0x7fcf7c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.057+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcf800e5c60 con 0x7fcf90101890 2024-09-10T21:07:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.058+0000 7fcf8ffff640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 0x7fcf7c0b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802a940 tx=0x7fcf78000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.061+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcf80014030 con 0x7fcf90101890 2024-09-10T21:07:09.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.244+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcf901a1750 con 0x7fcf90101890 2024-09-10T21:07:09.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.245+0000 7fcf8dffb640 1 -- 172.21.15.67:0/2091164767 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7fcf800acb50 con 0x7fcf90101890 2024-09-10T21:07:09.249 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2024-09-10T21:07:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 msgr2=0x7fcf7c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 0x7fcf7c0b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcf7802a940 tx=0x7fcf78000bc0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 msgr2=0x7fcf90198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000cce0 tx=0x7fcf8000a620 comp rx=0 tx=0).stop 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 shutdown_connections 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf901033a0 0x7fcf9019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fcf7c0b5360 0x7fcf7c0b7820 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf901029e0 0x7fcf901994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 --2- 172.21.15.67:0/2091164767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcf90101890 0x7fcf90198e50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 >> 172.21.15.67:0/2091164767 conn(0x7fcf900fd150 msgr2=0x7fcf900febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 shutdown_connections 2024-09-10T21:07:09.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.247+0000 7fcf97023640 1 -- 172.21.15.67:0/2091164767 wait complete. 2024-09-10T21:07:09.262 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T21:07:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.362+0000 7fccf9e57640 1 -- 172.21.15.67:0/3644078514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf41018b0 msgr2=0x7fccf4101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.362+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3644078514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf41018b0 0x7fccf4101cb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009930 tx=0x7fcce402a420 comp rx=0 tx=0).stop 2024-09-10T21:07:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- 172.21.15.67:0/3644078514 shutdown_connections 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3644078514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41033c0 0x7fccf4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3644078514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf4102a00 0x7fccf4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3644078514 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf41018b0 0x7fccf4101cb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- 172.21.15.67:0/3644078514 >> 172.21.15.67:0/3644078514 conn(0x7fccf40fd190 msgr2=0x7fccf40ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- 172.21.15.67:0/3644078514 shutdown_connections 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- 172.21.15.67:0/3644078514 wait complete. 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 Processor -- start 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- start start 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 0x7fccf4197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf41033c0 0x7fccf4198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.363+0000 7fccf9e57640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410d500 con 0x7fccf4102a00 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf9e57640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410d380 con 0x7fccf41018b0 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf9e57640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fccf410d680 con 0x7fccf41033c0 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35344/0 (socket says 172.21.15.67:35344) 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 -- 172.21.15.67:0/3023983259 learned_addr learned my addr 172.21.15.67:0/3023983259 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf37fe640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 0x7fccf4197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf3fff640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf41033c0 0x7fccf4198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 -- 172.21.15.67:0/3023983259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf41033c0 msgr2=0x7fccf4198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf41033c0 0x7fccf4198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 -- 172.21.15.67:0/3023983259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 msgr2=0x7fccf4197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 0x7fccf4197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 -- 172.21.15.67:0/3023983259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf4199850 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf37fe640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 0x7fccf4197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf2ffd640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcce800d950 tx=0x7fcce800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8017030 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce8004020 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf4199b40 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce80047a0 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.364+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf41a0210 con 0x7fccf4102a00 2024-09-10T21:07:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.365+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf4108c40 con 0x7fccf4102a00 2024-09-10T21:07:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.367+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fcce8009a30 con 0x7fccf4102a00 2024-09-10T21:07:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.367+0000 7fccf0ff9640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 0x7fccdc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.367+0000 7fccf37fe640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 0x7fccdc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.368+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcce80e5ca0 con 0x7fccf4102a00 2024-09-10T21:07:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.368+0000 7fccf37fe640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 0x7fccdc0b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcce4000c00 tx=0x7fcce40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:09.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.370+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcce80acc10 con 0x7fccf4102a00 2024-09-10T21:07:09.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.608+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fccf4063d50 con 0x7fccf4102a00 2024-09-10T21:07:09.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.616+0000 7fccf0ff9640 1 -- 172.21.15.67:0/3023983259 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+827942 (secure 0 0 0) 0x7fcce80ac510 con 0x7fccf4102a00 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "epoch": 20, 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "active_gid": 14150, 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "active_name": "x", 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "active_addrs": { 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-09-10T21:07:09.632 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:6800", 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1712569035 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v1", 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:6801", 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1712569035 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "active_addr": "172.21.15.67:6801/1712569035", 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "active_change": "2024-09-10T20:42:06.670693+0000", 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T21:07:09.633 INFO:teuthology.orchestra.run.smithi067.stdout: "available": true, 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "standbys": [ 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "gid": 24118, 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "z", 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr_features": 4540719139924082687, 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "available_modules": [ 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "alerts", 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:09.634 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.635 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.636 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.638 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.639 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.640 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_destination": { 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_destination", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.641 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_from_name": { 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_from_name", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.642 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "Ceph", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email From: name", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_host": { 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_host", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.643 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP server", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_password": { 2024-09-10T21:07:09.644 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_password", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Password to authenticate with", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.645 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_port": { 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_port", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "465", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP port", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.646 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_sender": { 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_sender", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.647 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_ssl": { 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_ssl", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.648 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_user": { 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_user", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "User to authenticate as", 2024-09-10T21:07:09.649 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "balancer", 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "active": { 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "active", 2024-09-10T21:07:09.651 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.652 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_time": { 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_time", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0000", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.653 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_weekday": { 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_weekday", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.654 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_max_iterations": { 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "25", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "250", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.655 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_metrics": { 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_metrics", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.656 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_step": { 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_step", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.5", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0.001", 2024-09-10T21:07:09.657 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "0.999", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "end_time": { 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_time", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2359", 2024-09-10T21:07:09.658 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "end_weekday": { 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_weekday", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.659 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.660 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.661 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.662 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.663 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.664 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.665 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "min_score": { 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_score", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:07:09.666 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "upmap", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.667 INFO:teuthology.orchestra.run.smithi067.stdout: "crush-compat", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "none", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "read", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap-read" 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Balancer mode", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_ids": { 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_ids", 2024-09-10T21:07:09.668 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:09.669 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.670 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_deviation": { 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_deviation", 2024-09-10T21:07:09.671 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_optimizations": { 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:07:09.672 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.673 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_down_multiplier": { 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_down_multiplier", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.674 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_refresh_rate": { 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_refresh_rate", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.675 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "20", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_starting_port": { 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_starting_port", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.676 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4721", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_ptrace": { 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_ptrace", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.677 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_interval": { 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_interval", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.678 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.679 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.7", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.680 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm_log_destination": { 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm_log_destination", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "file", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "file,syslog", 2024-09-10T21:07:09.681 INFO:teuthology.orchestra.run.smithi067.stdout: "syslog" 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "cgroups_split": { 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cgroups_split", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "config_checks_enabled": { 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_checks_enabled", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "config_dashboard": { 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_dashboard", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.684 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_alertmanager": { 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_alertmanager", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.685 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_base": { 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_base", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.686 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_elasticsearch": { 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.687 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "elasticsearch container image", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_grafana": { 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_grafana", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.688 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_haproxy": { 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_haproxy", 2024-09-10T21:07:09.689 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "HAproxy container image", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_agent": { 2024-09-10T21:07:09.690 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.691 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_collector": { 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.692 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_query": { 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger query container image", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.693 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_keepalived": { 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_keepalived", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Keepalived container image", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.694 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_loki": { 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_loki", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Loki container image", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.695 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nginx": { 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nginx", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nginx container image", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.696 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_node_exporter": { 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_node_exporter", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:09.697 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nvmeof": { 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nvmeof", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.698 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nvme-of container image", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.699 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_prometheus": { 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_prometheus", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.700 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_promtail": { 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_promtail", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.701 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Promtail container image", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba": { 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.702 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba_metrics": { 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:07:09.703 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_snmp_gateway": { 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.704 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "container_init": { 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_init", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.705 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "daemon_cache_timeout": { 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.706 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:07:09.707 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "900", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "default_registry": { 2024-09-10T21:07:09.708 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_registry", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "device_cache_timeout": { 2024-09-10T21:07:09.709 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_cache_timeout", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1800", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.710 INFO:teuthology.orchestra.run.smithi067.stdout: "device_enhanced_scan": { 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_enhanced_scan", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.711 INFO:teuthology.orchestra.run.smithi067.stdout: "facts_cache_timeout": { 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "facts_cache_timeout", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.712 INFO:teuthology.orchestra.run.smithi067.stdout: "grafana_dashboards_path": { 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.713 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "host_check_interval": { 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "host_check_interval", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.714 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "hw_monitoring": { 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hw_monitoring", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.715 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "inventory_list_all": { 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "inventory_list_all", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.716 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.717 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "log_refresh_metadata": { 2024-09-10T21:07:09.718 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_refresh_metadata", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.719 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.720 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.721 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.722 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.723 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.724 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "*", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "max_count_per_host": { 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_count_per_host", 2024-09-10T21:07:09.725 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.726 INFO:teuthology.orchestra.run.smithi067.stdout: "max_osd_draining_count": { 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_osd_draining_count", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.727 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "migration_current": { 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "migration_current", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "internal - do not modify", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.728 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "root", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.729 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm-package", 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "root" 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "oob_default_addr": { 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "oob_default_addr", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "169.254.1.1", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi067.stdout: "prometheus_alerts_path": { 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.732 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_insecure": { 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_insecure", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.733 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_password": { 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_password", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.734 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_url": { 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_url", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_username": { 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_username", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.736 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "secure_monitoring_stack": { 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.737 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "service_discovery_port": { 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "service_discovery_port", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8765", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.738 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.739 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "ssh_config_file": { 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssh_config_file", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.740 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "use_agent": { 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_agent", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.741 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "use_repo_digest": { 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_repo_digest", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.742 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_failed_host_check": { 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.743 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_daemons": { 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.744 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_hosts": { 2024-09-10T21:07:09.745 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.746 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crash", 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.748 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.749 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.750 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.751 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.752 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.753 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "retain_interval": { 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retain_interval", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "31536000", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.754 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.755 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_recent_interval": { 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_recent_interval", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1209600", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:07:09.756 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dashboard", 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:07:09.757 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:07:09.758 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:07:09.759 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.760 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.761 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.762 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.763 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.764 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.765 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.766 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.767 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.768 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.769 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.770 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.771 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.772 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.773 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_URL": { 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.774 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.775 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.776 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.777 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.778 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:07:09.779 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:07:09.780 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "[]", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:07:09.781 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "{}", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:07:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:07:09.783 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:07:09.784 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.785 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.786 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.787 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.788 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.789 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.790 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.791 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8", 2024-09-10T21:07:09.795 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.796 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "45", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.797 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.798 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.799 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.800 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.801 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.802 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.803 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.804 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.805 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "cross_origin_url": { 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cross_origin_url", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.806 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "crt_file": { 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crt_file", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.807 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "debug": { 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "debug", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.808 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "jwt_token_ttl": { 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "jwt_token_ttl", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.809 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "28800", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.810 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.811 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.812 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.813 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.814 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.815 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.816 INFO:teuthology.orchestra.run.smithi067.stdout: "motd": { 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "motd", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "The message of the day", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:09.818 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:09.819 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8080", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.820 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:09.821 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl_server_port": { 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl_server_port", 2024-09-10T21:07:09.822 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8443", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:09.823 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "redirect", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect" 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.824 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.825 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "url_prefix": { 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url_prefix", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.826 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_monitoring": { 2024-09-10T21:07:09.827 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_monitoring", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "monitor device health metrics", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.828 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.829 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.830 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.832 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.833 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "mark_out_threshold": { 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mark_out_threshold", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.834 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2419200", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_name": { 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_name", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.835 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "device_health_metrics", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "retention_period": { 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retention_period", 2024-09-10T21:07:09.836 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15552000", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_frequency": { 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_frequency", 2024-09-10T21:07:09.837 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "self_heal": { 2024-09-10T21:07:09.838 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "self_heal", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:09.839 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.841 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_threshold": { 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_threshold", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7257600", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "diskprediction_local", 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.844 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.845 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.846 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.847 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "predict_interval": { 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predict_interval", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.849 INFO:teuthology.orchestra.run.smithi067.stdout: "predictor_model": { 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predictor_model", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "prophetstor", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:09.850 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.851 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.852 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "influx", 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": false, 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "batch_size": { 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "batch_size", 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.853 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5000", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "database": { 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "database", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.854 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "ceph", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": { 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hostname", 2024-09-10T21:07:09.855 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:09.856 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "30", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "5", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.857 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.859 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.860 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.861 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.862 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "password": { 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "password", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.863 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "port": { 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "port", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8086", 2024-09-10T21:07:09.864 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server port", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.865 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.866 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "false", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "threads": { 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threads", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:09.867 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "32", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "username": { 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "username", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.868 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "verify_ssl": { 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "verify_ssl", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.869 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "true", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "insights", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.870 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.871 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.872 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.873 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.874 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.875 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.876 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "iostat", 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.877 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.878 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.879 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.880 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.881 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.882 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.883 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "k8sevents", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_event_retention_days": { 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7", 2024-09-10T21:07:09.884 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "config_check_secs": { 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_check_secs", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.885 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "10", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.886 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.887 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.888 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.889 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.890 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.891 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.892 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "localpool", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "failure_domain": { 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "failure_domain", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "host", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.893 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.894 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.895 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.896 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.897 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.898 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "min_size": { 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_size", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:07:09.899 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "num_rep": { 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "num_rep", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.900 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_num": { 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_num", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "128", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.901 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "prefix": { 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prefix", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.902 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.903 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "subtree": { 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "subtree", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "rack", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:07:09.904 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mds_autoscaler", 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.905 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.906 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.907 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.908 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.909 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.910 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.911 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirroring", 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.912 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.913 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.914 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.915 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.916 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.917 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.918 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "nfs", 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.919 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.920 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.921 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.922 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.923 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.924 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.925 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "fail_fs": { 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "fail_fs", 2024-09-10T21:07:09.926 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.927 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.928 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.929 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.930 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.931 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.932 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator": { 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.933 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "rook", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "test_orchestrator" 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Orchestrator backend", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.934 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.935 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_perf_query", 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.936 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.937 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.938 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.940 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.941 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.942 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_support", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.943 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.944 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.945 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.946 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.947 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.948 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.949 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_autoscaler", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.950 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.951 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.952 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.953 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.954 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.955 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.956 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "threshold": { 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threshold", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.957 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1.0", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "scaling threshold", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "progress", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.958 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_pg_recovery_event": { 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.959 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.960 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.961 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.962 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.963 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.964 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.965 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "max_completed_events": { 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_completed_events", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "50", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.966 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.967 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.968 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus", 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.969 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "cache": { 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cache", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.970 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "exclude_perf_counters": { 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "exclude_perf_counters", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.971 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.972 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.973 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.974 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.975 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.976 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools": { 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools", 2024-09-10T21:07:09.977 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.978 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "300", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_interval": { 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_interval", 2024-09-10T21:07:09.979 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15.0", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:09.980 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.981 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "9283", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.983 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "stale_cache_strategy": { 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stale_cache_strategy", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "log", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.984 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "default", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.985 INFO:teuthology.orchestra.run.smithi067.stdout: "default", 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "error" 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.986 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.987 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.988 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:09.989 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:09.990 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:09.991 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:09.992 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_snap_create": { 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:09.993 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.994 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:09.995 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "trash_purge_schedule": { 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "trash_purge_schedule", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.996 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.997 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "restful", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_auth": { 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_auth", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.998 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:09.999 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.000 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.001 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.002 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.003 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.004 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "max_requests": { 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_requests", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.005 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.006 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:10.007 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.008 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rgw", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.010 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.011 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.012 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.013 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.014 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.015 INFO:teuthology.orchestra.run.smithi067.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.016 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.017 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rook", 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.018 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.020 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.021 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.022 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.023 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "storage_class": { 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "storage_class", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.024 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "local", 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.025 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "selftest", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.026 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.027 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.028 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.029 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.030 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.031 INFO:teuthology.orchestra.run.smithi067.stdout: "roption1": { 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption1", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.032 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "roption2": { 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption2", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "xyz", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.033 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption1": { 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption1", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.034 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption2": { 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption2", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.035 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption3": { 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption3", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.036 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.037 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption4": { 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption4", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.038 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption5": { 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption5", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.039 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption6": { 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption6", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.040 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption7": { 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption7", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "42", 2024-09-10T21:07:10.041 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.042 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "testkey": { 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testkey", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.043 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "testlkey": { 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testlkey", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.044 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "testnewline": { 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testnewline", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.045 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.046 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smb", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "internal_store_backend": { 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "internal_store_backend", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.047 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.048 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.049 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.050 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.051 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.052 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.053 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "update_orchestration": { 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "update_orchestration", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.054 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.055 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snap_schedule", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_m_granularity": { 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_m_granularity", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.056 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "dump_on_update": { 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dump_on_update", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.057 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.058 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.059 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.061 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.062 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.063 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stats", 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.064 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.065 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.066 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.067 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.068 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.069 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.070 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "status", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.071 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.073 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.074 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.075 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.076 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.077 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telegraf", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "address": { 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "address", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.078 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.079 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.080 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.081 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.082 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.083 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.084 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.085 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telemetry", 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_basic": { 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_basic", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.087 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_crash": { 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_crash", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:07:10.088 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_device": { 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_device", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.089 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_ident": { 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_ident", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.090 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_perf": { 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_perf", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.091 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "contact": { 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "contact", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.092 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "description": { 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "description", 2024-09-10T21:07:10.093 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "device_url": { 2024-09-10T21:07:10.094 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_url", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.095 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.096 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "24", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "8", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.097 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "last_opt_revision": { 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "last_opt_revision", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.098 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard": { 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.099 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard_description": { 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard_description", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.100 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.101 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.102 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.103 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.104 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.105 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "organization": { 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "organization", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.106 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "proxy": { 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "proxy", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.107 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.108 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "url": { 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url", 2024-09-10T21:07:10.109 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.110 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "test_orchestrator", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.111 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.112 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.114 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.115 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.117 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.118 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.119 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.120 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.121 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.122 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.123 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_clones": { 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_clones", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.124 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "periodic_async_work": { 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "periodic_async_work", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.125 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Periodically check for async work", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_delay": { 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.126 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.127 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.128 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.129 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "discovery_interval": { 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "discovery_interval", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "100", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.130 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "identifier": { 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "identifier", 2024-09-10T21:07:10.131 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.132 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.133 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.134 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.135 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.136 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.137 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.138 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.139 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_host": { 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_host", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.140 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_port": { 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_port", 2024-09-10T21:07:10.141 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10051", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_sender": { 2024-09-10T21:07:10.142 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_sender", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.143 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "gid": 24146, 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "y", 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr_features": 4540719139924082687, 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "available_modules": [ 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "alerts", 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.144 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:07:10.145 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.146 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.147 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.148 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.149 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.150 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_destination": { 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_destination", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.151 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_from_name": { 2024-09-10T21:07:10.152 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_from_name", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "Ceph", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email From: name", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_host": { 2024-09-10T21:07:10.153 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_host", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP server", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.154 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_password": { 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_password", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Password to authenticate with", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.155 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_port": { 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_port", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "465", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP port", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.156 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_sender": { 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_sender", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.157 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_ssl": { 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_ssl", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.158 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_user": { 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_user", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "User to authenticate as", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.159 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.160 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "balancer", 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "active": { 2024-09-10T21:07:10.161 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "active", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.162 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_time": { 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_time", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0000", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.163 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_weekday": { 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_weekday", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.164 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_max_iterations": { 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "25", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "250", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.165 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_metrics": { 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_metrics", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.166 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_step": { 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_step", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.5", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0.001", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "0.999", 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.167 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "end_time": { 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_time", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2359", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.168 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "end_weekday": { 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_weekday", 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.169 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.170 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.171 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.172 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.173 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.174 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.175 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "min_score": { 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_score", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.176 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "upmap", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "crush-compat", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "none", 2024-09-10T21:07:10.177 INFO:teuthology.orchestra.run.smithi067.stdout: "read", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap-read" 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Balancer mode", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_ids": { 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_ids", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.178 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.180 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.181 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_deviation": { 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_deviation", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_optimizations": { 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.183 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm", 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_down_multiplier": { 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_down_multiplier", 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.184 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_refresh_rate": { 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_refresh_rate", 2024-09-10T21:07:10.185 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "20", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_starting_port": { 2024-09-10T21:07:10.186 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_starting_port", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4721", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.187 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_ptrace": { 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_ptrace", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_interval": { 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_interval", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.189 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.7", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:07:10.190 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm_log_destination": { 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm_log_destination", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.191 INFO:teuthology.orchestra.run.smithi067.stdout: "file", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "file,syslog", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "syslog" 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "cgroups_split": { 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cgroups_split", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.192 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "config_checks_enabled": { 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_checks_enabled", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.193 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "config_dashboard": { 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_dashboard", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.194 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_alertmanager": { 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_alertmanager", 2024-09-10T21:07:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_base": { 2024-09-10T21:07:10.196 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_base", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.197 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_elasticsearch": { 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "elasticsearch container image", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.198 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_grafana": { 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_grafana", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.199 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_haproxy": { 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_haproxy", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "HAproxy container image", 2024-09-10T21:07:10.200 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_agent": { 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.201 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_collector": { 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.202 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_query": { 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:07:10.203 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger query container image", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.204 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_keepalived": { 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_keepalived", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.205 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Keepalived container image", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_loki": { 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_loki", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:07:10.206 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Loki container image", 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nginx": { 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nginx", 2024-09-10T21:07:10.207 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nginx container image", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_node_exporter": { 2024-09-10T21:07:10.208 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_node_exporter", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.209 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nvmeof": { 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nvmeof", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nvme-of container image", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.210 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.211 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_prometheus": { 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_prometheus", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.212 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_promtail": { 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_promtail", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Promtail container image", 2024-09-10T21:07:10.213 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba": { 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:07:10.214 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba_metrics": { 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.215 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_snmp_gateway": { 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:07:10.216 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "container_init": { 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_init", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.217 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "daemon_cache_timeout": { 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.218 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.219 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "900", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "default_registry": { 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_registry", 2024-09-10T21:07:10.220 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "device_cache_timeout": { 2024-09-10T21:07:10.221 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_cache_timeout", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1800", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.222 INFO:teuthology.orchestra.run.smithi067.stdout: "device_enhanced_scan": { 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_enhanced_scan", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.223 INFO:teuthology.orchestra.run.smithi067.stdout: "facts_cache_timeout": { 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "facts_cache_timeout", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.224 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "grafana_dashboards_path": { 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.225 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "host_check_interval": { 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "host_check_interval", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.226 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "hw_monitoring": { 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hw_monitoring", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.227 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "inventory_list_all": { 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "inventory_list_all", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:07:10.228 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.229 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.230 INFO:teuthology.orchestra.run.smithi067.stdout: "log_refresh_metadata": { 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_refresh_metadata", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.231 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.232 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.233 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.234 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.235 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:07:10.236 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "*", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.237 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "max_count_per_host": { 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_count_per_host", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.238 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "max_osd_draining_count": { 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_osd_draining_count", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.239 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "migration_current": { 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "migration_current", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.240 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "internal - do not modify", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "root", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.241 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm-package", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "root" 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "oob_default_addr": { 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "oob_default_addr", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "169.254.1.1", 2024-09-10T21:07:10.242 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "prometheus_alerts_path": { 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.243 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_insecure": { 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_insecure", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.244 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_password": { 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_password", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.245 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_url": { 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_url", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_username": { 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_username", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.247 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "secure_monitoring_stack": { 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.248 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "service_discovery_port": { 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "service_discovery_port", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.249 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8765", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.250 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "ssh_config_file": { 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssh_config_file", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.251 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "use_agent": { 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_agent", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.252 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "use_repo_digest": { 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_repo_digest", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.253 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_failed_host_check": { 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.254 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_daemons": { 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.255 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_hosts": { 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.256 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.257 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crash", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.258 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.259 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.260 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.261 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.262 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "retain_interval": { 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retain_interval", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "31536000", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.263 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.264 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_recent_interval": { 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_recent_interval", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1209600", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:07:10.265 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dashboard", 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.266 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.267 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:07:10.268 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:07:10.269 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:07:10.270 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.271 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.272 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.273 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:07:10.274 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:07:10.275 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:07:10.276 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:07:10.277 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.278 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.279 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.280 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.281 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_URL": { 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.283 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.284 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.285 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.286 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.287 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.288 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "[]", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.289 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "{}", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.290 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.291 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.293 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.294 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.295 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.296 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.297 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.298 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.299 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:07:10.300 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.301 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.302 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:07:10.303 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:07:10.304 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "45", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:07:10.305 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.306 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.307 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.308 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.309 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.310 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.311 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.312 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.313 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "cross_origin_url": { 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cross_origin_url", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.314 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "crt_file": { 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crt_file", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.315 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "debug": { 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "debug", 2024-09-10T21:07:10.316 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "jwt_token_ttl": { 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "jwt_token_ttl", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.317 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "28800", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.318 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.319 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.320 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.321 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.322 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.323 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.324 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "motd": { 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "motd", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "The message of the day", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.325 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.326 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.327 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8080", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.328 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.329 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.330 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl_server_port": { 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl_server_port", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8443", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.331 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.332 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "redirect", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect" 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.333 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.334 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "url_prefix": { 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url_prefix", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.335 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_monitoring": { 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_monitoring", 2024-09-10T21:07:10.336 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "monitor device health metrics", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.337 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.338 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.339 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.340 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.341 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.342 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "mark_out_threshold": { 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mark_out_threshold", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2419200", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.343 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_name": { 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_name", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "device_health_metrics", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.344 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "retention_period": { 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retention_period", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15552000", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.345 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_frequency": { 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_frequency", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.346 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "self_heal": { 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "self_heal", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.347 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.348 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.349 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_threshold": { 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_threshold", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7257600", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.350 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "diskprediction_local", 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.351 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.352 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.353 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.354 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.355 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.356 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "predict_interval": { 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predict_interval", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.357 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "predictor_model": { 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predictor_model", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "prophetstor", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.358 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.359 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.360 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "influx", 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": false, 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "batch_size": { 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "batch_size", 2024-09-10T21:07:10.361 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5000", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "database": { 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "database", 2024-09-10T21:07:10.362 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "ceph", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": { 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hostname", 2024-09-10T21:07:10.363 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.364 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "30", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "5", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.365 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.366 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.367 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.368 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.369 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.370 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "password": { 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "password", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.371 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "port": { 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "port", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8086", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.372 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server port", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.373 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "false", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:10.374 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "threads": { 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threads", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "32", 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.375 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "username": { 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "username", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.376 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "verify_ssl": { 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "verify_ssl", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "true", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:10.377 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "insights", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.378 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.379 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.380 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.381 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.383 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.384 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "iostat", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.385 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.386 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.387 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.388 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.389 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.390 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "k8sevents", 2024-09-10T21:07:10.391 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_event_retention_days": { 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:07:10.392 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "config_check_secs": { 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_check_secs", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "10", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:07:10.393 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.394 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.395 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.396 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.397 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.398 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.399 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.400 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "localpool", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "failure_domain": { 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "failure_domain", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "host", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.401 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.402 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.403 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.404 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.405 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.406 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "min_size": { 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_size", 2024-09-10T21:07:10.407 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "num_rep": { 2024-09-10T21:07:10.408 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "num_rep", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.409 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_num": { 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_num", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "128", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.410 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "prefix": { 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prefix", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:07:10.411 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.412 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "subtree": { 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "subtree", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "rack", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.413 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mds_autoscaler", 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.414 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.415 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.416 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.417 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.418 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.419 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.420 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirroring", 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.421 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.422 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.423 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.424 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.425 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.426 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "nfs", 2024-09-10T21:07:10.427 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.428 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.429 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.430 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.431 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.432 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.433 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:10.434 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "fail_fs": { 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "fail_fs", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:07:10.435 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.436 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.438 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.439 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.440 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator": { 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.441 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "rook", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "test_orchestrator" 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Orchestrator backend", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.442 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_perf_query", 2024-09-10T21:07:10.443 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.444 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.445 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.446 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.447 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.448 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.449 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_support", 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.450 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.451 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.452 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.453 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.454 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.455 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.456 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_autoscaler", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.457 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.458 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.459 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.460 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.461 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.462 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.464 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.465 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "threshold": { 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threshold", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.466 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1.0", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "scaling threshold", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.467 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "progress", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_pg_recovery_event": { 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.468 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.469 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.470 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.471 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.472 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.473 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.474 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.475 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "max_completed_events": { 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_completed_events", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "50", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.476 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.477 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.478 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus", 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.479 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "cache": { 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cache", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "exclude_perf_counters": { 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "exclude_perf_counters", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:07:10.481 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.482 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.483 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.484 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.485 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.486 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools": { 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools", 2024-09-10T21:07:10.487 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.488 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "300", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.489 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_interval": { 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_interval", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15.0", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.490 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:10.491 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "9283", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.492 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "stale_cache_strategy": { 2024-09-10T21:07:10.493 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stale_cache_strategy", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "log", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.494 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "default", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "default", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "error" 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.495 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.496 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.497 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.498 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.499 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.500 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.501 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.502 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_snap_create": { 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.503 INFO:teuthology.orchestra.run.smithi067.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.504 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "trash_purge_schedule": { 2024-09-10T21:07:10.505 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "trash_purge_schedule", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.506 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "restful", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_auth": { 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_auth", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.507 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.508 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.509 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.510 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.511 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.512 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "max_requests": { 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_requests", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.514 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.515 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:10.516 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.517 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.518 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rgw", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.519 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.520 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.521 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.522 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.523 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.524 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.525 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.526 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rook", 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.527 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.528 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.529 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.530 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.531 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.532 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.533 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "storage_class": { 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "storage_class", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.534 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "local", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "selftest", 2024-09-10T21:07:10.535 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.536 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.537 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.538 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.539 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.540 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "roption1": { 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption1", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.541 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "roption2": { 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption2", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "xyz", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.542 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption1": { 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption1", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.543 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption2": { 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption2", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.544 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption3": { 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption3", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.545 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption4": { 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption4", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption5": { 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption5", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.547 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption6": { 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption6", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.548 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption7": { 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption7", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.549 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "42", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.550 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "testkey": { 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testkey", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.551 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "testlkey": { 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testlkey", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.552 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "testnewline": { 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testnewline", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.553 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smb", 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.554 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "internal_store_backend": { 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "internal_store_backend", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:07:10.555 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.556 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.557 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.558 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.559 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.560 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.561 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "update_orchestration": { 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "update_orchestration", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.562 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snap_schedule", 2024-09-10T21:07:10.563 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_m_granularity": { 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_m_granularity", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.564 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "dump_on_update": { 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dump_on_update", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.565 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.566 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.567 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.568 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.569 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.570 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.571 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stats", 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.572 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.573 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.574 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.575 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.576 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.577 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.578 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "status", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.579 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.580 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.581 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.584 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telegraf", 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "address": { 2024-09-10T21:07:10.585 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "address", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.586 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.587 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.588 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.589 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.590 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.591 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.592 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.593 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telemetry", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_basic": { 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_basic", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.594 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_crash": { 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_crash", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.595 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_device": { 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_device", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.596 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_ident": { 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_ident", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.597 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_perf": { 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_perf", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "contact": { 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "contact", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.599 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "description": { 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "description", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.600 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "device_url": { 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_url", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.601 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.602 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.603 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "24", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "8", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "last_opt_revision": { 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "last_opt_revision", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.604 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard": { 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.605 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard_description": { 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard_description", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.606 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.607 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.608 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.609 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.610 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.611 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "organization": { 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "organization", 2024-09-10T21:07:10.612 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "proxy": { 2024-09-10T21:07:10.613 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "proxy", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.614 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.615 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "url": { 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.616 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "test_orchestrator", 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.617 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.618 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.619 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.620 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.621 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.622 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.623 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.624 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.625 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.626 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.627 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.628 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.629 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_clones": { 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_clones", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.630 INFO:teuthology.orchestra.run.smithi067.stdout: "periodic_async_work": { 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "periodic_async_work", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Periodically check for async work", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.631 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_delay": { 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.632 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.633 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.634 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix", 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.635 INFO:teuthology.orchestra.run.smithi067.stdout: "discovery_interval": { 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "discovery_interval", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "100", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.636 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "identifier": { 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "identifier", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.637 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.638 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.639 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.640 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.641 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.642 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.643 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.644 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.645 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_host": { 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_host", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.646 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_port": { 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_port", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10051", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.647 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_sender": { 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_sender", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.648 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "modules": [ 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "dashboard", 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "iostat", 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "nfs", 2024-09-10T21:07:10.649 INFO:teuthology.orchestra.run.smithi067.stdout: "restful" 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "available_modules": [ 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "alerts", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.650 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.651 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.652 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.653 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.654 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.655 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.656 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_destination": { 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_destination", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.657 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_from_name": { 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_from_name", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "Ceph", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Email From: name", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.658 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_host": { 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_host", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP server", 2024-09-10T21:07:10.659 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_password": { 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_password", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.660 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Password to authenticate with", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_port": { 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_port", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "465", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.661 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP port", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_sender": { 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_sender", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.662 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_ssl": { 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_ssl", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.663 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "smtp_user": { 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smtp_user", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.664 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "User to authenticate as", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.665 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.666 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "balancer", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "active": { 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "active", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:07:10.667 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_time": { 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_time", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0000", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.668 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "begin_weekday": { 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "begin_weekday", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:10.669 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_max_iterations": { 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "25", 2024-09-10T21:07:10.670 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "250", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_metrics": { 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_metrics", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:07:10.671 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "crush_compat_step": { 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crush_compat_step", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.672 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.5", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0.001", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "0.999", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "end_time": { 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_time", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.673 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2359", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "end_weekday": { 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "end_weekday", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.674 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "0", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "6", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.675 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.676 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.677 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.678 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.679 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.680 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "min_score": { 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_score", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.681 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "upmap", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "crush-compat", 2024-09-10T21:07:10.682 INFO:teuthology.orchestra.run.smithi067.stdout: "none", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "read", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap-read" 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Balancer mode", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_ids": { 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_ids", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.683 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.684 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.685 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_deviation": { 2024-09-10T21:07:10.686 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_deviation", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "upmap_max_optimizations": { 2024-09-10T21:07:10.687 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.688 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_down_multiplier": { 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_down_multiplier", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.689 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_refresh_rate": { 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_refresh_rate", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "20", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:07:10.690 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "agent_starting_port": { 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "agent_starting_port", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4721", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.691 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_ptrace": { 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_ptrace", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.692 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_interval": { 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_interval", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.693 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0.7", 2024-09-10T21:07:10.694 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm_log_destination": { 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cephadm_log_destination", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.695 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "file", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "file,syslog", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "syslog" 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.696 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "cgroups_split": { 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cgroups_split", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.697 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "config_checks_enabled": { 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_checks_enabled", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.698 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "config_dashboard": { 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_dashboard", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.699 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_alertmanager": { 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_alertmanager", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.700 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_base": { 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_base", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:07:10.701 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_elasticsearch": { 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "elasticsearch container image", 2024-09-10T21:07:10.702 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_grafana": { 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_grafana", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.703 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_haproxy": { 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_haproxy", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "HAproxy container image", 2024-09-10T21:07:10.704 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_agent": { 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.705 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_collector": { 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_jaeger_query": { 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.707 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Jaeger query container image", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_keepalived": { 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_keepalived", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.708 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Keepalived container image", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_loki": { 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_loki", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.709 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Loki container image", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nginx": { 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nginx", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.710 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nginx container image", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_node_exporter": { 2024-09-10T21:07:10.711 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_node_exporter", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.712 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_nvmeof": { 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_nvmeof", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Nvme-of container image", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.713 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.714 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_prometheus": { 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_prometheus", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Prometheus container image", 2024-09-10T21:07:10.715 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_promtail": { 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_promtail", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.716 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Promtail container image", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba": { 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.717 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_samba_metrics": { 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.718 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "container_image_snmp_gateway": { 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.719 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "container_init": { 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "container_init", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.720 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "daemon_cache_timeout": { 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.721 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:07:10.722 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "900", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "default_registry": { 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "default_registry", 2024-09-10T21:07:10.723 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "docker.io", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "device_cache_timeout": { 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_cache_timeout", 2024-09-10T21:07:10.724 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1800", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "device_enhanced_scan": { 2024-09-10T21:07:10.725 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_enhanced_scan", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.726 INFO:teuthology.orchestra.run.smithi067.stdout: "facts_cache_timeout": { 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "facts_cache_timeout", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.727 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "grafana_dashboards_path": { 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.728 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "host_check_interval": { 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "host_check_interval", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.729 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "hw_monitoring": { 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hw_monitoring", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.730 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "inventory_list_all": { 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "inventory_list_all", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.731 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.732 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.733 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "log_refresh_metadata": { 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_refresh_metadata", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.734 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.735 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.736 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.737 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.738 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.739 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "*", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "max_count_per_host": { 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_count_per_host", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.740 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "max_osd_draining_count": { 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_osd_draining_count", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.741 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "migration_current": { 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "migration_current", 2024-09-10T21:07:10.742 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "internal - do not modify", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.743 INFO:teuthology.orchestra.run.smithi067.stdout: "mode": { 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mode", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "root", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm-package", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "root" 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:07:10.744 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "oob_default_addr": { 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "oob_default_addr", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "169.254.1.1", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.745 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "prometheus_alerts_path": { 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:07:10.746 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_insecure": { 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_insecure", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.747 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_password": { 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_password", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.748 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_url": { 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_url", 2024-09-10T21:07:10.749 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "registry_username": { 2024-09-10T21:07:10.750 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "registry_username", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.751 INFO:teuthology.orchestra.run.smithi067.stdout: "secure_monitoring_stack": { 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.752 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "service_discovery_port": { 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "service_discovery_port", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8765", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.753 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.754 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "ssh_config_file": { 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssh_config_file", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.755 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "use_agent": { 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_agent", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.756 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "use_repo_digest": { 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "use_repo_digest", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.757 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_failed_host_check": { 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.758 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_daemons": { 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_on_stray_hosts": { 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.760 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crash", 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.761 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.762 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.763 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.764 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.765 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.768 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.768 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.768 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.768 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.769 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "retain_interval": { 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retain_interval", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.770 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "31536000", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.771 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_recent_interval": { 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_recent_interval", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.772 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1209600", 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.773 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dashboard", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.774 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.775 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.776 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.777 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.778 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.779 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.780 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.781 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.783 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.784 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:07:10.785 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:07:10.786 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:07:10.787 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.788 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.789 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.790 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_URL": { 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.791 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.792 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.793 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.794 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:07:10.795 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.796 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.797 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "[]", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.798 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "{}", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.799 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.800 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:07:10.801 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.802 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.803 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.804 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.805 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.806 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:07:10.807 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.808 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.809 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.810 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.811 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.812 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.813 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.814 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.815 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "45", 2024-09-10T21:07:10.816 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.817 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:07:10.818 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "admin", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:07:10.819 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.821 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.822 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.823 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.824 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.825 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "cross_origin_url": { 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cross_origin_url", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.826 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "crt_file": { 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "crt_file", 2024-09-10T21:07:10.827 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.828 INFO:teuthology.orchestra.run.smithi067.stdout: "debug": { 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "debug", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.829 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "jwt_token_ttl": { 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "jwt_token_ttl", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "28800", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.830 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.831 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.832 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.833 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.834 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.835 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.836 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.837 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "motd": { 2024-09-10T21:07:10.838 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "motd", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "The message of the day", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.839 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.840 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.841 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8080", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.842 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.843 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.844 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl_server_port": { 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl_server_port", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.845 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8443", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:10.846 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "redirect", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "redirect" 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.847 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.848 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "url_prefix": { 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url_prefix", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.849 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-09-10T21:07:10.850 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_monitoring": { 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_monitoring", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "monitor device health metrics", 2024-09-10T21:07:10.851 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.852 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.853 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.854 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.855 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.856 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.857 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "mark_out_threshold": { 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mark_out_threshold", 2024-09-10T21:07:10.858 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "2419200", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.859 INFO:teuthology.orchestra.run.smithi067.stdout: "pool_name": { 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pool_name", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "device_health_metrics", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.860 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "retention_period": { 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "retention_period", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15552000", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:07:10.861 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_frequency": { 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_frequency", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.862 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "self_heal": { 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "self_heal", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:10.863 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.864 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.865 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.866 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "warn_threshold": { 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "warn_threshold", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7257600", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.867 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "diskprediction_local", 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.868 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.869 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.870 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.871 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.872 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.873 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.874 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "predict_interval": { 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predict_interval", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "86400", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.875 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "predictor_model": { 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "predictor_model", 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.876 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "prophetstor", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:10.877 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "600", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.878 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.879 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "influx", 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": false, 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:07:10.880 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "batch_size": { 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "batch_size", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5000", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.881 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "database": { 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "database", 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "ceph", 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.882 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "hostname": { 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "hostname", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.883 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.884 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "30", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "5", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.885 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.886 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.887 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.888 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.889 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.890 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.891 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "password": { 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "password", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.892 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "port": { 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "port", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "8086", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "InfluxDB server port", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.894 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.895 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "ssl": { 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ssl", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "false", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.896 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "threads": { 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threads", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:10.897 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "32", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "username": { 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "username", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.898 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "verify_ssl": { 2024-09-10T21:07:10.899 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "verify_ssl", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "true", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.900 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "insights", 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.901 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.902 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.903 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.904 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.905 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.906 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.907 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.908 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "iostat", 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.909 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.910 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.911 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.912 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.913 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.914 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.915 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.916 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "k8sevents", 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_event_retention_days": { 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.917 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "7", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.918 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "config_check_secs": { 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "config_check_secs", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "10", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.919 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.920 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.921 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.922 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.923 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.924 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.925 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.926 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "localpool", 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.927 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "failure_domain": { 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "failure_domain", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "host", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.928 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.929 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.930 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.931 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.932 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.933 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.934 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "min_size": { 2024-09-10T21:07:10.935 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "min_size", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.936 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "num_rep": { 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "num_rep", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.937 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_num": { 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_num", 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.938 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "128", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "prefix": { 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prefix", 2024-09-10T21:07:10.939 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.940 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.941 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "subtree": { 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "subtree", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "rack", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.942 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mds_autoscaler", 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.943 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.944 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.945 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.946 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.947 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.948 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.949 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.950 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirroring", 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.951 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.952 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.953 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.954 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.955 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.956 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.957 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.958 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.959 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "nfs", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.960 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.961 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.962 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.963 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.964 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.965 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.966 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.967 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "fail_fs": { 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "fail_fs", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.968 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.969 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.970 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.972 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.973 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.974 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.975 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.976 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator": { 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "orchestrator", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.977 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "cephadm", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "rook", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "test_orchestrator" 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Orchestrator backend", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.978 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.979 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_perf_query", 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.980 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.981 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.982 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.983 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.984 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.985 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.986 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.987 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "osd_support", 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.988 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.989 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.990 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.991 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.992 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.994 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.995 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "pg_autoscaler", 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:10.996 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:10.997 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:10.998 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:10.999 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.000 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.001 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.002 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.003 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.004 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "threshold": { 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "threshold", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.005 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "3.0", 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1.0", 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "scaling threshold", 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.006 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "progress", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_pg_recovery_event": { 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.007 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.008 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.009 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.010 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.011 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.012 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.013 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.014 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.015 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "max_completed_events": { 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_completed_events", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "50", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.016 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "sleep_interval": { 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sleep_interval", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.017 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.018 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.019 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "prometheus", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "cache": { 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "cache", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.020 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "exclude_perf_counters": { 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "exclude_perf_counters", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.021 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.022 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.023 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.024 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.025 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.026 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.027 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.028 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools": { 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.029 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "300", 2024-09-10T21:07:11.030 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "scrape_interval": { 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "scrape_interval", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.031 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15.0", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:11.032 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "::", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.033 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "9283", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.034 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.035 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "stale_cache_strategy": { 2024-09-10T21:07:11.036 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stale_cache_strategy", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "log", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.037 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_behaviour": { 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_behaviour", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "default", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "default", 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: "error" 2024-09-10T21:07:11.038 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "standby_error_status_code": { 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "standby_error_status_code", 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.039 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "400", 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "599", 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.040 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.041 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.042 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.043 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.044 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.045 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.046 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_snap_create": { 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.047 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.048 INFO:teuthology.orchestra.run.smithi067.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.049 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.050 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "trash_purge_schedule": { 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "trash_purge_schedule", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.051 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "restful", 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.052 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "enable_auth": { 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enable_auth", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.053 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "key_file": { 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "key_file", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.054 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.055 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.056 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.057 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.058 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.059 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.060 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "max_requests": { 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_requests", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "500", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:07:11.061 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "server_addr": { 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_addr", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.062 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "server_port": { 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "server_port", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.063 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.064 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.065 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rgw", 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.066 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.067 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.068 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.069 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.070 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.071 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "5", 2024-09-10T21:07:11.072 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.073 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.074 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rook", 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.075 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.076 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.077 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.078 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.079 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.080 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.081 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "storage_class": { 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "storage_class", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "local", 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "selftest", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.084 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.085 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.086 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.087 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.088 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.089 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "roption1": { 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption1", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.090 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "roption2": { 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "roption2", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.091 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "xyz", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.092 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption1": { 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption1", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.093 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption2": { 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption2", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.094 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption3": { 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption3", 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "float", 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.095 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption4": { 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption4", 2024-09-10T21:07:11.096 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.097 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption5": { 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption5", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.098 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption6": { 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption6", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.099 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "rwoption7": { 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rwoption7", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.100 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "1", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "42", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.101 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.102 INFO:teuthology.orchestra.run.smithi067.stdout: "testkey": { 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testkey", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.103 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "testlkey": { 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testlkey", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.104 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "testnewline": { 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "testnewline", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.105 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.106 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "smb", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "internal_store_backend": { 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "internal_store_backend", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.107 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.108 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.109 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.110 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.111 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.112 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.113 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.114 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "update_orchestration": { 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "update_orchestration", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.115 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.116 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snap_schedule", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "allow_m_granularity": { 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "allow_m_granularity", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.117 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "dump_on_update": { 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "dump_on_update", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.118 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.119 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.120 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.121 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.122 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.123 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.124 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.125 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.126 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "stats", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.127 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.128 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.129 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.130 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.131 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.132 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.133 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.134 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "status", 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.135 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.136 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.137 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.138 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.139 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.140 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.141 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.142 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telegraf", 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "address": { 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "address", 2024-09-10T21:07:11.143 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.144 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "15", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.145 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.146 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.147 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.148 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.149 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.150 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.151 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.152 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.153 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "telemetry", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_basic": { 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_basic", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.154 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_crash": { 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_crash", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.155 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_device": { 2024-09-10T21:07:11.156 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_device", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.157 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_ident": { 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_ident", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.158 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "channel_perf": { 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "channel_perf", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:07:11.159 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "contact": { 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "contact", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.160 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "description": { 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "description", 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.161 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "device_url": { 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "device_url", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.162 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": { 2024-09-10T21:07:11.163 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "enabled", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.164 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "24", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "8", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.165 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "last_opt_revision": { 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "last_opt_revision", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "1", 2024-09-10T21:07:11.166 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard": { 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.167 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "leaderboard_description": { 2024-09-10T21:07:11.168 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "leaderboard_description", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.169 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.170 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.171 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.172 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.173 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.174 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.176 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "organization": { 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "organization", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "proxy": { 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "proxy", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.178 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.179 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "url": { 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "url", 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.180 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.181 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "test_orchestrator", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.182 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.183 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.184 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.185 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.186 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.187 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.188 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.189 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.190 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.191 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.192 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.193 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.194 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.195 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.196 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "max_concurrent_clones": { 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "max_concurrent_clones", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "4", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:07:11.197 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "periodic_async_work": { 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "periodic_async_work", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.198 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Periodically check for async work", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_delay": { 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.199 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:07:11.200 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "True", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.201 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.202 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix", 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "can_run": true, 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "error_string": "", 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "module_options": { 2024-09-10T21:07:11.203 INFO:teuthology.orchestra.run.smithi067.stdout: "discovery_interval": { 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "discovery_interval", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "uint", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "100", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.204 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "identifier": { 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "identifier", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.205 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "interval": { 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "interval", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "secs", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "60", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.206 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "log_level": { 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_level", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.207 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.208 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster": { 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.209 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_cluster_level": { 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_cluster_level", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.210 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "info", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [ 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "critical", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "debug", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "error", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "info", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "warning" 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.211 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "log_to_file": { 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "log_to_file", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "bool", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "False", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.212 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "sqlite3_killpoint": { 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "dev", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 1, 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "0", 2024-09-10T21:07:11.213 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_host": { 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_host", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.214 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "", 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_port": { 2024-09-10T21:07:11.215 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_port", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "int", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "10051", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.216 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "zabbix_sender": { 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "zabbix_sender", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "str", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "level": "advanced", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "flags": 0, 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "min": "", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "max": "", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "enum_allowed": [], 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "desc": "", 2024-09-10T21:07:11.217 INFO:teuthology.orchestra.run.smithi067.stdout: "long_desc": "", 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "see_also": [] 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "services": { 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "dashboard": "https://172.21.15.67:8443/" 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "always_on_modules": { 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "octopus": [ 2024-09-10T21:07:11.218 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "pacific": [ 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-09-10T21:07:11.219 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "quincy": [ 2024-09-10T21:07:11.220 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "reef": [ 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-09-10T21:07:11.221 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "squid": [ 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "balancer", 2024-09-10T21:07:11.222 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "devicehealth", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "orchestrator", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "pg_autoscaler", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "progress", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "rbd_support", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "status", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "telemetry", 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "volumes" 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "force_disabled_modules": {}, 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "last_failure_osd_epoch": 3, 2024-09-10T21:07:11.223 INFO:teuthology.orchestra.run.smithi067.stdout: "active_clients": [ 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "devicehealth", 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3852801234 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.224 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "libcephsqlite", 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 55258694 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "rbd_support", 2024-09-10T21:07:11.225 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 1253346143 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "volumes", 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "addrvec": [ 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-10T21:07:11.226 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "v2", 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: "addr": "172.21.15.67:0", 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: "nonce": 3687331287 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2024-09-10T21:07:11.227 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 msgr2=0x7fccdc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 0x7fccdc0b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcce4000c00 tx=0x7fcce40314a0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 msgr2=0x7fccf4198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcce800d950 tx=0x7fcce800de10 comp rx=0 tx=0).stop 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 shutdown_connections 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fccdc0b5360 0x7fccdc0b7820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccf41033c0 0x7fccf4198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccf4102a00 0x7fccf4198360 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 --2- 172.21.15.67:0/3023983259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccf41018b0 0x7fccf4197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:11.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 >> 172.21.15.67:0/3023983259 conn(0x7fccf40fd190 msgr2=0x7fccf4105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:11.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 shutdown_connections 2024-09-10T21:07:11.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:09.622+0000 7fccf9e57640 1 -- 172.21.15.67:0/3023983259 wait complete. 2024-09-10T21:07:11.237 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T21:07:11.237 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T21:07:11.238 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:09 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2769006241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.238 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:09 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4041632539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.238 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:09 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2091164767' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.238 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:10 smithi067 ceph-mon[30891]: pgmap v816: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-10T21:07:11.238 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:10 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3023983259' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:07:11.239 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:09 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2769006241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.239 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:09 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4041632539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.239 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:09 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2091164767' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:10 smithi172 ceph-mon[35265]: pgmap v816: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:10 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3023983259' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:09 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2769006241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:09 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4041632539' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:09 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2091164767' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:10 smithi083 ceph-mon[35058]: pgmap v816: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 11 op/s 2024-09-10T21:07:11.240 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:10 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3023983259' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:07:11.507 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:12.017 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:12.017 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:12.017 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 293, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 288, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 851712, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 177504, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.052578784, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.023638256, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.034790214, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 287, 2024-09-10T21:07:12.018 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.016809169, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000058568 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 851712, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 177504 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 6, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 222, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 3312, 2024-09-10T21:07:12.019 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 200000, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.022922225, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.017163099, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.003555282, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 221, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.021487181, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000097227 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:12.020 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 200000 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 0, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 0, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.000329474, 2024-09-10T21:07:12.021 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000238498, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.022 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:12.023 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:12.024 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:12.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148682, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 29, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:12.026 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-10T21:07:12.027 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 295, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 810289, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:12.028 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 295, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 295, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 810289, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:12.029 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:12.715 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T21:07:12.715 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T21:07:12.715 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T21:07:12.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T21:07:12.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:12 smithi083 ceph-mon[35058]: pgmap v817: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-09-10T21:07:12.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:12 smithi172 ceph-mon[35265]: pgmap v817: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-09-10T21:07:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:13.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:12 smithi067 ceph-mon[30891]: pgmap v817: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.8 KiB/s wr, 9 op/s 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 303, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 296, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 856960, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 181488, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:13.501 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.054487651, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.025886063, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.033369144, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 296, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.036142882, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000122104 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:13.502 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 856960, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 181488 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 2, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 224, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 320, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 200256, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:13.503 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.020954331, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.016626457, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.001712150, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 222, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.024003850, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000108125 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:13.504 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 200256 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 0, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2, 2024-09-10T21:07:13.505 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 0, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.000426372, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000337045, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:13.506 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-10T21:07:13.507 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:13.508 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:13.509 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:13.510 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148721, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 30, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:13.511 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-10T21:07:13.512 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-10T21:07:13.513 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 301, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 811706, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 301, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 301, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 811706, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:13.514 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:13.515 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:13.515 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:13.515 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:14.178 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T21:07:14.178 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T21:07:14.178 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T21:07:14.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T21:07:14.438 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:14.884 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:14 smithi067 ceph-mon[30891]: pgmap v818: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-10T21:07:14.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:14 smithi083 ceph-mon[35058]: pgmap v818: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-10T21:07:14.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:14 smithi172 ceph-mon[35265]: pgmap v818: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 KiB/s wr, 9 op/s 2024-09-10T21:07:14.989 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:14.989 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:14.989 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 296, 2024-09-10T21:07:14.989 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 291, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 853152, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 179120, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.051047875, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.023193145, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.032607283, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 290, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.013635168, 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000047017 2024-09-10T21:07:14.990 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 853152, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 179120 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 2, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 222, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 320, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 199904, 2024-09-10T21:07:14.991 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.021544422, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.016499849, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.002352929, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 220, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.023916041, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000108709 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:14.992 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 199904 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 4, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 4, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 2992, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 448, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.002433994, 2024-09-10T21:07:14.993 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000035444, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.002334254, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 3, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.004410600, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.001470200 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:07:14.994 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:14.995 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:14.996 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148704, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 29, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:14.998 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:14.999 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 298, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 811316, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 298, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 298, 2024-09-10T21:07:15.000 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 811316, 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:15.001 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:15.684 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T21:07:15.684 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T21:07:15.684 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T21:07:15.685 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T21:07:15.941 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 301, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 296, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 854512, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 182320, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.052013938, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.024247395, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.033618444, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 295, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.029860118, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000101220 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 854512, 2024-09-10T21:07:16.507 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 182320 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 6, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 228, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 3312, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 201056, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.022599131, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.016833377, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.003924360, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:16.508 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 227, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.016109156, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000070965 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 201056 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.509 INFO:teuthology.orchestra.run.smithi067.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_messages": 0, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages": 2, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_bytes": 0, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_total_time": 0.000389988, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_recv_time": 0.000301209, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:16.510 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "cct": { 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "total_workers": 0, 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: "unhealthy_workers": 0 2024-09-10T21:07:16.511 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "mempool": { 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:16.512 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:16.513 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_items": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:16.514 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_bytes": 148721, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_anon_items": 30, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:16.516 INFO:teuthology.orchestra.run.smithi067.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "pgmap_items": 0, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:16.517 INFO:teuthology.orchestra.run.smithi067.stdout: "mds_co_items": 2, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_1_items": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "unittest_2_items": 0 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "val": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "max": 104857600, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_started": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get": 303, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_sum": 811966, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:16.518 INFO:teuthology.orchestra.run.smithi067.stdout: "get_or_fail_success": 303, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "take": 0, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "take_sum": 0, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "put": 303, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "put_sum": 811966, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "wait": { 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgcount": 0, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "sum": 0.000000000, 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: "avgtime": 0.000000000 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-10T21:07:16.519 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-10T21:07:16.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:16 smithi067 ceph-mon[30891]: pgmap v819: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T21:07:16.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:16 smithi083 ceph-mon[35058]: pgmap v819: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T21:07:16.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:16 smithi172 ceph-mon[35265]: pgmap v819: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T21:07:17.168 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T21:07:17.168 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T21:07:17.168 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T21:07:17.169 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T21:07:17.428 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:17.930 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 3592, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 5085, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1316116, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 7722410, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 171, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 8, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.443913050, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.163979517, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.187750087, 2024-09-10T21:07:17.931 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.081686589, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 5080, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.255233938, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000050242 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 7061, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.001213215, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000171 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1116400, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 2303216 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.932 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 5302, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 3311, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2299224, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 2003952, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 19, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 5, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.318473527, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.157584392, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.216053457, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.006006365, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3314, 2024-09-10T21:07:17.933 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.210779003, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000063602 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 7187, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000975968, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000135 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 945232, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 210896 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1110, 2024-09-10T21:07:17.934 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 1295, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 412221, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 983042, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 10, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 6, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.106964899, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.052975852, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.056254123, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.006145480, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1293, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.231382866, 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000178950 2024-09-10T21:07:17.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1605, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000301641, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000187 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 487680 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 1, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-MDSRank": { 2024-09-10T21:07:17.936 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 734, 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.666655943, 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000908250 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:17.937 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:17.939 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 23, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000565934, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000024605 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": { 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 1310, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "reply": 1284, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "reply_latency": { 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1284, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1.473978622, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001147958 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.940 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_reply": 0, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "forward": 26, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_commit": 39, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_split": 3, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_merge": 0, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes": 63, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_top": 24, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_bottom": 12, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pin_tail": 27, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pinned": 27, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_expired": 869, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_with_caps": 5, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 5, 2024-09-10T21:07:17.941 INFO:teuthology.orchestra.run.smithi083.stdout: "subtrees": 4, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse": 1486, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_hit": 1082, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_forward": 26, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_discover": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_lock": 1, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "load_cent": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "q": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "exported": 36, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "exported_inodes": 902, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "imported": 9, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "imported_inodes": 3, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:17.942 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_backtrace_fetch": 252, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rfiles": 1027, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rbytes": 1753489076, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rsnaps": 0, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_fetch": 252, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_inodes": 168, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_base_inodes": 21, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dirfrag_rstats": 147, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_file_inodes": 84, 2024-09-10T21:07:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_inode_file_caps": 2, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_revoke": 58, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_grant": 899, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps": 239, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps_dirty": 170, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_cap_release": 1, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "process_request_cap_release": 69 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_cache": { 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update": 0, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:17.944 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_try_discover": 0, 2024-09-10T21:07:17.945 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_send_discover": 0, 2024-09-10T21:07:17.945 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_handle_discover": 25, 2024-09-10T21:07:17.945 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays": 0, 2024-09-10T21:07:17.945 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_created": 9, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_enqueued": 8, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_reintegrated": 1, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_migrated": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_started": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_completed": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_enqueue_scrub": 21, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_exportdir": 36, 2024-09-10T21:07:17.946 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_flush": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragmentdir": 4, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_write_failed": 0 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_log": { 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "evlrg": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "evadd": 1287, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "evex": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "evtrm": 0, 2024-09-10T21:07:17.947 INFO:teuthology.orchestra.run.smithi083.stdout: "ev": 1287, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "evexg": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "evexd": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segadd": 3, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segex": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segtrm": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "seg": 3, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segmjr": 2, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segexg": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "segexd": 0, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "expos": 4194304, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "wrpos": 7199733, 2024-09-10T21:07:17.948 INFO:teuthology.orchestra.run.smithi083.stdout: "rdpos": 0, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "jlat": { 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 226, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 6.620075537, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.029292369 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "replayed": 0 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_mem": { 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 64, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "ino+": 907, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "ino-": 843, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "dir": 31, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "dir+": 71, 2024-09-10T21:07:17.949 INFO:teuthology.orchestra.run.smithi083.stdout: "dir-": 40, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "dn": 63, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "dn+": 1146, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "dn-": 1083, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "cap": 5, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "cap+": 876, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "cap-": 871, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "rss": 64768, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "heap": 277598208 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_server": { 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_client_request": 1360, 2024-09-10T21:07:17.950 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_server_request": 1, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_request": 1310, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_session": 39, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_peer_request": 12, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "req_create_latency": { 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 836, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1.210638761, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001448132 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getattr_latency": { 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 18, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.004236814, 2024-09-10T21:07:17.951 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000235378 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "req_link_latency": { 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000861722, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000861722 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookup_latency": { 2024-09-10T21:07:17.952 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 16, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.003327480, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000207967 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupino_latency": { 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000435312, 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000217656 2024-09-10T21:07:17.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupname_latency": { 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.954 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.955 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.955 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lssnap_latency": { 2024-09-10T21:07:17.955 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mkdir_latency": { 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 33, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.033916938, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001027786 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mknod_latency": { 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.956 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mksnap_latency": { 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "req_open_latency": { 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 336, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.046648558, 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000138834 2024-09-10T21:07:17.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "req_readdir_latency": { 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 18, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.042608642, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.002367146 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rename_latency": { 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 9, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.074741072, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.008304563 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.958 INFO:teuthology.orchestra.run.smithi083.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmdir_latency": { 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.959 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setattr_latency": { 2024-09-10T21:07:17.960 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.001101328, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001101328 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.961 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setlayout_latency": { 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setxattr_latency": { 2024-09-10T21:07:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 8, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.020427235, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.002553404 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "req_symlink_latency": { 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "req_unlink_latency": { 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 6, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.035034760, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.005839126 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:17.963 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_sessions": { 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "session_count": 1, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "session_add": 3, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "session_remove": 2, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_open": 1, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_stale": 0, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "total_load": 1228, 2024-09-10T21:07:17.964 INFO:teuthology.orchestra.run.smithi083.stdout: "average_load": 614, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "avg_session_uptime": 963, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:17.965 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:17.966 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:17.967 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 296186, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 140, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:17.968 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 152, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 241825, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2426, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.969 INFO:teuthology.orchestra.run.smithi083.stdout: "objecter": { 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_active": 0, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_laggy": 0, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send": 1179, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send_bytes": 3400255, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_resend": 37, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_reply": 1179, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_latency": { 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1179, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 25.336403794, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.021489740 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "op_inflight": 0, 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "oplen_avg": { 2024-09-10T21:07:17.970 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1179, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1250 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "op": 1179, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "op_r": 295, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "op_w": 884, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "op_rmw": 0, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "op_pg": 0, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_stat": 0, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_create": 11, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_read": 22, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_write": 227, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writefull": 62, 2024-09-10T21:07:17.971 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writesame": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_append": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_zero": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_truncate": 3, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_delete": 520, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_mapext": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_getxattr": 273, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_setxattr": 22, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:17.972 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_call": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_watch": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_notify": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_other": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_active": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_send": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_resend": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_ping": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_active": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_send": 0, 2024-09-10T21:07:17.973 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_resend": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_active": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_send": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_resend": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_active": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_send": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_resend": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "command_active": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "command_send": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "command_resend": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "map_epoch": 75, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "map_full": 0, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "map_inc": 2, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_sessions": 12, 2024-09-10T21:07:17.974 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_open": 12, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_close": 0, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_laggy": 0, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_wr": 97, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_rd": 0, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_del": 13 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "oft": { 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_objs": 1, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_updates": 0, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_removes": 0 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.975 INFO:teuthology.orchestra.run.smithi083.stdout: "purge_queue": { 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops_high_water": 8, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing": 0, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_high_water": 8, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed_ops": 8, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed": 8, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:17.976 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 10000, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 2964319, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 10000, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 10000, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 2964319, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.977 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 1179, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 3401063, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1179, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 3401063, 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:17.978 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 1024, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 1179, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 1179, 2024-09-10T21:07:17.979 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1179, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1179, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:17.980 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 8, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 808, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 8, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 1, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 808, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.981 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle-0x5601373fedc0": { 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 1287, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 3005429, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 1287, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 226, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 3005429, 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:17.982 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: "trackedop": { 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_ops_count": 0 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:17.983 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-10T21:07:18.824 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:18 smithi083 ceph-mon[35058]: pgmap v820: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-09-10T21:07:19.095 INFO:tasks.check_counter:Daemon mds.b mds.exported=36 2024-09-10T21:07:19.096 INFO:tasks.check_counter:Daemon mds.b mds.imported=9 2024-09-10T21:07:19.096 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T21:07:19.096 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T21:07:19.097 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:18 smithi067 ceph-mon[30891]: pgmap v820: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-09-10T21:07:19.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:18 smithi172 ceph-mon[35265]: pgmap v820: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 7 op/s 2024-09-10T21:07:19.347 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:19.889 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-10T21:07:19.889 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 542, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 544, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 4330947, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 172420, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 8, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.052134983, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.020483295, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.012868031, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.014287998, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 542, 2024-09-10T21:07:19.890 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.023193677, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000042792 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1183, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 1404, 2024-09-10T21:07:19.891 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 8564798, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 945475, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 6, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 4, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.117995237, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.050449094, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.030556532, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.027552376, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1403, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.080877514, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000057646 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:19.892 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 571184 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2058, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2042, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 5638574, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 736184, 2024-09-10T21:07:19.893 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.218700280, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.096536287, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.068878007, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.048634254, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2041, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.094728151, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000046412 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.894 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 916144, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 182864 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 1, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-MDSRank": { 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 5906, 2024-09-10T21:07:19.895 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.131160217, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000022207 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": { 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 0, 2024-09-10T21:07:19.896 INFO:teuthology.orchestra.run.smithi083.stdout: "reply": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "reply_latency": { 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_reply": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "forward": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_commit": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_split": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_merge": 0, 2024-09-10T21:07:19.897 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes": 1902, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_top": 29, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_bottom": 1873, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pin_tail": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pinned": 1861, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_expired": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_with_caps": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "subtrees": 4, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_hit": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_forward": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_discover": 0, 2024-09-10T21:07:19.898 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_lock": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "load_cent": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "q": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "exported": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "exported_inodes": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "imported": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "imported_inodes": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rfiles": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rbytes": 0, 2024-09-10T21:07:19.899 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rsnaps": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_file_inodes": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:07:19.900 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_cap_release": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "process_request_cap_release": 0 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_cache": { 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_try_discover": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_send_discover": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_handle_discover": 0, 2024-09-10T21:07:19.901 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_created": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_enqueued": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_reintegrated": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_migrated": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_started": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_completed": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:19.902 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_exportdir": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_flush": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_write_failed": 0 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_log": { 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "evlrg": 0, 2024-09-10T21:07:19.903 INFO:teuthology.orchestra.run.smithi083.stdout: "evadd": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "evex": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "evtrm": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "ev": 6826, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "evexg": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "evexd": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segadd": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segex": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segtrm": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "seg": 9, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segmjr": 2, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segexg": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "segexd": 0, 2024-09-10T21:07:19.904 INFO:teuthology.orchestra.run.smithi083.stdout: "expos": 4194304, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "wrpos": 20845436, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "rdpos": 20843383, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "jlat": { 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "replayed": 6826 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_mem": { 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1066, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "ino+": 1300, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "ino-": 234, 2024-09-10T21:07:19.905 INFO:teuthology.orchestra.run.smithi083.stdout: "dir": 64, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dir+": 67, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dir-": 3, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dn": 1902, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dn+": 1919, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "dn-": 17, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "cap": 0, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "cap+": 0, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "cap-": 0, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "rss": 56636, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "heap": 257380352 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.906 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_server": { 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_client_request": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_server_request": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_request": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_session": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_peer_request": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "req_create_latency": { 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getattr_latency": { 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.907 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "req_link_latency": { 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookup_latency": { 2024-09-10T21:07:19.908 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupino_latency": { 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.909 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupname_latency": { 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.910 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.911 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.911 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lssnap_latency": { 2024-09-10T21:07:19.911 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mkdir_latency": { 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mknod_latency": { 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mksnap_latency": { 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "req_open_latency": { 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "req_readdir_latency": { 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rename_latency": { 2024-09-10T21:07:19.914 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmdir_latency": { 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:19.916 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setattr_latency": { 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setlayout_latency": { 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setxattr_latency": { 2024-09-10T21:07:19.918 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "req_symlink_latency": { 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "req_unlink_latency": { 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:19.919 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_sessions": { 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "session_count": 1, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "session_add": 3, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "session_remove": 2, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_open": 2, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_stale": 0, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "total_load": 0, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "average_load": 0, 2024-09-10T21:07:19.920 INFO:teuthology.orchestra.run.smithi083.stdout: "avg_session_uptime": 3594, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:19.921 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:19.922 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 246839, 2024-09-10T21:07:19.923 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 1117, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 152, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-10T21:07:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 3876569, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 46156, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "objecter": { 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_active": 0, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_laggy": 0, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send": 3459, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send_bytes": 21, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_resend": 3, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_reply": 3459, 2024-09-10T21:07:19.925 INFO:teuthology.orchestra.run.smithi083.stdout: "op_latency": { 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3459, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 18.002578166, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.005204561 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op_inflight": 0, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "oplen_avg": { 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3459, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 3460 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op": 3459, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op_r": 3459, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op_w": 0, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op_rmw": 0, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "op_pg": 0, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_stat": 2002, 2024-09-10T21:07:19.926 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_create": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_read": 1455, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_write": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writefull": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writesame": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_append": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_zero": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_truncate": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_delete": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_mapext": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_getxattr": 1, 2024-09-10T21:07:19.927 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_setxattr": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_call": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_watch": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_notify": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_other": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_active": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_send": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_resend": 0, 2024-09-10T21:07:19.928 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_ping": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_active": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_send": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_resend": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_active": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_send": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_resend": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_active": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_send": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_resend": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "command_active": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "command_send": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "command_resend": 0, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "map_epoch": 75, 2024-09-10T21:07:19.929 INFO:teuthology.orchestra.run.smithi083.stdout: "map_full": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "map_inc": 2, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_sessions": 7, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_open": 8, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_close": 1, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_laggy": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_wr": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_rd": 2, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_del": 0 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "oft": { 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_objs": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_updates": 0, 2024-09-10T21:07:19.930 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_removes": 0 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "purge_queue": { 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_high_water": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed_ops": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:19.931 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 3779, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 18174839, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 3779, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 3779, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 18174839, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.932 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 3459, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 16651767, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 3459, 2024-09-10T21:07:19.933 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 16651767, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 1024, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:19.934 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 3459, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 3459, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 3459, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 3459, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:19.935 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.936 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle-0x562b69bb3040": { 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:19.937 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: "trackedop": { 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_ops_count": 0 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:19.938 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-10T21:07:20.720 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T21:07:20.720 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T21:07:20.720 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T21:07:20.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T21:07:20.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:20 smithi083 ceph-mon[35058]: pgmap v821: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-10T21:07:20.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:20 smithi172 ceph-mon[35265]: pgmap v821: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-10T21:07:20.966 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:21.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:20 smithi067 ceph-mon[30891]: pgmap v821: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.0 KiB/s wr, 8 op/s 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 7933, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 7935, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2004930, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 7304364, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 52, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 5, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.524898678, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.236770500, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.111488186, 2024-09-10T21:07:21.457 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.137866095, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 7933, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1.003508876, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000126498 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 62, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000009364, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000151 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 4064 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.458 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 30290, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 35351, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 9414324, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 25688357, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 13, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 6, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 2.010983009, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 1.107796657, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 1.091351117, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.192241807, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 35349, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 6.980764610, 2024-09-10T21:07:21.459 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000197481 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 34393, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.005858768, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000170 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 6695008, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 13642032 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 10847, 2024-09-10T21:07:21.460 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 13000, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 4401727, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 8344751, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 9, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 6, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.922690676, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.483476737, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.279470235, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.146187374, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 13000, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1.588951176, 2024-09-10T21:07:21.461 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000122227 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 8157, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.001505910, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000184 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 938144, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 207664 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 1, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.462 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-MDSRank": { 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 12015, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 16.497544225, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001373079 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "queue_len": 0, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "complete_latency": { 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 823, 2024-09-10T21:07:21.463 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.032759849, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000039805 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "mds": { 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "request": 10364, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "reply": 10352, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "reply_latency": { 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 10352, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 448.129328043, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.043289154 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.464 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_reply": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "forward": 12, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_commit": 11, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_split": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_merge": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes": 1632, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_top": 0, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_bottom": 1005, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pin_tail": 627, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_pinned": 1631, 2024-09-10T21:07:21.465 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_expired": 26, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "inodes_with_caps": 1051, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "caps": 1051, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "subtrees": 8, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse": 38420, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_hit": 37002, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_forward": 6, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_discover": 20, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "traverse_lock": 543, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "load_cent": 0, 2024-09-10T21:07:21.466 INFO:teuthology.orchestra.run.smithi083.stdout: "q": 0, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "exported": 10, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "exported_inodes": 14, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "imported": 36, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "imported_inodes": 911, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_backtrace_fetch": 20949, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rfiles": 1035, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rbytes": 1751430182, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "root_rsnaps": 0, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_fetch": 20949, 2024-09-10T21:07:21.467 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_inodes": 560, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_dirfrag_rstats": 560, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_file_inodes": 20389, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_inode_file_caps": 2, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_revoke": 6106, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_grant": 4186, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_trunc": 1, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps": 8678, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_caps_dirty": 1898, 2024-09-10T21:07:21.468 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_cap_release": 194, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "process_request_cap_release": 1336 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_cache": { 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_try_discover": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_send_discover": 23, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "dir_handle_discover": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_created": 517, 2024-09-10T21:07:21.469 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_enqueued": 232, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_reintegrated": 285, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "strays_migrated": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_started": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "recovery_completed": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_exportdir": 10, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_flush": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:21.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_started": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "uninline_write_failed": 0 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_log": { 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evlrg": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evadd": 6826, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evex": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evtrm": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "ev": 6826, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evexg": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "evexd": 0, 2024-09-10T21:07:21.471 INFO:teuthology.orchestra.run.smithi083.stdout: "segadd": 9, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "segex": 0, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "segtrm": 0, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "seg": 9, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "segmjr": 2, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "segexg": 0, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "segexd": 0, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "expos": 4194304, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "wrpos": 20845436, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "rdpos": 0, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "jlat": { 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3979, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 572.538075214, 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.143889940 2024-09-10T21:07:21.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "replayed": 0 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_mem": { 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1070, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "ino+": 1303, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "ino-": 233, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dir": 68, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dir+": 72, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dir-": 4, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dn": 1632, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dn+": 1952, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "dn-": 320, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "cap": 1051, 2024-09-10T21:07:21.473 INFO:teuthology.orchestra.run.smithi083.stdout: "cap+": 1608, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "cap-": 557, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "rss": 67760, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "heap": 277729280 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_server": { 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_client_request": 11862, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "dispatch_server_request": 48, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_request": 10364, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_client_session": 601, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "handle_peer_request": 97, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "req_create_latency": { 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 430, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.630044860, 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001465220 2024-09-10T21:07:21.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getattr_latency": { 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 7225, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 441.632863976, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.061125655 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "req_link_latency": { 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 285, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.566435132, 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001987491 2024-09-10T21:07:21.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookup_latency": { 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1398, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 1.880396857, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001345062 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupino_latency": { 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupname_latency": { 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "req_lssnap_latency": { 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.478 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mkdir_latency": { 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 4, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.002479626, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000619906 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mknod_latency": { 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.479 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_mksnap_latency": { 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_open_latency": { 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 148, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.063482067, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000428932 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "req_readdir_latency": { 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 50, 2024-09-10T21:07:21.480 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.312140962, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.006242819 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rename_latency": { 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 510, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 2.580083033, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.005058986 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.481 INFO:teuthology.orchestra.run.smithi083.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmdir_latency": { 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 2, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.010384492, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.005192246 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.482 INFO:teuthology.orchestra.run.smithi083.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setattr_latency": { 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 1, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.009331540, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.009331540 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.483 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setlayout_latency": { 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.484 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "req_setxattr_latency": { 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "req_symlink_latency": { 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "req_unlink_latency": { 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 299, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.441685498, 2024-09-10T21:07:21.485 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001477209 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_sessions": { 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "session_count": 1, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "session_add": 3, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "session_remove": 2, 2024-09-10T21:07:21.486 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_open": 1, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "sessions_stale": 0, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "total_load": 1471, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "average_load": 1471, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "avg_session_uptime": 965, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:21.487 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:21.488 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:21.489 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 334926, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 1152, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:21.490 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 152, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 4187769, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 64515, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-10T21:07:21.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "objecter": { 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_active": 0, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_laggy": 0, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send": 25873, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_send_bytes": 17005859, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_resend": 33, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_reply": 25873, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_latency": { 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 25873, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 616.508524072, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.023828258 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "op_inflight": 0, 2024-09-10T21:07:21.492 INFO:teuthology.orchestra.run.smithi083.stdout: "oplen_avg": { 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 25873, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 26234 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "op": 25873, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "op_r": 21049, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "op_w": 4824, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "op_rmw": 0, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "op_pg": 0, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_stat": 0, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_create": 10, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_read": 100, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_write": 4079, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writefull": 145, 2024-09-10T21:07:21.493 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_writesame": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_append": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_zero": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_truncate": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_delete": 261, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_mapext": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_getxattr": 20949, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_setxattr": 20, 2024-09-10T21:07:21.494 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_call": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_watch": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_notify": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:21.495 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls": 0, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "osdop_other": 1, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_active": 0, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_send": 0, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_resend": 0, 2024-09-10T21:07:21.496 INFO:teuthology.orchestra.run.smithi083.stdout: "linger_ping": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_active": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_send": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolop_resend": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_active": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_send": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "poolstat_resend": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_active": 0, 2024-09-10T21:07:21.497 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_send": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "statfs_resend": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "command_active": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "command_send": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "command_resend": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "map_epoch": 75, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "map_full": 0, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "map_inc": 2, 2024-09-10T21:07:21.498 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_sessions": 12, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_open": 12, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_session_close": 0, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_laggy": 0, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_wr": 540, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_rd": 0, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_del": 129 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "oft": { 2024-09-10T21:07:21.499 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_objs": 1, 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_updates": 0, 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: "omap_total_removes": 0 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: "purge_queue": { 2024-09-10T21:07:21.500 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_ops_high_water": 17, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing": 0, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executing_high_water": 10, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed_ops": 246, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_executed": 232, 2024-09-10T21:07:21.501 INFO:teuthology.orchestra.run.smithi083.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 49066, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 10468012, 2024-09-10T21:07:21.502 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 49066, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 49066, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 10468012, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.503 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 25873, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 17029291, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 25873, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 17029291, 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:21.504 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 1024, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 25873, 2024-09-10T21:07:21.505 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 25873, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 25873, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 25873, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 232, 2024-09-10T21:07:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 23432, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 232, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 100, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 23432, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-write_buf_throttle-0x555849c88dc0": { 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 3758096384, 2024-09-10T21:07:21.507 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 6826, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 16651132, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 6826, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 3979, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 16651132, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:21.508 INFO:teuthology.orchestra.run.smithi083.stdout: "trackedop": { 2024-09-10T21:07:21.509 INFO:teuthology.orchestra.run.smithi083.stdout: "slow_ops_count": 0 2024-09-10T21:07:21.509 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:21.509 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-10T21:07:22.137 INFO:tasks.check_counter:Daemon mds.h mds.exported=10 2024-09-10T21:07:22.137 INFO:tasks.check_counter:Daemon mds.h mds.imported=36 2024-09-10T21:07:22.137 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T21:07:22.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T21:07:22.382 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:22.820 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:22 smithi083 ceph-mon[35058]: pgmap v822: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T21:07:22.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:22 smithi172 ceph-mon[35265]: pgmap v822: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T21:07:23.013 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-10T21:07:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 303, 2024-09-10T21:07:23.013 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 298, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 855056, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 183600, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.044444309, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.019910204, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.032410041, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 297, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.021837817, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000073528 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.014 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 855056, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 183600 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 6, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 229, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 3312, 2024-09-10T21:07:23.015 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 201232, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.016903780, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011561707, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.003381437, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 228, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.022408575, 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000098283 2024-09-10T21:07:23.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 201232 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-09-10T21:07:23.017 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.000310777, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000232346, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:23.018 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.019 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:23.020 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:23.021 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148704, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 29, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-10T21:07:23.022 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:23.023 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 305, 2024-09-10T21:07:23.024 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 812226, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 305, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 305, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 812226, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:23.025 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-10T21:07:23.026 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-10T21:07:23.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:22 smithi067 ceph-mon[30891]: pgmap v822: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T21:07:23.698 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T21:07:23.698 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T21:07:23.698 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T21:07:23.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T21:07:23.959 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:07:24.469 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2252, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2254, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3672402, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 716146, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.213050713, 2024-09-10T21:07:24.470 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.089038575, 2024-09-10T21:07:24.471 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.050365024, 2024-09-10T21:07:24.471 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.057773069, 2024-09-10T21:07:24.471 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:24.471 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2252, 2024-09-10T21:07:24.471 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.104176474, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000046259 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:24.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 10, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 231, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4968, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 574170, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.017812217, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.011431371, 2024-09-10T21:07:24.473 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.004391431, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000082465, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 230, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.019620565, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000085306 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 572832 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1371, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1355, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1175167, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 517561, 2024-09-10T21:07:24.475 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.145865360, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.066381100, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.047527715, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.029551903, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1354, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.061502755, 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000045423 2024-09-10T21:07:24.476 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 916304, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 183024 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-10T21:07:24.477 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5473, 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.134792055, 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024628 2024-09-10T21:07:24.478 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-10T21:07:24.479 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:24.480 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 23, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 23, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 23, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-10T21:07:24.481 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-10T21:07:24.482 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 1027, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1753489076, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:24.483 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:07:24.484 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-10T21:07:24.485 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:24.486 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-10T21:07:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 1287, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-10T21:07:24.488 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 3, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 7199733, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 7194520, 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-10T21:07:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 1287 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 15, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 883, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 868, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 10, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 69, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 59, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 23, 2024-09-10T21:07:24.490 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 891, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 868, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 54368, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 252440576 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-10T21:07:24.491 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.492 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:24.494 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-10T21:07:24.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.496 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-10T21:07:24.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.500 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.501 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.502 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:24.503 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3559, 2024-09-10T21:07:24.504 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:24.505 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:24.506 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 190182, 2024-09-10T21:07:24.507 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 53, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 152, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:24.508 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 62851, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 312, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3308, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-09-10T21:07:24.509 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3308, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3308, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.172763540, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003075200 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3308, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3309 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3308, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3308, 2024-09-10T21:07:24.510 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2111, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1194, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-10T21:07:24.511 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:24.512 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-10T21:07:24.513 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 75, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 5, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 3, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-10T21:07:24.514 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-10T21:07:24.515 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3629, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 4506511, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3629, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:24.516 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3629, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4506511, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:24.517 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3308, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3005439, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3308, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3005439, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3308, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3308, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3308, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3308, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.519 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-10T21:07:24.520 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x56283f7b7040": { 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:24.521 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-10T21:07:24.522 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:24.523 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-10T21:07:24.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:24 smithi172 ceph-mon[35265]: pgmap v823: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T21:07:24.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:24 smithi083 ceph-mon[35058]: pgmap v823: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T21:07:25.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:24 smithi067 ceph-mon[30891]: pgmap v823: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-10T21:07:25.416 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T21:07:25.416 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T21:07:25.416 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T21:07:25.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T21:07:25.668 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3202, 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3202, 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1316053, 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1017419, 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-10T21:07:26.121 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.283486385, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.114278049, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.063201978, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.089698392, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3201, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.131901752, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041206 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.122 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 4, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 228, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 876, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 573274, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.015074045, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.011189712, 2024-09-10T21:07:26.123 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.001934976, 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000068147, 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 226, 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.018539534, 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000082033 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:26.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 572576 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 320, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 304, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 916684, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 183822, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:26.125 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.044088653, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.021362352, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.031430608, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000018011, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 303, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.013959650, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000046071 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 916416, 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 183504 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-10T21:07:26.127 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5370, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.121872771, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000022695 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-10T21:07:26.129 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 85, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 85, 2024-09-10T21:07:26.130 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 85, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:26.131 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:07:26.132 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-10T21:07:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-10T21:07:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:26.135 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 354, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-10T21:07:26.136 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4608416, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 4607842, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.137 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 354 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 12, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 57, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 45, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 10, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 18, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 8, 2024-09-10T21:07:26.138 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 85, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 102, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 17, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 50652, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 250339328 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-10T21:07:26.139 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.140 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.142 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-10T21:07:26.145 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.146 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:26.147 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-10T21:07:26.150 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-10T21:07:26.152 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3562, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:26.153 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:26.154 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:26.155 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 182235, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 52, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 152, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:26.156 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 98929, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 526, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3201, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-09-10T21:07:26.157 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3201, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3201, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 18.914560277, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005908953 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3201, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3202 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3201, 2024-09-10T21:07:26.158 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3201, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2009, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1190, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-10T21:07:26.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-10T21:07:26.160 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-10T21:07:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 75, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 4, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 6, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 2, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-10T21:07:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.163 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3522, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1897211, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3522, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3522, 2024-09-10T21:07:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1897211, 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.165 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3201, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 414117, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3201, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 414117, 2024-09-10T21:07:26.166 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3201, 2024-09-10T21:07:26.167 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3201, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3201, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3201, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:26.168 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.169 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x562c8a131040": { 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:26.170 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:26.171 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-10T21:07:26.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:26 smithi083 ceph-mon[35058]: pgmap v824: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-10T21:07:26.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:26 smithi172 ceph-mon[35265]: pgmap v824: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-10T21:07:26.935 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T21:07:26.935 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T21:07:26.936 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T21:07:26.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T21:07:27.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:26 smithi067 ceph-mon[30891]: pgmap v824: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-09-10T21:07:27.190 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1716, 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1731, 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1345513, 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1620922, 2024-09-10T21:07:27.666 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 49, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.178423649, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.077194438, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.105260045, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.009386251, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1729, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.079328023, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000045880 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1985, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000284397, 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000143 2024-09-10T21:07:27.667 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1071680, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 483248 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 873, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1128, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 232599, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 874897, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.105158941, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.052574345, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.044756099, 2024-09-10T21:07:27.668 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.007529204, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1128, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.057669647, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000051125 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1620, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000317859, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000196 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 483312 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.669 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 263, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 265, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 74241, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 163955, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 13, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.029093015, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.010845111, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.009239575, 2024-09-10T21:07:27.670 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.007172518, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 263, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.026178063, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000099536 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 11, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000001604, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000145 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-10T21:07:27.671 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 736 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 591, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.125506629, 2024-09-10T21:07:27.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000212363 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 116, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004535414, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000039098 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 118, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 116, 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-10T21:07:27.673 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 116, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.136798714, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001179299 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 2, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 56, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 39, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 17, 2024-09-10T21:07:27.674 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 56, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 3, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 3, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 4, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 361, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 245, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 1, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 2, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-10T21:07:27.675 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 1, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 10, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 2, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 12, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 96, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 1035, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1751430182, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 96, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-10T21:07:27.676 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 96, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 134, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 153, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 179, 2024-09-10T21:07:27.677 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 63, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 9, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 116 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 3, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 1, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 38, 2024-09-10T21:07:27.678 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 38, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 1, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-10T21:07:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 354, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 354, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-09-10T21:07:27.680 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4608416, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 180, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 19.691659396, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.109398107 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.681 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 21, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 59, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 38, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 20, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 1, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 56, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 94, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 38, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 3, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 42, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 39, 2024-09-10T21:07:27.682 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 54000, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 260825088 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 236, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 118, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 17, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 38, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 37, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.072105393, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001948794 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-10T21:07:27.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001730478, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000432619 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 30, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008747517, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000291583 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-10T21:07:27.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.687 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.688 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002724075, 2024-09-10T21:07:27.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000389153 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-10T21:07:27.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 38, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.051491251, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001355032 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-10T21:07:27.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 17, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 17, 2024-09-10T21:07:27.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 974, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:27.696 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:27.697 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 283915, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 124, 2024-09-10T21:07:27.698 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 880, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 10, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7400, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 152, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:27.699 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 114665, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 816, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 553, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 445806, 2024-09-10T21:07:27.700 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 553, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 553, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 30.651285034, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.055427278 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 553, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 691 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 553, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 108, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 445, 2024-09-10T21:07:27.701 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 12, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 192, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 67, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 50, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 96, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-10T21:07:27.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-10T21:07:27.703 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 75, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 2, 2024-09-10T21:07:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 203, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 41 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-10T21:07:27.705 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 9, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 9, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 38, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 38, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2848, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1356505, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2848, 2024-09-10T21:07:27.706 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2848, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1356505, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:27.707 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 553, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 449644, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 553, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 449644, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-10T21:07:27.708 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 553, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 553, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 553, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 553, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 38, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 3838, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 38, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 12, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3838, 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:27.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x558f25f2cdc0": { 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 354, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 414112, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 354, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 180, 2024-09-10T21:07:27.711 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 414112, 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:27.712 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-10T21:07:28.426 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-10T21:07:28.426 INFO:tasks.check_counter:Daemon mds.i mds.imported=2 2024-09-10T21:07:28.426 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T21:07:28.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T21:07:28.674 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:07:28.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:28 smithi172 ceph-mon[35265]: pgmap v825: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-09-10T21:07:28.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:28 smithi083 ceph-mon[35058]: pgmap v825: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-09-10T21:07:29.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:28 smithi067 ceph-mon[30891]: pgmap v825: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.6 KiB/s wr, 6 op/s 2024-09-10T21:07:29.153 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-10T21:07:29.153 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.001059664, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000223982, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:29.154 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 306, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 301, 2024-09-10T21:07:29.155 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 855872, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 185520, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.043764639, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.021050192, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.030275123, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 300, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.018357980, 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000061193 2024-09-10T21:07:29.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 855872, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 185520 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 6, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 231, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3312, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 201584, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-10T21:07:29.157 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.016675852, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.011868969, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.002799688, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 230, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.017490423, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000076045 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 201584 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:07:29.159 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:07:29.160 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:07:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 148744, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 30, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-09-10T21:07:29.162 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 968, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-10T21:07:29.163 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 308, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 812616, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 308, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 308, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 812616, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-10T21:07:29.164 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:29.165 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-10T21:07:29.165 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-10T21:07:29.868 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T21:07:29.868 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T21:07:29.868 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T21:07:29.882 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T21:07:29.883 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T21:07:29.883 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:29.906 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-10T21:07:29.906 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:07:29.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T21:07:30.280 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:30.736 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:30 smithi067 ceph-mon[30891]: pgmap v826: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T21:07:30.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:30 smithi083 ceph-mon[35058]: pgmap v826: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 -- 172.21.15.67:0/1597712879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac103ce0 msgr2=0x7f64ac1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 --2- 172.21.15.67:0/1597712879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac103ce0 0x7f64ac1040c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f649c009900 tx=0x7f649c02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 -- 172.21.15.67:0/1597712879 shutdown_connections 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 --2- 172.21.15.67:0/1597712879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac10d140 0x7f64ac10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 --2- 172.21.15.67:0/1597712879 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac104600 0x7f64ac10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 --2- 172.21.15.67:0/1597712879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac103ce0 0x7f64ac1040c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 -- 172.21.15.67:0/1597712879 >> 172.21.15.67:0/1597712879 conn(0x7f64ac0fd720 msgr2=0x7f64ac0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 -- 172.21.15.67:0/1597712879 shutdown_connections 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.818+0000 7f64b0de3640 1 -- 172.21.15.67:0/1597712879 wait complete. 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 Processor -- start 2024-09-10T21:07:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 -- start start 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac103ce0 0x7f64ac1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac10d140 0x7f64ac19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac112db0 con 0x7f64ac104600 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac112c30 con 0x7f64ac10d140 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64b0de3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac112f30 con 0x7f64ac103ce0 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46676/0 (socket says 172.21.15.67:46676) 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 -- 172.21.15.67:0/2530416937 learned_addr learned my addr 172.21.15.67:0/2530416937 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64aa59c640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac103ce0 0x7f64ac1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64aad9d640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac10d140 0x7f64ac19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 -- 172.21.15.67:0/2530416937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac103ce0 msgr2=0x7f64ac1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac103ce0 0x7f64ac1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 -- 172.21.15.67:0/2530416937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac10d140 msgr2=0x7f64ac19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac10d140 0x7f64ac19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.819+0000 7f64a9d9b640 1 -- 172.21.15.67:0/2530416937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac19f370 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f64a9d9b640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f64a000d740 tx=0x7f64a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0017020 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a000de50 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac19f660 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a000f620 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.820+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1a5d20 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.821+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac1040c0 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.822+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f64a0010460 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.823+0000 7f649b7fe640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 0x7f64940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.823+0000 7f64aa59c640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 0x7f64940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.823+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64a00e56b0 con 0x7f64ac104600 2024-09-10T21:07:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.824+0000 7f64aa59c640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 0x7f64940b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f649c031440 tx=0x7f649c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:30.827+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64a0021070 con 0x7f64ac104600 2024-09-10T21:07:30.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:30 smithi172 ceph-mon[35265]: pgmap v826: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-09-10T21:07:31.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.030+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f64ac1081e0 con 0x7f64ac104600 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.030+0000 7f649b7fe640 1 -- 172.21.15.67:0/2530416937 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v75) ==== 81+0+591 (secure 0 0 0) 0x7f64a00ac5a0 con 0x7f64ac104600 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/3935023259 2024-09-11T20:42:06.670586+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1803732354 2024-09-11T20:42:06.670586+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3510169462 2024-09-11T20:42:06.670586+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/3935023259 2024-09-11T20:42:06.670586+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/254721601 2024-09-11T20:42:06.670586+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/1741490673 2024-09-11T20:41:41.469649+0000 2024-09-10T21:07:31.035 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/1741490673 2024-09-11T20:41:41.469649+0000 2024-09-10T21:07:31.036 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3396835785 2024-09-11T20:41:41.469649+0000 2024-09-10T21:07:31.036 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3091391503 2024-09-11T20:41:41.469649+0000 2024-09-10T21:07:31.036 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3875557644 2024-09-11T20:41:41.469649+0000 2024-09-10T21:07:31.036 INFO:teuthology.orchestra.run.smithi067.stderr:listed 10 entries 2024-09-10T21:07:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 msgr2=0x7f64940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 0x7f64940b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f649c031440 tx=0x7f649c005b50 comp rx=0 tx=0).stop 2024-09-10T21:07:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 msgr2=0x7f64ac199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f64a000d740 tx=0x7f64a000dc00 comp rx=0 tx=0).stop 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 shutdown_connections 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64ac10d140 0x7f64ac19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64ac104600 0x7f64ac199800 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f64940b52e0 0x7f64940b77a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 --2- 172.21.15.67:0/2530416937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac103ce0 0x7f64ac1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 >> 172.21.15.67:0/2530416937 conn(0x7f64ac0fd720 msgr2=0x7f64ac0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 shutdown_connections 2024-09-10T21:07:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:31.033+0000 7f64b0de3640 1 -- 172.21.15.67:0/2530416937 wait complete. 2024-09-10T21:07:31.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:31 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/2530416937' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:07:31.845 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T21:07:31.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:31.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /tmp/cephfs 2024-09-10T21:07:31.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:31 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/2530416937' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:07:31.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:31 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/2530416937' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:07:32.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T21:07:32.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.203 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-10T21:07:32.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.247 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2024-09-10T21:07:32.333 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-10T21:07:32.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-10T21:07:32.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:07:32.418 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2024-09-10T21:07:32.543 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T21:07:32.553 INFO:tasks.cephadm:Teardown begin 2024-09-10T21:07:32.553 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T21:07:32.553 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:07:32.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:32 smithi067 ceph-mon[30891]: pgmap v827: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-10T21:07:32.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:32 smithi083 ceph-mon[35058]: pgmap v827: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-10T21:07:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:32.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:32 smithi172 ceph-mon[35265]: pgmap v827: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-09-10T21:07:33.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 -- 172.21.15.67:0/3825775597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 msgr2=0x7fed04107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/3825775597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed04107b20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fed00009900 tx=0x7fed0002a410 comp rx=0 tx=0).stop 2024-09-10T21:07:33.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 -- 172.21.15.67:0/3825775597 shutdown_connections 2024-09-10T21:07:33.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/3825775597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04108060 0x7fed0410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/3825775597 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed04107b20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/3825775597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04101cd0 0x7fed041020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 -- 172.21.15.67:0/3825775597 >> 172.21.15.67:0/3825775597 conn(0x7fed040fd700 msgr2=0x7fed040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 -- 172.21.15.67:0/3825775597 shutdown_connections 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.417+0000 7fed0c5f9640 1 -- 172.21.15.67:0/3825775597 wait complete. 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 Processor -- start 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 -- start start 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04101cd0 0x7fed04198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04108060 0x7fed0419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fed04111cb0 con 0x7fed041076e0 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fed04111b30 con 0x7fed04108060 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0c5f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed04111e30 con 0x7fed04101cd0 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59290/0 (socket says 172.21.15.67:59290) 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 -- 172.21.15.67:0/1228871791 learned_addr learned my addr 172.21.15.67:0/1228871791 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0a395640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04101cd0 0x7fed04198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed0ab96640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04108060 0x7fed0419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 -- 172.21.15.67:0/1228871791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04101cd0 msgr2=0x7fed04198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04101cd0 0x7fed04198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 -- 172.21.15.67:0/1228871791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04108060 msgr2=0x7fed0419da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04108060 0x7fed0419da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.418+0000 7fed09b94640 1 -- 172.21.15.67:0/1228871791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0419e210 con 0x7fed041076e0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fed09b94640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fed00005940 tx=0x7fed000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0003f030 con 0x7fed041076e0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed00003cb0 con 0x7fed041076e0 2024-09-10T21:07:33.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0419e4a0 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00035070 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.419+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041a4bc0 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.420+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed041020b0 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.421+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fed0003bbf0 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.422+0000 7fecf77fe640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 0x7fecf00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.422+0000 7fed0a395640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 0x7fecf00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.422+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fed001068c0 con 0x7fed041076e0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.423+0000 7fed0a395640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 0x7fecf00b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fecf8005d00 tx=0x7fecf800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:33.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.425+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed000cd160 con 0x7fed041076e0 2024-09-10T21:07:33.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.653+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed04109e40 con 0x7fed041076e0 2024-09-10T21:07:33.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.654+0000 7fecf77fe640 1 -- 172.21.15.67:0/1228871791 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7fed000d1b90 con 0x7fed041076e0 2024-09-10T21:07:33.658 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:33.659 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:07:33.659 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.656+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 msgr2=0x7fecf00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.656+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 0x7fecf00b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fecf8005d00 tx=0x7fecf800b410 comp rx=0 tx=0).stop 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.656+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 msgr2=0x7fed041986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.656+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fed00005940 tx=0x7fed000042f0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 shutdown_connections 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fed04108060 0x7fed0419da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fed041076e0 0x7fed041986a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fecf00b5360 0x7fecf00b7820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 --2- 172.21.15.67:0/1228871791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed04101cd0 0x7fed04198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 >> 172.21.15.67:0/1228871791 conn(0x7fed040fd700 msgr2=0x7fed040ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 shutdown_connections 2024-09-10T21:07:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:33.657+0000 7fed0c5f9640 1 -- 172.21.15.67:0/1228871791 wait complete. 2024-09-10T21:07:34.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:07:34.727 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:34.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:34 smithi067 ceph-mon[30891]: pgmap v828: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T21:07:34.796 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:34 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1228871791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:34 smithi083 ceph-mon[35058]: pgmap v828: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T21:07:34.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:34 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1228871791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:34 smithi172 ceph-mon[35265]: pgmap v828: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-09-10T21:07:34.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:34 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1228871791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:35.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1929110200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0108020 msgr2=0x7fe6c010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1929110200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0108020 0x7fe6c010e820 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009ca0 tx=0x7fe6b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1929110200 shutdown_connections 2024-09-10T21:07:35.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1929110200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0108020 0x7fe6c010e820 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1929110200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c01076a0 0x7fe6c0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1929110200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c0101c90 0x7fe6c0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1929110200 >> 172.21.15.67:0/1929110200 conn(0x7fe6c00fd700 msgr2=0x7fe6c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1929110200 shutdown_connections 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.207+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1929110200 wait complete. 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 Processor -- start 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 -- start start 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c01076a0 0x7fe6c00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c0108020 0x7fe6c00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0111ce0 con 0x7fe6c0101c90 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0111b60 con 0x7fe6c0108020 2024-09-10T21:07:35.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c7a4b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c0111e60 con 0x7fe6c01076a0 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59308/0 (socket says 172.21.15.67:59308) 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 -- 172.21.15.67:0/1952205337 learned_addr learned my addr 172.21.15.67:0/1952205337 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c4fe6640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c01076a0 0x7fe6c00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c5fe8640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c0108020 0x7fe6c00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 -- 172.21.15.67:0/1952205337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c01076a0 msgr2=0x7fe6c00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c01076a0 0x7fe6c00fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 -- 172.21.15.67:0/1952205337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c0108020 msgr2=0x7fe6c00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c0108020 0x7fe6c00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.208+0000 7fe6c57e7640 1 -- 172.21.15.67:0/1952205337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c01a76e0 con 0x7fe6c0101c90 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6c57e7640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00e9f0 tx=0x7fe6bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00cd80 con 0x7fe6c0101c90 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6bc0054d0 con 0x7fe6c0101c90 2024-09-10T21:07:35.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c01a79d0 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc010690 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.209+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c01a7f10 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.210+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c0102070 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.211+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fe6bc004e90 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.212+0000 7fe6b27fc640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 0x7fe6ac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.212+0000 7fe6c4fe6640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 0x7fe6ac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.212+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe6bc0e5fe0 con 0x7fe6c0101c90 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.213+0000 7fe6c4fe6640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 0x7fe6ac0b7820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ff6f0 tx=0x7fe6b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:35.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.216+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6bc0aced0 con 0x7fe6c0101c90 2024-09-10T21:07:35.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.440+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6c002e5c0 con 0x7fe6c0101c90 2024-09-10T21:07:35.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.441+0000 7fe6b27fc640 1 -- 172.21.15.67:0/1952205337 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11905 (secure 0 0 0) 0x7fe6bc0cf090 con 0x7fe6c0101c90 2024-09-10T21:07:35.446 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:35.446 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":34,"btime":"2024-09-10T20:56:19:641700+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14676,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1678307285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6834","nonce":1678307285},{"type":"v1","addr":"172.21.15.67:6835","nonce":1678307285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14688,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6837/3722693224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6836","nonce":3722693224},{"type":"v1","addr":"172.21.15.67:6837","nonce":3722693224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6839/4192230461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6838","nonce":4192230461},{"type":"v1","addr":"172.21.15.67:6839","nonce":4192230461}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6841/2489750374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6840","nonce":2489750374},{"type":"v1","addr":"172.21.15.67:6841","nonce":2489750374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24520,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/2002269630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2002269630},{"type":"v1","addr":"172.21.15.172:6833","nonce":2002269630}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24530,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6833/1389029488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1389029488},{"type":"v1","addr":"172.21.15.83:6833","nonce":1389029488}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T20:49:26.010912+0000","modified":"2024-09-10T20:56:19.561876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24608,"mds_1":24583,"mds_2":24581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24554":{"gid":24554,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.83:6835/1348947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1348947486},{"type":"v1","addr":"172.21.15.83:6835","nonce":1348947486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24559":{"gid":24559,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2165153315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2165153315},{"type":"v1","addr":"172.21.15.172:6835","nonce":2165153315}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24565":{"gid":24565,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6837/242991911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":242991911},{"type":"v1","addr":"172.21.15.172:6837","nonce":242991911}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.83:6837/725743109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":725743109},{"type":"v1","addr":"172.21.15.83:6837","nonce":725743109}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6839/977540301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":977540301},{"type":"v1","addr":"172.21.15.172:6839","nonce":977540301}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.83:6839/4114167156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":4114167156},{"type":"v1","addr":"172.21.15.83:6839","nonce":4114167156}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24608,"qdb_cluster":[24581,24583,24608]},"id":1}]} 2024-09-10T21:07:35.446 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 34 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 msgr2=0x7fe6ac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 0x7fe6ac0b7820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ff6f0 tx=0x7fe6b4005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 msgr2=0x7fe6c00fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00e9f0 tx=0x7fe6bc00edf0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 shutdown_connections 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6c0108020 0x7fe6c00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fe6ac0b5360 0x7fe6ac0b7820 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c01076a0 0x7fe6c00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 --2- 172.21.15.67:0/1952205337 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe6c0101c90 0x7fe6c00fdc00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:35.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.443+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 >> 172.21.15.67:0/1952205337 conn(0x7fe6c00fd700 msgr2=0x7fe6c006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:35.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.444+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 shutdown_connections 2024-09-10T21:07:35.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:35.444+0000 7fe6c7a4b640 1 -- 172.21.15.67:0/1952205337 wait complete. 2024-09-10T21:07:35.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:35 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/1952205337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:35.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:35 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/1952205337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:35.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:35 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/1952205337' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:07:36.212 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:07:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:36.858 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:36 smithi067 ceph-mon[30891]: pgmap v829: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-10T21:07:36.891 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:36 smithi083 ceph-mon[35058]: pgmap v829: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-10T21:07:36.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:36 smithi172 ceph-mon[35265]: pgmap v829: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 -- 172.21.15.67:0/1157538212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb760102dc0 msgr2=0x7fb7601031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 --2- 172.21.15.67:0/1157538212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb760102dc0 0x7fb7601031a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb758009900 tx=0x7fb75802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 -- 172.21.15.67:0/1157538212 shutdown_connections 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 --2- 172.21.15.67:0/1157538212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760109150 0x7fb76010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 --2- 172.21.15.67:0/1157538212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7601087d0 0x7fb760108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 --2- 172.21.15.67:0/1157538212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb760102dc0 0x7fb7601031a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 -- 172.21.15.67:0/1157538212 >> 172.21.15.67:0/1157538212 conn(0x7fb7600fe830 msgr2=0x7fb760100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.119+0000 7fb766fad640 1 -- 172.21.15.67:0/1157538212 shutdown_connections 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.120+0000 7fb766fad640 1 -- 172.21.15.67:0/1157538212 wait complete. 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.120+0000 7fb766fad640 1 Processor -- start 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.120+0000 7fb766fad640 1 -- start start 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760102dc0 0x7fb760199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb760109150 0x7fb76019eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7fb760112dd0 con 0x7fb7601087d0 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb760112c50 con 0x7fb760109150 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb766fad640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb760112f50 con 0x7fb760102dc0 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59320/0 (socket says 172.21.15.67:59320) 2024-09-10T21:07:37.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 -- 172.21.15.67:0/3460362233 learned_addr learned my addr 172.21.15.67:0/3460362233 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb76554a640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb760109150 0x7fb76019eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb764d49640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760102dc0 0x7fb760199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 -- 172.21.15.67:0/3460362233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760102dc0 msgr2=0x7fb760199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760102dc0 0x7fb760199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 -- 172.21.15.67:0/3460362233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb760109150 msgr2=0x7fb76019eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb760109150 0x7fb76019eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 -- 172.21.15.67:0/3460362233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76019f2f0 con 0x7fb7601087d0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.121+0000 7fb75ffff640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb75000cce0 tx=0x7fb75000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.122+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75000f650 con 0x7fb7601087d0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.122+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76019f5e0 con 0x7fb7601087d0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.122+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb75000fca0 con 0x7fb7601087d0 2024-09-10T21:07:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.122+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750018b40 con 0x7fb7601087d0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.122+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7601a5e70 con 0x7fb7601087d0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.123+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7601031a0 con 0x7fb7601087d0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.124+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7fb75000f7f0 con 0x7fb7601087d0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.125+0000 7fb75dffb640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 0x7fb74c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.125+0000 7fb764d49640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 0x7fb74c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.125+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb7500e5fe0 con 0x7fb7601087d0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.125+0000 7fb764d49640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 0x7fb74c0b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb758031440 tx=0x7fb758005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:37.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.129+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb750014030 con 0x7fb7601087d0 2024-09-10T21:07:37.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.318+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb76010af30 con 0x7fb7601087d0 2024-09-10T21:07:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.319+0000 7fb75dffb640 1 -- 172.21.15.67:0/3460362233 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22607 (secure 0 0 0) 0x7fb7500aced0 con 0x7fb7601087d0 2024-09-10T21:07:37.324 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-10T21:07:37.324 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":75,"fsid":"d92bf05e-6fb4-11ef-bcea-c7b262605968","created":"2024-09-10T20:41:20.189021+0000","modified":"2024-09-10T20:50:08.551921+0000","last_up_change":"2024-09-10T20:48:35.225707+0000","last_in_change":"2024-09-10T20:48:12.737374+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:44:51.135967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:49:21.721858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:49:23.984209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ccf7e4d5-d677-4722-8ca8-ce5156a1d333","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6803","nonce":363534915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6805","nonce":363534915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6809","nonce":363534915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":363534915},{"type":"v1","addr":"172.21.15.67:6807","nonce":363534915}]},"public_addr":"172.21.15.67:6803/363534915","cluster_addr":"172.21.15.67:6805/363534915","heartbeat_back_addr":"172.21.15.67:6809/363534915","heartbeat_front_addr":"172.21.15.67:6807/363534915","state":["exists","up"]},{"osd":1,"uuid":"c974252b-1bb0-4ca1-81e7-33a82fe76300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6801","nonce":459488332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6803","nonce":459488332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6807","nonce":459488332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":459488332},{"type":"v1","addr":"172.21.15.83:6805","nonce":459488332}]},"public_addr":"172.21.15.83:6801/459488332","cluster_addr":"172.21.15.83:6803/459488332","heartbeat_back_addr":"172.21.15.83:6807/459488332","heartbeat_front_addr":"172.21.15.83:6805/459488332","state":["exists","up"]},{"osd":2,"uuid":"84efdf2d-6565-4a34-89a6-8e825e3c1d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6801","nonce":1268193181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6803","nonce":1268193181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6807","nonce":1268193181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1268193181},{"type":"v1","addr":"172.21.15.172:6805","nonce":1268193181}]},"public_addr":"172.21.15.172:6801/1268193181","cluster_addr":"172.21.15.172:6803/1268193181","heartbeat_back_addr":"172.21.15.172:6807/1268193181","heartbeat_front_addr":"172.21.15.172:6805/1268193181","state":["exists","up"]},{"osd":3,"uuid":"428aeca1-57f7-4b42-888c-21fbfdbc9c6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6811","nonce":3075228399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6813","nonce":3075228399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6817","nonce":3075228399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":3075228399},{"type":"v1","addr":"172.21.15.67:6815","nonce":3075228399}]},"public_addr":"172.21.15.67:6811/3075228399","cluster_addr":"172.21.15.67:6813/3075228399","heartbeat_back_addr":"172.21.15.67:6817/3075228399","heartbeat_front_addr":"172.21.15.67:6815/3075228399","state":["exists","up"]},{"osd":4,"uuid":"72f98c5f-21d4-4013-8d85-70510054e05a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6809","nonce":451760367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6811","nonce":451760367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6815","nonce":451760367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":451760367},{"type":"v1","addr":"172.21.15.83:6813","nonce":451760367}]},"public_addr":"172.21.15.83:6809/451760367","cluster_addr":"172.21.15.83:6811/451760367","heartbeat_back_addr":"172.21.15.83:6815/451760367","heartbeat_front_addr":"172.21.15.83:6813/451760367","state":["exists","up"]},{"osd":5,"uuid":"68176cbf-20a3-44c1-82bb-2a78c8faf6fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6809","nonce":10580951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6811","nonce":10580951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6815","nonce":10580951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":10580951},{"type":"v1","addr":"172.21.15.172:6813","nonce":10580951}]},"public_addr":"172.21.15.172:6809/10580951","cluster_addr":"172.21.15.172:6811/10580951","heartbeat_back_addr":"172.21.15.172:6815/10580951","heartbeat_front_addr":"172.21.15.172:6813/10580951","state":["exists","up"]},{"osd":6,"uuid":"dc804584-08bf-4d2d-9d84-88f3d964c37d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6819","nonce":1669148747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6821","nonce":1669148747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6825","nonce":1669148747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1669148747},{"type":"v1","addr":"172.21.15.67:6823","nonce":1669148747}]},"public_addr":"172.21.15.67:6819/1669148747","cluster_addr":"172.21.15.67:6821/1669148747","heartbeat_back_addr":"172.21.15.67:6825/1669148747","heartbeat_front_addr":"172.21.15.67:6823/1669148747","state":["exists","up"]},{"osd":7,"uuid":"04b82fc4-1c68-44a1-8288-cf19eb6b81e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6817","nonce":3493783526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6819","nonce":3493783526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6823","nonce":3493783526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":3493783526},{"type":"v1","addr":"172.21.15.83:6821","nonce":3493783526}]},"public_addr":"172.21.15.83:6817/3493783526","cluster_addr":"172.21.15.83:6819/3493783526","heartbeat_back_addr":"172.21.15.83:6823/3493783526","heartbeat_front_addr":"172.21.15.83:6821/3493783526","state":["exists","up"]},{"osd":8,"uuid":"21f45657-f851-4a79-a825-3cab9b319417","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6817","nonce":4093279752}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6819","nonce":4093279752}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6823","nonce":4093279752}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4093279752},{"type":"v1","addr":"172.21.15.172:6821","nonce":4093279752}]},"public_addr":"172.21.15.172:6817/4093279752","cluster_addr":"172.21.15.172:6819/4093279752","heartbeat_back_addr":"172.21.15.172:6823/4093279752","heartbeat_front_addr":"172.21.15.172:6821/4093279752","state":["exists","up"]},{"osd":9,"uuid":"1523fce3-7f24-44fc-a1e2-e5369e8a87c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6827","nonce":2963981854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6829","nonce":2963981854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6833","nonce":2963981854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2963981854},{"type":"v1","addr":"172.21.15.67:6831","nonce":2963981854}]},"public_addr":"172.21.15.67:6827/2963981854","cluster_addr":"172.21.15.67:6829/2963981854","heartbeat_back_addr":"172.21.15.67:6833/2963981854","heartbeat_front_addr":"172.21.15.67:6831/2963981854","state":["exists","up"]},{"osd":10,"uuid":"bd1ab16a-dfb6-446d-b9d4-67e2262b81ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6825","nonce":2093574925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6827","nonce":2093574925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6831","nonce":2093574925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":2093574925},{"type":"v1","addr":"172.21.15.83:6829","nonce":2093574925}]},"public_addr":"172.21.15.83:6825/2093574925","cluster_addr":"172.21.15.83:6827/2093574925","heartbeat_back_addr":"172.21.15.83:6831/2093574925","heartbeat_front_addr":"172.21.15.83:6829/2093574925","state":["exists","up"]},{"osd":11,"uuid":"b8bee1a1-ca3e-42df-b858-ffe08396314c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6825","nonce":4044336910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6827","nonce":4044336910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6831","nonce":4044336910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4044336910},{"type":"v1","addr":"172.21.15.172:6829","nonce":4044336910}]},"public_addr":"172.21.15.172:6825/4044336910","cluster_addr":"172.21.15.172:6827/4044336910","heartbeat_back_addr":"172.21.15.172:6831/4044336910","heartbeat_front_addr":"172.21.15.172:6829/4044336910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:43:56.937737+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:23.065666+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:44:47.776337+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:12.754259+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:45:38.697394+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:03.179597+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:29.243073+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:46:54.784475+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:19.186289+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:47:44.740078+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:09.826859+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:48:33.747657+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/1803732354":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/3510169462":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6800/3935023259":"2024-09-11T20:42:06.670586+0000","172.21.15.67:0/254721601":"2024-09-11T20:42:06.670586+0000","172.21.15.67:6801/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:6800/1741490673":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3396835785":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3091391503":"2024-09-11T20:41:41.469649+0000","172.21.15.67:0/3875557644":"2024-09-11T20:41:41.469649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 msgr2=0x7fb74c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 0x7fb74c0b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb758031440 tx=0x7fb758005b50 comp rx=0 tx=0).stop 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 msgr2=0x7fb760199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb75000cce0 tx=0x7fb75000a620 comp rx=0 tx=0).stop 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 shutdown_connections 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb760109150 0x7fb76019eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7601087d0 0x7fb760199780 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7fb74c0b52e0 0x7fb74c0b77a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 --2- 172.21.15.67:0/3460362233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb760102dc0 0x7fb760199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 >> 172.21.15.67:0/3460362233 conn(0x7fb7600fe830 msgr2=0x7fb760100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 shutdown_connections 2024-09-10T21:07:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:37.322+0000 7fb766fad640 1 -- 172.21.15.67:0/3460362233 wait complete. 2024-09-10T21:07:37.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:37 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/3460362233' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:38.026 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:37 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/3460362233' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:38.057 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T21:07:38.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:37 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/3460362233' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:07:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:38.684 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:38 smithi067 ceph-mon[30891]: pgmap v830: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-09-10T21:07:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- 172.21.15.67:0/948903565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c41045c0 msgr2=0x7f63c410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 --2- 172.21.15.67:0/948903565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c41045c0 0x7f63c410cab0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009900 tx=0x7f63b802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- 172.21.15.67:0/948903565 shutdown_connections 2024-09-10T21:07:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 --2- 172.21.15.67:0/948903565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c410d100 0x7f63c410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 --2- 172.21.15.67:0/948903565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c41045c0 0x7f63c410cab0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 --2- 172.21.15.67:0/948903565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c4103ca0 0x7f63c4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- 172.21.15.67:0/948903565 >> 172.21.15.67:0/948903565 conn(0x7f63c40fd700 msgr2=0x7f63c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- 172.21.15.67:0/948903565 shutdown_connections 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- 172.21.15.67:0/948903565 wait complete. 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 Processor -- start 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.760+0000 7f63c93ea640 1 -- start start 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c41045c0 0x7f63c4199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c410d100 0x7f63c419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f63c4112e80 con 0x7f63c4103ca0 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f63c4112d00 con 0x7f63c410d100 2024-09-10T21:07:38.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63c4113000 con 0x7f63c41045c0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59334/0 (socket says 172.21.15.67:59334) 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 -- 172.21.15.67:0/302733927 learned_addr learned my addr 172.21.15.67:0/302733927 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c37fe640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c410d100 0x7f63c419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c27fc640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c41045c0 0x7f63c4199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 -- 172.21.15.67:0/302733927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c41045c0 msgr2=0x7f63c4199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c41045c0 0x7f63c4199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 -- 172.21.15.67:0/302733927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c410d100 msgr2=0x7f63c419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c410d100 0x7f63c419ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 -- 172.21.15.67:0/302733927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c419f4c0 con 0x7f63c4103ca0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c2ffd640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f63b400b4a0 tx=0x7f63b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4014070 con 0x7f63c4103ca0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b4010ac0 con 0x7f63c4103ca0 2024-09-10T21:07:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.761+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c419f7b0 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.762+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4017c30 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.762+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c41a5ef0 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.762+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c4104100 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.764+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f63b4010610 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.765+0000 7f63abfff640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 0x7f63ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.765+0000 7f63c27fc640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 0x7f63ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.765+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f63b40e5410 con 0x7f63c4103ca0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.766+0000 7f63c27fc640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 0x7f63ac0b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f63b8006010 tx=0x7f63b8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.768+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f63b40ac300 con 0x7f63c4103ca0 2024-09-10T21:07:38.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:38 smithi172 ceph-mon[35265]: pgmap v830: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-09-10T21:07:38.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.989+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f63c402e5c0 con 0x7f63c4103ca0 2024-09-10T21:07:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.992+0000 7f63abfff640 1 -- 172.21.15.67:0/302733927 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f63b40abc00 con 0x7f63c4103ca0 2024-09-10T21:07:38.996 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T21:07:39.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.995+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 msgr2=0x7f63ac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.995+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 0x7f63ac0b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f63b8006010 tx=0x7f63b8031400 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.995+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 msgr2=0x7f63c4199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.995+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f63b400b4a0 tx=0x7f63b400b960 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 shutdown_connections 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63c410d100 0x7f63c419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f63ac0b52e0 0x7f63ac0b77a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c41045c0 0x7f63c4199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 --2- 172.21.15.67:0/302733927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63c4103ca0 0x7f63c4199410 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 >> 172.21.15.67:0/302733927 conn(0x7f63c40fd700 msgr2=0x7f63c40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 shutdown_connections 2024-09-10T21:07:39.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:38.996+0000 7f63c93ea640 1 -- 172.21.15.67:0/302733927 wait complete. 2024-09-10T21:07:39.038 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:38 smithi083 ceph-mon[35058]: pgmap v830: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-09-10T21:07:39.295 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a[30887]: 2024-09-10T21:07:38.990+0000 7fb82a84f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:07:39.391 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.391 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: starting mds.b at 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mds[64560]: -- 172.21.15.83:0/3620391518 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605a2769860 con 0x5605a2747000 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: starting mds.e at 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.392 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.393 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mds[64862]: -- 172.21.15.83:0/2662381940 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9fb1ad860 con 0x55c9fb18b400 2024-09-10T21:07:39.393 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: starting mds.h at 2024-09-10T21:07:39.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mds[65023]: -- 172.21.15.172:0/2719670262 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fba22f860 con 0x563fba20c800 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: starting mds.i at 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mds[64719]: -- 172.21.15.172:0/2943861284 <== mon.2 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557bcbf77860 con 0x557bcbf54800 2024-09-10T21:07:39.450 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: starting mds.c at 2024-09-10T21:07:39.451 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: ignoring --setuser ceph since I am not root 2024-09-10T21:07:39.451 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: ignoring --setgroup ceph since I am not root 2024-09-10T21:07:39.451 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mds[64420]: -- 172.21.15.172:0/627360542 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562157559860 con 0x562157537000 2024-09-10T21:07:39.451 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: starting mds.f at 2024-09-10T21:07:39.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T21:07:39.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:07:39.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:07:39.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:07:39.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:07:39.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:07:39.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:39 smithi172 ceph-mon[35265]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T21:07:40.045 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:07:40.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:07:40.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:07:40.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:07:40.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:07:40.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:39 smithi067 ceph-mon[30891]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T21:07:40.049 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:40.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:07:40.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:07:40.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:07:40.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/302733927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:07:40.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:07:40.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:39 smithi083 ceph-mon[35058]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T21:07:40.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 -- 172.21.15.67:0/4092948959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc104590 msgr2=0x7f07fc10cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 --2- 172.21.15.67:0/4092948959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc104590 0x7f07fc10cb70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009900 tx=0x7f07e402a410 comp rx=0 tx=0).stop 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 -- 172.21.15.67:0/4092948959 shutdown_connections 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 --2- 172.21.15.67:0/4092948959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc10d140 0x7f07fc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 --2- 172.21.15.67:0/4092948959 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc104590 0x7f07fc10cb70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 --2- 172.21.15.67:0/4092948959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc103b90 0x7f07fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 -- 172.21.15.67:0/4092948959 >> 172.21.15.67:0/4092948959 conn(0x7f07fc0fd700 msgr2=0x7f07fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 -- 172.21.15.67:0/4092948959 shutdown_connections 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.552+0000 7f08029a1640 1 -- 172.21.15.67:0/4092948959 wait complete. 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 Processor -- start 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 -- start start 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc103b90 0x7f07fc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc104590 0x7f07fc199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:40.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112db0 con 0x7f07fc10d140 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112c30 con 0x7f07fc103b90 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f08029a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc112f30 con 0x7f07fc104590 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:59360/0 (socket says 172.21.15.67:59360) 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 -- 172.21.15.67:0/4017081967 learned_addr learned my addr 172.21.15.67:0/4017081967 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f07fbfff640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc103b90 0x7f07fc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f07f3fff640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc104590 0x7f07fc199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 -- 172.21.15.67:0/4017081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc104590 msgr2=0x7f07fc199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc104590 0x7f07fc199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 -- 172.21.15.67:0/4017081967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc103b90 msgr2=0x7f07fc1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:40.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc103b90 0x7f07fc1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.553+0000 7f0800f3e640 1 -- 172.21.15.67:0/4017081967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc19f370 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f0800f3e640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e9d0 tx=0x7f07f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f400cd80 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f4005020 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc19f660 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40116d0 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.554+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc1a5d20 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.555+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc06b0f0 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.556+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f07f400f040 con 0x7f07fc10d140 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.557+0000 7f07f9ffb640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.557+0000 7f07fbfff640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:40.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.557+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8440+0+0 (secure 0 0 0) 0x7f07f40e5f80 con 0x7f07fc10d140 2024-09-10T21:07:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.558+0000 7f07fbfff640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 0x7f07e80b7820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0058c0 tx=0x7f07ec00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:40.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.560+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07f4016030 con 0x7f07fc10d140 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: pgmap v832: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6834/2771757936,v1:172.21.15.83:6835/2771757936] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6834/57353311,v1:172.21.15.172:6835/57353311] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6836/2440144534,v1:172.21.15.172:6837/2440144534] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6836/3023945072,v1:172.21.15.83:6838/3023945072] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.83:6837/3687224746,v1:172.21.15.83:6839/3687224746] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: mds.? [v2:172.21.15.172:6838/1163400317,v1:172.21.15.172:6839/1163400317] up:boot 2024-09-10T21:07:40.778 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:07:40.779 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:40 smithi067 ceph-mon[30891]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:07:40.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:40.785+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f07fc1081b0 con 0x7f07fc10d140 2024-09-10T21:07:40.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: pgmap v832: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6834/2771757936,v1:172.21.15.83:6835/2771757936] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6834/57353311,v1:172.21.15.172:6835/57353311] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6836/2440144534,v1:172.21.15.172:6837/2440144534] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6836/3023945072,v1:172.21.15.83:6838/3023945072] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.83:6837/3687224746,v1:172.21.15.83:6839/3687224746] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: mds.? [v2:172.21.15.172:6838/1163400317,v1:172.21.15.172:6839/1163400317] up:boot 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:07:40.950 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:40 smithi172 ceph-mon[35265]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:07:41.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: pgmap v832: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6834/2771757936,v1:172.21.15.83:6835/2771757936] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6834/57353311,v1:172.21.15.172:6835/57353311] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6836/2440144534,v1:172.21.15.172:6837/2440144534] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6836/3023945072,v1:172.21.15.83:6838/3023945072] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.83:6837/3687224746,v1:172.21.15.83:6839/3687224746] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: mds.? [v2:172.21.15.172:6838/1163400317,v1:172.21.15.172:6839/1163400317] up:boot 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:07:41.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:40 smithi083 ceph-mon[35058]: from='mgr.14150 172.21.15.67:0/1694520760' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:07:41.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.648+0000 7f07f9ffb640 1 -- 172.21.15.67:0/4017081967 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f07f40acd90 con 0x7f07fc10d140 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 msgr2=0x7f07e80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 0x7f07e80b7820 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0058c0 tx=0x7f07ec00a250 comp rx=0 tx=0).stop 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 msgr2=0x7f07fc19eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e9d0 tx=0x7f07f400ee90 comp rx=0 tx=0).stop 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 shutdown_connections 2024-09-10T21:07:41.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07fc10d140 0x7f07fc19eba0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f07e80b5360 0x7f07e80b7820 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc104590 0x7f07fc199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 --2- 172.21.15.67:0/4017081967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07fc103b90 0x7f07fc1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 >> 172.21.15.67:0/4017081967 conn(0x7f07fc0fd700 msgr2=0x7f07fc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 shutdown_connections 2024-09-10T21:07:41.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:41.652+0000 7f08029a1640 1 -- 172.21.15.67:0/4017081967 wait complete. 2024-09-10T21:07:41.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:41 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:07:42.011 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:41 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:07:42.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:41 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:07:42.591 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T21:07:42.858 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:42 smithi172 ceph-mon[35265]: pgmap v833: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T21:07:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:42 smithi172 ceph-mon[35265]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:07:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:42 smithi172 ceph-mon[35265]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:07:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:42 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:07:42.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:42 smithi172 ceph-mon[35265]: fsmap 12 up:standby 2024-09-10T21:07:42.980 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:42 smithi067 ceph-mon[30891]: pgmap v833: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T21:07:42.980 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:42 smithi067 ceph-mon[30891]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:07:42.980 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:42 smithi067 ceph-mon[30891]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:07:42.980 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:42 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:07:42.980 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:42 smithi067 ceph-mon[30891]: fsmap 12 up:standby 2024-09-10T21:07:43.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:42 smithi083 ceph-mon[35058]: pgmap v833: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 8 op/s 2024-09-10T21:07:43.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:42 smithi083 ceph-mon[35058]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:07:43.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:42 smithi083 ceph-mon[35058]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:07:43.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:42 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/4017081967' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:07:43.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:42 smithi083 ceph-mon[35058]: fsmap 12 up:standby 2024-09-10T21:07:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 -- 172.21.15.67:0/2147760705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 msgr2=0x7f8684101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 --2- 172.21.15.67:0/2147760705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684101bf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8678009900 tx=0x7f867802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 -- 172.21.15.67:0/2147760705 shutdown_connections 2024-09-10T21:07:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 --2- 172.21.15.67:0/2147760705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410d250 0x7f868410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 --2- 172.21.15.67:0/2147760705 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410a920 0x7f868410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 --2- 172.21.15.67:0/2147760705 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684101bf0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 -- 172.21.15.67:0/2147760705 >> 172.21.15.67:0/2147760705 conn(0x7f8684076f50 msgr2=0x7f8684077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 -- 172.21.15.67:0/2147760705 shutdown_connections 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.323+0000 7f868ad68640 1 -- 172.21.15.67:0/2147760705 wait complete. 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.324+0000 7f868ad68640 1 Processor -- start 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.324+0000 7f868ad68640 1 -- start start 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.324+0000 7f868ad68640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410a920 0x7f86841997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410d250 0x7f868419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7f8684112d90 con 0x7f8684101810 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8684112c10 con 0x7f868410d250 2024-09-10T21:07:43.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8684112f10 con 0x7f868410a920 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56034/0 (socket says 172.21.15.67:56034) 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 -- 172.21.15.67:0/491042582 learned_addr learned my addr 172.21.15.67:0/491042582 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8683fff640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410a920 0x7f86841997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8689305640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410d250 0x7f868419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 -- 172.21.15.67:0/491042582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410a920 msgr2=0x7f86841997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410a920 0x7f86841997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 -- 172.21.15.67:0/491042582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410d250 msgr2=0x7f868419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410d250 0x7f868419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 -- 172.21.15.67:0/491042582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868419f310 con 0x7f8684101810 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8688b04640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8678006010 tx=0x7f86780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:43.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867803f030 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8678003800 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.325+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868419f5a0 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.326+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678035070 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.326+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86841a5cc0 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.327+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8684101bf0 con 0x7f8684101810 2024-09-10T21:07:43.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.328+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7f8678031b10 con 0x7f8684101810 2024-09-10T21:07:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.329+0000 7f8681ffb640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.329+0000 7f8683fff640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.329+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8440+0+0 (secure 0 0 0) 0x7f86781067c0 con 0x7f8684101810 2024-09-10T21:07:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.330+0000 7f8683fff640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 0x7f86740b77a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f868410c720 tx=0x7f867000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:43.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.332+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f86780ccf60 con 0x7f8684101810 2024-09-10T21:07:43.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.516+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f86841a5ef0 con 0x7f8684101810 2024-09-10T21:07:43.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.653+0000 7f8681ffb640 1 -- 172.21.15.67:0/491042582 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f86780d1990 con 0x7f8684101810 2024-09-10T21:07:43.658 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 msgr2=0x7f86740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 0x7f86740b77a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f868410c720 tx=0x7f867000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 msgr2=0x7f8684199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8678006010 tx=0x7f86780042f0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 shutdown_connections 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868410d250 0x7f868419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868410a920 0x7f86841997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 --2- 172.21.15.67:0/491042582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8684101810 0x7f8684199260 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.657+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 >> 172.21.15.67:0/491042582 conn(0x7f8684076f50 msgr2=0x7f86841005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.658+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 shutdown_connections 2024-09-10T21:07:43.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:43.658+0000 7f868ad68640 1 -- 172.21.15.67:0/491042582 wait complete. 2024-09-10T21:07:43.795 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:43 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:43.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:43 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:44.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:43 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:44.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T21:07:44.600 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:44 smithi172 ceph-mon[35265]: pgmap v834: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-10T21:07:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:44 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:44.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:44 smithi172 ceph-mon[35265]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:07:44.973 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:44 smithi067 ceph-mon[30891]: pgmap v834: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-10T21:07:44.973 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:44 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:44.973 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:44 smithi067 ceph-mon[30891]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- 172.21.15.67:0/2757961472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d81076a0 msgr2=0x7ff3d8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/2757961472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d81076a0 0x7ff3d8107ae0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009900 tx=0x7ff3c802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- 172.21.15.67:0/2757961472 shutdown_connections 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/2757961472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d8108020 0x7ff3d810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/2757961472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d81076a0 0x7ff3d8107ae0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/2757961472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 0x7ff3d8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- 172.21.15.67:0/2757961472 >> 172.21.15.67:0/2757961472 conn(0x7ff3d80fd700 msgr2=0x7ff3d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- 172.21.15.67:0/2757961472 shutdown_connections 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- 172.21.15.67:0/2757961472 wait complete. 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 Processor -- start 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.055+0000 7ff3df6c0640 1 -- start start 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 0x7ff3d8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 0x7ff3d81998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111ce0 con 0x7ff3d8108020 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111b60 con 0x7ff3d8101c90 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8111e60 con 0x7ff3d81076a0 2024-09-10T21:07:45.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56048/0 (socket says 172.21.15.67:56048) 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 -- 172.21.15.67:0/157998111 learned_addr learned my addr 172.21.15.67:0/157998111 (peer_addr_for_me v2:172.21.15.67:0/0) 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3dd45c640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 0x7ff3d8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3dcc5b640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 0x7ff3d81998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 -- 172.21.15.67:0/157998111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 msgr2=0x7ff3d81998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 0x7ff3d81998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 -- 172.21.15.67:0/157998111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 msgr2=0x7ff3d8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 0x7ff3d8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 -- 172.21.15.67:0/157998111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d819f420 con 0x7ff3d8108020 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3dcc5b640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 0x7ff3d81998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ddc5d640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b970 tx=0x7ff3d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0019070 con 0x7ff3d8108020 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d0014440 con 0x7ff3d8108020 2024-09-10T21:07:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d819f710 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.056+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00075d0 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.057+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d819faa0 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.057+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d8102070 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.059+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 20) ==== 153250+0+0 (secure 0 0 0) 0x7ff3d000cb40 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.060+0000 7ff3ce7fc640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 0x7ff3c40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.060+0000 7ff3dd45c640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 0x7ff3c40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.060+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7944+0+0 (secure 0 0 0) 0x7ff3d00e5610 con 0x7ff3d8108020 2024-09-10T21:07:45.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.060+0000 7ff3dd45c640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 0x7ff3c40b7820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400bbe0 tx=0x7ff3d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:45.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.063+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3d819faa0 con 0x7ff3d8108020 2024-09-10T21:07:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:44 smithi083 ceph-mon[35058]: pgmap v834: 97 pgs: 97 active+clean; 1.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-09-10T21:07:45.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:44 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/491042582' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:45.142 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:44 smithi083 ceph-mon[35058]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:07:45.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.253+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff3d81a6150 con 0x7ff3d8108020 2024-09-10T21:07:45.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.661+0000 7ff3ce7fc640 1 -- 172.21.15.67:0/157998111 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7ff3d00abff0 con 0x7ff3d8108020 2024-09-10T21:07:45.666 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2024-09-10T21:07:45.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.664+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 msgr2=0x7ff3c40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.664+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 0x7ff3c40b7820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400bbe0 tx=0x7ff3d400b390 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 msgr2=0x7ff3d819ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000b970 tx=0x7ff3d000be30 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 shutdown_connections 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff3d8108020 0x7ff3d819ec50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.67:6800/1712569035,v1:172.21.15.67:6801/1712569035] conn(0x7ff3c40b5360 0x7ff3c40b7820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3d81076a0 0x7ff3d81998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 --2- 172.21.15.67:0/157998111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3d8101c90 0x7ff3d8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:45.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.665+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 >> 172.21.15.67:0/157998111 conn(0x7ff3d80fd700 msgr2=0x7ff3d8104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:45.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.666+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 shutdown_connections 2024-09-10T21:07:45.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-10T21:07:45.666+0000 7ff3df6c0640 1 -- 172.21.15.67:0/157998111 wait complete. 2024-09-10T21:07:45.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:45 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:46.011 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:45 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:46.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:45 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:07:46.350 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:07:46.377 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:07:46.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:07:46.430 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T21:07:46.431 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:07:46.452 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:07:46.467 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:07:46.487 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T21:07:46.487 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T21:07:46.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a 2024-09-10T21:07:46.667 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 systemd[1]: Stopping Ceph mon.a for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:46 smithi172 ceph-mon[35265]: pgmap v836: 65 pgs: 65 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:07:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:46 smithi172 ceph-mon[35265]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:46.699 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:46 smithi172 ceph-mon[35265]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 ceph-mon[30891]: pgmap v836: 65 pgs: 65 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 ceph-mon[30891]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 ceph-mon[30891]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a[30887]: 2024-09-10T21:07:46.786+0000 7fb83005a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a[30887]: 2024-09-10T21:07:46.786+0000 7fb83005a640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T21:07:47.046 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:46 smithi067 podman[109818]: 2024-09-10 21:07:46.879097964 +0000 UTC m=+0.199226359 container died c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T21:07:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:46 smithi083 ceph-mon[35058]: pgmap v836: 65 pgs: 65 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:07:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:46 smithi083 ceph-mon[35058]: from='client.? 172.21.15.67:0/157998111' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:07:47.141 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:46 smithi083 ceph-mon[35058]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:07:47.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:47 smithi067 podman[109818]: 2024-09-10 21:07:47.420439539 +0000 UTC m=+0.740567934 container cleanup c4084bafde25dd3a961e847798bde802cbaa8d4a09569489fc4a367b27fb324e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:07:47.545 INFO:journalctl@ceph.mon.a.smithi067.stdout:Sep 10 21:07:47 smithi067 bash[109818]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-a 2024-09-10T21:07:47.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T21:07:47.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:47.978 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T21:07:47.978 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T21:07:47.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.b 2024-09-10T21:07:48.288 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 systemd[1]: Stopping Ceph mon.b for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-b[35054]: 2024-09-10T21:07:48.283+0000 7f27b12a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:07:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-b[35054]: 2024-09-10T21:07:48.283+0000 7f27b12a7640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T21:07:48.641 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 podman[70348]: 2024-09-10 21:07:48.476915661 +0000 UTC m=+0.317552893 container died 22f5fe731d4cc7258e9743c2f79914d28a2c16f72f2e57b4c470af3398e4d104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T21:07:49.114 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 podman[70348]: 2024-09-10 21:07:48.900650416 +0000 UTC m=+0.741287637 container cleanup 22f5fe731d4cc7258e9743c2f79914d28a2c16f72f2e57b4c470af3398e4d104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:07:49.114 INFO:journalctl@ceph.mon.b.smithi083.stdout:Sep 10 21:07:48 smithi083 bash[70348]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-b 2024-09-10T21:07:49.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T21:07:49.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:49.382 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T21:07:49.382 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T21:07:49.383 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.c 2024-09-10T21:07:49.692 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:49 smithi172 systemd[1]: Stopping Ceph mon.c for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:49.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c[35261]: 2024-09-10T21:07:49.688+0000 7f3eaba90640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:07:49.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c[35261]: 2024-09-10T21:07:49.688+0000 7f3eaba90640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T21:07:49.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:49 smithi172 podman[70068]: 2024-09-10 21:07:49.81090781 +0000 UTC m=+0.242754708 container died 80f3fbaa9a128fc125178de0467e2e42323ae916b2ade711532cec90f205c9f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:07:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:50 smithi172 podman[70068]: 2024-09-10 21:07:50.180919703 +0000 UTC m=+0.612766593 container cleanup 80f3fbaa9a128fc125178de0467e2e42323ae916b2ade711532cec90f205c9f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:07:50.449 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 10 21:07:50 smithi172 bash[70068]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mon-c 2024-09-10T21:07:50.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T21:07:50.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:50.631 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T21:07:50.632 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T21:07:50.632 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x 2024-09-10T21:07:50.960 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 21:07:50 smithi067 systemd[1]: Stopping Ceph mgr.x for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:51.247 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 21:07:50 smithi067 podman[109939]: 2024-09-10 21:07:50.956357019 +0000 UTC m=+0.136021557 container died c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T21:07:51.545 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 21:07:51 smithi067 podman[109939]: 2024-09-10 21:07:51.350679879 +0000 UTC m=+0.530344417 container cleanup c0ae6cce26607828b7b11781a42d48dc0c5eb88423a48a8c315d5af5ec73a8ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T21:07:51.546 INFO:journalctl@ceph.mgr.x.smithi067.stdout:Sep 10 21:07:51 smithi067 bash[109939]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-x 2024-09-10T21:07:51.718 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T21:07:51.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:51.756 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T21:07:51.756 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T21:07:51.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.y 2024-09-10T21:07:52.088 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 21:07:51 smithi083 systemd[1]: Stopping Ceph mgr.y for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:52.391 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 21:07:52 smithi083 podman[70469]: 2024-09-10 21:07:52.084697455 +0000 UTC m=+0.144648524 container died 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T21:07:52.827 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 21:07:52 smithi083 podman[70469]: 2024-09-10 21:07:52.547527694 +0000 UTC m=+0.607478763 container cleanup 86c77d7df2317bb5f408672dda812d301adf1d51f9be1743d41b861da1a525e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T21:07:52.827 INFO:journalctl@ceph.mgr.y.smithi083.stdout:Sep 10 21:07:52 smithi083 bash[70469]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-y 2024-09-10T21:07:52.983 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T21:07:53.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:53.017 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T21:07:53.017 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T21:07:53.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.z 2024-09-10T21:07:53.345 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 21:07:53 smithi172 systemd[1]: Stopping Ceph mgr.z for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:53.623 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 21:07:53 smithi172 podman[70189]: 2024-09-10 21:07:53.341795696 +0000 UTC m=+0.140700626 container died 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T21:07:53.949 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 21:07:53 smithi172 podman[70189]: 2024-09-10 21:07:53.718869427 +0000 UTC m=+0.517774344 container cleanup 0a709473e938a791ea738fad9ffbc14208ec7577d2f5814b7304ff9d750be41b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:07:53.949 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 10 21:07:53 smithi172 bash[70189]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mgr-z 2024-09-10T21:07:54.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T21:07:54.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:07:54.117 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T21:07:54.117 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T21:07:54.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.0 2024-09-10T21:07:54.407 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:07:54 smithi067 systemd[1]: Stopping Ceph osd.0 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:07:54.679 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:07:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T21:07:54.401+0000 7f8397e4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:07:54.679 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:07:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T21:07:54.401+0000 7f8397e4b640 -1 osd.0 78 *** Got signal Terminated *** 2024-09-10T21:07:54.679 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:07:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0[47249]: 2024-09-10T21:07:54.401+0000 7f8397e4b640 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:00.152 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:07:59 smithi067 podman[110058]: 2024-09-10 21:07:59.846783215 +0000 UTC m=+5.551081568 container died 84fb409cfe76b399f50a914c3e31901aaf86c4c1dfa3f41c962a770dd4f7f22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T21:08:00.510 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:00 smithi067 podman[110058]: 2024-09-10 21:08:00.247550199 +0000 UTC m=+5.951848551 container cleanup 84fb409cfe76b399f50a914c3e31901aaf86c4c1dfa3f41c962a770dd4f7f22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:00.511 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:00 smithi067 bash[110058]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0 2024-09-10T21:08:00.795 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:00 smithi067 podman[110084]: 2024-09-10 21:08:00.507299595 +0000 UTC m=+0.654056979 container remove 84fb409cfe76b399f50a914c3e31901aaf86c4c1dfa3f41c962a770dd4f7f22a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T21:08:01.174 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:00 smithi067 podman[110174]: 2024-09-10 21:08:00.779245577 +0000 UTC m=+0.016561915 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:01.174 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:00 smithi067 podman[110174]: 2024-09-10 21:08:00.891883372 +0000 UTC m=+0.129199751 container create 7378abc5ec56583a3602811e9f755ec64583af4dc3b8625e543d9f60854cf6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T21:08:01.546 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:01 smithi067 podman[110174]: 2024-09-10 21:08:01.170189225 +0000 UTC m=+0.407505570 container init 7378abc5ec56583a3602811e9f755ec64583af4dc3b8625e543d9f60854cf6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:08:01.546 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:01 smithi067 podman[110174]: 2024-09-10 21:08:01.174019627 +0000 UTC m=+0.411335975 container start 7378abc5ec56583a3602811e9f755ec64583af4dc3b8625e543d9f60854cf6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:08:01.546 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:01 smithi067 podman[110174]: 2024-09-10 21:08:01.26344957 +0000 UTC m=+0.500765915 container attach 7378abc5ec56583a3602811e9f755ec64583af4dc3b8625e543d9f60854cf6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:08:01.546 INFO:journalctl@ceph.osd.0.smithi067.stdout:Sep 10 21:08:01 smithi067 podman[110174]: 2024-09-10 21:08:01.368779988 +0000 UTC m=+0.606096326 container died 7378abc5ec56583a3602811e9f755ec64583af4dc3b8625e543d9f60854cf6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:01.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T21:08:02.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:02.032 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T21:08:02.032 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T21:08:02.032 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.1 2024-09-10T21:08:02.322 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:02 smithi083 systemd[1]: Stopping Ceph osd.1 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:02.641 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T21:08:02.351+0000 7fe05d4da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:02.641 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T21:08:02.351+0000 7fe05d4da640 -1 osd.1 78 *** Got signal Terminated *** 2024-09-10T21:08:02.641 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1[39520]: 2024-09-10T21:08:02.351+0000 7fe05d4da640 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:08.181 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:07 smithi083 podman[70593]: 2024-09-10 21:08:07.909532286 +0000 UTC m=+5.682304830 container died ff170f65c5eb82441c30b37a091fc206afe499c9986f661531f89897c4dc50be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:08:08.549 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:08 smithi083 podman[70593]: 2024-09-10 21:08:08.260739073 +0000 UTC m=+6.033511607 container cleanup ff170f65c5eb82441c30b37a091fc206afe499c9986f661531f89897c4dc50be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T21:08:08.549 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:08 smithi083 bash[70593]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1 2024-09-10T21:08:08.882 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:08 smithi083 podman[70619]: 2024-09-10 21:08:08.545414208 +0000 UTC m=+0.631193839 container remove ff170f65c5eb82441c30b37a091fc206afe499c9986f661531f89897c4dc50be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T21:08:09.135 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:08 smithi083 podman[70706]: 2024-09-10 21:08:08.781716174 +0000 UTC m=+0.016120105 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:09.135 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:08 smithi083 podman[70706]: 2024-09-10 21:08:08.896167698 +0000 UTC m=+0.130571616 container create 328eca1cabd5edfc5bd7c6f8316e3f46ddcd7a84eac6fd6fad0562cfea92db39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:08:09.135 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:09 smithi083 podman[70706]: 2024-09-10 21:08:09.131875395 +0000 UTC m=+0.366279320 container init 328eca1cabd5edfc5bd7c6f8316e3f46ddcd7a84eac6fd6fad0562cfea92db39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T21:08:09.391 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:09 smithi083 podman[70706]: 2024-09-10 21:08:09.135594226 +0000 UTC m=+0.369998156 container start 328eca1cabd5edfc5bd7c6f8316e3f46ddcd7a84eac6fd6fad0562cfea92db39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:08:09.392 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:09 smithi083 podman[70706]: 2024-09-10 21:08:09.215241386 +0000 UTC m=+0.449645317 container attach 328eca1cabd5edfc5bd7c6f8316e3f46ddcd7a84eac6fd6fad0562cfea92db39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T21:08:09.392 INFO:journalctl@ceph.osd.1.smithi083.stdout:Sep 10 21:08:09 smithi083 podman[70706]: 2024-09-10 21:08:09.322855236 +0000 UTC m=+0.557259172 container died 328eca1cabd5edfc5bd7c6f8316e3f46ddcd7a84eac6fd6fad0562cfea92db39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T21:08:09.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T21:08:10.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:10.035 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T21:08:10.035 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T21:08:10.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.2 2024-09-10T21:08:10.360 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:10 smithi172 systemd[1]: Stopping Ceph osd.2 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:10.699 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T21:08:10.354+0000 7f256cf10640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:10.699 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T21:08:10.354+0000 7f256cf10640 -1 osd.2 78 *** Got signal Terminated *** 2024-09-10T21:08:10.699 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2[40227]: 2024-09-10T21:08:10.354+0000 7f256cf10640 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:16.043 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:15 smithi172 podman[70323]: 2024-09-10 21:08:15.759241402 +0000 UTC m=+5.529389904 container died e2901c716b177811bf06ae45c0c3f1295b664425194ba928095de8af887a4182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:16.385 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70323]: 2024-09-10 21:08:16.122534412 +0000 UTC m=+5.892682916 container cleanup e2901c716b177811bf06ae45c0c3f1295b664425194ba928095de8af887a4182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T21:08:16.385 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 bash[70323]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2 2024-09-10T21:08:16.699 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70340]: 2024-09-10 21:08:16.38182501 +0000 UTC m=+0.623609400 container remove e2901c716b177811bf06ae45c0c3f1295b664425194ba928095de8af887a4182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-10T21:08:17.047 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70428]: 2024-09-10 21:08:16.644399711 +0000 UTC m=+0.015794628 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:17.047 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70428]: 2024-09-10 21:08:16.749645664 +0000 UTC m=+0.121040563 container create 9016b51df31a2627e2954bfee44591e49028d70b4cb8e8c0917f0c354a5279f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T21:08:17.047 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70428]: 2024-09-10 21:08:16.97693708 +0000 UTC m=+0.348331980 container init 9016b51df31a2627e2954bfee44591e49028d70b4cb8e8c0917f0c354a5279f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:08:17.047 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:16 smithi172 podman[70428]: 2024-09-10 21:08:16.980234194 +0000 UTC m=+0.351629094 container start 9016b51df31a2627e2954bfee44591e49028d70b4cb8e8c0917f0c354a5279f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:08:17.047 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:17 smithi172 podman[70428]: 2024-09-10 21:08:17.043593865 +0000 UTC m=+0.414988773 container attach 9016b51df31a2627e2954bfee44591e49028d70b4cb8e8c0917f0c354a5279f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T21:08:17.447 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 10 21:08:17 smithi172 podman[70428]: 2024-09-10 21:08:17.170207776 +0000 UTC m=+0.541602686 container died 9016b51df31a2627e2954bfee44591e49028d70b4cb8e8c0917f0c354a5279f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T21:08:17.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T21:08:17.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:17.825 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T21:08:17.825 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T21:08:17.825 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.3 2024-09-10T21:08:18.149 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:17 smithi067 systemd[1]: Stopping Ceph osd.3 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:18.545 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:18 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T21:08:18.145+0000 7f508feb9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:18.546 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:18 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T21:08:18.145+0000 7f508feb9640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-10T21:08:18.546 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:18 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T21:08:18.145+0000 7f508feb9640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:20.895 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:20.501+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:21.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:20 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:20.732+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:21.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:20.891+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:21.796 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:21 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T21:08:21.450+0000 7f508c4ce640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:58.854193+0000 front 2024-09-10T21:07:58.854332+0000 (oldest deadline 2024-09-10T21:08:21.154331+0000) 2024-09-10T21:08:21.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:21 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:21.556+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:21.930 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:22.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:21 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:21.709+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:22.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:21.926+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:22.795 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:22 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3[53824]: 2024-09-10T21:08:22.442+0000 7f508c4ce640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:58.854193+0000 front 2024-09-10T21:07:58.854332+0000 (oldest deadline 2024-09-10T21:08:21.154331+0000) 2024-09-10T21:08:22.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:22 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:22.544+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:22.888 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:22.463+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:23.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:22 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:22.672+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:23.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:22.884+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:23.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:23.454+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:23.700 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:23.406+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:23.900 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:23 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:23.581+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:23.900 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:23 smithi067 podman[110277]: 2024-09-10 21:08:23.592709331 +0000 UTC m=+5.561393040 container died 474ce131b04a1d98d8a65d749853770508925d0dff29fce72bd08563f1544ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T21:08:24.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:23 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:23.672+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:24.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:23.873+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:24.275 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110277]: 2024-09-10 21:08:24.087201726 +0000 UTC m=+6.055885434 container cleanup 474ce131b04a1d98d8a65d749853770508925d0dff29fce72bd08563f1544ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T21:08:24.275 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 bash[110277]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3 2024-09-10T21:08:24.276 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:24 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:24.136+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:24.545 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110293]: 2024-09-10 21:08:24.271996515 +0000 UTC m=+0.669350342 container remove 474ce131b04a1d98d8a65d749853770508925d0dff29fce72bd08563f1544ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T21:08:24.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:24.411+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:24.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:24.461+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:24.859 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110381]: 2024-09-10 21:08:24.622243797 +0000 UTC m=+0.016312146 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:24.860 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110381]: 2024-09-10 21:08:24.748045717 +0000 UTC m=+0.142114049 container create 8275b0fad25168e5a563b4388503509c82a7e6e101f8b5fe9b7f564bc24e9701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:24.860 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:24 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:24.590+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:25.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:24 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:24.643+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:25.170 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110381]: 2024-09-10 21:08:24.992661071 +0000 UTC m=+0.386729415 container init 8275b0fad25168e5a563b4388503509c82a7e6e101f8b5fe9b7f564bc24e9701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:08:25.170 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:24 smithi067 podman[110381]: 2024-09-10 21:08:24.996053253 +0000 UTC m=+0.390121588 container start 8275b0fad25168e5a563b4388503509c82a7e6e101f8b5fe9b7f564bc24e9701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T21:08:25.170 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:25 smithi067 podman[110381]: 2024-09-10 21:08:25.059099007 +0000 UTC m=+0.453167364 container attach 8275b0fad25168e5a563b4388503509c82a7e6e101f8b5fe9b7f564bc24e9701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T21:08:25.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:24.833+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:25.478 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:25 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:25.165+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:25.478 INFO:journalctl@ceph.osd.3.smithi067.stdout:Sep 10 21:08:25 smithi067 podman[110381]: 2024-09-10 21:08:25.189760122 +0000 UTC m=+0.583828457 container died 8275b0fad25168e5a563b4388503509c82a7e6e101f8b5fe9b7f564bc24e9701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:08:25.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:25.378+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:25.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:25.506+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:25.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:25 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:25.633+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:25.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T21:08:25.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:25.872 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T21:08:25.872 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T21:08:25.872 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.4 2024-09-10T21:08:25.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:25 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:25.620+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:26.175 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:25 smithi083 systemd[1]: Stopping Ceph osd.4 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:26.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:25.841+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:26.485 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:26 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:26.184+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:26.585 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:26 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:26.171+0000 7f4ccde74640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:26.585 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:26 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:26.171+0000 7f4ccde74640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-10T21:08:26.585 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:26 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:26.171+0000 7f4ccde74640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:26.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:26 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:26.330+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:26.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:26 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:26.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:26.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:26 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:26.587+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:26.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:26 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:26.581+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:27.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:26 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:26.800+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:27.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:27 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:27.190+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:27.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:27 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:27.545+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:27.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:27 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:27.302+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:27.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:27 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:27.588+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:28.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:27 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:27.607+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:28.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:27 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:27.791+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:28.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:28 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:28.225+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:28.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:28 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:28.347+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:28.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:28 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:28.565+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:28.879 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:28 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:28.603+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:29.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:28 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:28.563+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:29.141 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:28 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:28.875+0000 7f4cc6481640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.767508+0000 front 2024-09-10T21:08:05.767536+0000 (oldest deadline 2024-09-10T21:08:28.667651+0000) 2024-09-10T21:08:29.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:28 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:28.839+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:29.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:29 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:29.203+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:29.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:29 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:29.203+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:29.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:29 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:29.597+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:29.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:29 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:29.597+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:29.700 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:29 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:29.349+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:29.700 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:29 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:29.349+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:29.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:29 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:29.567+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:30.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:29 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:29.584+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:30.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:29 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:29.854+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:30.391 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:29 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:29.893+0000 7f4cc6481640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.767508+0000 front 2024-09-10T21:08:05.767536+0000 (oldest deadline 2024-09-10T21:08:28.667651+0000) 2024-09-10T21:08:30.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:30 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:30.158+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:30.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:30 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:30.158+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:30.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:30 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:30.552+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:30.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:30 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:30.552+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:30.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:30 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:30.329+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:30.700 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:30 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:30.329+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:30.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:30 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:30.538+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:31.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:30 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:30.580+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:31.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:30 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:30.580+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:31.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:30 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:30.845+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:31.391 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:30 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4[46453]: 2024-09-10T21:08:30.897+0000 7f4cc6481640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.767508+0000 front 2024-09-10T21:08:05.767536+0000 (oldest deadline 2024-09-10T21:08:28.667651+0000) 2024-09-10T21:08:31.470 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:31 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:31.297+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:31.470 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:31 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:31.297+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:31.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:31 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:31.206+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:31.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:31 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:31.206+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:31.671 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:31 smithi083 podman[70808]: 2024-09-10 21:08:31.577650243 +0000 UTC m=+5.515845985 container died 5aa7fda1c2e18f1156de4a40157e459bf674a64697dcf2d7706dd0b59b107130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T21:08:31.672 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:31 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:31.571+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:31.672 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:31 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:31.571+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:31.809 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:31 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:31.528+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:31.810 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:31 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:31.528+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:32.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:31 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:31.549+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:32.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:31 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:31.549+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:32.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:31 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:31.805+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:32.201 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:31 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:31.922+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:32.201 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:31 smithi083 podman[70808]: 2024-09-10 21:08:31.963614277 +0000 UTC m=+5.901810015 container cleanup 5aa7fda1c2e18f1156de4a40157e459bf674a64697dcf2d7706dd0b59b107130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:08:32.201 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:31 smithi083 bash[70808]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4 2024-09-10T21:08:32.518 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70824]: 2024-09-10 21:08:32.197981945 +0000 UTC m=+0.621163257 container remove 5aa7fda1c2e18f1156de4a40157e459bf674a64697dcf2d7706dd0b59b107130 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T21:08:32.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:32 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:32.179+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:32.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:32 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:32.179+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:32.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:32.334+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:32.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:32.334+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:32.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:32.531+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:32.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:32.531+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:32.780 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.515416442 +0000 UTC m=+0.110622954 container create c2284bf07cc3e8f3d474160e5b493d55e9d0fb0c068436bd19844109720d503c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T21:08:32.780 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.420920721 +0000 UTC m=+0.016127251 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:32.780 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:32 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:32.550+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:32.781 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:32 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:32.550+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:33.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:32 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:32.592+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:33.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:32 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:32.592+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:33.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:32 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:32.971+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:33.142 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.776591651 +0000 UTC m=+0.371798163 container init c2284bf07cc3e8f3d474160e5b493d55e9d0fb0c068436bd19844109720d503c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T21:08:33.142 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.780189109 +0000 UTC m=+0.375395622 container start c2284bf07cc3e8f3d474160e5b493d55e9d0fb0c068436bd19844109720d503c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T21:08:33.142 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.859448208 +0000 UTC m=+0.454654730 container attach c2284bf07cc3e8f3d474160e5b493d55e9d0fb0c068436bd19844109720d503c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T21:08:33.142 INFO:journalctl@ceph.osd.4.smithi083.stdout:Sep 10 21:08:32 smithi083 podman[70923]: 2024-09-10 21:08:32.980175538 +0000 UTC m=+0.575382066 container died c2284bf07cc3e8f3d474160e5b493d55e9d0fb0c068436bd19844109720d503c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T21:08:33.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:32 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:32.807+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:33.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:33 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:33.154+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:33.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:33 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:33.154+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:33.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T21:08:33.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:33.645 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T21:08:33.645 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T21:08:33.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.5 2024-09-10T21:08:33.673 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:33.297+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:33.673 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:33.297+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:33.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:33.503+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:33.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:33.503+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:33.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:33 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:33.547+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:33.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:33 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:33.547+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:33.937 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 systemd[1]: Stopping Ceph osd.5 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:33.937 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:33.757+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:34.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:33 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:33.611+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:34.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:33 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:33.611+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:34.199 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:33.933+0000 7f2c6e518640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:34.199 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:33.933+0000 7f2c6e518640 -1 osd.5 78 *** Got signal Terminated *** 2024-09-10T21:08:34.199 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:33 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:33.933+0000 7f2c6e518640 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:34.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:33 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:33.948+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:34.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:34.186+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:34.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:34.186+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:34.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:34.285+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:34.699 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:34.285+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:34.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:34.531+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:34.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:34.531+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:34.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:34 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:34.586+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:34.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:34 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:34.586+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:35.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:34.659+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:35.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:34.659+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:35.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:34 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:34.742+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:35.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:34 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:34.983+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:35.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:35 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:35.138+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:35.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:35 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:35.138+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:35.555 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:35 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:35.255+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:35.555 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:35 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:35.255+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:35.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:35 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:35.614+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:35.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:35 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:35.614+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:35.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:35 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:35.734+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:35.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:35 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:35.552+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:35.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:35 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:35.552+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:35.973 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:35 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:35.669+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:35.973 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:35 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:35.669+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:36.295 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:36.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:36.296 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:36.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:36.296 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:36.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:36.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:35 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:35.967+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:36.542 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:36 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:36.208+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:36.543 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:36 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:36.208+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:36.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:36 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:36.578+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:36.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:36 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:36.578+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:36.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:36 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:36.578+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:36.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:36 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:36.748+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:36.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:36 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:36.538+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:36.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:36 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:36.538+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:37.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:36.625+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:37.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:36.625+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:37.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:36 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:36.625+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:37.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:37 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:37.012+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:37.516 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:37.199+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:37.516 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:37.199+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:37.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:37.202+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:37.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:37.202+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:37.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:37.202+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:37.798 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:37.512+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:37.798 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:37.512+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:37.799 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:37.512+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:37.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:37 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:37.569+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:37.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:37 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:37.569+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:37.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:37 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:37.569+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:38.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:37.577+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:38.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:37.577+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:38.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:37 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:37.577+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:38.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:37.793+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:38.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:37 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:37.793+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:38.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:38 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:38.055+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:38.504 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:38.239+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.967049+0000 front 2024-09-10T21:07:57.967066+0000 (oldest deadline 2024-09-10T21:08:23.266978+0000) 2024-09-10T21:08:38.505 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:38.239+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.267334+0000 front 2024-09-10T21:08:03.267350+0000 (oldest deadline 2024-09-10T21:08:28.567538+0000) 2024-09-10T21:08:38.505 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5[46704]: 2024-09-10T21:08:38.239+0000 7f2c6ab2d640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:12.668436+0000 front 2024-09-10T21:08:12.668417+0000 (oldest deadline 2024-09-10T21:08:37.968462+0000) 2024-09-10T21:08:38.536 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:38.154+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:38.536 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:38.154+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:38.537 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:38.154+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:38.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:38.533+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:38.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:38.533+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:38.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:38 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:38.533+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:38.846 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:38.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:38.847 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:38.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:38.847 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:38.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:38.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:38 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:38.607+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:38.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:38 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:38.607+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:38.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:38 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:38.607+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:39.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:38.842+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:39.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:38 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:38.842+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:39.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:39.104+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:39.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:39.104+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:39.530 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:39.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:39.530 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:39.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:39.530 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:39.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:39.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:39.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:39.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:39.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:39.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:39.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:39.810 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:39 smithi172 podman[70554]: 2024-09-10 21:08:39.541978288 +0000 UTC m=+5.702437795 container died 7eef2def5dc25faaacb5405db17ce96797d2f4fec85dc9336c8c95566fd630bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:08:39.810 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:39.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:39.810 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:39.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:39.810 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:39.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:40.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:39.639+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:40.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:39.639+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:40.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:39 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:39.639+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:40.154 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:39 smithi172 podman[70554]: 2024-09-10 21:08:39.907768141 +0000 UTC m=+6.068227636 container cleanup 7eef2def5dc25faaacb5405db17ce96797d2f4fec85dc9336c8c95566fd630bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T21:08:40.154 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:39 smithi172 bash[70554]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5 2024-09-10T21:08:40.155 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:39.806+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:40.155 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:39 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:39.806+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:40.449 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70573]: 2024-09-10 21:08:40.150577658 +0000 UTC m=+0.609449249 container remove 7eef2def5dc25faaacb5405db17ce96797d2f4fec85dc9336c8c95566fd630bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:08:40.540 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:40.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:40.540 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:40.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:40.540 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:40.167+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:40.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:40.147+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:40.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:40.147+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:40.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:40.536+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:40.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:40.536+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:40.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:40 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:40.536+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:40.798 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:40 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:40.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:40 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:40.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:40 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:40.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.372772008 +0000 UTC m=+0.015348284 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.476386835 +0000 UTC m=+0.118963099 container create d2988160259b4cb0a47bd22df5c9970068c1c6b45ee0303bc932baa21b7c534a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.687240316 +0000 UTC m=+0.329816587 container init d2988160259b4cb0a47bd22df5c9970068c1c6b45ee0303bc932baa21b7c534a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.690499756 +0000 UTC m=+0.333076026 container start d2988160259b4cb0a47bd22df5c9970068c1c6b45ee0303bc932baa21b7c534a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T21:08:40.799 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.795531584 +0000 UTC m=+0.438107856 container attach d2988160259b4cb0a47bd22df5c9970068c1c6b45ee0303bc932baa21b7c534a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:41.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:40.668+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:41.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:40.668+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:41.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:40 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:40.668+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:41.152 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 10 21:08:40 smithi172 podman[70662]: 2024-09-10 21:08:40.881088027 +0000 UTC m=+0.523664301 container died d2988160259b4cb0a47bd22df5c9970068c1c6b45ee0303bc932baa21b7c534a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:08:41.152 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:40 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:40.828+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:41.152 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:40 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:40.828+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:41.468 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T21:08:41.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:41.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:41.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.192+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:41.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:41.549 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T21:08:41.549 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T21:08:41.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.6 2024-09-10T21:08:41.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:41 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:41.137+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:41.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:41 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:41.137+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:41.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:41 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:41.447+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:41.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:41 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:41.447+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:41.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:41 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:41.447+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:41.845 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 systemd[1]: Stopping Ceph osd.6 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:41.846 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:41.575+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:41.846 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:41.575+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:41.846 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:41.575+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:42.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:41 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:41.665+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:42.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:41 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:41.665+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:42.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:41 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:41.665+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:42.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:41 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:41.783+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:42.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:41 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:41.783+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:42.239 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.840+0000 7f9663f72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:42.239 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.840+0000 7f9663f72640 -1 osd.6 78 *** Got signal Terminated *** 2024-09-10T21:08:42.239 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:41 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:41.840+0000 7f9663f72640 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:42.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:42.235+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:42.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:42.235+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:42.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:42.235+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:42.641 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:42 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:42.138+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:42.642 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:42 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:42.138+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:42.751 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:42 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:42.475+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:42.752 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:42 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:42.475+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:42.752 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:42 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:42.475+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:43.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:42.570+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:43.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:42.570+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:43.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:42.571+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:43.117 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:42 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:42.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:43.117 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:42 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:42.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:43.117 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:42 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:42.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:43.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:42 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:42.748+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:43.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:42 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:42.748+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:43.392 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:43 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:43.113+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:43.392 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:43 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:43.113+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:43.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:43.257+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:43.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:43.257+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:43.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:43.257+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:43.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:43 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:43.430+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:43.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:43 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:43.430+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:43.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:43 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:43.430+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:44.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:43.597+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:44.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:43.597+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:44.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:43 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:43.597+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:44.085 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:43 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:43.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:44.085 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:43 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:43.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:44.085 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:43 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:43.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:44.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:43 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:43.795+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:44.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:43 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:43.795+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:44.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:44.081+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:44.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:44.081+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:44.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:44.240+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:44.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:44.240+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:44.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:44.240+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:44.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:44.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:44.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:44.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:44.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:44.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:45.036 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:44.709+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:45.036 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:44.709+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:45.036 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:44.709+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:45.036 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:44 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:44.709+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:45.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:44.629+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:45.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:44.629+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:45.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:44.629+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:45.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:44 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:44.629+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:45.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:44.786+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:45.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:44.786+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:45.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:44 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:44.786+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:45.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.032+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:45.392 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.032+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:45.392 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.032+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:45.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:45.197+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:45.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:45.197+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:45.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:45.197+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:45.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:45.197+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.148577+0000 front 2024-09-10T21:08:21.148561+0000 (oldest deadline 2024-09-10T21:08:44.648697+0000) 2024-09-10T21:08:45.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:45.378+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:45.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:45.378+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:45.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:45.378+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:45.995 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:45.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:45.995 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:45.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:45.995 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:45.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:45.995 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:45.707+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:46.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:45.670+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:46.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:45.670+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:46.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:45.670+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:46.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:45 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:45.670+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:46.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:45.825+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:46.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:45.825+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:46.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:45 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:45.825+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:46.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.991+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:46.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.991+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:46.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:45 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:45.991+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:46.545 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:46.165+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.344646+0000 front 2024-09-10T21:07:57.344670+0000 (oldest deadline 2024-09-10T21:08:23.244800+0000) 2024-09-10T21:08:46.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:46.165+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:03.745633+0000 front 2024-09-10T21:08:03.745794+0000 (oldest deadline 2024-09-10T21:08:28.445705+0000) 2024-09-10T21:08:46.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:46.165+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.746745+0000 front 2024-09-10T21:08:10.746715+0000 (oldest deadline 2024-09-10T21:08:36.046718+0000) 2024-09-10T21:08:46.546 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6[60628]: 2024-09-10T21:08:46.165+0000 7f9660587640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.148577+0000 front 2024-09-10T21:08:21.148561+0000 (oldest deadline 2024-09-10T21:08:44.648697+0000) 2024-09-10T21:08:46.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:46.342+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:46.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:46.342+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:46.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:46.342+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:47.024 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:46 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:46.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:47.024 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:46 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:46.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:47.024 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:46 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:46.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:47.024 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:46 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:46.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:47.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:46.660+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:47.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:46.660+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:47.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:46.660+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:47.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:46 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:46.660+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:47.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:46.775+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:47.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:46.775+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:47.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:46 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:46.775+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:47.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.020+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:47.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.020+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:47.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.020+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:47.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:47.368+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:47.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:47.368+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:47.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:47.368+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:47.795 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:47 smithi067 podman[110497]: 2024-09-10 21:08:47.459448538 +0000 UTC m=+5.712420681 container died 0df7277018ba2c429a1dff91bf5afa1df660a3a55cca9b40ca1b41dee8450648 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T21:08:47.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:47 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:47.622+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:47.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:47 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:47.622+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:47.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:47 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:47.622+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:47.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:47 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:47.622+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:48.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.996+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:48.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.996+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:48.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:47.996+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:48.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:47.766+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:48.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:47.766+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:48.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:47.766+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:48.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:47.766+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:48.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:47.728+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:48.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:47.728+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:48.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:47 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:47.728+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:48.295 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:47 smithi067 podman[110497]: 2024-09-10 21:08:47.899675599 +0000 UTC m=+6.152647740 container cleanup 0df7277018ba2c429a1dff91bf5afa1df660a3a55cca9b40ca1b41dee8450648 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T21:08:48.296 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:47 smithi067 bash[110497]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6 2024-09-10T21:08:48.296 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110512]: 2024-09-10 21:08:48.068153859 +0000 UTC m=+0.607265050 container remove 0df7277018ba2c429a1dff91bf5afa1df660a3a55cca9b40ca1b41dee8450648 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T21:08:48.684 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:48.371+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:48.684 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:48.371+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:48.684 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:48.371+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:48.792 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:48 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:48.603+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:48.792 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:48 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:48.603+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:48.792 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:48 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:48.603+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:48.792 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:48 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:48.603+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:48.792 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.376827218 +0000 UTC m=+0.016424768 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:48.793 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.49396355 +0000 UTC m=+0.133561082 container create 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T21:08:48.793 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.704486614 +0000 UTC m=+0.344084162 container init 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T21:08:48.793 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.707809196 +0000 UTC m=+0.347406736 container start 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T21:08:48.793 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.787859335 +0000 UTC m=+0.427456870 container attach 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T21:08:48.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:48.680+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:48.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:48.680+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:48.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:48 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:48.680+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:49.005 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:48.728+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:49.005 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:48.728+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:49.005 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:48.728+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:49.005 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:48 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:48.728+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:49.045 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:48 smithi067 podman[110605]: 2024-09-10 21:08:48.905018734 +0000 UTC m=+0.544616267 container died 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:08:49.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.001+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:49.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.001+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:49.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.001+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:49.470 INFO:journalctl@ceph.osd.6.smithi067.stdout:Sep 10 21:08:49 smithi067 podman[110627]: 2024-09-10 21:08:49.449615563 +0000 UTC m=+0.538465415 container remove 8240dd518a7375dbf6fb47eb1a28cd94be69e2cb5ed29efd260f492b3a26bec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T21:08:49.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T21:08:49.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:49.515 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T21:08:49.515 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T21:08:49.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.7 2024-09-10T21:08:49.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:49.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:49.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:49.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:49.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:49.400+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:49.735 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:49 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:49.601+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:49.735 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:49 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:49.601+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:49.735 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:49 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:49.601+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:49.735 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:49 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:49.601+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:49.837 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 systemd[1]: Stopping Ceph osd.7 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:49.837 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.833+0000 7fdb6c7c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:49.837 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.833+0000 7fdb6c7c7640 -1 osd.7 78 *** Got signal Terminated *** 2024-09-10T21:08:49.837 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:49.833+0000 7fdb6c7c7640 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:49.838 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:49.686+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:49.838 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:49.686+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:49.838 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:49.686+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:49.838 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:49 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:49.686+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:49.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:49.670+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:49.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:49.670+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:49.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:49 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:49.670+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:50.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:50.017+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:50.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:50.017+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:50.141 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:50.017+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:50.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:50.406+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:50.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:50.406+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:50.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:50.406+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:50.700 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:50.650+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:50.700 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:50.650+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:50.700 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:50 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:50.650+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:51.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:50 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:50.556+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:51.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:50 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:50.556+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:51.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:50 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:50.556+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:51.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:50 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:50.556+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:51.055 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:50.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:51.055 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:50.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:51.055 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:50.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:51.055 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:50 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:50.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:51.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:51.051+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:51.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:51.051+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:51.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:51.051+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:51.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:51.655+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:51.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:51.655+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:51.660 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:51.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:51.660 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:51.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:51.660 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:51.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:51.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:51.655+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:51.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:51 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:51.655+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:52.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:51 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:51.546+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:52.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:51 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:51.546+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:52.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:51 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:51.546+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:52.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:51 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:51.546+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:52.087 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:51.670+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:52.087 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:51.670+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:52.087 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:51.670+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:52.087 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:51 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:51.670+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:52.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:52.083+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:52.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:52.083+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:52.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:52.083+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:52.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:52.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:52.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:52.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:52.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:52.405+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:52.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:52 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:52.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:52.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:52 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:52.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:52.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:52 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:52.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:52.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:52 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:52.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:53.081 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:52.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:53.081 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:52.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:53.081 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:52.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:53.081 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:52.718+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:53.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:52.702+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:53.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:52.702+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:53.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:52.702+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:53.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:52 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:52.702+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:53.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:53.076+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:53.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:53.076+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:53.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:53.076+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:53.391 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:53.076+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.953785+0000 front 2024-09-10T21:08:28.953764+0000 (oldest deadline 2024-09-10T21:08:52.354422+0000) 2024-09-10T21:08:53.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:53 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:53.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:53.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:53 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:53.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:53.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:53 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:53.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:53.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:53 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:53.526+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:53.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:53.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:53.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:53.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:53.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:53.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:53.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:53.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:53.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:53.448+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:53.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:53.448+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:53.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:53 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:53.448+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:54.122 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:53.690+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:54.122 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:53.690+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:54.123 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:53.690+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:54.123 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:53 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:53.690+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:54.394 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:54.118+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.650047+0000 front 2024-09-10T21:08:05.650194+0000 (oldest deadline 2024-09-10T21:08:31.550202+0000) 2024-09-10T21:08:54.394 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:54.118+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:15.051281+0000 front 2024-09-10T21:08:15.051371+0000 (oldest deadline 2024-09-10T21:08:38.551279+0000) 2024-09-10T21:08:54.394 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:54.118+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.953042+0000 front 2024-09-10T21:08:21.952881+0000 (oldest deadline 2024-09-10T21:08:44.252861+0000) 2024-09-10T21:08:54.394 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7[52949]: 2024-09-10T21:08:54.118+0000 7fdb64dd4640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.953785+0000 front 2024-09-10T21:08:28.953764+0000 (oldest deadline 2024-09-10T21:08:52.354422+0000) 2024-09-10T21:08:54.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:54.485+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:54.485+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:54.485+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:54.485+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:54.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:54.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:54.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:54.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:54 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:54.696+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:55.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:54.560+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:55.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:54.560+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:55.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:54.560+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:55.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:54.560+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:55.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:54 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:54.560+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:55.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:54.674+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:55.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:54.674+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:55.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:54.674+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:55.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:54.674+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:55.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:54 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:54.674+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:08:55.587 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:55 smithi083 podman[71028]: 2024-09-10 21:08:55.294263019 +0000 UTC m=+5.578024991 container died 371772db483a817ee4f9a9a0b833c54ba227f35e9b8b770735bd2432b4048f39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T21:08:55.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:55.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:55.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:55.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:55.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:55.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:55.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:55.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:55.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:55 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:55.521+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:55.891 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:55 smithi083 podman[71028]: 2024-09-10 21:08:55.715320993 +0000 UTC m=+5.999082967 container cleanup 371772db483a817ee4f9a9a0b833c54ba227f35e9b8b770735bd2432b4048f39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T21:08:55.891 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:55 smithi083 bash[71028]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7 2024-09-10T21:08:55.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:55 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:55.645+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:55.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:55 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:55.645+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:55.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:55 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:55.645+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:55.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:55 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:55.645+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:55.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:55 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:55.645+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:08:55.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:55.657+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:55.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:55.657+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:55.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:55.657+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:55.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:55.657+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:55.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:55.483+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:55.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:55.483+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:55.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:55.483+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:55.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:55 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:55.483+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:08:56.333 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:55 smithi083 podman[71043]: 2024-09-10 21:08:55.89135737 +0000 UTC m=+0.600443714 container remove 371772db483a817ee4f9a9a0b833c54ba227f35e9b8b770735bd2432b4048f39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T21:08:56.642 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.23218629 +0000 UTC m=+0.015711923 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:08:56.642 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.342185228 +0000 UTC m=+0.125710861 container create aef95201dea254d1ac09e75916928d0fd219aff25e81b956ba0c9934c7a57f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:08:56.642 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.553316685 +0000 UTC m=+0.336842312 container init aef95201dea254d1ac09e75916928d0fd219aff25e81b956ba0c9934c7a57f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T21:08:56.642 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.556774547 +0000 UTC m=+0.340300183 container start aef95201dea254d1ac09e75916928d0fd219aff25e81b956ba0c9934c7a57f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T21:08:56.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:56.679+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:56.949 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:56.679+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:56.679+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:56.679+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:56.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:56.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:56.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:56.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:56 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:56.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:08:57.045 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:56 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:56.541+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:57.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:56 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:56.541+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:57.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:56 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:56.541+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:57.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:56 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:56.541+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:57.046 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:56 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:56.541+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:57.059 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.662420499 +0000 UTC m=+0.445946138 container attach aef95201dea254d1ac09e75916928d0fd219aff25e81b956ba0c9934c7a57f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T21:08:57.059 INFO:journalctl@ceph.osd.7.smithi083.stdout:Sep 10 21:08:56 smithi083 podman[71130]: 2024-09-10 21:08:56.744349265 +0000 UTC m=+0.527874894 container died aef95201dea254d1ac09e75916928d0fd219aff25e81b956ba0c9934c7a57f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T21:08:57.060 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:56.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:57.060 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:56.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:57.060 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:56.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:57.060 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:56.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:57.060 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:56.689+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:08:57.377 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T21:08:57.415 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:08:57.416 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T21:08:57.416 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T21:08:57.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.8 2024-09-10T21:08:57.699 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 systemd[1]: Stopping Ceph osd.8 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:08:57.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:57.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:57.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:57.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:57.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:57.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:57.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:57.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:08:57.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:57.493+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:57.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:57.493+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:57.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:57.493+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:57.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:57.493+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:57.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:57 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:57.493+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:57.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:57.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:57.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:57.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:57.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:57.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:57.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:57.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:57.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:57 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:57.694+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:08:58.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:58.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:58.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:58.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:58.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017ce5d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:08:58.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017ce5d640 -1 osd.8 78 *** Got signal Terminated *** 2024-09-10T21:08:58.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:57 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:57.724+0000 7f017ce5d640 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:08:58.760 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:58.466+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:58.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:58.466+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:58.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:58.466+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:58.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:58.466+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:08:58.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:58 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:58.496+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:58.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:58 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:58.496+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:58.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:58 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:58.496+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:58.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:58 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:58.496+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:58.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:58 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:58.496+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:58.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:58 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:58.659+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:08:58.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:58 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:58.659+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:08:58.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:58 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:58.659+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:08:58.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:58 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:58.659+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:08:58.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:58 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:58.659+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:08:59.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:58.755+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:08:59.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:58.755+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:08:59.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:58.755+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:08:59.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:58 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:58.755+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:08:59.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:59 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:59.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:08:59.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:59 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:59.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:08:59.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:59 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:59.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:08:59.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:59 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:59.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:08:59.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:08:59 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:08:59.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:08:59.807 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:59.469+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:08:59.807 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:59.469+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:08:59.808 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:59.469+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:08:59.808 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:08:59.469+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:00.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:59 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:59.706+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:00.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:59 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:59.706+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:00.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:59 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:59.706+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:00.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:59 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:59.706+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:00.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:08:59 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:08:59.706+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:00.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:59.803+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:09:00.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:59.803+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:09:00.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:59.803+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:09:00.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:08:59 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:08:59.803+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:09:00.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:00 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:00.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:00.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:00 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:00.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:00.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:00 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:00.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:00.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:00 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:00.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:00.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:00 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:00.485+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:00.854 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:00.515+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:00.854 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:00.515+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:00.854 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:00.515+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:00.854 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:00.515+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:01.043 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:00.711+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:01.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:00.849+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:09:01.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:00.849+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:09:01.199 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:00.849+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:09:01.200 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:00 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:00.849+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:09:01.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:01.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:01.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:01.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:01.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:01.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:01.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:01.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:01.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:01 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:01.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:01.868 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:01.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:01.868 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:01.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:01.868 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:01.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:01.868 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:01.530+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:02.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:02.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:02.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:02.141 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:01 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:01.662+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:01.863+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.889684+0000 front 2024-09-10T21:07:57.889744+0000 (oldest deadline 2024-09-10T21:08:20.789843+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:01.863+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:13.691971+0000 front 2024-09-10T21:08:13.691881+0000 (oldest deadline 2024-09-10T21:08:37.191931+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:01.863+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.893888+0000 front 2024-09-10T21:08:22.893877+0000 (oldest deadline 2024-09-10T21:08:44.593754+0000) 2024-09-10T21:09:02.142 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:01 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8[53203]: 2024-09-10T21:09:01.863+0000 7f017546a640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:26.894965+0000 front 2024-09-10T21:08:26.894933+0000 (oldest deadline 2024-09-10T21:08:51.594838+0000) 2024-09-10T21:09:02.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:02.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:02.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:02.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:02.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:02.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:02 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:02.395+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:02.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:02.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:02.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:02.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:02.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:02.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:02 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:02.631+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:02.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:02 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:02.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:02.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:02 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:02.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:02.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:02 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:02.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:02.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:02 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:02.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:03.396 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:03 smithi172 podman[70765]: 2024-09-10 21:09:03.119595491 +0000 UTC m=+5.512059641 container died c4b29db4c13bc78b12e6c6d05cb36308103c76c19cc49ddf88bd80208869c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T21:09:03.699 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:03 smithi172 podman[70765]: 2024-09-10 21:09:03.491943506 +0000 UTC m=+5.884407653 container cleanup c4b29db4c13bc78b12e6c6d05cb36308103c76c19cc49ddf88bd80208869c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T21:09:03.699 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:03 smithi172 bash[70765]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8 2024-09-10T21:09:03.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:03.502+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:03.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:03.502+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:03.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:03.502+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:03.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:03 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:03.502+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:03.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:03.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:03.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:03.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:03.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:03.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:03 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:03.439+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:03.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:03.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:03.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:03.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:03.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:03.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:03 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:03.605+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:04.071 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:03 smithi172 podman[70794]: 2024-09-10 21:09:03.760052585 +0000 UTC m=+0.641105095 container remove c4b29db4c13bc78b12e6c6d05cb36308103c76c19cc49ddf88bd80208869c7bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:09:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:03.970857122 +0000 UTC m=+0.015956101 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:09:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:04.094063781 +0000 UTC m=+0.139162759 container create 6482cea9d4218f2c63773fd9814d88196455d19fc074bd6a09b6869eb249452c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T21:09:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:04.304590672 +0000 UTC m=+0.349689650 container init 6482cea9d4218f2c63773fd9814d88196455d19fc074bd6a09b6869eb249452c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T21:09:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:04.307891868 +0000 UTC m=+0.352990847 container start 6482cea9d4218f2c63773fd9814d88196455d19fc074bd6a09b6869eb249452c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:09:04.383 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:04.379450911 +0000 UTC m=+0.424549898 container attach 6482cea9d4218f2c63773fd9814d88196455d19fc074bd6a09b6869eb249452c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:09:04.699 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 10 21:09:04 smithi172 podman[70881]: 2024-09-10 21:09:04.497421494 +0000 UTC m=+0.542520473 container died 6482cea9d4218f2c63773fd9814d88196455d19fc074bd6a09b6869eb249452c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T21:09:04.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:04.544+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:04.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:04.544+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:04.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:04.544+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:04.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:04.544+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:04.751 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:04 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:04.455+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:04.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:04.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:04.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:04.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:04.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:04.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:04 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:04.625+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:05.096 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T21:09:05.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:05.135 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T21:09:05.135 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T21:09:05.136 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.9 2024-09-10T21:09:05.433 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 systemd[1]: Stopping Ceph osd.9 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:05.433 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:05.433 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:05.434 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:05.434 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:05.434 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:05.434 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.429+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:05.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.452+0000 7f6b121a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:05.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.452+0000 7f6b121a2640 -1 osd.9 78 *** Got signal Terminated *** 2024-09-10T21:09:05.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:05 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:05.452+0000 7f6b121a2640 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:09:05.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:05.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:05.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:05.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:05.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:05.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:05 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:05.585+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:05.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:05 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:05.509+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:05.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:05 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:05.509+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:05.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:05 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:05.509+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:05.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:05 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:05.509+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:05.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:05 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:05.509+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:06.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:06.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:06.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:06.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:06.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:06.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:06 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:06.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:06.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:06.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:06.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:06.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:06.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:06.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:06 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:06.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:06.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:06 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:06.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:06.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:06 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:06.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:06.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:06 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:06.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:06.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:06 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:06.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:06.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:06 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:06.473+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:07.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:07.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:07.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:07.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:07.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:07.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:07 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:07.374+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:07.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:07.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:07.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:07.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:07.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:07.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:07 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:07.597+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:07.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:07.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:07.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:07.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:07.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:07.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:07.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:07.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:07.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:07 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:07.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:08.795 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:08.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:08 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:08.414+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.328624+0000 front 2024-09-10T21:08:46.328652+0000 (oldest deadline 2024-09-10T21:09:08.028699+0000) 2024-09-10T21:09:08.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:08.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:08.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:08.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:08.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:08.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:08 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:08.548+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:08.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:08.525+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:08.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:08.525+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:08.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:08.525+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:08.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:08.525+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:08.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:08.525+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:57.921787+0000 front 2024-09-10T21:07:57.921763+0000 (oldest deadline 2024-09-10T21:08:20.821968+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.923191+0000 front 2024-09-10T21:08:04.923345+0000 (oldest deadline 2024-09-10T21:08:30.223113+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.324069+0000 front 2024-09-10T21:08:11.323993+0000 (oldest deadline 2024-09-10T21:08:36.023962+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:21.225293+0000 front 2024-09-10T21:08:21.225386+0000 (oldest deadline 2024-09-10T21:08:44.125420+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.226344+0000 front 2024-09-10T21:08:28.226443+0000 (oldest deadline 2024-09-10T21:08:54.126491+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.827544+0000 front 2024-09-10T21:08:38.827593+0000 (oldest deadline 2024-09-10T21:09:02.327398+0000) 2024-09-10T21:09:09.796 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:09 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9[67145]: 2024-09-10T21:09:09.453+0000 7f6b0a7af640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.328624+0000 front 2024-09-10T21:08:46.328652+0000 (oldest deadline 2024-09-10T21:09:08.028699+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:09.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:09 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:09.556+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:09.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:09 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:09.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:10.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:10.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:10.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:10.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:10.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:10.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:10 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:10.515+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:10.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:10.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:10.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:10.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:10.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:10.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:10 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:10.474+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:11.232 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:10 smithi067 podman[110718]: 2024-09-10 21:09:10.975372961 +0000 UTC m=+5.637849716 container died 2f2d4fd62aafb828a667b938374397c3266386e79be674ee623878aa6b75d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:09:11.545 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:11 smithi067 podman[110718]: 2024-09-10 21:09:11.36966903 +0000 UTC m=+6.032145830 container cleanup 2f2d4fd62aafb828a667b938374397c3266386e79be674ee623878aa6b75d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T21:09:11.546 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:11 smithi067 bash[110718]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9 2024-09-10T21:09:11.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:11.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:11.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:11.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:11.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:11.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:11 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:11.533+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:11.921 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:11 smithi067 podman[110736]: 2024-09-10 21:09:11.579181116 +0000 UTC m=+0.604201939 container remove 2f2d4fd62aafb828a667b938374397c3266386e79be674ee623878aa6b75d0c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:11.952 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:11 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:11.504+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:12.186 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:11 smithi067 podman[110823]: 2024-09-10 21:09:11.82114325 +0000 UTC m=+0.016373402 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:09:12.186 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:11 smithi067 podman[110823]: 2024-09-10 21:09:11.921752909 +0000 UTC m=+0.116983091 container create d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:09:12.186 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:12 smithi067 podman[110823]: 2024-09-10 21:09:12.182619801 +0000 UTC m=+0.377849940 container init d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:09:12.546 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:12 smithi067 podman[110823]: 2024-09-10 21:09:12.186065705 +0000 UTC m=+0.381295845 container start d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T21:09:12.546 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:12 smithi067 podman[110823]: 2024-09-10 21:09:12.274331822 +0000 UTC m=+0.469561961 container attach d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:09:12.546 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:12 smithi067 podman[110823]: 2024-09-10 21:09:12.386803522 +0000 UTC m=+0.582033672 container died d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T21:09:12.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:12.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:12.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:12.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:12.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:12.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:12 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:12.510+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:12.949 INFO:journalctl@ceph.osd.9.smithi067.stdout:Sep 10 21:09:12 smithi067 podman[110846]: 2024-09-10 21:09:12.927484099 +0000 UTC m=+0.530559911 container remove d75ba4cfdd9003adbaf6279ede2081f1d3cf03fbcb3ef99353ab476fbd8c3436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T21:09:12.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:12.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:12.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:12.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:12.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:12.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:12.481+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:12.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T21:09:12.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:12.995 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T21:09:12.995 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T21:09:12.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.10 2024-09-10T21:09:13.305 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 systemd[1]: Stopping Ceph osd.10 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:13.641 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.300+0000 7ff64ceac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.300+0000 7ff64ceac640 -1 osd.10 78 *** Got signal Terminated *** 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.300+0000 7ff64ceac640 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:13.642 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:13 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:13.514+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.058806+0000 front 2024-09-10T21:08:46.058774+0000 (oldest deadline 2024-09-10T21:09:13.059273+0000) 2024-09-10T21:09:13.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:13.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:13.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:13.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:13.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:13.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:13 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:13.513+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:14.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:14.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:14.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:14.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:14.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:14.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:14.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:14 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:14.524+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.058806+0000 front 2024-09-10T21:08:46.058774+0000 (oldest deadline 2024-09-10T21:09:13.059273+0000) 2024-09-10T21:09:14.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:14.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:14.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:14.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:14.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:14.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:14 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:14.536+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:15.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:15.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:15.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:15.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:15.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:15.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:15.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:15 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:15.477+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.058806+0000 front 2024-09-10T21:08:46.058774+0000 (oldest deadline 2024-09-10T21:09:13.059273+0000) 2024-09-10T21:09:15.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:15.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:15.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:15.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:15.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:15.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:15.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:15 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:15.495+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:16.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:16.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:16 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:16.486+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.058806+0000 front 2024-09-10T21:08:46.058774+0000 (oldest deadline 2024-09-10T21:09:13.059273+0000) 2024-09-10T21:09:16.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:16.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:16.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:16.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:16.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:16.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:16.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:16.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:17.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:54.250277+0000 front 2024-09-10T21:07:54.250262+0000 (oldest deadline 2024-09-10T21:08:20.150246+0000) 2024-09-10T21:09:17.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:05.951739+0000 front 2024-09-10T21:08:05.951764+0000 (oldest deadline 2024-09-10T21:08:31.251949+0000) 2024-09-10T21:09:17.891 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:11.252585+0000 front 2024-09-10T21:08:11.252474+0000 (oldest deadline 2024-09-10T21:08:36.552452+0000) 2024-09-10T21:09:17.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6814 osd.3 since back 2024-09-10T21:08:22.954168+0000 front 2024-09-10T21:08:22.954091+0000 (oldest deadline 2024-09-10T21:08:44.054169+0000) 2024-09-10T21:09:17.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.155033+0000 front 2024-09-10T21:08:28.155006+0000 (oldest deadline 2024-09-10T21:08:54.055105+0000) 2024-09-10T21:09:17.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:36.757399+0000 front 2024-09-10T21:08:36.757325+0000 (oldest deadline 2024-09-10T21:09:00.257133+0000) 2024-09-10T21:09:17.892 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:17 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10[59538]: 2024-09-10T21:09:17.464+0000 7ff6494c1640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:46.058806+0000 front 2024-09-10T21:08:46.058774+0000 (oldest deadline 2024-09-10T21:09:13.059273+0000) 2024-09-10T21:09:17.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:17.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:17 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:17.535+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:18.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:18.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:18 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:18.510+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:18.972 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:18 smithi083 podman[71242]: 2024-09-10 21:09:18.687346308 +0000 UTC m=+5.492467858 container stop 62214fb5088fa75c6f6d2bf2d6fff824dbb9f56b243907805ce9494770d5da49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:09:18.972 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:18 smithi083 podman[71242]: 2024-09-10 21:09:18.692241896 +0000 UTC m=+5.497363529 container died 62214fb5088fa75c6f6d2bf2d6fff824dbb9f56b243907805ce9494770d5da49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T21:09:19.314 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71242]: 2024-09-10 21:09:19.050717197 +0000 UTC m=+5.855838747 container cleanup 62214fb5088fa75c6f6d2bf2d6fff824dbb9f56b243907805ce9494770d5da49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:09:19.314 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 bash[71242]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10 2024-09-10T21:09:19.641 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71256]: 2024-09-10 21:09:19.310364604 +0000 UTC m=+0.611761942 container remove 62214fb5088fa75c6f6d2bf2d6fff824dbb9f56b243907805ce9494770d5da49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T21:09:19.942 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71345]: 2024-09-10 21:09:19.644397607 +0000 UTC m=+0.103666926 container create 6f5542586db8970e9cc44f0adf403d73723fe4a6842105f7586d42ca8d803db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T21:09:19.942 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71345]: 2024-09-10 21:09:19.556414816 +0000 UTC m=+0.015684139 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:09:19.942 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71345]: 2024-09-10 21:09:19.855238279 +0000 UTC m=+0.314507601 container init 6f5542586db8970e9cc44f0adf403d73723fe4a6842105f7586d42ca8d803db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux ) 2024-09-10T21:09:19.942 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71345]: 2024-09-10 21:09:19.858488532 +0000 UTC m=+0.317757861 container start 6f5542586db8970e9cc44f0adf403d73723fe4a6842105f7586d42ca8d803db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:09:19.942 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:19 smithi083 podman[71345]: 2024-09-10 21:09:19.938508263 +0000 UTC m=+0.397777600 container attach 6f5542586db8970e9cc44f0adf403d73723fe4a6842105f7586d42ca8d803db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T21:09:19.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:19.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:19.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:19.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:19.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:19.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:19.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:19 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:19.489+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:20.344 INFO:journalctl@ceph.osd.10.smithi083.stdout:Sep 10 21:09:20 smithi083 podman[71345]: 2024-09-10 21:09:20.047269759 +0000 UTC m=+0.506539081 container died 6f5542586db8970e9cc44f0adf403d73723fe4a6842105f7586d42ca8d803db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T21:09:20.637 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T21:09:20.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:20.676 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T21:09:20.676 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T21:09:20.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.11 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.493+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:20.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 systemd[1]: Stopping Ceph osd.11 for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:21.449 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.960+0000 7f1946f6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:21.450 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.960+0000 7f1946f6c640 -1 osd.11 78 *** Got signal Terminated *** 2024-09-10T21:09:21.450 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:20 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:20.960+0000 7f1946f6c640 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:09:21.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:21.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:21.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:21.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:21.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:21.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:21.951 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:21 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:21.462+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:22.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:22.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:22.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:22.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:22.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:22.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:22.700 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:22 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:22.441+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:23.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:23.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:23 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:23.484+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:24.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:24.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:24 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:24.527+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-10T21:09:00.403485+0000 front 2024-09-10T21:09:00.403442+0000 (oldest deadline 2024-09-10T21:09:24.503438+0000) 2024-09-10T21:09:25.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2024-09-10T21:07:56.394482+0000 front 2024-09-10T21:07:56.394491+0000 (oldest deadline 2024-09-10T21:08:20.494512+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6804 osd.1 since back 2024-09-10T21:08:04.595446+0000 front 2024-09-10T21:08:04.595503+0000 (oldest deadline 2024-09-10T21:08:28.695470+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-10T21:08:10.896944+0000 front 2024-09-10T21:08:10.896882+0000 (oldest deadline 2024-09-10T21:08:36.797045+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6812 osd.4 since back 2024-09-10T21:08:28.399639+0000 front 2024-09-10T21:08:28.399533+0000 (oldest deadline 2024-09-10T21:08:53.699413+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-10T21:08:38.900573+0000 front 2024-09-10T21:08:38.900555+0000 (oldest deadline 2024-09-10T21:09:04.800668+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.67:6822 osd.6 since back 2024-09-10T21:08:44.801437+0000 front 2024-09-10T21:08:44.801362+0000 (oldest deadline 2024-09-10T21:09:09.501117+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.83:6820 osd.7 since back 2024-09-10T21:08:54.201988+0000 front 2024-09-10T21:08:54.202022+0000 (oldest deadline 2024-09-10T21:09:15.301941+0000) 2024-09-10T21:09:25.950 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:25 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11[59771]: 2024-09-10T21:09:25.500+0000 7f1943581640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-10T21:09:00.403485+0000 front 2024-09-10T21:09:00.403442+0000 (oldest deadline 2024-09-10T21:09:24.503438+0000) 2024-09-10T21:09:26.699 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:26 smithi172 podman[70983]: 2024-09-10 21:09:26.425741723 +0000 UTC m=+5.558158149 container died 82a4cc13b46fc91fcad4b2ff669380ae294c4995fb6f1e35c587ec46209b1230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:09:27.055 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:26 smithi172 podman[70983]: 2024-09-10 21:09:26.78466041 +0000 UTC m=+5.917076844 container cleanup 82a4cc13b46fc91fcad4b2ff669380ae294c4995fb6f1e35c587ec46209b1230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:09:27.056 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:26 smithi172 bash[70983]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11 2024-09-10T21:09:27.408 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71001]: 2024-09-10 21:09:27.052293966 +0000 UTC m=+0.623643835 container remove 82a4cc13b46fc91fcad4b2ff669380ae294c4995fb6f1e35c587ec46209b1230 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T21:09:27.692 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.308092169 +0000 UTC m=+0.015622370 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:09:27.692 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.411460485 +0000 UTC m=+0.118990722 container create d0108442a98f37d88b3c516750b85639c2a15e0b111ac8eb982507df565d4e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T21:09:27.692 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.605610411 +0000 UTC m=+0.313140602 container init d0108442a98f37d88b3c516750b85639c2a15e0b111ac8eb982507df565d4e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T21:09:27.693 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.608808928 +0000 UTC m=+0.316339120 container start d0108442a98f37d88b3c516750b85639c2a15e0b111ac8eb982507df565d4e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T21:09:27.693 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.688922077 +0000 UTC m=+0.396452285 container attach d0108442a98f37d88b3c516750b85639c2a15e0b111ac8eb982507df565d4e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:09:27.949 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 10 21:09:27 smithi172 podman[71087]: 2024-09-10 21:09:27.799224642 +0000 UTC m=+0.506754834 container died d0108442a98f37d88b3c516750b85639c2a15e0b111ac8eb982507df565d4e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T21:09:28.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T21:09:28.474 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:28.474 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T21:09:28.474 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T21:09:28.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.a 2024-09-10T21:09:28.792 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:28 smithi067 systemd[1]: Stopping Ceph mds.a for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:29.045 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:28 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a[74285]: 2024-09-10T21:09:28.787+0000 7f8257589640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:29.045 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:28 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a[74285]: 2024-09-10T21:09:28.787+0000 7f8257589640 -1 mds.a *** got signal Terminated *** 2024-09-10T21:09:33.085 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:32 smithi067 podman[110926]: 2024-09-10 21:09:32.801922402 +0000 UTC m=+4.118659847 container died 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T21:09:33.543 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:33 smithi067 podman[110926]: 2024-09-10 21:09:33.255396854 +0000 UTC m=+4.572134357 container cleanup 54e977863d8e7e6f31eb860289af25e46cdd7b87282272dc939aec44c8431006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T21:09:33.543 INFO:journalctl@ceph.mds.a.smithi067.stdout:Sep 10 21:09:33 smithi067 bash[110926]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-a 2024-09-10T21:09:33.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T21:09:33.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:33.738 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T21:09:33.738 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T21:09:33.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.d 2024-09-10T21:09:34.072 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:33 smithi067 systemd[1]: Stopping Ceph mds.d for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:34.546 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d[73103]: 2024-09-10T21:09:34.067+0000 7f258b12d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:34.546 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:34 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d[73103]: 2024-09-10T21:09:34.067+0000 7f258b12d640 -1 mds.d *** got signal Terminated *** 2024-09-10T21:09:38.348 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 podman[111059]: 2024-09-10 21:09:38.077318429 +0000 UTC m=+4.114009303 container died ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-10T21:09:38.630 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 podman[111059]: 2024-09-10 21:09:38.417659889 +0000 UTC m=+4.454350763 container cleanup ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:09:38.631 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 bash[111059]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d 2024-09-10T21:09:38.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T21:09:38.882 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 podman[111071]: 2024-09-10 21:09:38.627189147 +0000 UTC m=+0.540606047 container remove ad76e935829f8b071f67f15e1601dbf1c762cfb32bb93ee2c1547e5199caf6db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T21:09:38.882 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 systemd[1]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-10T21:09:38.882 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 systemd[1]: Stopped Ceph mds.d for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T21:09:38.882 INFO:journalctl@ceph.mds.d.smithi067.stdout:Sep 10 21:09:38 smithi067 systemd[1]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.d.service: Consumed 1.113s CPU time. 2024-09-10T21:09:38.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:38.892 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T21:09:38.892 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T21:09:38.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.g 2024-09-10T21:09:39.217 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:38 smithi067 systemd[1]: Stopping Ceph mds.g for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:39.545 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g[73872]: 2024-09-10T21:09:39.212+0000 7f5153ebb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:39.545 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:39 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g[73872]: 2024-09-10T21:09:39.212+0000 7f5153ebb640 -1 mds.g *** got signal Terminated *** 2024-09-10T21:09:42.046 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:41 smithi067 podman[111180]: 2024-09-10 21:09:41.651383184 +0000 UTC m=+2.544068952 container died 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T21:09:42.360 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:42 smithi067 podman[111180]: 2024-09-10 21:09:42.138226819 +0000 UTC m=+3.030912583 container cleanup 5dd0d32ecdaf728b86fef8ccefac988a2709852b2ccc96192d39782ab21b0ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T21:09:42.360 INFO:journalctl@ceph.mds.g.smithi067.stdout:Sep 10 21:09:42 smithi067 bash[111180]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-g 2024-09-10T21:09:42.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T21:09:42.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:42.544 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T21:09:42.544 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T21:09:42.545 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.j 2024-09-10T21:09:42.888 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:42 smithi067 systemd[1]: Stopping Ceph mds.j for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:43.296 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j[72689]: 2024-09-10T21:09:42.883+0000 7f4a7fad8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:43.296 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:42 smithi067 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j[72689]: 2024-09-10T21:09:42.883+0000 7f4a7fad8640 -1 mds.j *** got signal Terminated *** 2024-09-10T21:09:46.988 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:46 smithi067 podman[111300]: 2024-09-10 21:09:46.711813388 +0000 UTC m=+3.951041502 container died 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T21:09:47.295 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 podman[111300]: 2024-09-10 21:09:47.142385451 +0000 UTC m=+4.381613605 container cleanup 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:09:47.296 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 bash[111300]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j 2024-09-10T21:09:47.588 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T21:09:47.610 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 podman[111313]: 2024-09-10 21:09:47.343770203 +0000 UTC m=+0.629441225 container remove 5cefe523bf5d6810492a9cf9544d2440c8854f6d52931f6ce4a36fc1020c716e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T21:09:47.610 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 systemd[1]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-10T21:09:47.610 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 systemd[1]: Stopped Ceph mds.j for d92bf05e-6fb4-11ef-bcea-c7b262605968. 2024-09-10T21:09:47.610 INFO:journalctl@ceph.mds.j.smithi067.stdout:Sep 10 21:09:47 smithi067 systemd[1]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.j.service: Consumed 1.113s CPU time. 2024-09-10T21:09:47.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:47.622 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T21:09:47.622 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T21:09:47.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.b 2024-09-10T21:09:47.921 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:47 smithi083 systemd[1]: Stopping Ceph mds.b for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:48.186 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: 2024-09-10T21:09:47.916+0000 7eff76884640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:48.186 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:47 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b[65159]: 2024-09-10T21:09:47.916+0000 7eff76884640 -1 mds.b *** got signal Terminated *** 2024-09-10T21:09:51.388 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:51 smithi083 podman[71447]: 2024-09-10 21:09:51.067702334 +0000 UTC m=+3.256453030 container died 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T21:09:51.641 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:51 smithi083 podman[71447]: 2024-09-10 21:09:51.467143397 +0000 UTC m=+3.655894083 container cleanup 6144f8cea0d1abdfa8d40ed2835002d735133be7f84e0e1058e46fd9868b1f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T21:09:51.641 INFO:journalctl@ceph.mds.b.smithi083.stdout:Sep 10 21:09:51 smithi083 bash[71447]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-b 2024-09-10T21:09:51.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T21:09:51.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:51.873 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T21:09:51.874 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T21:09:51.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.e 2024-09-10T21:09:52.391 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:51 smithi083 systemd[1]: Stopping Ceph mds.e for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:52.391 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: 2024-09-10T21:09:52.187+0000 7f32262c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:52.391 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:52 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e[64556]: 2024-09-10T21:09:52.187+0000 7f32262c2640 -1 mds.e *** got signal Terminated *** 2024-09-10T21:09:55.359 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:55 smithi083 podman[71578]: 2024-09-10 21:09:55.072141427 +0000 UTC m=+2.982526420 container died 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T21:09:55.641 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:55 smithi083 podman[71578]: 2024-09-10 21:09:55.437756797 +0000 UTC m=+3.348141787 container cleanup 78ef0270f0cfc3a87ee1c89fd6eb3a8ca092ffcbe7a2acf1107a43793d13cc5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:09:55.641 INFO:journalctl@ceph.mds.e.smithi083.stdout:Sep 10 21:09:55 smithi083 bash[71578]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-e 2024-09-10T21:09:55.878 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T21:09:55.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:55.911 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T21:09:55.912 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T21:09:55.912 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.h 2024-09-10T21:09:56.391 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:55 smithi083 systemd[1]: Stopping Ceph mds.h for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:09:56.391 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-10T21:09:56.216+0000 7f5f487bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:09:56.391 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:56 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h[64858]: 2024-09-10T21:09:56.216+0000 7f5f487bf640 -1 mds.h *** got signal Terminated *** 2024-09-10T21:09:59.353 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:59 smithi083 podman[71701]: 2024-09-10 21:09:59.054673335 +0000 UTC m=+2.933082117 container died 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T21:09:59.641 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:59 smithi083 podman[71701]: 2024-09-10 21:09:59.466503145 +0000 UTC m=+3.344911927 container cleanup 01b8b8eb55e4a25fe25ba21ad0a6aac55bca3ff4dfc0bde957e5d1251b77ac42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:09:59.641 INFO:journalctl@ceph.mds.h.smithi083.stdout:Sep 10 21:09:59 smithi083 bash[71701]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-h 2024-09-10T21:09:59.827 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T21:09:59.860 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:09:59.860 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T21:09:59.860 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T21:09:59.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.k 2024-09-10T21:10:00.201 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:09:59 smithi083 systemd[1]: Stopping Ceph mds.k for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:10:00.201 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:10:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k[64253]: 2024-09-10T21:10:00.186+0000 7f07f55ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:10:00.201 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:10:00 smithi083 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k[64253]: 2024-09-10T21:10:00.186+0000 7f07f55ec640 -1 mds.k *** got signal Terminated *** 2024-09-10T21:10:04.049 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:10:03 smithi083 podman[71821]: 2024-09-10 21:10:03.762402974 +0000 UTC m=+3.681358644 container died ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:10:04.391 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:10:04 smithi083 podman[71821]: 2024-09-10 21:10:04.162315146 +0000 UTC m=+4.081270815 container cleanup ee21f51464bc6a6aa57629acc4db3f1addcfe8f6595851af85125bd140dda111 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T21:10:04.391 INFO:journalctl@ceph.mds.k.smithi083.stdout:Sep 10 21:10:04 smithi083 bash[71821]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-k 2024-09-10T21:10:04.542 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T21:10:04.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:10:04.574 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T21:10:04.574 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T21:10:04.575 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.c 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:04 smithi172 systemd[1]: Stopping Ceph mds.c for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:10:05.199 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: 2024-09-10T21:10:04.906+0000 7fc3b86c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:10:05.199 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:04 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c[64715]: 2024-09-10T21:10:04.906+0000 7fc3b86c2640 -1 mds.c *** got signal Terminated *** 2024-09-10T21:10:07.446 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:07 smithi172 podman[71191]: 2024-09-10 21:10:07.068073667 +0000 UTC m=+2.309212873 container died 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T21:10:07.699 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:07 smithi172 podman[71191]: 2024-09-10 21:10:07.633686706 +0000 UTC m=+2.874825911 container cleanup 1c6917cb8a3310f692c3fcfe9cc3540d6f914a5ac2affb95c488848797fe772c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T21:10:07.699 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 10 21:10:07 smithi172 bash[71191]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-c 2024-09-10T21:10:08.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T21:10:08.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:10:08.114 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T21:10:08.114 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T21:10:08.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.f 2024-09-10T21:10:08.433 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:08 smithi172 systemd[1]: Stopping Ceph mds.f for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:10:08.699 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: 2024-09-10T21:10:08.429+0000 7f74172e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:10:08.699 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:08 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f[64416]: 2024-09-10T21:10:08.429+0000 7f74172e3640 -1 mds.f *** got signal Terminated *** 2024-09-10T21:10:11.399 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:11 smithi172 podman[71326]: 2024-09-10 21:10:11.0636007 +0000 UTC m=+2.729671240 container died e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T21:10:11.399 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:11 smithi172 podman[71326]: 2024-09-10 21:10:11.3953185 +0000 UTC m=+3.061389040 container cleanup e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T21:10:11.699 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:11 smithi172 bash[71326]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f 2024-09-10T21:10:11.699 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 10 21:10:11 smithi172 podman[71338]: 2024-09-10 21:10:11.596585749 +0000 UTC m=+0.522229651 container remove e3714ce99259052e1c3df9487d2061c92577205a7bb043cbb1d8911ab0dd7bf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:10:11.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T21:10:11.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:10:11.858 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T21:10:11.859 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T21:10:11.859 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.i 2024-09-10T21:10:12.186 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:11 smithi172 systemd[1]: Stopping Ceph mds.i for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:10:12.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: 2024-09-10T21:10:12.182+0000 7f9cf37c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:10:12.449 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:12 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i[65019]: 2024-09-10T21:10:12.182+0000 7f9cf37c6640 -1 mds.i *** got signal Terminated *** 2024-09-10T21:10:15.361 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:15 smithi172 podman[71445]: 2024-09-10 21:10:15.06070992 +0000 UTC m=+2.991178504 container died c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-10T21:10:15.678 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:15 smithi172 podman[71445]: 2024-09-10 21:10:15.423913716 +0000 UTC m=+3.354382298 container cleanup c47520a66d017110670ea603e63b7f2223ddcc0067aec8300730b8d0c0db5ad7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T21:10:15.678 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 10 21:10:15 smithi172 bash[71445]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-i 2024-09-10T21:10:15.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T21:10:15.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:10:15.838 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T21:10:15.839 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T21:10:15.839 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.l 2024-09-10T21:10:15.949 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:15 smithi172 systemd[1]: Stopping Ceph mds.l for d92bf05e-6fb4-11ef-bcea-c7b262605968... 2024-09-10T21:10:16.450 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l[64098]: 2024-09-10T21:10:16.152+0000 7f23e03f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:10:16.450 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:16 smithi172 ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l[64098]: 2024-09-10T21:10:16.152+0000 7f23e03f8640 -1 mds.l *** got signal Terminated *** 2024-09-10T21:10:17.431 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:17 smithi172 podman[71567]: 2024-09-10 21:10:17.146160409 +0000 UTC m=+1.097671708 container died 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T21:10:17.699 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:17 smithi172 podman[71567]: 2024-09-10 21:10:17.510955452 +0000 UTC m=+1.462466823 container cleanup 946c86bed926bf6bb72b9ec029319f429d38451f840b4b582aa7916034ce8cd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:10:17.699 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 10 21:10:17 smithi172 bash[71567]: ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968-mds-l 2024-09-10T21:10:17.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d92bf05e-6fb4-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T21:10:17.914 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:10:17.914 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T21:10:17.914 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:10:18.129 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:10:20.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:10:20.947 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:10:23.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:10:23.631 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:10:26.042 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:10:26.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:10:26.110 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:10:26.137 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T21:10:26.139 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi067/crash 2024-09-10T21:10:26.140 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:10:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:10:26.178 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:10:26.180 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi083/crash 2024-09-10T21:10:26.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:10:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:tar: /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:10:26.231 INFO:teuthology.orchestra.run.smithi083.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:10:26.233 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi172/crash 2024-09-10T21:10:26.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:10:26.297 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:10:26.297 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:10:26.298 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T21:10:26.298 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T21:10:26.341 INFO:teuthology.orchestra.run.smithi067.stdout:2024-09-10T20:56:03.540317+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T21:10:26.341 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T21:10:26.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[SEC\]' /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T21:10:26.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]' /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T21:10:26.499 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[WRN\]' /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T21:10:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:2024-09-10T20:56:03.540317+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T21:10:26.577 INFO:tasks.cephadm:Compressing logs... 2024-09-10T21:10:26.578 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:10:26.620 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:10:26.623 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:10:26.645 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T21:10:26.645 INFO:teuthology.orchestra.run.smithi067.stderr:: No such file or directory 2024-09-10T21:10:26.645 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T21:10:26.645 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:10:26.645 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:10:26.647 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T21:10:26.648 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:10:26.649 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:10:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T21:10:26.653 INFO:teuthology.orchestra.run.smithi083.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T21:10:26.653 INFO:teuthology.orchestra.run.smithi083.stderr:: No such file or directory 2024-09-10T21:10:26.653 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T21:10:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T21:10:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:10:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T21:10:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T21:10:26.654 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log: 83.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:10:26.659 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr: 82.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr: 90.4% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log: 87.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T21:10:26.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T21:10:26.662 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T21:10:26.662 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr: 95.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.d.log: 95.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr: 91.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:10:26.663 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:10:26.664 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:10:26.664 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T21:10:26.666 INFO:teuthology.orchestra.run.smithi067.stderr: 95.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T21:10:26.666 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T21:10:26.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T21:10:26.666 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:10:26.667 INFO:teuthology.orchestra.run.smithi083.stderr: 91.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:10:26.667 INFO:teuthology.orchestra.run.smithi083.stderr: 92.8% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T21:10:26.667 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.z.log: 94.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T21:10:26.670 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log: 87.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:10:26.671 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T21:10:26.672 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T21:10:26.672 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T21:10:26.672 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T21:10:26.672 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:10:26.673 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:10:26.674 INFO:teuthology.orchestra.run.smithi067.stderr: 95.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T21:10:26.674 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:10:26.680 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:10:26.687 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:10:26.813 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T21:10:26.893 INFO:teuthology.orchestra.run.smithi067.stderr: 90.7% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T21:10:26.918 INFO:teuthology.orchestra.run.smithi172.stderr: 94.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T21:10:27.039 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T21:10:27.040 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T21:10:27.180 INFO:teuthology.orchestra.run.smithi083.stderr: 91.6% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T21:10:27.291 INFO:teuthology.orchestra.run.smithi083.stderr: 94.8% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T21:10:28.153 INFO:teuthology.orchestra.run.smithi067.stderr: 90.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T21:10:28.586 INFO:teuthology.orchestra.run.smithi083.stderr: 93.5% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T21:10:41.716 INFO:teuthology.orchestra.run.smithi083.stderr: 93.9% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T21:10:43.044 INFO:teuthology.orchestra.run.smithi172.stderr: 94.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T21:10:44.960 INFO:teuthology.orchestra.run.smithi083.stderr: 94.3% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T21:10:44.988 INFO:teuthology.orchestra.run.smithi172.stderr: 94.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T21:10:45.121 INFO:teuthology.orchestra.run.smithi067.stderr: 94.3% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T21:10:45.597 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T21:10:46.019 INFO:teuthology.orchestra.run.smithi083.stderr: 94.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T21:10:47.188 INFO:teuthology.orchestra.run.smithi067.stderr: 94.0% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T21:10:47.970 INFO:teuthology.orchestra.run.smithi067.stderr: 94.3% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T21:10:49.214 INFO:teuthology.orchestra.run.smithi067.stderr: 94.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T21:10:49.216 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-10T21:10:49.216 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m22.583s 2024-09-10T21:10:49.216 INFO:teuthology.orchestra.run.smithi067.stderr:user 1m21.598s 2024-09-10T21:10:49.216 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m2.932s 2024-09-10T21:10:51.109 INFO:teuthology.orchestra.run.smithi172.stderr: 94.3% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T21:10:51.111 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-10T21:10:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m24.472s 2024-09-10T21:10:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:user 1m16.170s 2024-09-10T21:10:51.111 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m2.867s 2024-09-10T21:10:51.894 INFO:teuthology.orchestra.run.smithi083.stderr: 94.1% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T21:10:54.886 INFO:teuthology.orchestra.run.smithi083.stderr: 94.2% -- replaced with /var/log/ceph/d92bf05e-6fb4-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T21:10:54.888 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-10T21:10:54.888 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m28.249s 2024-09-10T21:10:54.888 INFO:teuthology.orchestra.run.smithi083.stderr:user 1m45.555s 2024-09-10T21:10:54.889 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m3.556s 2024-09-10T21:10:54.889 INFO:tasks.cephadm:Archiving logs... 2024-09-10T21:10:54.890 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi067/log 2024-09-10T21:10:54.891 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:11:06.321 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi083/log 2024-09-10T21:11:06.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:11:20.062 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi172/log 2024-09-10T21:11:20.063 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:11:30.842 INFO:tasks.cephadm:Removing cluster... 2024-09-10T21:11:30.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force 2024-09-10T21:11:31.059 INFO:teuthology.orchestra.run.smithi067.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:11:31.462 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force 2024-09-10T21:11:31.665 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:11:32.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d92bf05e-6fb4-11ef-bcea-c7b262605968 --force 2024-09-10T21:11:32.249 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: d92bf05e-6fb4-11ef-bcea-c7b262605968 2024-09-10T21:11:32.613 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T21:11:32.613 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:11:32.631 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:11:32.649 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:11:32.665 INFO:tasks.cephadm:Teardown complete 2024-09-10T21:11:32.665 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T21:11:32.676 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T21:11:32.677 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:11:32.680 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:11:32.692 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:11:32.827 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T21:11:32.838 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T21:11:32.839 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:11:32.841 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:11:32.844 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:11:32.854 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:11:32.858 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:11:32.858 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:11:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-10T21:11:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -408us[ -383us] +/- 39ms 2024-09-10T21:11:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +1874us[+1874us] +/- 65ms 2024-09-10T21:11:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -1137us[-1137us] +/- 68ms 2024-09-10T21:11:32.859 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:11:32.862 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:11:32.863 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:11:32.863 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-10T21:11:32.863 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -446us[ -418us] +/- 39ms 2024-09-10T21:11:32.863 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +1839us[+1839us] +/- 65ms 2024-09-10T21:11:32.863 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -1178us[-1149us] +/- 68ms 2024-09-10T21:11:32.864 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -417us[ -395us] +/- 39ms 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +1882us[+1882us] +/- 65ms 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -1146us[-1146us] +/- 68ms 2024-09-10T21:11:32.867 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:11:32.867 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T21:11:32.877 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T21:11:32.878 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T21:11:32.897 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:11:32.985 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:11:33.059 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:11:33.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:11:33.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:33.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:11:33.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:33.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:11:33.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:33.218 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T21:11:33.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T21:11:33.282 INFO:teuthology.task.internal:Duration was 2263.036153 seconds 2024-09-10T21:11:33.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T21:11:33.311 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T21:11:33.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:11:33.314 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:11:33.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:11:33.353 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:11:33.356 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:11:33.356 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:11:33.733 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T21:11:33.734 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-10T21:11:33.734 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:11:33.755 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-09-10T21:11:33.755 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:11:33.794 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-10T21:11:33.794 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:11:33.816 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T21:11:33.816 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:11:33.819 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:11:33.837 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:11:33.882 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T21:11:33.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:11:33.886 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:11:33.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:11:35.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T21:11:35.157 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T21:11:35.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:11:35.183 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:11:35.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:11:35.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T21:11:35.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.303 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-10T21:11:35.310 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-09-10T21:11:35.312 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-10T21:11:35.590 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:35.606 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:35.624 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:11:35.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:11:35.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T21:11:35.660 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T21:11:35.661 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi067 2024-09-10T21:11:35.662 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:11:35.725 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi083 2024-09-10T21:11:35.725 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:11:35.767 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899631/remote/smithi172 2024-09-10T21:11:35.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:11:35.808 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T21:11:35.808 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:11:35.811 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:11:35.814 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:11:35.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T21:11:35.872 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T21:11:35.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T21:11:35.887 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T21:11:35.887 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:11:35.890 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:11:35.892 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:11:35.903 INFO:teuthology.orchestra.run.smithi067.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:11 /home/ubuntu/cephtest 2024-09-10T21:11:35.908 INFO:teuthology.orchestra.run.smithi083.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:11 /home/ubuntu/cephtest 2024-09-10T21:11:35.918 INFO:teuthology.orchestra.run.smithi172.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:11 /home/ubuntu/cephtest 2024-09-10T21:11:35.919 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T21:11:35.930 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T21:11:36.009 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 2263.0361528396606 failure_reason: '"2024-09-10T20:56:03.540317+0000 mon.a (mon.0) 1171 : cluster [WRN] Health check failed: 7 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-09-10T21:11:36.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T21:11:36.102 INFO:teuthology.run:FAIL